Data mining and analysis software for USGS NWIS Web streamflow data

Documentation

Granato, G.E., 2009, Computer programs for obtaining and analyzing daily mean streamflow data from the U.S. Geological Survey National Water Information System Web Site: U.S. Geological Survey Open-File Report 2008–1362, 123 p. on CD-ROM, 5 appendixes. Report On-Line

• Appendix 1. GNWISQ Get National Water Information System Streamflow (Q) files
• Appendix 2. MkPP Make Plotting Position
• Appendix 3. SREF Streamflow Record Extension Facilitator
• Appendix 4. QSTATS Streamflow (Q) Statistics
• Appendix 5. MkDF Make U.S. Environmental Protection Agency DFLOW3 batch-input files

Abstract

Five computer programs were developed for obtaining and analyzing streamflow from the National Water Information System (NWISWeb). The programs were developed as part of a study by the U.S. Geological Survey, in cooperation with the Federal Highway Administration, to develop a stochastic empirical loading and dilution model. The programs were developed because reliable, efficient, and repeatable methods are needed to access and process streamflow information and data. The first program (GNWISQ) is designed to facilitate the downloading and reformatting of NWISWeb streamflow data. The second program (MkPP) is designed to facilitate graphical analysis of streamflow data. The third program (SREF) is designed to facilitate streamflow-record extension and augmentation to help develop long-term statistical estimates for sites with limited data. The fourth program (QSTATS) is designed to facilitate statistical analysis of streamflow data. The fifth program (MkDF) is a preprocessor to create batch input files for the U.S. Environmental Protection Agency DFLOW3 program for calculating low-flow statistics. These computer programs were developed to facilitate the analysis of daily mean streamflow data for planning-level water-quality analyses but also are useful for many other applications pertaining to streamflow data and statistics.

These programs from and the associated documentation are included on the CD-ROM accompanying USGS Open-File Report 2008–1362 (Granato, 2009). This report and the appendixes on the CD-ROM describe the implementation and use of the programs and the interpretation of results from the programs. The body of this report provides an overview of the five programs included on this CD-ROM. The appendixes are the software manuals for each program. These manuals describe statistical and numerical methods used to implement each program, input-file formats, output-file formats, installation of the programs, and use of the programs. Each appendix is written as a self-contained manual because each program may have many uses alone or in tandem with other programs on the CD-ROM. Each of these programs uses graphical user interface that follows standard Microsoft Windows interface conventions.

System Requirements

These software programs are written in Visual Basic 6.0 and therefore use is limited to Microsoft Windows operating systems. The graphical display forms require a screen resolution of at least 1024 x 768 pixels.

Software Packages:

GNWISQ Get National Water Information System Streamflow (Q) files (Appendix 1)

History:

    Version 1.1.1 September 2015 - Made the error-file output tab delimited.

    Version 1.1 September 2014 - Added the ability to filter data to keep only full water years.

    Version 1.0 December 2009

Summary:

    This program is used to obtain streamflow data from NWIS Web and reformat the data for use with the other programs.

Manual:

    ofr2008-1362-A1-GNWISQ.pdf (0.5 MB)

Installation Package:

    Version 1.1.1 GNWISQv1.1.1InstallFiles2015-08.zip (1.53 MB)

    Version 1.1.0 GNWISQv1.1Install2014.zip (1.53 MB)

    Version 1.0.0 GNWISQInstall.zip (1.55 MB)

Visual Basic 6.0 Source Code:

    Version 1.1.1 GNWISQv1.1.1CodeFiles2015-08.zip (67 KB)

    Version 1.1.0 GNWISQv1.1Code2014.zip (67 KB)

    Version 1.0.0 GNWISQCode.zip (23 KB)

Visual Basic 6.0 Software Driver Files:

    Version 1.1.1 NWISQv1.1.1DriverFiles2015-08.zip (1.54 MB)

Example Input and Output Files:

    GNWISQExample.zip (1 MB)

MkPP Make Plotting Position (Appendix 2)

History:

    Version 1.0 December 2009

Summary:

    This program is used to calculate plotting positions, percentiles, and frequency factors from streamflow data for graphing probability plots and flow-duration curves.

Manual:

    ofr2008-1362-A2-MkPP.pdf (0.6 MB)

Installation Package:

    Version 1.0 MkPPInstall.zip (1.5 MB)

Visual Basic 6.0 Source Code:

    Version 1.0 MkPPCode.zip (15 KB)

Example Input and Output Files:

    MkPPQExample.zip (1 MB)

SREF Streamflow Record Extension Facilitator (Appendix 3)

History:

    Version 1.0 December 2009

Summary:

    This program is used to augment and extend streamflow records by using the maintenance of variance (MOVE) type I and type III methods or another regression technique such as the Kendall-Theil Robust Line

Manual:

    ofr2008-1362-A3-SREF.pdf (0.6 MB)

Installation Package:

    Version 1.0 SREFInstall.zip (2.1 MB)

Visual Basic 6.0 Source Code:

    Version 1.0 SREFCode.zip (69 KB)

Example Input and Output Files:

    SREFExample.zip (1 MB)

QSTATS Streamflow (Q) Statistics (Appendix 4)

History:

    Version 1.1.2 October 2015 - Modified output files for use with the Streamstats database.

    Version 1.1.1 August 2015 - Fixed and reorganized the interface, added a SELDM output file for use with the Streamstats database, and made the error file tab delimited.

    Version 1.1.0 September 2014 - Added the ability to calculate non-interpretive daily, monthly, and annual statistics for the USGS Streamstats database.

    Version 1.0.0 December 2009 - Summary:

    This program is used to calculate streamflow statistics including the proportion of zero flows; the average, standard deviation, skew, median, probability-weighted moments and L-moments of of daily mean streamflow values; and the logarithms of these values. Version 1.1 calculates the average, standard deviation, minimum, median, and maximum of daily, monthly, and annual flows and selected percentiles for daily flows for use in Streamstats

Manual:

    ofr2008-1362-A4-QSTATS.pdf (0.5 MB)

Installation Package:

    Version 1.1.2 QSTATSv1.1.2-InstallFiles2015-11.zip (1.48 MB)

    Version 1.1.1 QSTATSv1.1.1-InstallFiles2015-08.zip (1.47 MB)

    Version 1.1 QSTATSv1.1Install2014.zip (1.47 MB)

    Version 1.0 QSTATSInstall.zip (1.55 MB)

Visual Basic 6.0 Source Code:

    Version 1.1.2 QSTATSv1.1.2-CodeFiles2015-11.zip (83 KB)

    Version 1.1.1 QSTATSv1.1.1-CodeFiles2015-08.zip (133 KB)

    Version 1.1 QSTATSv1.1Code2014.zip (74 KB)

    Version 1.0 QSTATSCode.zip (23 KB)

Visual Basic 6.0 Software Driver Files:

    Version 1.1.2 QSTATSv1.1.2-DriverFiles2015-11.zip (1.49 MB)

    Version 1.1.1 QSTATSv1.1.1-DriverFiles2015-08.zip (1.5 MB)

Example Input and Output Files:

    QSTATSExample.zip (74 KB)

MkDF Make U.S. Environmental Protection Agency DFLOW3 batch-input files (Appendix 5)

History:

    Version 1.0 December 2009

Summary:

    This program is used to facilitate calculation of biological low flows for multiple stations using the U.S. Environmental Protection Agency DFLOW3 by creating batch-input files

Manual:

    ofr2008-1362-A5-MkDF.pdf (0.6 MB)

Installation Package:

    Version 1.0 MkDFInstall.zip (1.5 MB)

Visual Basic 6.0 Source Code:

    Version 1.0 MkDFCode.zip (13 KB)

Example Input and Output Files:

    MkDFExample.zip (1 MB)

 

Support

Limited support is provided for correcting bugs and clarification of how the code is intended to work. Currently, there are no known bugs or suggestions for improvement. For support or to provide feedback or suggestions for improvement, contact Greg Granato.

User Rights

This software and related material (data and documentation) are made available by the USGS to be used in the public interest and the advancement of science. You may, without any fee or cost, use, copy, modify, or distribute this software, and any derivative works thereof, and its supporting documentation, subject to the USGS Software User Rights Notice

Product Disclaimer

Any use of trade, product, or firm names is for decriptive purposes only and does not imply endorsement by the U.S. Government.