dataRetrieval

This R package is designed to obtain USGS or EPA water quality sample data, streamflow data and metadata directly from web services.
https://github.com/DOI-USGS/dataRetrieval

Category: Natural Resources
Sub Category: Water Supply and Quality

Keywords

r r-package rstats usgs

Keywords from Contributors

hydrology water-quality measur observation annotation ecology water generic features grid-data

Last synced: about 9 hours ago
JSON representation

Repository metadata

This R package is designed to obtain USGS or EPA water quality sample data, streamflow data, and metadata directly from web services.

• Host: GitHub
• URL: https://github.com/DOI-USGS/dataRetrieval
• Owner: DOI-USGS
• License: other
• Created: 2013-01-14T20:02:58.000Z (over 12 years ago)
• Default Branch: main
• Last Pushed: 2025-04-18T20:58:43.000Z (24 days ago)
• Last Synced: 2025-05-03T18:03:43.445Z (10 days ago)
• Topics: r, r-package, rstats, usgs
• Language: R
• Homepage: https://doi-usgs.github.io/dataRetrieval/
• Size: 46.2 MB
• Stars: 290
• Watchers: 31
• Forks: 87
• Open Issues: 12
• Releases: 60
• Metadata Files:
  • Readme: README.Rmd
  • Changelog: NEWS
  • License: LICENSE.md

README.Rmd

          ---
title: "README"
output:
  md_document:
    variant: gfm
editor_options: 
  chunk_output_type: console
---

```{r setup, include=FALSE}
knitr::opts_chunk$set(
  collapse = TRUE,
  comment = "#>",
  fig.path = "man/figures/",
  warning = FALSE,
  message = FALSE,
  fig.height = 7,
  fig.width = 7
)
library(dataRetrieval)
```


# dataRetrieval 

[![CRAN version](http://www.r-pkg.org/badges/version/dataRetrieval)](https://cran.r-project.org/package=EGRET)
[![](http://cranlogs.r-pkg.org/badges/dataRetrieval)](https://cran.r-project.org/package=dataRetrieval)
[![](http://cranlogs.r-pkg.org/badges/grand-total/dataRetrieval)](https://cran.r-project.org/package=dataRetrieval)

The `dataRetrieval` package was created to simplify the process of loading hydrologic data into the R environment. It is designed to retrieve the major data types of U.S. Geological Survey (USGS) hydrology data that are available on the Web, as well as data from the Water Quality Portal (WQP), which currently houses water quality data from the Environmental Protection Agency (EPA), U.S. Department of Agriculture (USDA), and USGS. Direct USGS data is obtained from a service called the National Water Information System (NWIS). 

# Introduction

:warning: USGS discrete water-quality data availability and format are changing. Beginning March 11, 2024 USGS data obtained from legacy services will not include new USGS data or recent updates to existing data. To view the status of changes in data availability and code functionality, visit: 

If you have additional questions about these changes, email [email protected].

# What would you like to do?

1. Get instantaneous USGS discharge data. Start here: `?readNWISuv`

2. Get daily USGS discharge data. Start here: `?readNWISdv`

3. Get USGS groundwater data. Start here: `?readNWISgwl`

4. Get discrete water quality data. Start here: `?readWQPdata`

4. Discover USGS data (not including discrete water quality data). Start here: `?whatNWISdata`

6. Find Hydro Network-Linked Data Index (NLDI) data. Start here: `?findNLDI`

For additional tutorials, see:

[Basic Tutorial](https://doi-usgs.github.io/dataRetrieval/articles/tutorial.html)

[dataRetrieval Introduction 1](https://rconnect.usgs.gov/dataRetrieval_workshop)

[dataRetrieval Introduction 2](https://rconnect.usgs.gov/NMC_dataRetrieval_2)


# Installation of dataRetrieval

To install the `dataRetrieval` package, you must be using R 3.0 or greater and run the following command:

```{r eval=FALSE}
install.packages("dataRetrieval")
```

# New USGS data access

The USGS is planning to modernize all web services in the near future. For each of these updates, `dataRetrieval` will create a new function to access the new services. 

## New Features

### Style

New functions will use a "snake case", such as "read_USGS_samples". Older functions use camel case, such as "readNWISdv". The difference is the underscore between words. This should be a handy way to tell the difference between newer modern data access, and the older traditional functions. 

### Structure

Historically, we allowed users to customize their queries via the `...` argument structure. With `...`, users needed to know the exact names of query parameters before using the function. Now, the new functions will include **ALL** possible arguments that the web service APIs support. This will allow users to use tab-autocompletes (available in RStudio and other IDEs). **Users will need to understand that it is not advisable to specify all of these parameters. The systems can get bogged down with redundant query parameters.** We expect this will be easier for users, but it might take some time to smooth out the documentation and test usability. There may be additional consequences, such as users won't be able to build up argument lists to pass into the function.  

### Dependencies

As we develop functions for the modern USGS web services, we'll continue to explore updating package dependencies.  

### Developmental workflow

CRAN-stable documentation will be available on the GitHub pages:


In-development documentation will be available on the USGS GitLab pages:


Development of `dataRetrieval` will happen on a git branch called "develop". The "develop" branch will only move to the "main" branch when we submit to CRAN, unless there are bug fixes that pertain to the CRAN release. The "develop" branch WILL change frequently, and there are no promises of future behavior. Users must accept that they are using those functions at their own risk. If you willing to accept this risk, the installation instructions are:

```{r eval=FALSE}
library(remotes)

install_github("DOI-USGS/dataRetrieval",
               ref = "develop")

```


# Reporting bugs

Please consider reporting bugs and asking questions on the Issues page:
[https://github.com/DOI-USGS/dataRetrieval/issues](https://github.com/DOI-USGS/dataRetrieval/issues)

# Citations

## Citing the dataRetrieval package

```{r cite, eval=TRUE}
citation(package = "dataRetrieval")
```

## Citing NWIS data

U.S. Geological Survey, 2023, National Water Information System data available on the World Wide Web (USGS Water Data for the Nation), accessed [April 26, 2023], at http://waterdata.usgs.gov/nwis/. http://dx.doi.org/10.5066/F7P55KJN

This can be done using the `create_NWIS_bib` function:


```{r}

dv <- readNWISdv("09010500", "00060")

NWIScitation <- create_NWIS_bib(dv)

NWIScitation
print(NWIScitation, style = "Bibtex")


```

## Citing WQP data

Citations for specific datasets should use this format:

National Water Quality Monitoring Council, YYYY, Water Quality Portal, accessed mm, dd, yyyy, hyperlink_for_query, https://doi.org/10.5066/P9QRKUVJ.

This can be done using the `create_WQP_bib` function:

```{r}
SC <- readWQPqw(siteNumbers = "USGS-05288705",
                parameterCd = "00300")

WQPcitation <- create_WQP_bib(SC)
WQPcitation
print(WQPcitation, style = "Bibtex")
```

## Citing Water Quality Portal itself

General Water Quality Portal citations should use the following:

Water Quality Portal. Washington (DC): National Water Quality Monitoring Council, United States Geological Survey (USGS), Environmental Protection Agency (EPA); 2021. https://doi.org/10.5066/P9QRKUVJ.

# Package Support

The Water Mission Area of the USGS supports the development and maintenance of `dataRetrieval`, and most likely further into the future. Resources are available primarily for maintenance and responding to user questions. Priorities on the development of new features are determined by the `dataRetrieval` development team. This software was last released with USGS record: IP-147158.

```{r disclaimer, child="DISCLAIMER.md", eval=TRUE}
```



        

---

Owner metadata

• Name: U.S. Geological Survey
• Login: DOI-USGS
• Email: [email protected]
• Kind: organization
• Description: By integrating our diverse scientific expertise, we understand complex natural science phenomena and provide scientific products that lead to solutions.
• Website: https://www.usgs.gov/
• Location: United States of America
• Twitter: USGS
• Company:
• Icon url: https://avatars.githubusercontent.com/u/65027635?v=4
• Repositories: 59
• Last ynced at: 2023-06-11T08:40:17.441Z
• Profile URL: https://github.com/DOI-USGS

---

GitHub Events

Total

• Create event: 2
• Issues event: 6
• Release event: 1
• Watch event: 25
• Issue comment event: 32
• Push event: 25
• Pull request review event: 48
• Pull request review comment event: 42
• Pull request event: 56
• Fork event: 5

Last Year

• Create event: 2
• Issues event: 6
• Release event: 1
• Watch event: 25
• Issue comment event: 32
• Push event: 25
• Pull request review event: 48
• Pull request review comment event: 42
• Pull request event: 56
• Fork event: 5

---

Committers metadata

Last synced: 3 days ago

Name	Email	Commits
Laura DeCicco	l****o@u****v	1963
wdwatkins	w****s@u****v	135
Lindsay Carr	l****r@u****v	48
mike	j****0@u****u	25
David Blodgett	d****t@u****v	11
Krall	a****l@u****v	11
Jessica Thompson	j****s@u****v	9
Jordan S Read	j****d@u****v	8
Julie Padilla	p****0@g****m	7
Doug Friedman	s****b@g****m	6
Jordan Walker	j****r@u****v	6
elbeejay	j****n@u****v	6
jsta	s****2@m****u	5
Lee Stanish	8****s	5
Elise Hinman	e****n@u****v	4
Jerry Martin	A****t	2
matt rhoads	m****1@g****m	2
Alison Appling	a****g@u****v	1
Bryan McCloskey	b****y@u****v	1
Jim Hester	j****r@g****m	1
Katrin Leinweber	9****r	1
Kevin M. Smith	K****h@t****u	1
unknown	l****o@I****t	1
David Blodgett		1
Padilla	J****a@s****v	1
dependabot[bot]	4****]	1
jwpestrak	j****k	1

Committer domains:

• usgs.gov: 12
• seattle.gov: 1
• igsarmewltlad2.gs.doi.net: 1
• tufts.edu: 1
• msu.edu: 1
• ucsb.edu: 1

---

Issue and Pull Request metadata

Last synced: 1 day ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/DOI-USGS/dataRetrieval

---

---

---

Package metadata

• Total packages: 1
• Total downloads:
  • cran: 3,540 last-month
• Total docker downloads: 42,194
• Total dependent packages: 10
• Total dependent repositories: 50
• Total versions: 35
• Total maintainers: 1

---

Dependencies

Score: 19.738346920650322