Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology

A curated list of open technology projects to sustain a stable climate, energy supply, biodiversity and natural resources.

Recent Releases of FedData

FedData - FedData version 4.3.0 CRAN release

This is a minor release from FedData v4.2.0 to FedData v4.3.0.

  • Updated get_padus() to pull PAD-US 4.0 data. Closes Issue #124.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky 15 days ago

FedData - FedData version 4.1.0 CRAN release

This is a minor release from FedData v4.0.1 to FedData v4.1.0.

  • Removed {styler} and several other packages from the Suggests field in the DESCRIPTION file.
  • Moved {ggplot2} and {ncdf4} to the Suggests field.
  • get_nass() now throws an error (soft deprecated since v3.0.0).
  • Added support for the annual NLCD product via the new get_nlcd_annual() function.

Full Changelog: https://github.com/ropensci/FedData/compare/v4.0.0...v4.1.0

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky 6 months ago

FedData - FedData version 4.0.0 CRAN release

This is a major release from FedData v3.0.4 to FedData v4.0.0. As of FedData v4 we have retired dependencies on the sp and raster packages. All functions in FedData v4 return terra (raster) or sf (vector) objects by default, and there may be other breaking changes.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky over 1 year ago

FedData - FedData version 3.0.4 CRAN release

This is the 3.0.4 CRAN release of FedData. This release patches several bugs.

Here is a rundown of changes (as reflected in the package NEWS.md file):

  • Updated get_ghcn_daily() and related functions to use https addresses
    instead of the legacy ftp server Issue #99.
  • Updated get_nhd() to gracefully handle situations where no point data (or any NHD data) are available within an area of interest, using solution offered in Issue #98.
  • Updated get_nhd() to handle some strange geometries present in the NHD Issue #98.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky almost 2 years ago

FedData - FedData version 3.0.3 CRAN release

This is the 3.0.3 CRAN release of FedData. This release patches several bugs and improves perf.

Here is a rundown of changes (as reflected in the package NEWS.md file):

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky about 2 years ago

FedData - FedData version 3.0.0 CRAN release

This is the 3.0.0 CRAN release of FedData. This is a major release, with breaking changes in several functions.

Here is a rundown of major changes (as reflected in the package NEWS.md file):

  • All get_*() functions now return sf or raster objects.
  • Changed SDA_query() to soils_query() to avoid namespace masking with SoilDB.
  • Added get_nass_cdl() to retrieve the NASS Cropland Data Layer
  • Updated get_daymet() to pull from ORNL WCS, and fixed bug in Issue #49
  • Fixed issue where soils_query() was only returning first SSURGO study area (Issue #51)
  • Fixed issue where date parsing was USA-specific by leveraging lubridate::parse_date_time (Issue #61)
  • get_ssurgo() now saves in the GeoPackage file format
  • get_nhd() now access ESRI web services. Users can optionally get data from NHDPlus.
  • get_nlcd() now provides data in native CRS (CONUS Albers), rather than web-mercator (Issue #77) by pulling from self-hosted Cloud-Optimized GeoTiffs.
  • Issue #88 identified an issue with GDAL versions prior GDAL 3 reading COGs using the vsicurl functionality in GDAL. Accordingly, FedData3 requires GDAL >= 3.0.0.
  • Added Mesa Verde National Park as exemplar region, and removed use of paleocar package.
  • get_ned() now pulls from USGS NED Cloud-Optimized GeoTiffs available at https://prd-tnm.s3.amazonaws.com/index.html?prefix=StagedProducts/Elevation/.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky over 2 years ago

FedData - FedData version 2.5.4 CRAN release

This is the 2.5.4 CRAN release of FedData.

  • Fixed issue in downloading NED tiles caused by a shift in naming conventions on the USGS Amazon S3 served data. The USGS is slowly migrating to a new file name convention; as recent LiDaR data are added to the underlying DEM, the file name is changing. This was making some tiles not available. The get_ned() function now uses the new convention, but falls back to the old one when necessary. A new test has been added to ensure that the legacy fallback works.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky almost 7 years ago

FedData - FedData version 2.5.2 CRAN release

This is the FedData version 2.5.2 CRAN release. For documentation, see http://ropensci.github.io/FedData.

  • Updated NHD HUC4 to copy stored on Github.
  • Fixed bug in ITRDB that caused some chronologies not to be read.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky about 7 years ago

FedData - FedData version 2.5.1 CRAN release

This is the FedData version 2.5.1 CRAN release. For documentation, see http://ropensci.github.io/FedData.

  • Switch to laze-loading data.
  • Updated NHD paths to new National Map directory structure.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky over 7 years ago

FedData - FedData version 2.4.6 CRAN release

This is the FedData version 2.4.6 CRAN release, and the first release as part of ROpenSci. For documentation, see http://ropensci.github.io/FedData.

  • DAYMET functions now do not operate in parallel. This was breaking the download functions.
  • Final update for version 2 of FedData.
  • Accepted to ROpenSci! Migrating to the ROpenSci organization on GitHub.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky over 7 years ago

FedData - FedData version 2.4.5 CRAN release

This is the FedData version 2.4.5 CRAN release. For documentation, see http://www.bocinsky.io/FedData/.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky about 8 years ago

FedData - FedData 2.0.3 CRAN release

FedData (v2.0.3)

An R package implementing functions to automate downloading geospatial data available from several federated data sources (mainly sources maintained by the US Federal government). Currently, the package allows for retrieval of five datasets:

Additional data sources are in the works, including global DEM resources (ETOPO1, STRM), global soils (HWSD), MODIS satellite data products, the National Atlas (US only), Natural Earth, PRISM, and WorldClim.

This package is designed with the large-scale geographic information system (GIS) use-case in mind: cases where the use of dynamic web-services is impractical due to the scale (spatial and/or temporal) of analysis. It functions primarily as a means of downloading tiled or otherwise spatially-defined datasets; additionally, it can preprocess those datasets by extracting data within an area of interest (AoI), defined spatially. It relies heavily on the sp, raster, and rgdal packages.

I recommend Homebrew for installing R and GDAL:

brew install gdal --with-complete --with-opencll --with-unsupported --with-libkml --with-python

(adding the --HEAD tag will install the latest development version.)

brew install r --with-openblas

Remember, if installing R with Homebrew, you must completely remove old R installations, including the R framework, typically installed at /Library/Frameworks. This package has been built and tested on a source (Homebrew) install of R on Mac OS 10.10 (Yosemite), and has been successfully run on an Ubuntu Linux cluster, and binary installs of R on Mac OS 10.10 (Yosemite) and Windows 7.

Installation

To install, use the following command in R:

devtools::install_github("bocinsky/FedData")

Some OS X systems have trouble installing the rgdal package from source. If your install fails, and you've installed the Homebrew version of GDAL and R, try the following command (from within R:

install.packages("rgdal", configure.args="--with-proj-include=/usr/local/include --with-proj-lib=/usr/local/lib")

A demo script is available in the /inst folder at the location of the installed package.

Acknowledgements

This package is a product of SKOPE (Synthesized Knowledge of Past Environments) and the Village Ecodynamics Project. This software is licensed under GPLv3.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky over 9 years ago

FedData - FedData 2.0.0 CRAN release

FedData (v2.0.0)

An R package implementing functions to automate downloading geospatial data available from several federated data sources (mainly sources maintained by the US Federal government). Currently, the package allows for retrieval of five datasets:

Additional data sources are in the works, including global DEM resources (ETOPO1, STRM), global soils (HWSD), MODIS satellite data products, the National Atlas (US only), Natural Earth, PRISM, and WorldClim.

This package is designed with the large-scale geographic information system (GIS) use-case in mind: cases where the use of dynamic web-services is impractical due to the scale (spatial and/or temporal) of analysis. It functions primarily as a means of downloading tiled or otherwise spatially-defined datasets; additionally, it can preprocess those datasets by extracting data within an area of interest (AoI), defined spatially. It relies heavily on the sp, raster, and rgdal packages.

I recommend Homebrew for installing R and GDAL:

brew install gdal --with-complete --with-opencll --with-unsupported --with-libkml --with-python

(adding the --HEAD tag will install the latest development version.)

brew install r --with-openblas

Remember, if installing R with Homebrew, you must completely remove old R installations, including the R framework, typically installed at /Library/Frameworks. This package has been built and tested on a source (Homebrew) install of R on Mac OS 10.10 (Yosemite), and has been successfully run on an Ubuntu Linux cluster, and binary installs of R on Mac OS 10.10 (Yosemite) and Windows 7.

Installation

To install, use the following command in R:

devtools::install_github("bocinsky/FedData")

Some OS X systems have trouble installing the rgdal package from source. If your install fails, and you've installed the Homebrew version of GDAL and R, try the following command (from within R:

install.packages("rgdal", configure.args="--with-proj-include=/usr/local/include --with-proj-lib=/usr/local/lib")

A demo script is available in the /inst folder at the location of the installed package.

Acknowledgements

This package is a product of SKOPE (Synthesized Knowledge of Past Environments) and the Village Ecodynamics Project. This software is licensed under GPLv3.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky almost 10 years ago

FedData - FedData 1.1.0 CRAN release

FedData (v1.1.0)

An R package implementing functions to automate downloading geospatial data available from several federated data sources (mainly sources maintained by the US Federal government). Currently, the package allows for retrieval of five datasets:

Additional data sources are in the works, including global DEM resources (ETOPO1, STRM), global soils (HWSD), MODIS satellite data products, the National Atlas (US only), Natural Earth, PRISM, and WorldClim.

This package is designed with the large-scale geographic information system (GIS) use-case in mind: cases where the use of dynamic web-services is impractical due to the scale (spatial and/or temporal) of analysis. It functions primarily as a means of downloading tiled or otherwise spatially-defined datasets; additionally, it can preprocess those datasets by extracting data within an area of interest (AoI), defined spatially. It relies heavily on the sp, raster, and rgdal packages.

NOTE: As of May 5, 2015, version 0.9-2 of the rgdal package for R does not work well with GDAL 1.11.2. This breaks the getNHD() function for retrieving the National Hydrography Dataset. Please install GDAL 1.11.1 and rgdal from source, or wait for an update to rgdal.

I recommend Homebrew for installing R and GDAL:

brew install gdal --complete --enable-mdb --enable-opencl --enable-unsupported --with-libkml --with-python

brew install r --with-openblas

Remember, if installing R with Homebrew, you must completely remove old R installations, including the R framework, typically installed at /Library/Frameworks. This package has been built and tested on a source (Homebrew) install of R on Mac OS 10.10 (Yosemite), and has been successfully run on a source install on an Ubuntu Linux cluster, and binary installs of R on Mac OS 10.10 (Yosemite) and Windows 7.

Installation

To install, use the following command in R:

devtools::install_github("bocinsky/FedData")

Some OS X systems have trouble installing the rgdal package from source. If your install fails, try the following command:

install.packages("rgdal", configure.args="--with-proj-include=/usr/local/include --with-proj-lib=/usr/local/lib")

A demo script is available in the /inst folder at the location of the installed package.

Acknowledgements

This package is a product of SKOPE (Synthesized Knowledge of Past Environments) and the Village Ecodynamics Project. This software is licensed under GPLv3.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky almost 10 years ago

FedData - FedData 1.0 CRAN release

This is the initial v1.0 release of the FedData package, as submitted to the CRAN.

Sustainable Development - Data Catalogs and Interfaces - R
Published by bocinsky about 10 years ago