Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology

Earthdata Cloud Cookbook

This Cookbook is learning-oriented to support scientific researchers using NASA Earthdata from Distributed Active Archive Centers as they migrate their workflows to the cloud.
https://nasa-openscapes.github.io/earthdata-cloud-cookbook/

Category: Sustainable Development
Sub Category: Education

Keywords from Contributors

open-science pangeo openscience climate-data cloud-computing access cmr nasa-api data-access end-user-facing

Last synced: about 4 hours ago
JSON representation

Repository metadata

A tutorial book of workflows for research using NASA EarthData in the Cloud created by the NASA-Openscapes team

README.md

DOI

NASA Earthdata Cloud Cookbook

Supporting NASA Earth Science Research Teams' Migration to the Cloud

The NASA Openscapes Earthdata Cloud Cookbook is a learning resource for
scientific researchers who use NASA Earthdata as NASA migrates data and
workflows to the cloud. It is built as a cross-DAAC collaboration by the
NASA-Openscapes team and is under active,
open development.

Live site: nasa-openscapes.github.io/earthdata-cloud-cookbook

What's in the Cookbook

Section Description
Our Cookbooks Links to DAAC-specific cookbooks (PO.DAAC, NSIDC, ORNL, OB.DAAC, and more)
Core Concepts Conceptual background on cloud computing for Earth science
Tutorials End-to-end, learn-by-doing workflows (hurricanes, sea level rise, carbon stocks, and more)
How-To Guides Goal-oriented recipes for finding, accessing, and working with data
Reference Glossary, cheatsheets

Quick Start

You can follow along the examples provided on the cookbook or run them locally
download the corn environment.yml
from the NASA-Openscapes JupyterHub base image and create a conda environment:

conda env create -f environment.yml
conda activate nasaopenscapes_env

Key Tools

Python: earthaccess

The earthaccess Python
library streamlines access to NASA Earthdata locally or in the cloud and is
used throughout this Cookbook.

import earthaccess
earthaccess.login()

R: earthdatalogin

The earthdatalogin R package streamlines access to NASA Earthdata from R. While it is not as fully featured as earthaccess, it is the easiest way to authenticate and search for NASA Earthdata from R. As we continue to develop more tutorials in R, they will use this package throughout.

library(earthdatalogin)
edl_netrc()

Contributing

We welcome contributions from the community. See the Contributing
Guide
for setup instructions, workflows, and notebook templates.

Citation

Please cite this resource using the Zenodo DOI:
10.5281/zenodo.7786710. This DOI
always resolves to the latest version.

Andy Barrett, Chris Battisto, Brandon Bottomley, Aaron Friesz, Alexis
Hunzinger, Mahsa Jami, Alex Lewandowski, Bri Lind, Luis López, Jack McNelis,
Cassie Nickles, Catalina Oaida Taglialatela, Celia Ou, Brianna Pagán, Sargent
Shriver, Amy Steiker, Michele Thornton, Makhan Virdi, Jessica Nicole Welch,
Jess Welch, Erin Robinson, Julia Stewart Lowndes. (2023).
NASA-Openscapes/earthdata-cloud-cookbook: NASA EarthData Cloud Cookbook
v2023.03.0. Zenodo. https://doi.org/10.5281/zenodo.7786711

License

All materials are publicly available under a CC-BY license,
adapted from The Turing Way.

Owner metadata

GitHub Events

Total
Last Year

Committers metadata

Last synced: 1 day ago

Total Commits: 951
Total Committers: 46
Avg Commits per committer: 20.674
Development Distribution Score (DDS): 0.615

Commits in past year: 106
Committers in past year: 9
Avg Commits per committer in past year: 11.778
Development Distribution Score (DDS) in past year: 0.509

Name Email Commits
Julia Stewart Lowndes l****s@n****u 366
Andy Teucher a****r@g****m 106
Stefanie Butland s****d@g****m 80
Carl c****g@g****m 44
asteiker a****r@g****m 43
Andy Barrett a****t@n****g 36
ronnyhdez r****m@g****m 29
Ian Carroll c****n@g****m 19
Alexis Hunzinger a****r@g****m 16
Eli Holmes - NOAA e****s@n****v 15
Jess Welch w****n@o****v 14
Chris Battisto 3****x 14
cassienickles c****5@g****m 14
erinmr e****r@g****m 13
Andy Barrett a****t@g****m 12
Sheyenne Kirkland s****3@u****u 12
betolink l****a@c****u 11
asteiker 4****r 11
mjami00 8****0 10
mikala-nsidc m****g@c****u 10
pommevilla p****3@g****m 9
amfriesz a****z@g****m 6
Makhan Virdi M****i@g****m 6
Heather h****e@j****v 5
Ziheng Sun z****n@g****u 5
JJ Allaire jj@r****m 5
Catalina O 5****8 5
betolink:w l****z@n****g 5
Cassie Nickles c****s@j****v 5
Cedric Wannaz c****z@g****m 4
and 16 more...

Committer domains:

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 184
Total pull requests: 171
Average time to close issues: 10 months
Average time to close pull requests: 5 days
Total issue authors: 23
Total pull request authors: 28
Average comments per issue: 1.17
Average comments per pull request: 1.37
Merged pull request: 141
Bot issues: 0
Bot pull requests: 0

Past year issues: 62
Past year pull requests: 28
Past year average time to close issues: about 1 month
Past year average time to close pull requests: 15 days
Past year issue authors: 7
Past year pull request authors: 8
Past year average comments per issue: 1.0
Past year average comments per pull request: 2.96
Past year merged pull request: 21
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/nasa-openscapes/earthdata-cloud-cookbook

Top Issue Authors

  • jules32 (62)
  • ateucher (32)
  • ronnyhdez (19)
  • itcarroll (14)
  • asteiker (11)
  • stefaniebutland (9)
  • erinmr (8)
  • andypbarrett (5)
  • danielfromearth (5)
  • alexishunzinger (5)
  • virdi (2)
  • cassienickles (1)
  • scottyhq (1)
  • chris-durbin (1)
  • tsnow03 (1)

Top Pull Request Authors

  • jules32 (61)
  • ateucher (31)
  • asteiker (6)
  • stefaniebutland (6)
  • ronnyhdez (6)
  • itcarroll (5)
  • pommevilla (5)
  • jjallaire (5)
  • andypbarrett (5)
  • erinmr (4)
  • amfriesz (4)
  • mikala-nsidc (4)
  • alexishunzinger (4)
  • cassienickles (4)
  • danielfromearth (3)

Top Issue Labels

  • maintenance (32)
  • content: new (20)
  • notebook: howto (19)
  • enhancement (18)
  • documentation (10)
  • help wanted (8)
  • discussions (6)
  • content: update (6)
  • bug (5)
  • good first issue (4)
  • coworking (3)
  • design (3)
  • hackday (2)
  • contributing (2)
  • needs: triage (2)
  • lang: r (1)
  • troubleshooting (1)
  • automation (1)
  • content: remove (1)

Top Pull Request Labels

  • enhancement (2)
  • notebook: howto (1)
  • documentation (1)
  • bug (1)
  • lang: r (1)

Package metadata

proxy.golang.org: github.com/NASA-Openscapes/earthdata-cloud-cookbook

proxy.golang.org: github.com/nasa-openscapes/earthdata-cloud-cookbook

Dependencies

.github/workflows/quarto-publish.yml actions
  • actions/checkout v2 composite
  • conda-incubator/setup-miniconda v2 composite
  • quarto-dev/quarto-actions/publish v2 composite
  • quarto-dev/quarto-actions/setup v2 composite
.github/workflows/test-build.yaml actions
  • actions/checkout v3 composite
.devcontainer/environment.yml conda
  • awscliv2
  • bqplot
  • cartopy
  • code-server >=3.2
  • coiled
  • conda-lock
  • dask
  • dask-gateway
  • dask-labextension
  • datashader
  • distributed
  • earthaccess >=0.8.2
  • gdal ~=3.8
  • geopandas
  • geoviews
  • git >=2.39
  • graphviz
  • h5coro
  • h5netcdf
  • h5py
  • hdf5plugin
  • holoviews 1.16.2
  • hvplot
  • icepyx
  • intake
  • ipyleaflet
  • ipympl
  • ipywidgets
  • itslive
  • joblib
  • jupyter-book
  • jupyter-resource-usage
  • jupyter-rsession-proxy
  • jupyter-server-proxy
  • jupyter-vscode-proxy
  • jupyterhub-singleuser
  • jupyterlab >4
  • jupyterlab-favorites
  • jupyterlab-geojson
  • jupyterlab-git
  • jupyterlab-h5web
  • jupyterlab-myst
  • kerchunk
  • lxml
  • matplotlib-base
  • nbgitpuller
  • netcdf4 >=1.6.4
  • ocl-icd-system
  • odc-stac
  • pip
  • pooch
  • pqdm
  • pydap
  • pynco
  • pyopencl
  • pyproj
  • pyresample
  • pystac-client
  • python 3.10
  • qgis ~=3.28
  • rasterio
  • rasterstats
  • rechunker
  • rioxarray
  • s3fs
  • scikit-image
  • seaborn
  • shapely
  • sliderule >=3.6.0
  • spectral
  • websockify >=0.10
  • xarray >=2022.12
  • zarr
_import/environment.yml conda
  • nbformat
  • pip
  • pytest 6.2
  • pytest-watch 4.1
  • python 3.8
  • requests 2.26
.github/workflows/deploy-preview.yml actions
  • actions/checkout v4 composite
  • nwtgck/actions-netlify v3 composite
  • quarto-dev/quarto-actions/render v2 composite
  • quarto-dev/quarto-actions/setup v2 composite
.github/workflows/docker-image-conda.yml actions
  • actions/checkout v3 composite
  • docker/login-action v1 composite
.github/workflows/docker-image-venv.yml actions
  • actions/checkout v3 composite
  • docker/login-action v1 composite
examples/NSIDC/environment.yml conda
  • awscli ~=1.19
  • bqplot ~=0.12.23
  • cartopy ~=0.18.0
  • dask ~=2021.7.2
  • dask-labextension ~=5.0.1
  • fsspec ~=2021.6.1
  • geojson ~=2.5
  • geopandas ~=0.9.0
  • h5netcdf ~=0.11
  • h5py ~=3.2
  • ipyleaflet ~=0.13.5
  • ipympl ~=0.6.3
  • joblib ~=1.0.1
  • jupyterlab 3
  • matplotlib-base ~=3.3.4
  • netcdf4 ~=1.5.6
  • pip
  • python 3.8
  • requests ~=2.25.1
  • rioxarray ~=0.3.1
  • s3fs ~=2021.6.1
  • s3fs ~=2021.6
  • sidecar ~=0.5.0
  • tqdm ~=4.59.0
  • xarray ~=0.18
  • zarr ~=2.8
.devcontainer/Dockerfile docker
  • ghcr.io/rocker-org/devcontainer/tidyverse 4.3 build
.devcontainer/nasa-requirements.txt pypi
  • contextily * development
  • dask * development
  • distributed * development
  • earthaccess * development
  • geopandas * development
  • geoviews * development
  • gh-scoped-creds * development
  • h5netcdf * development
  • h5py * development
  • hvplot * development
  • jupyter-console * development
  • jupyter-events * development
  • jupyter-lsp * development
  • jupyter-rsession-proxy * development
  • jupyter-vscode-proxy * development
  • jupyter_client * development
  • jupyter_core * development
  • jupyter_server * development
  • jupyter_server_terminals * development
  • jupyterhub * development
  • jupyterlab * development
  • jupyterlab-pygments * development
  • jupyterlab-quarto * development
  • jupyterlab-widgets * development
  • jupyterlab_server * development
  • lxml * development
  • nbconvert * development
  • nbformat * development
  • netCDF4 * development
  • notebook * development
  • odc-stac * development
  • planetary-computer * development
  • polars * development
  • pyarrow * development
  • pyresample * development
  • pystac-client * development
  • rasterstats * development
  • rioxarray * development
  • scikit-image * development
  • zarr * development

Score: -Infinity