Earthdata Cloud Cookbook

This Cookbook is learning-oriented to support scientific researchers using NASA Earthdata from Distributed Active Archive Centers as they migrate their workflows to the cloud.
https://nasa-openscapes.github.io/earthdata-cloud-cookbook/

Category: Sustainable Development
Sub Category: Education

Keywords from Contributors

open-science pangeo openscience climate-data cloud-computing access cmr nasa-api data-access end-user-facing

Last synced: about 6 hours ago
JSON representation

Repository metadata

A tutorial book of workflows for research using NASA EarthData in the Cloud created by the NASA-Openscapes team

README.md

DOI

Open in GitHub Codespaces

Hello!

This Earthdata Cloud Cookbook is being developed by the NASA Openscapes team.

How to contribute to our book

Information for our team to contribute to the Cookbook. This includes setup and workflow instructions.

Hackdays

In 2023 we are iterating and improving on our original cookbook structure, incorporating current technical approaches and what we've learned teaching NASA colleagues and Earth science researchers. We will increasingly track our tasks and progress using issues in this repository. We are having ongoing virtual Hackdays (ongoing notes and spreadsheet) to focus progress together.

Hackdays:

  • February 2, 2023
  • March 2, 2023
  • March 30, 2023
  • May 10, 2023

Hackday 4 Summary

This was our first Hackday "opening up" to folks beyond the NASA Mentors. Thanks Owen Littlejohns for joining and contributing!

Hackday 3 Summary

Brief planning check-in and then mostly worked in breakouts the whole time - 

  • OPeNDAP tutorial (Chris) - goal to not use pyDAP, instead earthaccess/Xarray and Zarr.

  • How-Tos: Harmony-py subset example with PO.DAAC data (Amy) 

    • Progress: Pushed work-in-progress to branch, draft PR 
  • How-Tos: Populated "access data"; created "read data" for python. (Cassie & Andy) 

    • Progress: merged PR

    • Next steps: Tagging R people fill in their wisdom - please go through and populate some of the R parts

  • Tutorials: Import AppEEARS tutorial (Mahsa & Julie)

    • Progress: successful import and draft PR

    • Question: not re-import all notebooks each time (see draft PR)

  • Tutorials: earthaccess walk-through (Jess). Shared workflow with Luis (conversation below). Focus: how to use earthaccess outside the JupyterHub

  • Get-Started section (Jess) -  reviewed old chapters commented out in quarto_yml to see how to incorporate/delete. 

    • Progress: notes/suggestions below

    • Next steps: review & do!

  • Environments chapter (Erin) started, notes here: #186 

  • DOI, Zenodo, Citation, Documentation (Stef) - Deposit in Zenodo & get DOI for cookbook #178. Added DOI badge to README: commit

Hackday 2 Summary

At our 2nd hackday we had a brief overview of cookbook progress since we'd last met before working in breakout groups together. In this session: 

  • Updated the importer function by adding .md capability and rethinking storing copies of notebooks bc will get out of sync (commit) (Cassie+Luis)

  • added CC-BY license and added license text to page footer (Erin+Stef)

  • Planned How-Tos restructure through organization & level of granularity on left and right nav (draft PR) (Andy, Catalina, Mahsa, Alexis, Julie)

  • Update and add Cloud OPeNDAP tutorials (issue) (Chris, Michele)

  • Reviewing earthaccess tutorial in cookbook to parse and point to the docs; also how to sync a forked repo via cmd line (Jess)

Progress following Hackday 1


Owner metadata


GitHub Events

Total
Last Year

Committers metadata

Last synced: 4 days ago

Total Commits: 848
Total Committers: 41
Avg Commits per committer: 20.683
Development Distribution Score (DDS): 0.568

Commits in past year: 58
Committers in past year: 7
Avg Commits per committer in past year: 8.286
Development Distribution Score (DDS) in past year: 0.759

Name Email Commits
Julia Stewart Lowndes l****s@n****u 366
Stefanie Butland s****d@g****m 80
Andy Teucher a****r@g****m 54
Carl c****g@g****m 44
asteiker a****r@g****m 42
Andy Barrett a****t@n****g 36
Alexis Hunzinger a****r@g****m 16
Eli Holmes - NOAA e****s@n****v 15
cassienickles c****5@g****m 14
Chris Battisto 3****x 14
Jess Welch w****n@o****v 14
erinmr e****r@g****m 13
Andy Barrett a****t@g****m 12
Sheyenne Kirkland s****3@u****u 12
betolink l****a@c****u 11
asteiker 4****r 11
mjami00 8****0 10
mikala-nsidc m****g@c****u 10
pommevilla p****3@g****m 9
amfriesz a****z@g****m 6
Makhan Virdi M****i@g****m 6
Ian Carroll i****l@n****v 6
Ziheng Sun z****n@g****u 5
JJ Allaire jj@r****m 5
Catalina O 5****8 5
betolink:w l****z@n****g 5
Cassie Nickles c****s@j****v 5
Cedric Wannaz c****z@g****m 4
Daniel Kaufman 1****h 3
mjami00 m****i@g****m 2
and 11 more...

Committer domains:


Issue and Pull Request metadata

Last synced: 7 days ago

Total issues: 122
Total pull requests: 145
Average time to close issues: 11 months
Average time to close pull requests: 2 days
Total issue authors: 21
Total pull request authors: 24
Average comments per issue: 1.2
Average comments per pull request: 1.06
Merged pull request: 122
Bot issues: 0
Bot pull requests: 0

Past year issues: 14
Past year pull requests: 20
Past year average time to close issues: 1 day
Past year average time to close pull requests: 4 days
Past year issue authors: 6
Past year pull request authors: 5
Past year average comments per issue: 0.57
Past year average comments per pull request: 1.3
Past year merged pull request: 12
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/nasa-openscapes/earthdata-cloud-cookbook

Top Issue Authors

  • jules32 (61)
  • asteiker (11)
  • ateucher (8)
  • erinmr (8)
  • stefaniebutland (7)
  • alexishunzinger (5)
  • andypbarrett (4)
  • danielfromearth (4)
  • virdi (2)
  • tsnow03 (1)
  • chris-durbin (1)
  • graymckenna96 (1)
  • cassienickles (1)
  • battistowx (1)
  • mjami00 (1)

Top Pull Request Authors

  • jules32 (61)
  • ateucher (19)
  • stefaniebutland (6)
  • pommevilla (5)
  • jjallaire (5)
  • andypbarrett (5)
  • asteiker (5)
  • cassienickles (4)
  • erinmr (4)
  • amfriesz (4)
  • mikala-nsidc (4)
  • alexishunzinger (4)
  • danielfromearth (3)
  • betolink (3)
  • mojafa (2)

Top Issue Labels

  • enhancement (9)
  • documentation (8)
  • help wanted (8)
  • discussions (6)
  • good first issue (4)
  • maintenance (3)
  • design (3)
  • bug (2)
  • hackday (2)
  • coworking (2)
  • troubleshooting (1)
  • lang: r (1)

Top Pull Request Labels

  • enhancement (2)
  • bug (1)

Dependencies

.github/workflows/quarto-publish.yml actions
  • actions/checkout v2 composite
  • conda-incubator/setup-miniconda v2 composite
  • quarto-dev/quarto-actions/publish v2 composite
  • quarto-dev/quarto-actions/setup v2 composite
_import/environment.yml pypi
  • markdown *
  • pqdm *
examples/NSIDC/environment.yml pypi
  • eo-metadata-tools-cmr *
  • pqdm *

Score: 8.776167099731275