Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology

A curated list of open technology projects to sustain a stable climate, energy supply, biodiversity and natural resources.

IOOS Cloud Sandbox

A collaborative platform to develop regional coastal models.
https://github.com/ioos/cloud-sandbox

Category: Hydrosphere
Sub Category: Coastal and Reefs

Last synced: about 16 hours ago
JSON representation

Repository metadata

IOOS' Coastal Modeling Cloud Sandbox provides a framework for developing, modifying and running models in the cloud. It provides repeatable configurations, model code and required libraries, input data and analysis of model outputs. The Sandbox supports not only the development of services and models, but also Cloud HPC to run and validate models.

README.md

IOOS Cloud Sandbox

The IOOS Cloud Sandbox is a collaborative platform for running regional coastal models in the cloud.

It provides repeatable configurations, model code and required libraries, input data, and analysis of model outputs. The Sandbox provisions Cloud HPC to aid in the development of services and models, and also supports running and validating models. The Sandbox is intended for use across industries and is inclusive to anyone who wants to develop, enhance, and run coastal models.

Use cases

  • Inter-organization collaboration
  • University graduate courses
  • Hindcasts/Reanalysis
  • Research to Operations (R2O)
  • On-demand HPC capacity
  • Quasi-operational HPC fail-over (natural disasters, data-center problems)
  • AI/ML training

Deployment options

  • Self deployed/hosted: Deploy using your own AWS cloud account
  • IOOS hosted: NOAA AWS Government Cloud – Lynker contract
  • RPS hosted: Isolated secure Virtual Private Cloud (VPC)

The Cloud Sandbox has been used to run:

I want to...

Software Stack

The Cloud Sandbox uses CloudFlow to orchestrate the execution of the model. CloudFlow is a customized workflow for running models built on Prefect Workflows.

Modeling Stack

Software Architecture

The Cloud Sandbox uses Terraform to deploy resources to the cloud. The sandbox currently only supports the Amazon Web Services (AWS) cloud platform.

  • Head Node: The head node is the machine that runs the CloudFlow scheduler. Users can SSH into this machine to run CloudFlow tasks.
  • Preconfigured AMI: This Amazon Machine Image (AMI) contains all of the necessary code to run the model. This image will run on the worker nodes.
  • Worker Nodes: The worker nodes are provisioned by Terraform and run CloudFlow tasks. This runs the preconfigured AMI.

Owner metadata

GitHub Events

Total
Last Year

Committers metadata

Last synced: 7 days ago

Total Commits: 142
Total Committers: 9
Avg Commits per committer: 15.778
Development Distribution Score (DDS): 0.204

Commits in past year: 9
Committers in past year: 4
Avg Commits per committer in past year: 2.25
Development Distribution Score (DDS) in past year: 0.556

Name Email Commits
Patrick Tripp p****p@r****m 113
Jonathan Joyce J****e@r****m 10
ZacharyWills 6****s 6
Micah Wengren m****n@g****m 6
Jason Ducker 8****P 3
Mahmud Monim 3****M 1
Benjamin Adams b****s@r****m 1
Ubuntu u****u@i****l 1
Patrick Tripp p****p@g****m 1

Committer domains:

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 49
Total pull requests: 99
Average time to close issues: about 1 year
Average time to close pull requests: 5 days
Total issue authors: 12
Total pull request authors: 13
Average comments per issue: 3.1
Average comments per pull request: 0.61
Merged pull request: 84
Bot issues: 0
Bot pull requests: 0

Past year issues: 21
Past year pull requests: 20
Past year average time to close issues: 4 months
Past year average time to close pull requests: 8 days
Past year issue authors: 6
Past year pull request authors: 9
Past year average comments per issue: 2.29
Past year average comments per pull request: 0.7
Past year merged pull request: 11
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/ioos/cloud-sandbox

Top Issue Authors

  • Michael-Lalime (14)
  • ZacharyWills (8)
  • KatherinePowell-NOAA (7)
  • mykelalvis (5)
  • breannalcv (3)
  • mwengren (3)
  • cpaternostro (2)
  • aliabdolali (2)
  • dpsnowden (2)
  • rezuma (1)
  • jduckerOWP (1)
  • hellkite500 (1)

Top Pull Request Authors

  • patrick-tripp (61)
  • ZacharyWills (16)
  • mwengren (6)
  • jonmjoyce (4)
  • jduckerOWP (3)
  • kennethells (2)
  • RATED-R-SUNDRAM (1)
  • ruhhh1130 (1)
  • mykelalvis (1)
  • nayaaaaaann (1)
  • MahmudM (1)
  • benjwadams (1)
  • sakshamg19 (1)

Top Issue Labels

  • LiveOcean 12-year reanalysis (2)
  • high priority (2)

Top Pull Request Labels

Dependencies

cloudflow/plotting/requirements.txt pypi
  • Pillow *
  • cmocean *
  • dask *
  • distributed *
  • matplotlib *
  • netCDF4 *
  • numpy *
  • pyproj ==2.6
cloudflow/requirements.txt pypi
  • Pillow *
  • cmocean *
  • dask *
  • distributed *
  • matplotlib *
  • netCDF4 *
  • numpy *
  • plotting *
  • pyproj *
cloudflow/setup.py pypi
  • Pillow *
  • cmocean *
  • dask *
  • distributed *
  • matplotlib *
  • netCDF4 *
  • numpy *
  • pyproj *
setup.py pypi
  • Pillow *
  • boto3 *
  • dask *
  • distributed *
  • matplotlib *
  • netCDF4 *
  • numpy *
  • plotting *
  • prefect *
  • pyproj ==2.6
cloudflow/notebooks/requirements.txt pypi
  • boto3 *
  • cartopy ==0.20.2
  • cmocean ==2.0
  • netCDF4 *
  • netcdf4 ==1.5.8
  • numpy *
  • scipy *
  • xarray ==2022.3.0

Score: 5.808142489980444