global-workflow

Global Superstructure/Workflow currently supporting the Finite-Volume on a Cubed-Sphere Global Forecast System.
https://github.com/NOAA-EMC/global-workflow

Category: Climate Change
Sub Category: Earth and Climate Modeling

Keywords

gdas gefs gfs jedi s2s sfs ufs

Keywords from Contributors

numerical-weather-prediction nwp weather-model community-modeling forecast-model unified-forecast-system weather numerical-modelling climate regional-model

Last synced: about 3 hours ago
JSON representation

Repository metadata

Global Superstructure/Workflow supporting the Global, Global Ensemble, and Seasonal Forecast Systems (GFS, GEFS, SFS)

README.md

Read The Docs Status
shellnorms
pynorms
Custom badge

Custom badge
Custom badge
Custom badge
Custom badge
Custom badge

The Global Workflow supporting the Global Forecast System (GFS), the Global Ensemble Forecasting System (GEFS), and the Seasonal Forecast System (SFS) with the UFS-weather-model. Data assimilation, currently only available for the GFS, is provided by both the GSI- and GDASApp (JEDI)-based Data Assimilation systems.

In progress documentation is available.

Prerequisites

The Global Workflow depends on the following prerequisities to be available on the system:

  • Workflow Engines - Rocoto and ecFlow (for NWS Operations)
  • Compiler - Intel classic compiler suite version 2021.x
  • Software - NCEPLIBS (various), ESMF, HDF5, NetCDF, and a host of other softwares (see module files under /modulefiles for additional details).
    • Spack-stack is recommended for the installation of dependent libraries.

Supported platforms

The Global Workflow currently supports the following machines at the indicated tier.

HPC Tier Notes
WCOSS2NCO 1 GEFS testing is not regularly performed.
UrsaNOAA RDHPCS 1 METplus verification and vminmon GSI-monitor jobs and GCAFS system not supported yet.
HerculesMSU 1 Currently does not support the TC Tracker.
Gaea C6RDHPCS 1
HeraNOAA RDHPCS 2
OrionMSU 2 The GSI runs very slowly on Orion and the TC tracker is not supported.
AWS, GCP, Azure NOAA Parallel Works 3 Supported by EPIC.

Tier Definitions

  1. Fully supported by the EMC global workflow team. CI testing is regularly performed on these systems, the majority of the global workflow features are supported, and the team will address any platform-specific features, bugs, upgrades, and requests for data.
  2. Supported by the global workflow team on an ad-hoc basis. CI tests are supported on these systems, but not regularly performed.
  3. No official support by the global workflow team, but may be supported by other entities (e.g. EPIC).

Disclaimer

The United States Department of Commerce (DOC) GitHub project code is provided
on an "as is" basis and the user assumes responsibility for its use. DOC has
relinquished control of the information and no longer has responsibility to
protect the integrity, confidentiality, or availability of the information. Any
claims against the Department of Commerce stemming from the use of its GitHub
project will be governed by all applicable Federal law. Any reference to
specific commercial products, processes, or services by service mark,
trademark, manufacturer, or otherwise, does not constitute or imply their
endorsement, recommendation or favoring by the Department of Commerce. The
Department of Commerce seal and logo, or the seal and logo of a DOC bureau,
shall not be used in any manner to imply endorsement of any commercial product
or activity by DOC or the United States Government.


Owner metadata


GitHub Events

Total
Last Year

Committers metadata

Last synced: 6 days ago

Total Commits: 3,888
Total Committers: 99
Avg Commits per committer: 39.273
Development Distribution Score (DDS): 0.818

Commits in past year: 456
Committers in past year: 49
Avg Commits per committer in past year: 9.306
Development Distribution Score (DDS) in past year: 0.816

Name Email Commits
fanglin.yang f****g@n****v 706
kate.friedman k****n@n****v 643
russ.treadon R****n@n****v 273
Rahul Mahajan a****l 236
Walter Kolczynski - NOAA W****i@n****v 201
David Huber 6****A 201
george.gayno@noaa.gov g****o@n****v 164
TerrenceMcGuinness-NOAA t****s@c****t 125
Jessica Meixner j****r@n****v 125
Boi Vuong B****g@n****v 104
Mallory Row m****w@n****v 87
jswhit J****r@n****v 84
Henrique Alves h****s@n****v 83
Lin.Gan l****n@n****v 68
Guang.Ping.Lou G****u@n****v 63
Judy.K.Henderson J****n@n****v 61
Cory Martin c****n@n****v 58
AndrewEichmann-NOAA 5****A 54
CatherineThomas-NOAA 5****A 45
Henry R. Winterbottom 4****A 39
DavidNew-NOAA 1****A 33
Guillaume Vernieres g****s@n****v 33
AntonMFernando-NOAA 1****A 30
samuel.trahan@noaa.gov s****n@n****v 24
philip.pegion@noaa.gov p****n@n****v 18
Wei Huang w****g@n****v 17
anning.cheng a****g@n****v 17
Eric Sinsky - NOAA 4****A 16
edward.safford e****d@n****v 14
Neil Barton 1****A 13
and 69 more...

Committer domains:


Issue and Pull Request metadata

Last synced: 4 days ago

Total issues: 1,811
Total pull requests: 2,927
Average time to close issues: 3 months
Average time to close pull requests: 8 days
Total issue authors: 121
Total pull request authors: 95
Average comments per issue: 4.18
Average comments per pull request: 7.83
Merged pull request: 2,238
Bot issues: 0
Bot pull requests: 0

Past year issues: 451
Past year pull requests: 683
Past year average time to close issues: 23 days
Past year average time to close pull requests: 8 days
Past year issue authors: 57
Past year pull request authors: 49
Past year average comments per issue: 1.95
Past year average comments per pull request: 7.08
Past year merged pull request: 479
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/NOAA-EMC/global-workflow

Top Issue Authors

  • KateFriedman-NOAA (232)
  • WalterKolczynski-NOAA (210)
  • DavidHuber-NOAA (171)
  • JessicaMeixner-NOAA (149)
  • RussTreadon-NOAA (145)
  • TerrenceMcGuinness-NOAA (81)
  • aerorahul (81)
  • CoryMartin-NOAA (58)
  • lgannoaa (43)
  • CatherineThomas-NOAA (41)
  • guillaumevernieres (40)
  • AndrewEichmann-NOAA (38)
  • EricSinsky-NOAA (31)
  • jiaruidong2017 (27)
  • TaylorRoper-NOAA (25)

Top Pull Request Authors

  • KateFriedman-NOAA (447)
  • TerrenceMcGuinness-NOAA (319)
  • WalterKolczynski-NOAA (260)
  • aerorahul (253)
  • DavidHuber-NOAA (242)
  • JessicaMeixner-NOAA (139)
  • RussTreadon-NOAA (91)
  • AndrewEichmann-NOAA (86)
  • HenryWinterbottom-NOAA (76)
  • lgannoaa (60)
  • EricSinsky-NOAA (58)
  • CoryMartin-NOAA (56)
  • AntonMFernando-NOAA (52)
  • guillaumevernieres (51)
  • weihuang-jedi (46)

Top Issue Labels

  • bug (426)
  • feature (413)
  • triage (391)
  • maintenance (100)
  • Static Data Mgmt (75)
  • CI/CD (71)
  • production update (66)
  • Fix Files (54)
  • coupled (46)
  • nco-bug (33)
  • Epic (28)
  • task (21)
  • JEDI (17)
  • uncoupled (15)
  • port (15)
  • documentation (11)
  • duplicate (9)
  • enhancement (8)
  • wontfix (8)
  • blocked (8)
  • help wanted (6)
  • invalid (6)
  • implementation work (6)
  • ON HOLD (3)
  • CI-Hera-Passed (3)
  • GEFS (2)
  • EMERGENCY (2)
  • Enabler (2)
  • good for beginners (1)
  • CI-Orion-Passed (1)

Top Pull Request Labels

  • CI-Hera-Passed (511)
  • CI-Wcoss2-Passed (315)
  • CI/CD (292)
  • CI-Orion-Passed (240)
  • CI-Hercules-Passed (230)
  • production update (121)
  • bug (119)
  • CI-Gaeac6-Passed (92)
  • maintenance (91)
  • feature (81)
  • CI-Orion-Failed (58)
  • CI-Hera-Failed (57)
  • port (41)
  • CI-Hercules-Failed (38)
  • JEDI (31)
  • coupled (30)
  • CI-Gaeac6-Failed (21)
  • documentation (13)
  • CI-Wcoss2-Running (10)
  • CI-Hera-Running (10)
  • CI-Hera-Ready (9)
  • CI-Wcoss2-Failed (9)
  • CI-Gaea-Failed (7)
  • GEFS (7)
  • CI-Orion-Running (6)
  • uncoupled (6)
  • CI-Hera-Passed (cm) (5)
  • CI-Ursa-Passed (5)
  • CI-Hercules-Running (5)
  • blocked (5)

Dependencies

.github/workflows/docs.yaml actions
  • actions/checkout v3 composite
  • actions/github-script v6 composite
  • actions/setup-python v4 composite
  • actions/upload-artifact v3 composite
.github/workflows/linters.yaml actions
  • actions/checkout v3 composite
  • actions/upload-artifact v3 composite
  • redhat-plumbers-in-action/differential-shellcheck v4 composite
.github/workflows/pynorms.yaml actions
  • actions/checkout v3 composite
docs/requirements.txt pypi
  • sphinx *
  • sphinx-autobuild *
  • sphinx-copybutton *
  • sphinx_rtd_theme *
  • sphinxcontrib-bibtex *
.github/workflows/ci_unit_tests.yaml actions
  • EnricoMi/publish-unit-test-result-action v2 composite
  • actions/cache v4 composite
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
.github/workflows/pw_aws_ci.yaml actions
  • actions/checkout v4 composite
.github/workflows/trigger-gitlab-pipelines.yml actions
.github/workflows/validate-ci-matrices.yaml actions
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
  • actions/upload-artifact v4 composite
.github/workflows/wcoss2.yaml actions
  • schneegans/dynamic-badges-action v1.6.0 composite
dev/workflow/requirements.txt pypi
  • jinja2 >=3.0 development
  • numpy >=1.23 development
  • pycodestyle >=2.12 development
  • pyyaml >=6.0 development
  • wxflow >=0.2.0 development

Score: 10.120572789266372