WeatherBench 2
A framework for evaluating and comparing data-driven and traditional numerical weather forecasting models.
https://github.com/google-research/weatherbench2
Category: Atmosphere
Sub Category: Meteorological Observation and Forecast
Keywords from Contributors
convolutional-neural-network transformers weather jax deep-neural-networks deeplearning distributed python-framework python-tensorflow tensorflow2
Last synced: about 15 hours ago
JSON representation
Repository metadata
A benchmark for the next generation of data-driven global weather models.
- Host: GitHub
- URL: https://github.com/google-research/weatherbench2
- Owner: google-research
- License: apache-2.0
- Created: 2023-02-24T09:44:32.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2025-05-13T21:08:40.000Z (4 days ago)
- Last Synced: 2025-05-15T22:02:59.468Z (1 day ago)
- Language: Python
- Homepage: https://weatherbench2.readthedocs.io
- Size: 1.72 MB
- Stars: 522
- Watchers: 9
- Forks: 55
- Open Issues: 70
- Releases: 2
-
Metadata Files:
- Readme: README.md
- Contributing: docs/contributing.md
- License: LICENSE
- Code of conduct: docs/code-of-conduct.md
README.md
WeatherBench 2 - A benchmark for the next generation of data-driven global weather models
🚨🚨🚨 WeatherBench-X has been released. It provides an updated version of our evaluation code base. We encourage users to switch to the new codebase. The [data guide] (https://weatherbench2.readthedocs.io/en/latest/data-guide.html) is still up-to-date. 🚨🚨🚨
arXiv paper
Google AI Blog post
Why WeatherBench?
WeatherBench 2 is a framework for evaluating and comparing data-driven and traditional numerical weather forecasting models. WeatherBench consists of:
- Publicly available, cloud-optimized ground truth and baseline datasets. For a complete list, see this page.
- Open-source evaluation code. See this quick-start to explore the basic functionality or the API docs for more detail. Since high-resolution forecast files can be large, the WeatherBench 2 code was written with scalability in mind. See the command-line scripts based on Xarray-Beam and this guide for running the scripts on GCP using DataFlow.
- A website displaying up-to-date scores of many of the state-of-the-art data-driven and physical approaches.
- A paper describing the rationale behind the evaluation setup.
WeatherBench 2 has been built as an evolving tool for the entire community. For this reason, we welcome any feedback (ideally, submitted as GitHub issues) or contributions. If you would like you model to be part of WeatherBench, check out this guide.
Citation
@misc{rasp2023weatherbench,
title={WeatherBench 2: A benchmark for the next generation of data-driven global weather models},
author={Stephan Rasp and Stephan Hoyer and Alexander Merose and Ian Langmore and Peter Battaglia and Tyler Russel and Alvaro Sanchez-Gonzalez and Vivian Yang and Rob Carver and Shreya Agrawal and Matthew Chantry and Zied Ben Bouallegue and Peter Dueben and Carla Bromberg and Jared Sisk and Luke Barrington and Aaron Bell and Fei Sha},
year={2023},
eprint={2308.15560},
archivePrefix={arXiv},
primaryClass={physics.ao-ph}
}
License
This is not an official Google product.
Copyright 2023 Google LLC
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
https://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
Owner metadata
- Name: Google Research
- Login: google-research
- Email:
- Kind: organization
- Description:
- Website: https://research.google
- Location: Earth
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/43830688?v=4
- Repositories: 226
- Last ynced at: 2023-03-02T14:20:27.989Z
- Profile URL: https://github.com/google-research
GitHub Events
Total
- Issues event: 36
- Watch event: 94
- Delete event: 32
- Issue comment event: 50
- Push event: 181
- Pull request review event: 4
- Pull request event: 80
- Fork event: 11
- Create event: 43
Last Year
- Issues event: 36
- Watch event: 94
- Delete event: 32
- Issue comment event: 50
- Push event: 181
- Pull request review event: 4
- Pull request event: 80
- Fork event: 11
- Create event: 43
Committers metadata
Last synced: 7 days ago
Total Commits: 246
Total Committers: 10
Avg Commits per committer: 24.6
Development Distribution Score (DDS): 0.74
Commits in past year: 44
Committers in past year: 6
Avg Commits per committer in past year: 7.333
Development Distribution Score (DDS) in past year: 0.318
| Name | Commits | |
|---|---|---|
| Alex Merose | a****r@g****m | 64 |
| Ian Langmore | l****e@g****m | 60 |
| Stephan Rasp | r****n@g****m | 46 |
| Weatherbench authors | n****y@g****m | 31 |
| Ignacio Lopez-Gomez | i****p@g****m | 21 |
| Stephan Hoyer | s****r@g****m | 18 |
| Vivian Yang | v****g@g****m | 3 |
| Yilei Yang | y****g@g****m | 1 |
| Peter Hawkins | p****s@g****m | 1 |
| Janni Yuval | j****l@g****m | 1 |
Committer domains:
- google.com: 9
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 69
Total pull requests: 202
Average time to close issues: 20 days
Average time to close pull requests: 8 days
Total issue authors: 42
Total pull request authors: 7
Average comments per issue: 1.65
Average comments per pull request: 0.21
Merged pull request: 76
Bot issues: 0
Bot pull requests: 169
Past year issues: 37
Past year pull requests: 70
Past year average time to close issues: 5 days
Past year average time to close pull requests: 9 days
Past year issue authors: 25
Past year pull request authors: 5
Past year average comments per issue: 1.38
Past year average comments per pull request: 0.09
Past year merged pull request: 27
Past year bot issues: 0
Past year bot pull requests: 65
Top Issue Authors
- ShileiCao (6)
- alxmrs (6)
- oliverangelil (5)
- jdwillard19 (4)
- raspstephan (4)
- sehoffmann (4)
- markmbaum (3)
- LevanBokeria (2)
- rs-lsl (2)
- gcouairon (1)
- oliverwm1 (1)
- jrbourbeau (1)
- Arcomano1234 (1)
- williamhobbs (1)
- aliamrrr (1)
Top Pull Request Authors
- copybara-service[bot] (165)
- alxmrs (15)
- raspstephan (14)
- dependabot[bot] (4)
- peter-dudbridge (2)
- emmanuel-ferdman (1)
- greysab (1)
Top Issue Labels
- bug (1)
Top Pull Request Labels
- pull ready (25)
- dependencies (4)
- python (1)
Dependencies
- actions/cache v2 composite
- actions/checkout v2 composite
- actions/setup-python v2 composite
- styfle/cancel-workflow-action 0.7.0 composite
- actions/cache v2 composite
- actions/checkout v2 composite
- actions/setup-python v2 composite
- styfle/cancel-workflow-action 0.7.0 composite
- Jinja2 ==3.1.2
- apache_beam >=2.31.0
- myst-nb ==0.17.2
- myst-parser ==0.18.1
- numpy ==1.24.4
- pandas ==2.0.3
- scipy ==1.10.1
- sphinx ==5.3.0
- sphinx_rtd_theme ==1.2.1
- xarray ==2023.6.0
- xarray-beam ==0.6.2
- zarr ==2.15.0
- gcsfs *
Score: 8.68609172787805