Extreme Weather Bench

Builds on the successful work of WeatherBench and introduces a set of high-impact weather events, spanning across multiple spatial and temporal scales and different parts of the weather spectrum.
https://github.com/brightbandtech/extremeweatherbench

Category: Atmosphere
Sub Category: Meteorological Observation and Forecast

Keywords

benchmarking meteorology

Last synced: about 11 hours ago
JSON representation

Repository metadata

Benchmarking of machine learning and numerical weather prediction (MLWP & NWP) models, with a focus on extreme events.

• Host: GitHub
• URL: https://github.com/brightbandtech/extremeweatherbench
• Owner: brightbandtech
• License: mit
• Created: 2024-08-15T15:33:50.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2026-05-05T18:06:52.000Z (about 1 month ago)
• Last Synced: 2026-06-05T08:03:11.879Z (6 days ago)
• Topics: benchmarking, meteorology
• Language: Python
• Homepage: https://extremeweatherbench.readthedocs.io/
• Size: 3.84 MB
• Stars: 121
• Watchers: 5
• Forks: 11
• Open Issues: 24
• Releases: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

README.md

$ pip install extremeweatherbench

# Or, add to an existing uv virtual environment
$ uv add extremeweatherbench

$ pip install git+https://github.com/brightbandtech/ExtremeWeatherBench.git 

# For running the data prep modules:
$ pip install "extremeweatherbench[data-prep]"
$ uv add "extremeweatherbench[data-prep]"

import extremeweatherbench as ewb

# Load in a forecast; here, we load in GFS initialized FCNv2 from the CIRA MLWP archive with a default variable built-in for convenience
fcnv2_heatwave_forecast = ewb.defaults.cira_fcnv2_heatwave_forecast

# Load in ERA5 with another default convenience variable 
era5_heatwave_target = ewb.defaults.era5_heatwave_target

# EvaluationObjects are used to evaluate a single forecast source against a single target source with a defined event type. Event types are declared with each case. One or more metrics can be evaluated with each EvaluationObject.
heatwave_evaluation_list = [
    ewb.inputs.EvaluationObject(
        event_type="heat_wave",
        metric_list=[
            ewb.metrics.MaximumMeanAbsoluteError(),
            ewb.metrics.RootMeanSquaredError(),
            ewb.metrics.MaximumLowestMeanAbsoluteError(),
        ],
        target=era5_heatwave_target,
        forecast=fcnv2_heatwave_forecast,
    ),
]
# Load in the EWB default list of event cases
case_metadata = ewb.cases.load_ewb_events_yaml_into_case_list()

# Create the evaluation class, with cases and evaluation objects declared
ewb_instance = ewb.evaluation(
    case_metadata=case_metadata,
    evaluation_objects=heatwave_evaluation_list,
)

# Execute a parallel run and return the evaluation results as a pandas DataFrame
heatwave_outputs = ewb_instance.run_evaluation(
    parallel_config={'n_jobs':16} # Uses 16 jobs with the loky backend as default
)

# Save the results
heatwave_outputs.to_csv('heatwave_evaluation_results.csv')

$ ewb --default

Owner metadata

• Name: Brightband
• Login: brightbandtech
• Email:
• Kind: organization
• Description: Brightband is making weather and climate predictable for all, to help humanity adapt to increasingly extreme weather.
• Website: brightband.com
• Location: United States of America
• Twitter: brightbandtech
• Company:
• Icon url: https://avatars.githubusercontent.com/u/159490539?v=4
• Repositories: 1
• Last ynced at: 2024-09-18T00:32:39.957Z
• Profile URL: https://github.com/brightbandtech

GitHub Events

Total

• Release event: 3
• Delete event: 162
• Pull request event: 201
• Fork event: 4
• Issues event: 87
• Watch event: 70
• Issue comment event: 109
• Public event: 1
• Push event: 1351
• Pull request review event: 146
• Pull request review comment event: 218
• Create event: 167

Last Year

• Release event: 2
• Delete event: 126
• Pull request event: 125
• Fork event: 1
• Issues event: 36
• Watch event: 24
• Issue comment event: 40
• Push event: 968
• Pull request review event: 78
• Pull request review comment event: 109
• Create event: 123

Committers metadata

Last synced: 4 days ago

Committer domains:

• danielrothenberg.com: 1
• ou.edu: 1

Issue and Pull Request metadata

Last synced: 6 days ago

Package metadata

• Total packages: 3
• Total downloads:
  • pypi: 211 last-month
• Total dependent packages: 0 (may contain duplicates)
• Total dependent repositories: 0 (may contain duplicates)
• Total versions: 16
• Total maintainers: 1

Dependencies

Score: 11.719614378212476