Open Sustainable Technology

A curated list of open technology projects to sustain a stable climate, energy supply, biodiversity and natural resources.

Browse accepted projects | Review proposed projects | Propose new project | Open Issues

Hagelslag

An object-based severe storm forecasting system that utilizing image processing and machine learning tools to derive calibrated probabilities of severe hazards from convection-allowing numerical weather prediction model output.
https://github.com/djgagne/hagelslag

geojson hail hrrr machine-learning mrms netcdf performance performance-diagram python reliability segmentation storms tracking verification weather zarr

Last synced: about 2 hours ago
JSON representation

Repository metadata

Hagelslag supports segmentation and tracking of weather fields and scalable verification, including performance diagrams and reliability diagrams.

README

        

# Hagelslag
## Storm tracking, machine learning, and probabilistic evaluation
[![NSF-1261776](https://img.shields.io/badge/NSF-1261776-blue)](https://www.nsf.gov/awardsearch/showAward?AWD_ID=1261776&HistoricalAwards=false)

Hagelslag is an object-based severe storm forecasting system that utilizing image processing and machine learning tools
to derive calibrated probabilities of severe hazards from convection-allowing numerical weather prediction model output.
The package contains modules for storm identification and tracking, spatio-temporal data extraction, and
machine learning model training to predict hazard intensity as well as space and time translations.

### Citation
If you employ hagelslag in your research, please acknowledge its use with the following citations:

Gagne, D. J., A. McGovern, S. E. Haupt, R. A. Sobash, J. K. Williams, M. Xue, 2017: Storm-Based Probabilistic Hail
Forecasting with Machine Learning Applied to Convection-Allowing Ensembles, Wea. Forecasting, 32, 1819-1840.
https://doi.org/10.1175/WAF-D-17-0010.1.

Gagne II, D. J., A. McGovern, N. Snook, R. Sobash, J. Labriola, J. K. Williams, S. E. Haupt, and M. Xue, 2016:
Hagelslag: Scalable object-based severe weather analysis and forecasting. Proceedings of the Sixth Symposium on
Advances in Modeling and Analysis Using Python, New Orleans, LA, Amer. Meteor. Soc., 447.

If you discover any issues, please post them to the Github issue tracker page. Questions and comments should be sent to
djgagne at ou dot edu.

### Requirements

Hagelslag is compatible with Python 3.6 or newer. Hagelslag is easiest to install with the help of the [Miniconda
Python Distribution](https://docs.conda.io/en/latest/miniconda.html), but it should work with other
Python setups as well. Hagelslag requires the following packages and recommends the following versions:

* numpy >= 1.10
* scipy >= 0.15
* matplotlib >= 1.4
* scikit-learn >= 0.16
* pandas >= 0.15
* arrow >= 0.8.0
* pyproj
* netCDF4-python
* xarray
* jupyter
* ncepgrib2
* pygrib
* cython
* pip
* sphinx
* mock

Install dependencies with the following commands:
```
git clone https://github.com/djgagne/hagelslag.git
cd ~/hagelslag
conda env create -f environment.yml
conda activate hagelslag
```

### Installation
Install the latest version of hagelslag with the following command from the top-level hagelslag directory (where setup.py
is):
`pip install .`

Hagelslag will install the libraries in site-packages and will also install 3 applications into the `bin` directory
of your Python installation.

### Use
A Jupyter notebook is located in the demos directory that showcases the functionality of the package. For larger scale
use, 3 scripts are provided in the bin directory.

* `hsdata` performs object tracking and matching as well as data processing.
* `hsfore` trains and applies machine learning models.
* `hseval` performs forecast verification.

All scripts take input from a config file. The config file should be valid Python code and contain a dictionary called
config. Custom machine learning models and parameters should be contained within the config files. Examples of them can
be found in the config directory.

### Documentation
API Documentation is available [here](http://hagelslag.readthedocs.io/en/latest/).


Owner metadata


GitHub Events

Total
Last Year

Committers metadata

Last synced: 1 day ago

Total Commits: 619
Total Committers: 20
Avg Commits per committer: 30.95
Development Distribution Score (DDS): 0.415

Commits in past year: 12
Committers in past year: 3
Avg Commits per committer in past year: 4.0
Development Distribution Score (DDS) in past year: 0.333

Name Email Commits
David John Gagne d****e@o****u 362
ahijevyc a****c@u****u 73
David John Gagne d****e@g****m 64
Amanda Burke a****e@n****t 35
Amanda Burke 3****e 31
Ubuntu t****o@e****t 10
Charlie Becker c****r@g****m 9
Charlie Becker 3****r 6
Amanda Burke a****e@l****u 5
Amanda Burke a****e@l****u 4
Amanda Burke a****e@l****u 3
Amanda Burke a****e@s****u 3
Kate Avery k****y@o****u 3
Nathan Wendt n****t@o****u 3
Amanda Burke a****e@d****u 2
Amanda Burke a****e@l****u 2
Thomas Martin 3****o 1
David Gagne d****e@s****u 1
Luke Madaus m****e@g****m 1
Maria J. Molina h****a@g****m 1

Committer domains:


Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 7
Total pull requests: 43
Average time to close issues: N/A
Average time to close pull requests: 19 days
Total issue authors: 5
Total pull request authors: 8
Average comments per issue: 0.0
Average comments per pull request: 0.84
Merged pull request: 41
Bot issues: 0
Bot pull requests: 0

Past year issues: 3
Past year pull requests: 4
Past year average time to close issues: N/A
Past year average time to close pull requests: 18 days
Past year issue authors: 2
Past year pull request authors: 3
Past year average comments per issue: 0.0
Past year average comments per pull request: 0.5
Past year merged pull request: 4
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/djgagne/hagelslag

Top Issue Authors

  • ahijevyc (2)
  • kresguerra02 (2)
  • charlie-becker (1)
  • djgagne (1)
  • mariajmolina (1)

Top Pull Request Authors

  • djgagne (19)
  • ahijevyc (9)
  • charlie-becker (5)
  • alburke (5)
  • nawendt (2)
  • ThomasMGeo (1)
  • mariajmolina (1)
  • lmadaus (1)

Top Issue Labels

Top Pull Request Labels


Package metadata

pypi.org: hagelslag

Hagelslag is a Python package for storm-based analysis, forecasting, and evaluation.

  • Homepage:
  • Documentation: https://hagelslag.readthedocs.io/
  • Licenses: MIT License
  • Latest release: 0.6 (published 4 months ago)
  • Last Synced: 2024-05-10T09:01:16.917Z (1 day ago)
  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 2
  • Downloads: 152 Last month
  • Rankings:
    • Dependent packages count: 7.31%
    • Forks count: 7.6%
    • Stargazers count: 8.403%
    • Dependent repos count: 11.798%
    • Average: 12.246%
    • Downloads: 26.116%
  • Maintainers (2)

Dependencies

requirements.txt pypi
  • arrow >=0.8
  • cython *
  • h5py *
  • matplotlib *
  • mock *
  • netcdf4 *
  • numpy >=1.18
  • pandas >=1.2
  • pygrib *
  • pyproj *
  • pytest *
  • s3fs *
  • scikit-image *
  • scikit-learn >=0.2
  • scipy *
  • sphinx *
  • xarray *
rtd_requirements.txt pypi
  • arrow >=0.8
  • matplotlib *
  • mock *
  • netcdf4 *
  • numpy *
  • pandas *
  • scikit-image *
  • scikit-learn *
  • scipy *
.github/workflows/python-package-conda.yml actions
  • actions/checkout v2 composite
  • conda-incubator/setup-miniconda v2 composite
.github/workflows/python-publish.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v3 composite
  • pypa/gh-action-pypi-publish 27b31702a0e7fc50959f5ad993c78deac1bdfc29 composite
setup.py pypi
pyproject.toml pypi
  • dask *
  • matplotlib *
  • numba *
  • numpy *
  • pandas *
  • pyarrow *
  • pygrib *
  • pyproj *
  • pyshp *
  • scikit-image *
  • scikit-learn *
  • scipy *
  • xarray *
  • zarr *
environment.yml conda
  • arrow
  • cython
  • dask
  • flake8
  • h5py
  • jasper
  • jupyter
  • jupyterlab
  • matplotlib
  • mock
  • netcdf4
  • numba
  • numpy
  • pandas
  • pip
  • pyarrow
  • pygrib
  • pyproj
  • pytest
  • python <=3.10
  • s3fs
  • scikit-image
  • scikit-learn
  • scipy
  • sphinx
  • xarray
  • zarr

Score: 12.329616831621628