goes2go
Download and process GOES-16 and GOES-17 data from NOAA's archive on AWS using Python.
https://github.com/blaylockbk/goes2go
Category: Sustainable Development
Sub Category: Environmental Satellites
Keywords
big-data-program download glm goes goes-16 goes-17 goes-satellite netcdf noaa-satellite open-data python satellite satellite-data satellite-imagery xarray
Keywords from Contributors
weather grib grib2 atmospheric-science plot charts serialize observational meteorology polars
Last synced: about 16 hours ago
JSON representation
Repository metadata
Download and process GOES-16 and GOES-17 data from NOAA's archive on AWS using Python.
- Host: GitHub
- URL: https://github.com/blaylockbk/goes2go
- Owner: blaylockbk
- License: mit
- Created: 2020-09-18T21:59:47.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2025-02-11T05:00:51.000Z (3 months ago)
- Last Synced: 2025-04-18T23:18:41.960Z (8 days ago)
- Topics: big-data-program, download, glm, goes, goes-16, goes-17, goes-satellite, netcdf, noaa-satellite, open-data, python, satellite, satellite-data, satellite-imagery, xarray
- Language: Python
- Homepage: https://goes2go.readthedocs.io/
- Size: 343 MB
- Stars: 223
- Watchers: 13
- Forks: 41
- Open Issues: 29
- Releases: 12
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Citation: CITATION.cff
README.md
Download and display GOES-East and GOES-West data
GOES-East and GOES-West satellite data are made available on Amazon Web Services through NOAA's Open Data Dissemination Program. GOES-2-go is a python package that makes it easy to find and download the files you want from AWS to your local computer with some additional helpers to visualize and understand the data.
GOES-2-go Documentation
📔Installation
The easiest way to install goes2go
and its dependencies is with Conda from conda-forge.
conda install -c conda-forge goes2go
You may also create the provided Conda environment, environment.yml
.
# Download environment file
wget https://github.com/blaylockbk/goes2go/raw/main/environment.yml
# Modify that file if you wish.
# Create the environment
conda env create -f environment.yml
# Activate the environment
conda activate goes2go
Alternatively, goes2go
is published on PyPI and you can install it with pip, but it requires some additional dependencies that you will have to install yourself:
- Python 3.8+
- Cartopy, which requires GEOS and Proj (if using
cartopy<0.22.0
). - MetPy
- Optional: Carpenter Workshop
When those are installed within your environment, then you can install GOES-2-go with pip.
# Latest published version
pip install goes2go
# ~~ or ~~
# Most recent changes
pip install git+https://github.com/blaylockbk/goes2go.git
Capabilities
graph TD;
aws16[(AWS\nnoaa-goes16)] -.-> G
aws17[(AWS\nnoaa-goes17)] -.-> G
aws18[(AWS\nnoaa-goes18)] -.-> G
G((. GOES 2-go .))
G --- .latest
G --- .nearesttime
G --- .timerange
.latest --> ds[(xarray.DataSet)]
.nearesttime --> ds[(xarray.DataSet)]
.timerange --> ds[(xarray.DataSet)]
ds --- rgb[ds.rgb\naccessor to make RGB composites]
ds --- fov[ds.FOV\naccessor to get field-of-view polygons]
style G fill:#F8AF22,stroke:#259DD7,stroke-width:4px,color:#000000
Download Data
Download GOES ABI or GLM NetCDF files to your local computer. Files can also be read with xarray.
First, create a GOES object to specify the satellite, data product, and domain you are interested in. The example below downloads the Multi-Channel Cloud Moisture Imagery for CONUS.
from goes2go import GOES
# ABI Multi-Channel Cloud Moisture Imagry Product
G = GOES(satellite=16, product="ABI-L2-MCMIP", domain='C')
# Geostationary Lightning Mapper
G = GOES(satellite=17, product="GLM-L2-LCFA", domain='C')
# ABI Level 1b Data
G = GOES(satellite=17, product="ABI-L1b-Rad", domain='F')
A complete listing of the products available are available here.
There are methods to do the following:
- List the available files for a time range
- Download data to your local drive for a specified time range
- Read the data into an xarray Dataset for a specific time
# Produce a pandas DataFrame of the available files in a time range
df = G.df(start='2022-07-04 01:00', end='2022-07-04 01:30')
# Download and read the data as an xarray Dataset nearest a specific time
ds = G.nearesttime('2022-01-01')
# Download and read the latest data as an xarray Dataset
ds = G.latest()
# Download data for a specified time range
G.timerange(start='2022-06-01 00:00', end='2022-06-01 01:00')
# Download recent data for a specific interval
G.timerange(recent='30min')
RGB Recipes
The rgb
xarray accessor computes various RGB products from a GOES ABI ABI-L2-MCMIP (multi-channel cloud and moisture imagry products) xarray.Dataset
. See the demo for more examples of RGB products.
import matplotlib.pyplot as plt
ds = GOES().latest()
ax = plt.subplot(projection=ds.rgb.crs)
ax.imshow(ds.rgb.TrueColor(), **ds.rgb.imshow_kwargs)
ax.coastlines()
Field of View
The FOV
xarray accessor creates shapely.Polygon
objects for the ABI and GLM field of view. See notebooks for GLM and ABI field of view.
from goes2go.data import goes_latest
G = goes_latest()
# Get polygons of the full disk or ABI domain field of view.
G.FOV.full_disk
G.FOV.domain
# Get Cartopy coordinate reference system
G.FOV.crs
GOES-West is centered over -137 W and GOES-East is centered over -75 W. When GOES was being tested, it was in a "central" position, outlined in the dashed black line. Below is the ABI field of view for the full disk:
The GLM field of view is slightly smaller and limited by a bounding box. Below is the approximated GLM field of view:
How to Cite and Acknowledge
If GOES-2-go played an important role in your work, please tell me about it! Also, consider including a citation or acknowledgement in your article or product.
Suggested Citation
Blaylock, B. K. (2023). GOES-2-go: Download and display GOES-East and GOES-West data (Version 2022.07.15) [Computer software]. https://github.com/blaylockbk/goes2go
Suggested Acknowledgment
A portion of this work used code generously provided by Brian Blaylock's GOES-2-go python package (https://github.com/blaylockbk/goes2go)
What if I don't like the GOES-2-go or Python?
As an alternative you can use rclone to download GOES files from AWS. I quite like rclone. Here is a short rclone tutorial.
I hope you find this makes GOES data easier to retrieve and display. Enjoy!
- Brian Blaylock
👨🏻💻 Contributing Guidelines
💬 GitHub Discussions
🚑 GitHub Issues
🌐 Personal Webpage
P.S. If you like GOES-2-go, check out my other python packages
- 🏁 Herbie: download numerical weather model data
- 🌡️ SynopticPy: retrieve mesonet data from the Synoptic API.
- 🌹 Pandas-rose: easly wind rose from Pandas dataframe.
Related Content
Citation (CITATION.cff)
cff-version: 1.2.0 abstract: GOES-East and GOES-West satellite data are made available on Amazon Web Services through the NOAA Open Data Dissemination (NODD) Program (formerly the Big Data Program). GOES-2-go is a python package that makes it easy to find and download the files you want to your local computer with some additional helpers to look at and understand the data. message: "If you use this software, please cite it as below." authors: - family-names: Blaylock given-names: Brian K. email: [email protected] orcid: "https://orcid.org/0000-0003-2133-9313" title: "GOES-2-go: Download and display GOES-East and GOES-West data" version: 2023.04.0 date-released: "2023-04-10" url: "https://goes2go.readthedocs.io/" repository-code: "https://github.com/blaylockbk/goes2go" type: software keywords: - meteorology - weather - atmosphere - satellite license: "MIT" identifiers: - type: doi value: 10.5281/zenodo.4567558
Owner metadata
- Name: Brian Blaylock
- Login: blaylockbk
- Email:
- Kind: user
- Description: Meteorologist
- Website: http://home.chpc.utah.edu/~u0553130/Brian_Blaylock/home.html
- Location: Monterey, CA
- Twitter: blaylockbk
- Company:
- Icon url: https://avatars.githubusercontent.com/u/6249613?u=83e593317387e0cfacc6d86df40f6d2ee2f13676&v=4
- Repositories: 45
- Last ynced at: 2024-03-15T18:11:46.924Z
- Profile URL: https://github.com/blaylockbk
GitHub Events
Total
- Create event: 1
- Issues event: 4
- Release event: 1
- Watch event: 27
- Issue comment event: 13
- Push event: 2
- Pull request event: 5
- Fork event: 9
Last Year
- Create event: 1
- Issues event: 4
- Release event: 1
- Watch event: 27
- Issue comment event: 13
- Push event: 2
- Pull request event: 5
- Fork event: 9
Committers metadata
Last synced: 4 days ago
Total Commits: 363
Total Committers: 10
Avg Commits per committer: 36.3
Development Distribution Score (DDS): 0.085
Commits in past year: 33
Committers in past year: 5
Avg Commits per committer in past year: 6.6
Development Distribution Score (DDS) in past year: 0.606
Name | Commits | |
---|---|---|
Brian Blaylock | b****k@g****m | 332 |
Isaac Barlet | i****t@l****m | 13 |
ifscript | 1****t | 6 |
Brian Blaylock | b****r@n****l | 4 |
Bryan Guarente | 3****e | 2 |
Cedric Sam | c****6@b****t | 2 |
The Gitter Badger | b****r@g****m | 1 |
Santiago Monserrat Campanello | s****r@h****m | 1 |
Filipe Fernandes | o****f@g****m | 1 |
Oli McCormack | o****i@t****o | 1 |
Committer domains:
- tothelee.co: 1
- gitter.im: 1
- bloomberg.net: 1
- nrlmry.navy.mil: 1
- linevisioninc.com: 1
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 65
Total pull requests: 21
Average time to close issues: 29 days
Average time to close pull requests: 3 days
Total issue authors: 38
Total pull request authors: 11
Average comments per issue: 1.35
Average comments per pull request: 1.1
Merged pull request: 18
Bot issues: 0
Bot pull requests: 0
Past year issues: 15
Past year pull requests: 8
Past year average time to close issues: 8 days
Past year average time to close pull requests: 9 days
Past year issue authors: 10
Past year pull request authors: 6
Past year average comments per issue: 0.93
Past year average comments per pull request: 1.5
Past year merged pull request: 5
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- blaylockbk (22)
- csteele2 (3)
- DirkMPetersen (3)
- thomasdewitt (2)
- EmanuelCastanho (2)
- guidocioni (1)
- w-k-jones (1)
- scottthomaswx (1)
- bryanguarente (1)
- nrchade (1)
- john-a-m (1)
- zmcfire (1)
- ilmesi (1)
- santimc (1)
- craigim (1)
Top Pull Request Authors
- blaylockbk (8)
- coliveir-aer (2)
- bryanguarente (2)
- ibarlet (2)
- cedricsam (1)
- gitter-badger (1)
- ocefpaf (1)
- santimc (1)
- olimcc (1)
- mcuahutle (1)
- ifscript (1)
Top Issue Labels
- help wanted (6)
- bug (3)
- install (3)
- enhancement (3)
- documentation (1)
- need more info (1)
Top Pull Request Labels
Package metadata
- Total packages: 2
-
Total downloads:
- pypi: 1,216 last-month
- Total docker downloads: 35
- Total dependent packages: 1 (may contain duplicates)
- Total dependent repositories: 1 (may contain duplicates)
- Total versions: 14
- Total maintainers: 1
pypi.org: goes2go
Retrieve GOES Satellite data from AWS. Also proves some RGB recipes.
- Homepage: https://github.com/blaylockbk/goes2go
- Documentation: https://goes2go.readthedocs.io/
- Licenses: MIT License Copyright (c) 2019-2022 Brian Blaylock Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
- Latest release: 2025.2.0 (published 3 months ago)
- Last Synced: 2025-04-26T15:03:40.284Z (about 16 hours ago)
- Versions: 13
- Dependent Packages: 1
- Dependent Repositories: 1
- Downloads: 1,216 Last month
- Docker Downloads: 35
-
Rankings:
- Stargazers count: 6.072%
- Dependent packages count: 7.373%
- Forks count: 7.818%
- Average: 11.108%
- Downloads: 12.043%
- Dependent repos count: 22.233%
- Maintainers (1)
conda-forge.org: goes2go
GOES-East and GOES-West satellite data are made available on Amazon Web Services through NOAA's Big Data Program. `goes2go` is a python package that makes it easy to find and download the files you need to your local computer. Some additional helpers are provided that make working with GOES data easy and fun, such as recipes for RGB composites.
- Homepage: https://github.com/blaylockbk/goes2go
- Licenses: MIT
- Latest release: 2022.10.0 (published over 2 years ago)
- Last Synced: 2025-04-25T14:37:57.177Z (1 day ago)
- Versions: 1
- Dependent Packages: 0
- Dependent Repositories: 0
-
Rankings:
- Dependent repos count: 9.315%
- Average: 33.146%
- Stargazers count: 33.683%
- Forks count: 37.186%
- Dependent packages count: 52.399%
Dependencies
- actions/checkout v3 composite
- actions/setup-python v3 composite
- pypa/gh-action-pypi-publish release/v1 composite
- actions/checkout v3 composite
- actions/setup-python v4 composite
- cartopy >=0.22.0
- h5netcdf *
- matplotlib *
- metpy *
- numpy *
- pandas *
- s3fs >=2023.6.0
- toml *
- xarray *
- pytest <8 test
- cartopy >=0.22.0
- h5netcdf *
- matplotlib *
- metpy *
- numpy *
- pandas *
- s3fs >=2023.6.0
- toml *
- xarray *
- black
- black-jupyter
- cartopy
- geopandas
- git
- goes2go
- h5netcdf
- isort
- jupyter
- jupyterlab
- matplotlib
- metpy
- netcdf4
- numpy
- pandas
- pip
- pytest
- python >=3.11
- rclone >=1.58.0
- ruff
- s3fs >=2023.6.0
- toml
- xarray
Score: 14.966905032071352