EUREC4A Intake catalogue
Access to data from the EUREC4A field campaign, which aims to improve the understanding of the interplay between clouds, convection and circulation and their role in climate change.
https://github.com/eurec4a/eurec4a-intake
Category: Atmosphere
Sub Category: Atmospheric Chemistry and Aerosol
Keywords from Contributors
data-access data-catalog zarr
Last synced: about 12 hours ago
JSON representation
Repository metadata
Intake catalogue for EUREC4A field campaign datasets
- Host: GitHub
- URL: https://github.com/eurec4a/eurec4a-intake
- Owner: eurec4a
- Created: 2020-07-27T18:08:39.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2025-02-16T18:19:43.000Z (2 months ago)
- Last Synced: 2025-04-01T11:04:05.929Z (27 days ago)
- Language: Python
- Size: 425 KB
- Stars: 17
- Watchers: 2
- Forks: 18
- Open Issues: 8
- Releases: 1
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- Citation: CITATION.md
README.md
EUREC4A Intake catalogue
This repository contains an intake
catalogue for acessing data from the EUREC4A field
campaign stored on: 1)
AERIS and 2) Munich
University (via OPeNDAP) and 3) OPeNDAP access to files at
NOAA's National Center for Environmental Information and 4) data linked via IPFS.
Usage
To use you will need to install intake
, xarray
, intake-xarray
, zarr
,
pydap
, requests
, s3fs
and ipfsspec
pip install "intake<2.0.0" xarray intake-xarray zarr pydap s3fs requests ipfsspec
Or, if you feel courageous (and want the newest updates), you can also install the requirements.txt
directly:
pip install -r https://raw.githubusercontent.com/eurec4a/eurec4a-intake/master/requirements.txt
The catalogue (and underlying data) can then be accessed directly from python:
> from intake import open_catalog
> cat = open_catalog("https://raw.githubusercontent.com/eurec4a/eurec4a-intake/master/catalog.yml")
You can list the available sources with:
>> list(cat)
['radiosondes', 'barbados', 'dropsondes', 'halo', 'p3', 'specmacs']
>> list(cat.radiosondes)
['atalante_meteomodem',
'atalante_vaisala',
'bco',
'meteor',
'ms_merian',
'ronbrown']
Then load up a dask-backed xarray.Dataset
so
that you have access to all the available variables and attributes in the
dataset:
>> ds = cat.radiosondes.ronbrown.to_dask()
>> ds
<xarray.Dataset>
Dimensions: (alt: 3100, nv: 2, sounding: 329)
Coordinates:
* alt (alt) int16 0 10 20 30 40 50 ... 30950 30960 30970 30980 30990
flight_time (sounding, alt) datetime64[ns] dask.array<chunksize=(83, 775), meta=np.ndarray>
lat (sounding, alt) float32 dask.array<chunksize=(83, 1550), meta=np.ndarray>
lon (sounding, alt) float32 dask.array<chunksize=(83, 1550), meta=np.ndarray>
sounding_id (sounding) |S1000 dask.array<chunksize=(165,), meta=np.ndarray>
Dimensions without coordinates: nv, sounding
Data variables:
N_gps (sounding, alt) float32 dask.array<chunksize=(83, 1550), meta=np.ndarray>
N_ptu (sounding, alt) float32 dask.array<chunksize=(83, 1550), meta=np.ndarray>
alt_bnds (alt, nv) int16 dask.array<chunksize=(3100, 2), meta=np.ndarray>
...
You can then slice and access the data as if you had it available locally
Contributing
Please have a look at our contribution guide.
Citation (CITATION.md)
# Citing Please cite the catalog as following when refering to a specific version of the catalog, e.g., in the data availability section: ```bibtex @dataset{eurec4a_community_2023, title = {{{EUREC4A}}}, author = {{community}, EUREC4A}, date = {2023-10}, publisher = {{Zenodo}}, doi = {10.5281/zenodo.8422322}, version = {v1.0.0} } ``` In case the catalog is cited within the main body of the manuscript, please reference the general version of catalog available at https://zenodo.org/doi/10.5281/zenodo.8422321 > [!IMPORTANT] > The catalog only links to datasets and has no influence or control on the data itself. To improve the reproducability and to give credit to the authors of the underlying datasets, it is recommended to cite each dataset individually in addition to the catalog itself. ## Example citation for data availability section > The EUREC4A data used in this study is freely available and can be easily accessed via the EUREC4A-Intake catalog at https://github.com/eurec4a/eurec4a-intake as described at howto.eurec4a.eu. The specific data sets used from the catalog v1.0.0 (EUREC4A community, 2023) include the JOANNE dropsonde data set (George, 2021), the EUREC4A radiosonde data set (Stephan et al., 2020),...
Owner metadata
- Name: eurec4a
- Login: eurec4a
- Email:
- Kind: organization
- Description:
- Website:
- Location:
- Twitter:
- Company:
- Icon url: https://avatars.githubusercontent.com/u/58219792?v=4
- Repositories: 6
- Last ynced at: 2023-03-04T00:44:57.799Z
- Profile URL: https://github.com/eurec4a
GitHub Events
Total
- Push event: 4
- Pull request review event: 1
- Pull request event: 3
- Create event: 1
Last Year
- Push event: 4
- Pull request review event: 1
- Pull request event: 3
- Create event: 1
Committers metadata
Last synced: 8 days ago
Total Commits: 363
Total Committers: 17
Avg Commits per committer: 21.353
Development Distribution Score (DDS): 0.529
Commits in past year: 14
Committers in past year: 2
Avg Commits per committer in past year: 7.0
Development Distribution Score (DDS) in past year: 0.071
Name | Commits | |
---|---|---|
Hauke Schulz | 4****s | 171 |
Tobias Kölling | t****g@m****e | 72 |
Robert Pincus | R****s@c****u | 32 |
Leif Denby | l****f@d****u | 23 |
Theresa Mieslinger | t****r@g****m | 18 |
Johannes Röttenbacher | j****r@w****e | 9 |
JuleRadtke | j****e@u****e | 9 |
Marek Jacob | M****X | 5 |
Fredrik Jansson | f****n@a****i | 5 |
Lea Volkmer | L****r@p****e | 4 |
Johannes Röttenbacher | 4****r | 3 |
Clau Clouds | 3****s | 3 |
Xuanyu Chen | x****n@c****u | 2 |
Veronika Pörtge | v****e@g****m | 2 |
lbariteau | 7****u | 2 |
leonie-villiger | l****r@e****h | 2 |
h_campos | g****b@c****e | 1 |
Committer domains:
- camposcampos.de: 1
- env.ethz.ch: 1
- colorado.edu: 1
- physik.uni-muenchen.de: 1
- abo.fi: 1
- uni-hamburg.de: 1
- denby.eu: 1
- columbia.edu: 1
- mpimet.mpg.de: 1
Issue and Pull Request metadata
Last synced: 1 day ago
Total issues: 16
Total pull requests: 95
Average time to close issues: 3 months
Average time to close pull requests: about 2 months
Total issue authors: 5
Total pull request authors: 12
Average comments per issue: 4.75
Average comments per pull request: 1.97
Merged pull request: 79
Bot issues: 0
Bot pull requests: 0
Past year issues: 1
Past year pull requests: 3
Past year average time to close issues: about 1 hour
Past year average time to close pull requests: about 3 hours
Past year issue authors: 1
Past year pull request authors: 1
Past year average comments per issue: 0.0
Past year average comments per pull request: 0.33
Past year merged pull request: 2
Past year bot issues: 0
Past year bot pull requests: 0
Top Issue Authors
- observingClouds (10)
- suessspeise (2)
- d70-t (2)
- martinjanssens (1)
- leifdenby (1)
Top Pull Request Authors
- observingClouds (59)
- d70-t (17)
- leifdenby (4)
- RobertPincus (4)
- lbariteau (2)
- jroettenbacher (2)
- fjansson (2)
- vpoertge (1)
- suessspeise (1)
- leonie-villiger (1)
- lvol08 (1)
- ClauClouds (1)
Top Issue Labels
- data version update (3)
- data source changed (3)
- enhancement (1)
- good first issue (1)
- bug (1)
Top Pull Request Labels
- data version update (13)
- data source changed (12)
- new dataset (7)
- infrastructure (1)
- bug (1)
- enhancement (1)
Dependencies
- fsspec >=0.7.4
- intake *
- intake-xarray >=0.3.2
- ipfsspec *
- pydap *
- requests *
- s3fs *
- xarray *
- zarr *
- actions/checkout v3 composite
- actions/setup-python v4 composite
- actions/checkout v3 composite
- actions/setup-python v4 composite
Score: 6.052089168924416