Pangeo Docker Images

The images defined in this repository capture reproducible computing environments used by Pangeo Cloud.
https://github.com/pangeo-data/pangeo-docker-images

Category: Climate Change
Sub Category: Earth and Climate Modeling

Keywords

docker jupyter pangeo python

Keywords from Contributors

data-catalog data-engine zarr transforms etl climate-model pydata earth-science finite-volume climate

Last synced: about 17 hours ago
JSON representation

Repository metadata

Docker Images For Pangeo Jupyter Environment

Host: GitHub
URL: https://github.com/pangeo-data/pangeo-docker-images
Owner: pangeo-data
License: mit
Created: 2020-02-19T01:23:30.000Z (about 5 years ago)
Default Branch: master
Last Pushed: 2025-04-07T03:37:37.000Z (20 days ago)
Last Synced: 2025-04-10T07:04:10.557Z (17 days ago)
Topics: docker, jupyter, pangeo, python
Language: Dockerfile
Homepage: https://pangeo-docker-images.readthedocs.io
Size: 8.01 MB
Stars: 132
Watchers: 12
Forks: 100
Open Issues: 40
Releases: 0
Metadata Files:
- Readme: README.md
- Contributing: docs/contributing.md
- License: LICENSE

Pangeo Docker Images

DockerHub Version

The images defined in this repository capture reproducible computing environments used by Pangeo Cloud. They build on top of the Ubuntu operating system and include conda environments with a curated set of Python packages for geospatial analysis. While initially intended for Pangeo Cloud, they can be used outside of Pangeo infrastructure too!

More details can be found in our documentation.

Images are hosted on DockerHub and on Quay.io

Image	Description	Size	Pulls
base-image	Foundational Dockerfile for builds
base-notebook	minimally functional image for pangeo hubs
pangeo-notebook	base-notebook + core earth science analysis packages
pytorch-notebook	pangeo-notebook + GPU-enabled pytorch
ml-notebook	pangeo-notebook + GPU-enabled tensorflow2

Click on the image name in the table above for a current list of installed packages and versions

graph TD;
    base-image-->base-notebook;
    base-notebook-->pangeo-notebook;
    pangeo-notebook-->pytorch-notebook;
    pangeo-notebook-->ml-notebook;
    click base-image "https://hub.docker.com/r/pangeo/base-image" "Open this in a new tab" _blank
    click base-notebook "https://hub.docker.com/r/pangeo/base-notebook" "Open this in a new tab" _blank
    click pangeo-notebook "https://hub.docker.com/r/pangeo/pangeo-notebook" "Open this in a new tab" _blank
    click pytorch-notebook "https://hub.docker.com/r/pangeo/pytorch-notebook" "Open this in a new tab" _blank
    click ml-notebook "https://hub.docker.com/r/pangeo/ml-notebook" "Open this in a new tab" _blank

Using the image with Singularity on HPC systems

If you want to use this image on an HPC system (including a GPU system), we recommend using Singularity. Please see the Singularity guide.

Dask-gateway compatibility

The primary use of these Docker images is running on Pangeo Cloud deployments with dask-gateway. Generally, the dask-gateway library version built into the image must match the dask-gateway version deployed in the cloud environment. The follow table keeps track of the first time a new dask-gateway version appears in a tagged image:

dask-gateway	Image tag
0.9	2020.11.06
0.8	2020.07.28
0.7	2020.04.22

Other notes

Since 2020.10.16, mamba is installed into the base-image and conda-lock environment and is used by default to solve for a compatible environment (see #146)
For a simple list of packages for a given image, you can use a link like this: https://github.com/pangeo-data/pangeo-docker-images/blob/2020.10.08/pangeo-notebook/packages.txt
To compare changes between two images, you can use a link like this: https://github.com/pangeo-data/pangeo-docker-images/compare/2020.10.03..2020.10.08
As of 2024.05.21, the ml-notebook and pytorch-notebook docker images contain
machine learning libraries built with CUDA 12. In previous versions, we have suggested
ml-notebook users to install cuda-nvcc manually to obtain JAX and/or TensorFlow
with XLA optimization, but this workaround should no longer
be needed if you are using ml-notebook 2024.06.02 or newer that comes with
cuda-nvcc pre-installed.
There used to be a pangeo/forge image, built for use with pangeo-forge. It is
no longer actively maintained or used, but you can still use the historical tags
if you wish.

Owner metadata

Name: Pangeo
Login: pangeo-data
Email:
Kind: organization
Description: A community effort for big data geoscience
Website: http://pangeo.io
Location: earth
Twitter: pangeo_data
Company:
Icon url: https://avatars.githubusercontent.com/u/23299451?v=4
Repositories: 54
Last ynced at: 2023-02-27T08:40:21.915Z
Profile URL: https://github.com/pangeo-data

GitHub Events

Total

Issues event: 7
Watch event: 8
Delete event: 8
Issue comment event: 82
Push event: 28
Pull request review comment event: 22
Pull request review event: 27
Pull request event: 30
Fork event: 3
Create event: 15

Last Year

Issues event: 7
Watch event: 8
Delete event: 8
Issue comment event: 82
Push event: 28
Pull request review comment event: 22
Pull request review event: 27
Pull request event: 30
Fork event: 3
Create event: 15

Committers metadata

Last synced: 6 days ago

Total Commits: 698
Total Committers: 37
Avg Commits per committer: 18.865
Development Distribution Score (DDS): 0.675

Commits in past year: 57
Committers in past year: 7
Avg Commits per committer in past year: 8.143
Development Distribution Score (DDS) in past year: 0.684

Name	Email	Commits
pangeo-bot	p****t	227
Scott Henderson	s**h@u**u	222
YuviPanda	y**a@g**m	64
actions-bot	5****t	35
Wei Ji	2****4	24
Ryan Abernathey	r**y@g**m	20
dependabot[bot]	4****]	16
Joseph Hamman	j**n@u**u	10
Tom Augspurger	t**r@g**m	9
Julius Busecke	j**s@l**u	8
Tim Crone	t**e@g**m	7
Deepak Cherian	d****n	6
Rich Signell	r**l@u**v	5
ngam	6****m	5
Erik Sundell	e**l@g**m	5
jhamman	j****n	5
Henri Drake	h**e@g**m	4
Anderson Banihirwe	a**e@g**m	2
Charles Stern	6****n	2
GitHub Action	a**n@g**m	2
bsmith-hat	b**h@h**m	2
github-actions[bot]	4****]	2
Joe Hamman	j**e@c**g	2
sharkinsspatial	s**s@g**m	1
thomas	t**e@e**r	1
paigem	p**r@u**u	1
Willi Rath	w****h	1
Shunzi Lu	3****u	1
Shanice Bailey	3****y	1
Naomi Goldenson	t****g	1
and 7 more...

Committer domains:

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 68
Total pull requests: 185
Average time to close issues: 9 months
Average time to close pull requests: about 1 month
Total issue authors: 26
Total pull request authors: 24
Average comments per issue: 4.87
Average comments per pull request: 3.27
Merged pull request: 150
Bot issues: 0
Bot pull requests: 23

Past year issues: 15
Past year pull requests: 59
Past year average time to close issues: 14 days
Past year average time to close pull requests: 6 days
Past year issue authors: 9
Past year pull request authors: 10
Past year average comments per issue: 2.2
Past year average comments per pull request: 2.88
Past year merged pull request: 45
Past year bot issues: 0
Past year bot pull requests: 13

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/pangeo-data/pangeo-docker-images

Top Issue Authors

scottyhq (22)
jbusecke (8)
dhruvbalwada (6)
rabernat (6)
ed-randall-blk (3)
consideRatio (2)
guillaumeeb (2)
racheetmatai (1)
yutianwuldeo (1)
cisaacstern (1)
cmdupuis3 (1)
sebastian-luna-valero (1)
acocac (1)
singhakr (1)
thwllms (1)

Top Pull Request Authors

pangeo-bot (75)
scottyhq (27)
dependabot[bot] (23)
weiji14 (17)
yuvipanda (8)
dcherian (6)
jbusecke (5)
valentin-genin (3)
jhamman (2)
cisaacstern (2)
andersy005 (2)
eroan-marie (2)
phaustin (2)
maxrjones (1)
ds4114 (1)

Top Issue Labels

good first issue (2)
enhancement (2)
documentation (1)
duplicate (1)
question (1)
bug (1)

Top Pull Request Labels

dependencies (23)

Dependencies

.github/workflows/BinderPR.yml actions

peter-evans/create-or-update-comment v2 composite

.github/workflows/Build.yml actions

actions/checkout v3 composite
docker/build-push-action v3 composite
docker/login-action v2 composite
docker/setup-buildx-action v2 composite

.github/workflows/ChatOpsDispatcher.yml actions

peter-evans/slash-command-dispatch v3 composite

.github/workflows/CondaLock.yml actions

actions/cache v3 composite
actions/checkout v3 composite
conda-incubator/setup-miniconda v2 composite
peter-evans/create-or-update-comment v2 composite

.github/workflows/PR.yml actions

actions/checkout v3 composite
peter-evans/create-or-update-comment v2 composite

.github/workflows/Publish.yml actions

actions/checkout v3 composite
docker/login-action v2 composite
docker/setup-buildx-action v2 composite

.github/workflows/Test.yml actions

actions/checkout v3 composite
docker/build-push-action v3 composite
docker/setup-buildx-action v2 composite
registry 2 docker

.github/workflows/WatchCondaForge.yml actions

actions/checkout v3 composite
jacobtomlinson/gha-anaconda-package-version 0.1.3 composite
jacobtomlinson/gha-find-replace 0.1.1 composite
peter-evans/create-pull-request v3 composite

base-image/Dockerfile docker

ubuntu 22.04 build

base-notebook/Dockerfile docker

pangeo/base-image ${PANGEO_BASE_IMAGE_TAG} build

ml-notebook/Dockerfile docker

pangeo/base-image ${PANGEO_BASE_IMAGE_TAG} build

pangeo-notebook/Dockerfile docker

pangeo/base-image ${PANGEO_BASE_IMAGE_TAG} build

pytorch-notebook/Dockerfile docker

pangeo/base-image ${PANGEO_BASE_IMAGE_TAG} build

base-notebook/environment.yml pypi

docs/requirements.txt pypi

myst-parser *
sphinx-book-theme *

ml-notebook/environment.yml pypi

pangeo-notebook/environment.yml pypi

pytorch-notebook/environment.yml pypi

Score: 8.758412389457677

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology

Pangeo Docker Images

Keywords

Keywords from Contributors

Repository metadata

README.md

Pangeo Docker Images

Using the image with Singularity on HPC systems

Dask-gateway compatibility

Other notes

Owner metadata

GitHub Events

Total

Last Year

Committers metadata

Committer domains:

Issue and Pull Request metadata

Top Issue Authors

Top Pull Request Authors

Top Issue Labels

Top Pull Request Labels

Dependencies