Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology

Pangeo Docker Images

The images defined in this repository capture reproducible computing environments used by Pangeo Cloud.
https://github.com/pangeo-data/pangeo-docker-images

Category: Climate Change
Sub Category: Earth and Climate Modeling

Keywords

docker jupyter pangeo python

Keywords from Contributors

zarr data-catalogs data-engineering transforms etl compression earth-science climate-model finite-volume pydata

Last synced: about 4 hours ago
JSON representation

Repository metadata

Docker Images For Pangeo Jupyter Environment

README.md

Pangeo Docker Images

Documentation build status
Build Status
Publish Status
DockerHub Version

The images defined in this repository capture reproducible computing environments used by Pangeo Cloud. They build on top of the Ubuntu operating system and include conda environments with a curated set of Python packages for geospatial analysis. While initially intended for Pangeo Cloud, they can be used outside of Pangeo infrastructure too!

More details can be found in our documentation.

Images are hosted on DockerHub and on Quay.io

Image Description Size Pulls
base-image Foundational Dockerfile for builds
base-notebook minimally functional image for pangeo hubs
pangeo-notebook base-notebook + core earth science analysis packages
pytorch-notebook pangeo-notebook + GPU-enabled pytorch
ml-notebook pangeo-notebook + GPU-enabled tensorflow2

Click on the image name in the table above for a current list of installed packages and versions

graph TD;
    base-image-->base-notebook;
    base-notebook-->pangeo-notebook;
    pangeo-notebook-->pytorch-notebook;
    pangeo-notebook-->ml-notebook;
    click base-image "https://hub.docker.com/r/pangeo/base-image" "Open this in a new tab" _blank
    click base-notebook "https://hub.docker.com/r/pangeo/base-notebook" "Open this in a new tab" _blank
    click pangeo-notebook "https://hub.docker.com/r/pangeo/pangeo-notebook" "Open this in a new tab" _blank
    click pytorch-notebook "https://hub.docker.com/r/pangeo/pytorch-notebook" "Open this in a new tab" _blank
    click ml-notebook "https://hub.docker.com/r/pangeo/ml-notebook" "Open this in a new tab" _blank

Using the image with Singularity on HPC systems

If you want to use this image on an HPC system (including a GPU system), we recommend using Singularity. Please see the Singularity guide.

Dask-gateway compatibility

The primary use of these Docker images is running on Pangeo Cloud deployments with dask-gateway. Generally, the dask-gateway library version built into the image must match the dask-gateway version deployed in the cloud environment. The follow table keeps track of the first time a new dask-gateway version appears in a tagged image:

dask-gateway Image tag
0.9 2020.11.06
0.8 2020.07.28
0.7 2020.04.22

Other notes

  • Since 2020.10.16, mamba is installed into the base-image and conda-lock environment and is used by default to solve for a compatible environment (see #146)
  • For a simple list of packages for a given image, you can use a link like this: https://github.com/pangeo-data/pangeo-docker-images/blob/2020.10.08/pangeo-notebook/packages.txt
  • To compare changes between two images, you can use a link like this: https://github.com/pangeo-data/pangeo-docker-images/compare/2020.10.03..2020.10.08
  • As of 2024.05.21, the ml-notebook and pytorch-notebook docker images contain
    machine learning libraries built with CUDA 12. In previous versions, we have suggested
    ml-notebook users to install cuda-nvcc manually to obtain JAX and/or TensorFlow
    with XLA optimization, but this workaround should no longer
    be needed if you are using ml-notebook 2024.06.02 or newer that comes with
    cuda-nvcc pre-installed.
  • There used to be a pangeo/forge image, built for use with pangeo-forge. It is
    no longer actively maintained or used, but you can still use the historical tags
    if you wish.
  • Note that users of zarr-python are advised to avoid using image tags 2025.01.10
    and 2025.01.24 due to a bug in zarr-python>=3.0.0,<=3.0.7 that may result in
    potential data loss, see more details in
    https://github.com/pangeo-data/pangeo-docker-images/issues/606
  • Since 2025.07.31, the docker images are using Ubuntu-24.04 (Noble Numbat) instead of
    Ubuntu 22.04 (Jammy Jellyfish) as the base image.

Owner metadata

GitHub Events

Total
Last Year

Committers metadata

Last synced: about 1 month ago

Total Commits: 706
Total Committers: 38
Avg Commits per committer: 18.579
Development Distribution Score (DDS): 0.676

Commits in past year: 30
Committers in past year: 9
Avg Commits per committer in past year: 3.333
Development Distribution Score (DDS) in past year: 0.6

Name Email Commits
pangeo-bot p****t 229
Scott Henderson s****h@u****u 223
YuviPanda y****a@g****m 64
actions-bot 5****t 35
Wei Ji 2****4 27
Ryan Abernathey r****y@g****m 20
dependabot[bot] 4****] 16
Joseph Hamman j****n@u****u 10
Tom Augspurger t****r@g****m 9
Julius Busecke j****s@l****u 8
Tim Crone t****e@g****m 7
Deepak Cherian d****n 6
Rich Signell r****l@u****v 5
ngam 6****m 5
Erik Sundell e****l@g****m 5
jhamman j****n 5
Henri Drake h****e@g****m 4
Joe Hamman j****e@c****g 2
Anderson Banihirwe a****e@g****m 2
Charles Stern 6****n 2
GitHub Action a****n@g****m 2
Max Jones 1****s 2
bsmith-hat b****h@h****m 2
github-actions[bot] 4****] 2
sharkinsspatial s****s@g****m 1
paigem p****r@u****u 1
thomas t****e@e****r 1
Willi Rath w****h 1
Tatsu D Monkman 5****7 1
Shunzi Lu 3****u 1
and 8 more...

Committer domains:

Issue and Pull Request metadata

Last synced: 3 days ago

Total issues: 65
Total pull requests: 254
Average time to close issues: 9 months
Average time to close pull requests: about 1 month
Total issue authors: 30
Total pull request authors: 27
Average comments per issue: 4.51
Average comments per pull request: 2.95
Merged pull request: 199
Bot issues: 0
Bot pull requests: 34

Past year issues: 7
Past year pull requests: 61
Past year average time to close issues: 2 days
Past year average time to close pull requests: 13 days
Past year issue authors: 7
Past year pull request authors: 13
Past year average comments per issue: 1.14
Past year average comments per pull request: 2.72
Past year merged pull request: 39
Past year bot issues: 0
Past year bot pull requests: 12

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/pangeo-data/pangeo-docker-images

Top Issue Authors

  • scottyhq (19)
  • dhruvbalwada (6)
  • jbusecke (6)
  • rabernat (5)
  • pangeo-bot (2)
  • consideRatio (2)
  • guillaumeeb (2)
  • thwllms (1)
  • singhakr (1)
  • acocac (1)
  • sebastian-luna-valero (1)
  • maxrjones (1)
  • ed-randall-blk (1)
  • cmdupuis3 (1)
  • cisaacstern (1)

Top Pull Request Authors

  • pangeo-bot (97)
  • dependabot[bot] (34)
  • scottyhq (33)
  • weiji14 (27)
  • yuvipanda (10)
  • dcherian (9)
  • jbusecke (6)
  • valentin-genin (6)
  • eroan-marie (4)
  • jhamman (2)
  • hillsonghimire (2)
  • consideRatio (2)
  • cisaacstern (2)
  • andersy005 (2)
  • jsignell (2)

Top Issue Labels

  • documentation (1)
  • duplicate (1)
  • question (1)
  • good first issue (1)

Top Pull Request Labels

  • dependencies (34)
  • github_actions (2)

Dependencies

.github/workflows/BinderPR.yml actions
  • peter-evans/create-or-update-comment v2 composite
.github/workflows/Build.yml actions
  • actions/checkout v3 composite
  • docker/build-push-action v3 composite
  • docker/login-action v2 composite
  • docker/setup-buildx-action v2 composite
.github/workflows/ChatOpsDispatcher.yml actions
  • peter-evans/slash-command-dispatch v3 composite
.github/workflows/CondaLock.yml actions
  • actions/cache v3 composite
  • actions/checkout v3 composite
  • conda-incubator/setup-miniconda v2 composite
  • peter-evans/create-or-update-comment v2 composite
.github/workflows/PR.yml actions
  • actions/checkout v3 composite
  • peter-evans/create-or-update-comment v2 composite
.github/workflows/Publish.yml actions
  • actions/checkout v3 composite
  • docker/login-action v2 composite
  • docker/setup-buildx-action v2 composite
.github/workflows/Test.yml actions
  • actions/checkout v3 composite
  • docker/build-push-action v3 composite
  • docker/setup-buildx-action v2 composite
  • registry 2 docker
.github/workflows/WatchCondaForge.yml actions
  • actions/checkout v3 composite
  • jacobtomlinson/gha-anaconda-package-version 0.1.3 composite
  • jacobtomlinson/gha-find-replace 0.1.1 composite
  • peter-evans/create-pull-request v3 composite
base-image/Dockerfile docker
  • ubuntu 22.04 build
base-notebook/Dockerfile docker
  • pangeo/base-image ${PANGEO_BASE_IMAGE_TAG} build
ml-notebook/Dockerfile docker
  • pangeo/base-image ${PANGEO_BASE_IMAGE_TAG} build
pangeo-notebook/Dockerfile docker
  • pangeo/base-image ${PANGEO_BASE_IMAGE_TAG} build
pytorch-notebook/Dockerfile docker
  • pangeo/base-image ${PANGEO_BASE_IMAGE_TAG} build
base-notebook/environment.yml pypi
docs/requirements.txt pypi
  • myst-parser *
  • sphinx-book-theme *
ml-notebook/environment.yml pypi
pangeo-notebook/environment.yml pypi
pytorch-notebook/environment.yml pypi

Score: 8.8023721336499