Pangeo Docker Images

The images defined in this repository capture reproducible computing environments used by Pangeo Cloud.
https://github.com/pangeo-data/pangeo-docker-images

docker jupyter pangeo python

Last synced: about 23 hours ago
JSON representation

Repository metadata

Docker Images For Pangeo Jupyter Environment

• Host: GitHub
• URL: https://github.com/pangeo-data/pangeo-docker-images
• Owner: pangeo-data
• License: mit
• Created: 2020-02-19T01:23:30.000Z (about 4 years ago)
• Default Branch: master
• Last Pushed: 2024-05-09T09:19:51.000Z (2 days ago)
• Last Synced: 2024-05-10T06:04:25.621Z (1 day ago)
• Topics: docker, jupyter, pangeo, python
• Language: Dockerfile
• Homepage: https://pangeo-docker-images.readthedocs.io
• Size: 5.59 MB
• Stars: 115
• Watchers: 15
• Forks: 90
• Open Issues: 37
• Metadata Files:
  • Readme: README.md
  • Contributing: docs/contributing.md
  • License: LICENSE

README

        
# Pangeo Docker Images

[![Documentation build status](https://img.shields.io/readthedocs/pangeo-docker-images?logo=read-the-docs)](https://pangeo-docker-images.readthedocs.org/en/latest/)

![Build Status](https://github.com/pangeo-data/pangeo-docker-images/workflows/Build/badge.svg)

![Publish Status](https://github.com/pangeo-data/pangeo-docker-images/workflows/Publish/badge.svg)

![DockerHub Version](https://img.shields.io/docker/v/pangeo/base-image?sort=date)

The images defined in this repository capture reproducible computing environments used by [Pangeo Cloud](https://pangeo.io/cloud.html). They build on top of the Ubuntu operating system and include [conda environments](https://conda.io/projects/conda) with a curated set of Python packages for geospatial analysis. While initially intended for Pangeo Cloud, they can be used outside of Pangeo infrastructure too!

More details can be found in [our documentation](https://pangeo-docker-images.readthedocs.io).

Images are hosted on [DockerHub](https://hub.docker.com/u/pangeo) and on [Quay.io](https://quay.io/organization/pangeo)

| Image           | Description                                   |  Size | Pulls |

|-----------------|-----------------------------------------------|--------------|-------------|

| base-image      | Foundational Dockerfile for builds            | ![](https://img.shields.io/docker/image-size/pangeo/base-image?sort=date) | ![](https://img.shields.io/docker/pulls/pangeo/base-image?sort=date)

| [base-notebook](base-notebook/packages.txt) | minimally functional image for pangeo hubs | ![](https://img.shields.io/docker/image-size/pangeo/base-notebook?sort=date) | ![](https://img.shields.io/docker/pulls/pangeo/base-notebook?sort=date)

| [pangeo-notebook](pangeo-notebook/packages.txt) | base-notebook + core earth science analysis packages | ![](https://img.shields.io/docker/image-size/pangeo/pangeo-notebook?sort=date) | ![](https://img.shields.io/docker/pulls/pangeo/pangeo-notebook?sort=date)

| [pytorch-notebook](pytorch-notebook/packages.txt) | pangeo-notebook + GPU-enabled pytorch | ![](https://img.shields.io/docker/image-size/pangeo/pytorch-notebook?sort=date) | ![](https://img.shields.io/docker/pulls/pangeo/pytorch-notebook?sort=date)

| [ml-notebook](ml-notebook/packages.txt) | pangeo-notebook + GPU-enabled tensorflow2 | ![](https://img.shields.io/docker/image-size/pangeo/ml-notebook?sort=date) | ![](https://img.shields.io/docker/pulls/pangeo/ml-notebook?sort=date)

*Click on the image name in the table above for a current list of installed packages and versions*

```mermaid

graph TD;

    base-image-->base-notebook;

    base-notebook-->pangeo-notebook;

    pangeo-notebook-->pytorch-notebook;

    pangeo-notebook-->ml-notebook;

    click base-image "https://hub.docker.com/r/pangeo/base-image" "Open this in a new tab" _blank

    click base-notebook "https://hub.docker.com/r/pangeo/base-notebook" "Open this in a new tab" _blank

    click pangeo-notebook "https://hub.docker.com/r/pangeo/pangeo-notebook" "Open this in a new tab" _blank

    click pytorch-notebook "https://hub.docker.com/r/pangeo/pytorch-notebook" "Open this in a new tab" _blank

    click ml-notebook "https://hub.docker.com/r/pangeo/ml-notebook" "Open this in a new tab" _blank

```

### Using the image with Singularity on HPC systems

If you want to use this image on an HPC system (including a GPU system), we recommend using Singularity. Please see the [Singularity guide](Sing+GPU.md).

### Dask-gateway compatibility

The primary use of these Docker images is running on Pangeo Cloud deployments with [dask-gateway](https://github.com/dask/dask-gateway). Generally, the dask-gateway library version built into the image must match the dask-gateway version deployed in the cloud environment. The follow table keeps track of the first time a new dask-gateway version appears in a tagged image:

| dask-gateway |  Image tag  |

|--------------|-------------|

| 0.9          | 2020.11.06  |

| 0.8          | 2020.07.28  |

| 0.7          | 2020.04.22  |

### Other notes

* Since 2020.10.16, [mamba](https://github.com/mamba-org/mamba) is installed into the base-image and conda-lock environment and is used by default to solve for a compatible environment (see #146)

* For a simple list of packages for a given image, you can use a link like this: https://github.com/pangeo-data/pangeo-docker-images/blob/2020.10.08/pangeo-notebook/packages.txt

* To compare changes between two images, you can use a link like this: https://github.com/pangeo-data/pangeo-docker-images/compare/2020.10.03..2020.10.08

* Our `ml-notebook` image now contains JAX and TensorFlow with XLA enabled. Due to licensing issues, conda-forge does not have `ptxas`, but `ptxas` is needed for XLA to work correctly. Should you like to use JAX and/or TensorFlow with XLA optimization, please install `ptxas` on your own, for example, by `conda install -c nvidia cuda-nvcc`. At the time of writing (October 2022), JAX throws a compilation error if the `ptxas` version is higher than the driver version. There does not exist an easy solution for K80 GPUs, but in the case of T4 GPUs, you should install `conda install -c nvidia cuda-nvcc==11.6.*` to be safe. Alternatively for any GPU, you could set an environment variable to resolve the error caused by JAX: `XLA_FLAGS="--xla_gpu_force_compilation_parallelism=1"`. The aforementioned error will be removed (and likely turned into a warning) in a future version of JAX. See https://github.com/google/jax/issues/12776#issuecomment-1276649134

* There used to be a `pangeo/forge` image, built for use with [pangeo-forge](https://pangeo-forge.org/). It is

  no longer actively maintained or used, but you can still use the [historical tags](https://quay.io/repository/pangeo/forge?tab=tags)

  if you wish.
      

---

Owner metadata

• Name: Pangeo
• Login: pangeo-data
• Email:
• Kind: organization
• Description: A community effort for big data geoscience
• Website: http://pangeo.io
• Location: earth
• Twitter: pangeo_data
• Company:
• Icon url: https://avatars.githubusercontent.com/u/23299451?v=4
• Repositories: 54
• Last ynced at: 2023-02-27T08:40:21.915Z
• Profile URL: https://github.com/pangeo-data

---

GitHub Events

Total

• Create event: 330
• Commit comment event: 1
• Issues event: 173
• Watch event: 104
• Delete event: 209
• Member event: 3
• Issue comment event: 1450
• Push event: 590
• Pull request review event: 389
• Pull request event: 691
• Pull request review comment event: 209
• Fork event: 78

Last Year

• Create event: 71
• Delete event: 46
• Fork event: 13
• Issue comment event: 272
• Issues event: 27
• Member event: 2
• Pull request event: 115
• Pull request review comment event: 54
• Pull request review event: 110
• Push event: 135
• Watch event: 23

---

Committers metadata

Last synced: 1 day ago

Name	Email	Commits
pangeo-bot	p****t	212
Scott Henderson	s****h@u****u	208
YuviPanda	y****a@g****m	62
actions-bot	5****t	35
Ryan Abernathey	r****y@g****m	20
Wei Ji	2****4	19
dependabot[bot]	4****]	10
Joseph Hamman	j****n@u****u	10
Tom Augspurger	t****r@g****m	9
Julius Busecke	j****s@l****u	7
Tim Crone	t****e@g****m	7
Rich Signell	r****l@u****v	5
ngam	6****m	5
Deepak Cherian	d****n	4
Erik Sundell	e****l@g****m	4
Henri Drake	h****e@g****m	4
jhamman	j****n	4
Anderson Banihirwe	a****e@g****m	2
Joe Hamman	j****e@c****g	2
bsmith-hat	b****h@h****m	2
Charles Stern	6****n	2
github-actions[bot]	4****]	2
GitHub Action	a****n@g****m	2
paigem	p****r@u****u	1
Willi Rath	w****h	1
Shunzi Lu	3****u	1
Shanice Bailey	3****y	1
Naomi Goldenson	t****g	1
Max Jones	1****s	1
Mario	8****z	1
and 9 more...

Committer domains:

• github.com: 2
• sundellopensource.se: 1
• earthmover.io: 1
• ensta-paristech.fr: 1
• esr.org: 1
• ucdavis.edu: 1
• umich.edu: 1
• hatfieldgroup.com: 1
• carbonplan.org: 1
• usgs.gov: 1
• ldeo.columbia.edu: 1
• ucar.edu: 1
• uw.edu: 1

---

Issue and Pull Request metadata

Last synced: 2 days ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/pangeo-data/pangeo-docker-images

---

---

---

Dependencies

Score: 8.687442166975924