Skip to content
This repository has been archived by the owner on Dec 11, 2024. It is now read-only.

Latest commit

 

History

History
125 lines (94 loc) · 5.54 KB

README.md

File metadata and controls

125 lines (94 loc) · 5.54 KB
Raw

Dask Docker image for Coffea Columnar Object Framework For Effective Analysis

CI/CD status GitHub issues GitHub pull requests

Latest DockerHub Images: https://hub.docker.com/orgs/coffeateam/repositories

Image Description Size Pulls Version
coffea-dask Debian Dask Coffea image with latest XrootD and CA certicates
coffea-dask-cc7 Centos7 Dask Coffea image with latest XrootD and CA certicates
coffea-dask-cc7-gateway Centos7 Dask Gateway Coffea image with latest XrootD and CA certicates (FNAL)
coffea-dask-almalinux8 Almalinux8 Dask Coffea image with latest XrootD and CA certicates

TL;DR

$ docker run -it --name docker-coffea-dask coffeateam/coffea-dask
$ docker run -it --name docker-coffea-dask-cc7 coffeateam/coffea-dask-cc7
$ docker run -it --name docker-coffea-dask-cc7-gateway coffeateam/coffea-dask-cc7-gateway
$ docker run -it --name docker-coffea-dask-almalinux8 coffeateam/coffea-dask-almalinux8

or, if using singularity and CVMFS is available,

$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest
$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7:latest
$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7-gateway:latest
$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-almalinux8:latest

Get this image

The recommended way to get the Coffea Dask Docker image is to pull the prebuilt image from the Docker Hub Registry or Docker Hub Registry or Docker Hub Registry or or Docker Hub Registry

$ docker pull coffeateam/coffea-dask:latest
$ docker pull coffeateam/coffea-dask-cc7:latest
$ docker pull coffeateam/coffea-dask-cc7-gateway:latest
$ docker pull coffeateam/coffea-dask-almalinux8:latest

To use a specific version, you can pull a versioned tag. You can view the list of available versions in the Docker Hub Registry.

$ docker pull coffeateam/coffea-dask:[TAG]
$ docker pull coffeateam/coffea-dask-cc7:[TAG]
$ docker pull coffeateam/coffea-dask-cc7-gateway:[TAG]
$ docker pull coffeateam/coffea-dask-almalinux8:[TAG]

The latest image is also distributed as a singularity image on the unpacked.cern.ch service:

/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest

/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7:latest

/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7-gateway:latest

/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-almalinux8:latest

If you wish, you can also build the image yourself.

$ sudo docker build -t coffeateam/coffea-dask dask
$ sudo docker build -t coffeateam/coffea-dask-cc7 dask-cc7
$ sudo docker build -t coffeateam/coffea-dask-cc7-gateway dask-cc7-gateway
$ sudo docker build -t coffeateam/coffea-dask-cc7-gateway dask-almalinux8

Releasing

Building and releasing new image versions is done automatically via Github CI.

When new commits are pushed to the master branch, images with the recent Coffea and Dask/Distributed tag and as well with latest tag are built and pushed to Docker Hub.

How it work: when a new version of Dask/Distributed is released a PR should be raised to bump the versions in the Dockerfiles and then once that has been merged a new tag matching the Coffea version should be pushed.