Dask Docker image for Coffea Columnar Object Framework For Effective Analysis

Latest DockerHub Images: https://hub.docker.com/orgs/coffeateam/repositories

Image	Description	Size	Pulls	Version
coffea-dask	Debian Dask Coffea image with latest XrootD and CA certicates
coffea-dask-cc7	Centos7 Dask Coffea image with latest XrootD and CA certicates
coffea-dask-cc7-gateway	Centos7 Dask Gateway Coffea image with latest XrootD and CA certicates (FNAL)
coffea-dask-almalinux8	Almalinux8 Dask Coffea image with latest XrootD and CA certicates

TL;DR

$ docker run -it --name docker-coffea-dask coffeateam/coffea-dask

$ docker run -it --name docker-coffea-dask-cc7 coffeateam/coffea-dask-cc7

$ docker run -it --name docker-coffea-dask-cc7-gateway coffeateam/coffea-dask-cc7-gateway

$ docker run -it --name docker-coffea-dask-almalinux8 coffeateam/coffea-dask-almalinux8

or, if using singularity and CVMFS is available,

$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest

$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7:latest

$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7-gateway:latest

$ singularity shell -B ${PWD}:/work /cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-almalinux8:latest

Get this image

The recommended way to get the Coffea Dask Docker image is to pull the prebuilt image from the Docker Hub Registry or Docker Hub Registry or Docker Hub Registry or or Docker Hub Registry

$ docker pull coffeateam/coffea-dask:latest

$ docker pull coffeateam/coffea-dask-cc7:latest

$ docker pull coffeateam/coffea-dask-cc7-gateway:latest

$ docker pull coffeateam/coffea-dask-almalinux8:latest

To use a specific version, you can pull a versioned tag. You can view the list of available versions in the Docker Hub Registry.

$ docker pull coffeateam/coffea-dask:[TAG]

$ docker pull coffeateam/coffea-dask-cc7:[TAG]

$ docker pull coffeateam/coffea-dask-cc7-gateway:[TAG]

$ docker pull coffeateam/coffea-dask-almalinux8:[TAG]

The latest image is also distributed as a singularity image on the unpacked.cern.ch service:

/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask:latest

/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7:latest

/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-cc7-gateway:latest

/cvmfs/unpacked.cern.ch/registry.hub.docker.com/coffeateam/coffea-dask-almalinux8:latest

If you wish, you can also build the image yourself.

$ sudo docker build -t coffeateam/coffea-dask dask

$ sudo docker build -t coffeateam/coffea-dask-cc7 dask-cc7

$ sudo docker build -t coffeateam/coffea-dask-cc7-gateway dask-cc7-gateway

$ sudo docker build -t coffeateam/coffea-dask-cc7-gateway dask-almalinux8

Releasing

Building and releasing new image versions is done automatically via Github CI.

When new commits are pushed to the master branch, images with the recent Coffea and Dask/Distributed tag and as well with latest tag are built and pushed to Docker Hub.

How it work: when a new version of Dask/Distributed is released a PR should be raised to bump the versions in the Dockerfiles and then once that has been merged a new tag matching the Coffea version should be pushed.