Update of Anaconda deps... finally

[Xaenalt]

That's right, it's the moment you've all been waiting for, finally an upgrade of the Anaconda deps xD

[Xaenalt]

@trujillm behold!

[harshad16]

@Xaenalt can you share what command you used to set this up ?
as it would help us do this in future as well

[Xaenalt]

Yep
For the base image, it's just conda env export -p /opt/app-root > environment.yml after installation/update of packages. That just freezes the base deps

For the datascience image, it was running:

conda install -c conda-forge $(cat environment.in)
conda env export -p /opt/app-root > environment.yml

The environment.in was generated by just taking the pipfile's Packages section and reformatting it (and chopping the last digit of the version, since they may not always 1:1 match wit the ones available, and debugging that kfp-tekton was an unsatisfiable package version with all the others

[harshad16]

Yep For the base image, it's just conda env export -p /opt/app-root > environment.yml after installation/update of packages. That just freezes the base deps

what commands did you use for installation and update ?

For the datascience image, it was running:

conda install -c conda-forge $(cat environment.in)
conda env export -p /opt/app-root > environment.yml

The environment.in was generated by just taking the pipfile's Packages section and reformatting it (and chopping the last digit of the version, since they may not always 1:1 match wit the ones available, and debugging that kfp-tekton was an unsatisfiable package version with all the others

ack, did you update environment.yml for data-science as well.

[Xaenalt]

Yep, environment.yml is updated for both, also some other good news is @trujillm will be taking over the maintenance of these in the future, as well as writing some of the automation I wasn't able to figure out

[Xaenalt]

For install and update, I just copied the block in the Dockerfile for install:

ANACONDA_INSTALLER_NAME=Miniconda3-latest-Linux-x86_64.sh
curl -O "https://repo.anaconda.com/miniconda/${ANACONDA_INSTALLER_NAME}"
chmod +x ${ANACONDA_INSTALLER_NAME}
./${ANACONDA_INSTALLER_NAME} -b -p /opt/anaconda3
rm -f ${ANACONDA_INSTALLER_NAME}

Followed by

/opt/anaconda3/bin/conda env create --file environment.yml -p /opt/app-root && \
source /opt/anaconda3/bin/activate /opt/app-root && \
conda update --all -y && \
/opt/anaconda3/bin/conda env export > environment.yml

[trujillm]

@harshad16 do you know when this will get merged?

[harshad16]

/lgtm
/approve

thanks for the excellent work 💯

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: harshad16

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [harshad16]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[jstourac]

Thank you, Sean, for fixing this for us! 🚀 I suppose that this is tied with the #195 so mentioning it here for the reference.