Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Finding original alternatives to k8scc01covidacr.azurecr.io/jupyter-apis images etc. #308

Open
Analect opened this issue Feb 7, 2023 · 1 comment
Assignees

Comments

@Analect
Copy link

Analect commented Feb 7, 2023

Thanks for this resource - the local capabilities for testing kubeflow on k3d are really helpful.
However, I'm looking to fix a few things in order to get jupyter notebooks working in a generic way (non-specific to StatCan). Currently that component is failing given its dependency on some proprietary pre-built images.

I can see if I generate a preview of manifests for the local stack and then search for azure, then there are various dependencies on non-public images.

task stack:local:preview ... outputs a file to ../manifests/local.yaml.
I then run: cat manifests/local.yaml | grep azure

I realise I can re-create these types of images here.

k8scc01covidacr.azurecr.io/jupyterlab-cpu:v1
k8scc01covidacr.azurecr.io/jupyterlab-pytorch:v1
k8scc01covidacr.azurecr.io/jupyterlab-tensorflow:v1

But there are these other images that are more fundamental to the inner-workings for kubeflow. I can see for k8scc01covidacr.azurecr.io/jupyter-apis that this is derived from here - "A Golang replacement for the Kubeflow Jupyter Web APIs." ... if I wanted to make this work in a more generic way (non-StatCan-specific), where would I find these images that this previously pointed to?

image: k8scc01covidacr.azurecr.io/kubeflow/centraldashboard:1611594946cb8d04afb5dcb7eaff0e7cd39ac5df
image: k8scc01covidacr.azurecr.io/jupyter-apis:6c50acdff0845486863942c70699198b343f1004
image: k8scc01covidacr.azurecr.io/oidc-authservice:latest

Thanks for any guidance you might be able to offer.

@Souheil-Yazji
Copy link
Contributor

Hi @Analect

The jupyter-apis will only be available through the statcan repo as it's our Go implementation of the python api. Image can be found here https://github.com/kubeflow/manifests/blob/master/apps/jupyter/jupyter-web-app/upstream/base/kustomization.yaml#L23.

central dashboard would be retrieved from Kubeflow/Kubeflow if you'd like to build them yourself. Otherwise you can pull https://github.com/kubeflow/manifests/blob/master/apps/centraldashboard/upstream/base/kustomization.yaml#L18 if it's available.

The oicd authservice can be traced to https://github.com/kubeflow/manifests/blob/master/common/oidc-authservice/base/kustomization.yaml#L44 which should be pull-able from that gcr. This is a build of the repo arritko/oicd-authservice so if you'd like to build that service yourself, you can do so.

We have stringent guidelines for security and performance purposes and use our own images for that purpose.

Cheers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants