Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for mounting files/secrets on vcluster that can be accessed by the apiserver #2028

Open
rharpavat opened this issue Aug 5, 2024 · 0 comments

Comments

@rharpavat
Copy link

Is your feature request related to a problem?

I'm working on a project that adds a custom webhook handler (for authentication/authorization) to a k8s cluster. We configure this on regular k8s clusters by:

  1. Installing the webhook handler, which creates some secrets internally,
  2. Manually extracting the secrets and putting them in a file accessible to the k8s cluster, and
  3. Adding custom apiserver flags that reference those files, and restarting the apiserver.

For example, when testing I am using a minikube cluster - once the webhook is installed on the cluster, we manually extract the secrets, ssh into the node, and create those secret files on the node's filesystem so the apiserver can have access.

I'm wondering if there is a way to do this with a vcluster since the vcluster under the hood is just a pod, not a node. Our infrastructure would be creating a vcluster on top of an AKS cluster, onto which we'd need to install the custom webhook (which works fine). However I'm not sure where to put those secrets/files such that they would be accessible to the apiserver. I do see that there's a way to pass custom flags to the apiserver (

- --service-account-jwks-uri=https://kubernetes.default.svc.cluster.local/openid/v1/jwks
) but haven't been able to figure out if there is a way to mount the files such that the apiserver would be able to access them.

Any suggestions would be appreciated!

Which solution do you suggest?

No solution known at the moment but would like to see if this is possible/supported by vcluster.

Which alternative solutions exist?

N/A

Additional context

N/A

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant