Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: gpu passthrough to service #888

Open
tanmoysrt opened this issue Jun 26, 2024 — with Linear · 0 comments
Open

feat: gpu passthrough to service #888

tanmoysrt opened this issue Jun 26, 2024 — with Linear · 0 comments

Comments

Copy link
Member

In Swarm, if we have some containers which requires access to GPU, we can provide that with GPU passthrough.

NVIDIA has support for docker to do this.

In Server Management, provide option to enable GPU access, so that the containers required GPU access, get deployed on the servers which has GPU in system. For this we can utilize node labels t o deploy those kind of only on specific server

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant