New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Any chance for MPS? #2

Open

cchance27 opened this issue Nov 8, 2024 · 1 comment

cchance27 commented Nov 8, 2024

Would this be something that could work on Apple MPS

Collaborator

lmxyy commented Nov 9, 2024 •

edited

Loading

Currently, our 4-bit model only supports NVIDIA GPUs. But we will take a look at it. Stay tuned.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment