-
Notifications
You must be signed in to change notification settings - Fork 41
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add EXLA to enable use of at least CPU-based ML #559
base: main
Are you sure you want to change the base?
Conversation
I think this is all that's needed. I didn't build and run it. If you need me to, I can. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is really amazing. Thanks for getting this started.
I rebased on |
ff9194a
to
152d8f7
Compare
Let me know if you need me to try this on anything. |
@lawik Could you check it? I think it works, but it's pretty easy to hang my RPi5 when using Bumblebee, so I'm not sure. |
I'll give it a bash :) |
This PR requires elixir-nx/nx#1543 to build on MacOS and on Linux machines that have CUDA tools installed. There are a couple ways this could be fixed, but that's why I haven't merged it yet. |
I rebased again. |
From working with Paulo Valente and Jonatan Klosko it seems we need to run from unreleased versions right now. Not sure what fix it is we need but that was the case when I tried to run Whisper.