You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, thanks for the fantastic job. Do you plan to add integration with Apple Silicon, right now it is actively looking for CUDA cores and fails to do so, therefore, sticking with the CPU.
The text was updated successfully, but these errors were encountered:
AriaShishegaran
changed the title
Enable integration with Metal APIs for accelerated generation on Apple Silicon
Enable integration with Metal API for accelerated generation on Apple Silicon
Mar 28, 2024
Prior to that PR, I had done some testing and found it made no improvement. I think it will be useful if/when there's basically full CUDA compatibility and it work with deepspeed. I have not checked for progress in the last few weeks, but when I did last check I saw there were still quite a few missing operators that XTTS needs.
Hi, thanks for the fantastic job. Do you plan to add integration with Apple Silicon, right now it is actively looking for CUDA cores and fails to do so, therefore, sticking with the CPU.
The text was updated successfully, but these errors were encountered: