New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix numel()=0 #9

Merged

mgoin merged 1 commit into neuralmagic:main from comaniac:patch-1

Jun 1, 2024

Contributor

comaniac commented May 28, 2024

Bypass numel()==0; otherwise _scaled_mm will throw out an error.
Allow L4 to quantize using _scaled_mm.


          Update quantize.py

c762239

mgoin approved these changes

View reviewed changes

Member

mgoin commented Jun 1, 2024

In order to enable support for scaled_mm on CUDA compute capability 8.9, we should require torch>=2.3

mgoin merged commit 5495e4c into neuralmagic:main

4 checks passed

comaniac deleted the patch-1 branch

June 1, 2024 23:08

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet