Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What is the supported precision for gemm in oneMKL open source project ? #310

Open
FatmaElbadry2 opened this issue Apr 30, 2023 · 2 comments
Assignees
Labels
question A request for more information or clarification

Comments

@FatmaElbadry2
Copy link

FatmaElbadry2 commented Apr 30, 2023

As far as I understand, the oneMKL open source project provides implementation for the Intel MKL product, with multiple hardware support. I was checking the documentation for both of them to check the supported data type precisions for the matrix multiplication function gemm. I found that the Intel MKL product supports int8_t data type. However, the open source project only supports floating point precisions. Is integer precision missing from documentation or it is not supported ? and is it going to be supported soon ?

@FatmaElbadry2 FatmaElbadry2 added the question A request for more information or clarification label Apr 30, 2023
@mmeterel
Copy link
Contributor

mmeterel commented May 1, 2023

@FatmaElbadry2 Thanks for your interest and your question. As you have noticed, GEMM API with int8_t data type have not been added to oneMKL open source interfaces project yet. Typically, Intel oneMKL product moves ahead of oneMKL open source interfaces project. Can you provide more information (priority, timeline, etc..) if this is a feature you are interested?

@andrewtbarker andrewtbarker self-assigned this Nov 22, 2023
@andrewtbarker
Copy link
Contributor

It is maybe worth pointing out that gemm_bias does support integer precisions, so it can be used with ao, bo, and co set to zero. See also #466 which is proposing to add support for batch gemm with some integer type support.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question A request for more information or clarification
Projects
None yet
Development

No branches or pull requests

3 participants