Skip to content
Pull Request Labeler

store kvcache as float16 on AVX2/AVX512 in SDPA node. #53

Sign in to view logs

store kvcache as float16 on AVX2/AVX512 in SDPA node.

store kvcache as float16 on AVX2/AVX512 in SDPA node. #53

Run time

Learn about OS pricing on GitHub Actions
Job Run time
triage
5s
5s