Skip to content
Webassembly

store kvcache as float16 on AVX2/AVX512 in SDPA node. #3

Sign in to view logs

store kvcache as float16 on AVX2/AVX512 in SDPA node.

store kvcache as float16 on AVX2/AVX512 in SDPA node. #3

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Build
1s
1s