Skip to content
Documentation

store kvcache as float16 on AVX2/AVX512 in SDPA node. #705

Sign in to view logs

store kvcache as float16 on AVX2/AVX512 in SDPA node.

store kvcache as float16 on AVX2/AVX512 in SDPA node. #705

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Build_Doc
4m 9s
4m 9s