Skip to content

Replaced grouped_gemm with vLLM's Fused MoE Kernel for Inference Optimization #7

Replaced grouped_gemm with vLLM's Fused MoE Kernel for Inference Optimization

Replaced grouped_gemm with vLLM's Fused MoE Kernel for Inference Optimization #7

test

succeeded Nov 13, 2024 in 2m 25s