[Kernel][Triton][AMD] Change default block size for triton_scaled_mm to 128 for 3-5x speedup#11698

Open

rasmith wants to merge 2 commits intovllm-project:mainfrom rasmith:ransmith_128_scaled_mm

+16

Commits on Jan 2, 2025

Change defeault block size for triton_scaled_mm to 128 for 4-5x speedup
rasmith
committed

Commits on Jan 3, 2025

Use heuristic based on cutlass_gemm_sm90_int8_dispatch
rasmith
committed