Skip to content

[Bugfix][Frontend] correctly record prefill and decode time metrics #10853

Merged
robertgshaw2-neuralmagic merged 1 commit intovllm-project:mainfrom tomeras91:fix-prefill-decode-metricsDec 3, 2024
+2-2

Commits