Code

Make benchmark_guided_serving.py#10879

Code

Closed

mgoin wants to merge 4 commits intovllm-project:mainvllm-project/vllm:mainfrom neuralmagic:benchmark-guided-serving-scriptneuralmagic/vllm:benchmark-guided-serving-scriptCopy head branch name to clipboard

+479

Commits

Commits on Dec 3, 2024

• Make benchmark_guided_serving.py

  Show description for 7854d0e
  mgoin

  committed
  7854d0e

• Format

  Show description for cec935a
  mgoin

  committed
  cec935a

• Incorrect output token throughput

  Show description for 5ad706e
  mgoin

  committed
  5ad706e

Commits on Dec 4, 2024

• Format

  Show description for 82e2978
  mgoin

  committed
  82e2978