Code

Add hf_transfer to testing image#29

Code

Open

mgoin wants to merge 14 commits intomainneuralmagic/vllm:mainfrom test-image-hf-transferneuralmagic/vllm:test-image-hf-transferCopy head branch name to clipboard

+1,130-420

Commits

Commits on Nov 6, 2024

• Add hf_transfer to testing image

  mgoin

  authored
  151a609

  Copy full SHA for 151a609

Commits on Nov 7, 2024

• [Misc] Consolidate ModelConfig code related to HF config (vllm-project#10104)

  Show description for db7db4a
  DarkLight1337

  authored
  db7db4a

  Copy full SHA for db7db4a

• [CI/Build] re-add codespell to CI (vllm-project#10083)

  Show description for 104d729
  russellb

  authored
  104d729

  Copy full SHA for 104d729

• Doc: Improve benchmark documentation (vllm-project#9927)

  Show description for d7263a1
  rafvasq

  authored
  d7263a1

  Copy full SHA for d7263a1

• [Core][Distributed] Refactor ipc buffer init in CustomAllreduce (vllm-project#10030)

  Show description for 6192e9b
  hanzhi713

  authored
  6192e9b

  Copy full SHA for 6192e9b

• [CI/Build] Improve mypy + python version matrix (vllm-project#10041)

  Show description for e036e52
  russellb

  authored
  e036e52

  Copy full SHA for e036e52

• Adds method to read the pooling types from model's files (vllm-project#9506)

  Show description for aa9078f
  

  flaviabeo

  and

  maxdebayser

  authored
  aa9078f

  Copy full SHA for aa9078f

• [Frontend] Fix multiple values for keyword argument error (vllm-project#10075) (vllm-project#10076)

  Show description for 0dfba97
  DIYer22

  authored
  0dfba97

  Copy full SHA for 0dfba97

• [Hardware][CPU][bugfix] Fix half dtype support on AVX2-only target (vllm-project#10108)

  Show description for a6f332d
  bigPYJ1151

  authored
  a6f332d

  Copy full SHA for a6f332d

• [Bugfix] Make image processor respect mm_processor_kwargs for Qwen2-VL (vllm-project#10112)

  Show description for 999df95
  li-plus

  authored
  999df95

  Copy full SHA for 999df95

• [Misc] Add Gamma-Distribution Request Generation Support for Serving Benchmark. (vllm-project#10105)

  Show description for a62bc01
  

  spliii

  and

  ywang96

  authored
  a62bc01

  Copy full SHA for a62bc01

• [Frontend] Tool calling parser for Granite 3.0 models (vllm-project#9027)

  Show description for ae62fd1
  maxdebayser

  authored
  ae62fd1

  Copy full SHA for ae62fd1

• Update Dockerfile

  mgoin

  authored
  2f0ed5e

  Copy full SHA for 2f0ed5e

• Merge branch 'main' into test-image-hf-transfer

  mgoin

  authored
  67bfc08

  Copy full SHA for 67bfc08