Code

updated#50

Code

Open

robertgshaw2-redhat wants to merge 44 commits intofix-shutdownneuralmagic/vllm:fix-shutdownfrom tp-shutdownneuralmagic/vllm:tp-shutdownCopy head branch name to clipboard

+4,125-2,056

Commits

Commits on Dec 31, 2024

• [V1][VLM] V1 support for selected single-image models. (vllm-project#11632)

  Show description for e7c7c5e
  

  3 peopleauthored
  e7c7c5e

  Copy full SHA for e7c7c5e

Commits on Jan 1, 2025

• [Benchmark] Add benchmark script for CPU offloading (vllm-project#11533)

  Show description for 0c6f998
  

  ApostaC

  and

  KuntaiDu

  authored
  0c6f998

  Copy full SHA for 0c6f998

• [Bugfix][Refactor] Unify model management in frontend (vllm-project#11660)

  Show description for 4db72e5
  joerunde

  authored
  4db72e5

  Copy full SHA for 4db72e5

• [VLM] Add max-count checking in data parser for single image models (vllm-project#11661)

  Show description for 365801f
  

  DarkLight1337

  and

  ywang96

  authored
  365801f

  Copy full SHA for 365801f

• [Misc] Optimize Qwen2-VL LoRA test (vllm-project#11663)

  Show description for 11d8a09
  jeejeelee

  authored
  11d8a09

  Copy full SHA for 11d8a09

• [Misc] Replace space with - in the file names (vllm-project#11667)

  Show description for f962f42
  houseroad

  authored
  f962f42

  Copy full SHA for f962f42

• [Doc] Fix typo (vllm-project#11666)

  Show description for 6d70198
  serihiro

  authored
  6d70198

  Copy full SHA for 6d70198

• [V1] Implement Cascade Attention (vllm-project#11635)

  Show description for 7300144
  WoosukKwon

  authored
  7300144

  Copy full SHA for 7300144

• [VLM] Move supported limits and max tokens to merged multi-modal processor (vllm-project#11669)

  Show description for a115ac4
  

  DarkLight1337

  and

  Isotr0py

  authored
  a115ac4

  Copy full SHA for a115ac4

Commits on Jan 2, 2025

• [VLM][Bugfix] Multi-modal processor compatible with V1 multi-input (vllm-project#11674)

  Show description for 23c1b10
  DarkLight1337

  authored
  23c1b10

  Copy full SHA for 23c1b10

• [mypy] Pass type checking in vllm/inputs (vllm-project#11680)

  Show description for b6087a6
  CloseChoice

  authored
  b6087a6

  Copy full SHA for b6087a6

• [VLM] Merged multi-modal processor for LLaVA-NeXT (vllm-project#11682)

  Show description for 8c38ee7
  DarkLight1337

  authored
  8c38ee7

  Copy full SHA for 8c38ee7

• According to vllm.EngineArgs, the name should be distributed_executor_backend (vllm-project#11689)

  chunyang-wen

  authored
  84c35c3

  Copy full SHA for 84c35c3

• [Bugfix] Free cross attention block table for preempted-for-recompute sequence group. (vllm-project#10013)

  Show description for 2f38518
  kathyyu-google

  authored
  2f38518

  Copy full SHA for 2f38518

• [V1][Minor] Optimize token_ids_cpu copy (vllm-project#11692)

  Show description for b55ed6e
  WoosukKwon

  authored
  b55ed6e

  Copy full SHA for b55ed6e

• [Bugfix] Change kv scaling factor by param json on nvidia gpu (vllm-project#11688)

  Show description for 187e329
  

  bjmsong

  and

  mdattack

  authored
  187e329

  Copy full SHA for 187e329

• Resolve race conditions in Marlin kernel (vllm-project#11493)

  Show description for 5dba257
  wchen61

  authored
  5dba257

  Copy full SHA for 5dba257

• [Misc] Minimum requirements for SageMaker compatibility (vllm-project#11576)

  nathan-az

  authored
  68d3780

  Copy full SHA for 68d3780

Commits on Jan 3, 2025

• Update default max_num_batch_tokens for chunked prefill (vllm-project#11694)

  SachinVarghese

  authored
  2f1e8e8

  Copy full SHA for 2f1e8e8

• [Bugfix] Check chain_speculative_sampling before calling it (vllm-project#11673)

  Show description for 07064cb
  houseroad

  authored
  07064cb

  Copy full SHA for 07064cb

• [perf-benchmark] Fix dependency for steps in benchmark pipeline (vllm-project#11710)

  khluu

  authored
  fd3a62a

  Copy full SHA for fd3a62a

• [Model] Whisper model implementation (vllm-project#11280)

  Show description for e1a5c2f
  

  aurickq

  and

  sfc-gh-aqiao

  authored
  e1a5c2f

  Copy full SHA for e1a5c2f

• updated

  robertgshaw2-redhat

  committed
  1c4b92a

  Copy full SHA for 1c4b92a

• stash

  robertgshaw2-redhat

  committed
  eb9b00b

  Copy full SHA for eb9b00b

• [V1] Simplify Shutdown (vllm-project#11659)

  robertgshaw2-redhat

  authored
  80c751e

  Copy full SHA for 80c751e

• updated

  robertgshaw2-redhat

  committed
  1da99a8

  Copy full SHA for 1da99a8

• Merge branch 'main' into tp-shutdown

  robertgshaw2-redhat

  committed
  ca7b92d

  Copy full SHA for ca7b92d

• updated

  robertgshaw2-redhat

  committed
  2743166

  Copy full SHA for 2743166

• stash

  robertgshaw2-redhat

  committed
  8e257c1

  Copy full SHA for 8e257c1

• revert spurious change

  robertgshaw2-redhat

  committed
  b7c50dc

  Copy full SHA for b7c50dc

• updated

  robertgshaw2-redhat

  committed
  dcfd3b8

  Copy full SHA for dcfd3b8

• stash

  robertgshaw2-redhat

  committed
  6e0e0d4

  Copy full SHA for 6e0e0d4

• updated

  robertgshaw2-redhat

  committed
  55a6195

  Copy full SHA for 55a6195

• updated

  robertgshaw2-redhat

  committed
  aa6954f

  Copy full SHA for aa6954f

• remove cruft

  robertgshaw2-redhat

  committed
  1d15ae0

  Copy full SHA for 1d15ae0

• Update vllm/v1/executor/multiproc_executor.py

  Show description for 0347baa
  

  robertgshaw2-redhat

  and

  tlrmchlsmth

  authored
  0347baa

  Copy full SHA for 0347baa

• stash

  robertgshaw2-redhat

  committed
  20b8fa2

  Copy full SHA for 20b8fa2

• Merge branch 'tp-shutdown' of https://github.com/neuralmagic/vllm into tp-shutdown

  robertgshaw2-redhat

  committed
  32840f2

  Copy full SHA for 32840f2

• switch to SIGUSR1

  robertgshaw2-redhat

  committed
  884879a

  Copy full SHA for 884879a

• updated

  robertgshaw2-redhat

  committed
  bb86a03

  Copy full SHA for bb86a03

• Update vllm/v1/engine/core_client.py

  Show description for 405bcc1
  

  robertgshaw2-redhat

  and

  tlrmchlsmth

  authored
  405bcc1

  Copy full SHA for 405bcc1

• update message

  robertgshaw2-redhat

  committed
  25e0fea

  Copy full SHA for 25e0fea

• updated

  robertgshaw2-redhat

  committed
  efd6270

  Copy full SHA for efd6270

• fixed!

  robertgshaw2-redhat

  committed
  a5a306e

  Copy full SHA for a5a306e