Code

[V1] Implement Cascade Attention#11635

Code

Merged

WoosukKwon merged 23 commits intomainvllm-project/vllm:mainfrom v1-cascadevllm-project/vllm:v1-cascadeCopy head branch name to clipboardJan 1, 2025

+693-16

Commits

Commits on Dec 30, 2024

• [V1] Implement Cascade Inference

  Show description for bf06942
  WoosukKwon

  committed
  bf06942

• Minor

  Show description for 4faac41
  WoosukKwon

  committed
  4faac41

Commits on Dec 31, 2024

• Merge branch 'main' into v1-cascade

  WoosukKwon

  committed
  012775f

• Minor

  Show description for 8093b2e
  WoosukKwon

  committed
  8093b2e

Commits on Jan 1, 2025

• Merge branch 'main' into v1-cascade

  WoosukKwon

  committed
  21c988d

• isort

  Show description for 2dc2531
  WoosukKwon

  committed
  2dc2531

• Comment

  Show description for 910752e
  WoosukKwon

  committed
  910752e

• Minor

  Show description for c8b32de
  WoosukKwon

  committed
  c8b32de

• minor

  Show description for 42efe0d
  WoosukKwon

  committed
  42efe0d

• comment

  Show description for ca7b756
  WoosukKwon

  committed
  ca7b756

• minor

  Show description for 58af494
  WoosukKwon

  committed
  58af494

• comment

  Show description for d6a7daf
  WoosukKwon

  committed
  d6a7daf

• Minor

  Show description for d802be9
  WoosukKwon

  committed
  d802be9

• docstring

  Show description for afe8af7
  WoosukKwon

  committed
  afe8af7

• comment

  Show description for 3766125
  WoosukKwon

  committed
  3766125

• Fix

  Show description for 801b521
  WoosukKwon

  committed
  801b521

• Consider prefix only

  Show description for 1dfd2d4
  WoosukKwon

  committed
  1dfd2d4

• comment

  Show description for c47a449
  WoosukKwon

  committed
  c47a449

• Minor

  Show description for 34da6dd
  WoosukKwon

  committed
  34da6dd

• Add debug

  Show description for 03a2809
  WoosukKwon

  committed
  03a2809

• Fix

  Show description for bf94bfa
  WoosukKwon

  committed
  bf94bfa

• Add kernel test

  Show description for 350de8a
  WoosukKwon

  committed
  350de8a

• Add e2e test

  Show description for 8b3291d
  WoosukKwon

  committed
  8b3291d