Code

[V1] Prefix caching (take 2)#9972

Code

Merged

WoosukKwon merged 18 commits intovllm-project:mainvllm-project/vllm:mainfrom comaniac:v1_prefix_caching_retrycomaniac/vllm:v1_prefix_caching_retryCopy head branch name to clipboardNov 8, 2024

+771-66

Commits

Commits on Nov 8, 2024

• wip

  Show description for 0dbfc83
  comaniac

  committed
  0dbfc83

• wip

  Show description for 00ee8c4
  comaniac

  committed
  00ee8c4

• work

  Show description for ad3126b
  comaniac

  committed
  ad3126b

• fix

  Show description for 853365b
  comaniac

  committed
  853365b

• fix

  Show description for fb5bcd9
  comaniac

  committed
  fb5bcd9

• refactor

  Show description for 4227342
  comaniac

  committed
  4227342

• async

  Show description for 0f31dfa
  comaniac

  committed
  0f31dfa

• fix

  Show description for bd09754
  comaniac

  committed
  bd09754

• format

  Show description for 01e907c
  comaniac

  committed
  01e907c

• test

  Show description for 73e4273
  comaniac

  committed
  73e4273

• fix example

  Show description for 64830a6
  comaniac

  committed
  64830a6

• fix allocation est

  Show description for c198a9c
  comaniac

  committed
  c198a9c

• dll

  Show description for a85ad98
  comaniac

  committed
  a85ad98

• fix

  Show description for bd56a8c
  comaniac

  committed
  bd56a8c

• test

  Show description for c21b24b
  comaniac

  committed
  c21b24b

• comment

  Show description for 925069d
  comaniac

  committed
  925069d

• index using block

  Show description for 33cacf9
  comaniac

  committed
  33cacf9

• comments

  Show description for 9c56442
  comaniac

  committed
  9c56442