Code

Lora scheduler#10840

Code

Draft

Scott-Hickmann wants to merge 17 commits intovllm-project:mainvllm-project/vllm:mainfrom Scott-Hickmann:lora-schedulerScott-Hickmann/vllm:lora-schedulerCopy head branch name to clipboard

+1,334-37

Commits

Commits on Dec 2, 2024

• Co-authored-by: Schwinn Saereesitthipitak <[email protected]>

  Scott-Hickmann

  committed
  08baaa1

• Basic scheduling and round robin

  Show description for db32bf2
  

  Scott-Hickmann

  and

  galletas1712

  committed
  db32bf2

• Gen rand loras

  Scott-Hickmann

  committed
  6e2d0c8

• Generate lora from garbage

  Scott-Hickmann

  committed
  e0c8676

• Functional generate rand loras

  Scott-Hickmann

  committed
  a8e5cf1

• Perfectly uniform scheduler

  Show description for 21f4783
  

  Scott-Hickmann

  and

  galletas1712

  committed
  21f4783

• Updated generate random loras

  Show description for 8cb13cb
  

  Scott-Hickmann

  and

  galletas1712

  committed
  8cb13cb

Commits on Dec 3, 2024

• Not working scheduler but working everything else

  Scott-Hickmann

  committed
  e09fc7c

• Working scheduler

  Scott-Hickmann

  committed
  9e88df0

Commits on Dec 4, 2024

• Atindra's distribution changes

  Scott-Hickmann

  committed
  067d9d8

• Collect metrics

  Scott-Hickmann

  committed
  9347878

• Plot metrics

  Scott-Hickmann

  committed
  38c298a

• Plots per distribution

  Scott-Hickmann

  committed
  5864af8

• Collect data into single csv with all parameters varied into

  Scott-Hickmann

  committed
  a6579b5

• More words

  Scott-Hickmann

  committed
  463a867

• Update benchmarks, cap scheduler

  Scott-Hickmann

  committed
  04bc72b

Commits on Dec 6, 2024

• Updated tests

  Scott-Hickmann

  committed
  c7e1d09