Code

Zhn/fish e2e merge#11426

Code

Draft

niuzheng168 wants to merge 70 commits intovllm-project:mainvllm-project/vllm:mainfrom niuzheng168:zhn/fish-e2e-mergeniuzheng168/vllm:zhn/fish-e2e-mergeCopy head branch name to clipboard

+2,488-79

Commits

Commits on Jul 7, 2024

• init

  niuzheng168

  committed
  4cc189a

• Merge branch 'main' of https://github.com/vllm-project/vllm

  niuzheng168

  committed
  b90de40

Commits on Jul 8, 2024

• foward logits

  

  Zheng Niu

  committed
  0ec7803

Commits on Jul 9, 2024

• foward logits

  

  Zheng Niu

  committed
  43e9214

Commits on Jul 10, 2024

• update

  

  Ubuntu

  committed
  41e1655

• genrate multihead output token

  

  Zheng Niu

  committed
  9c4be7b

Commits on Jul 11, 2024

• update spk_emb

  

  root

  committed
  d488634

• fix bug

  

  Zheng Niu

  committed
  3cad09b

Commits on Jul 12, 2024

• add output hiddens

  

  Zheng Niu

  committed
  1bf42a2

• add output hiddens

  

  Zheng Niu

  committed
  2918e8b

Commits on Jul 13, 2024

• add async

  

  Zheng Niu

  committed
  d1f961f

Commits on Jul 14, 2024

• add spk emb

  

  Zheng Niu

  committed
  9a86ee8

Commits on Jul 15, 2024

• Merge branch 'vllm-project:main' into main

  niuzheng168

  authored
  c9cc8f9

• add benchmark

  

  Zheng Niu

  committed
  693c2d9

• Merge branch 'main' of https://github.com/niuzheng168/vllm

  

  Zheng Niu

  committed
  0f79d54

• add benchmark

  

  Zheng Niu

  committed
  90802c5

Commits on Jul 16, 2024

• remove weight norm

  

  Ubuntu

  committed
  a632185

• VocabParallelEmbedding

  

  Ubuntu

  committed
  3e127db

Commits on Jul 29, 2024

• use base64

  

  Ubuntu

  committed
  b8c94af

Commits on Aug 20, 2024

• merge main

  

  Ubuntu

  committed
  2185376

• merge main

  

  Ubuntu

  committed
  bd0fc4f

• fix merge

  

  Ubuntu

  committed
  a0acc44

Commits on Aug 21, 2024

• fix merge main

  

  Ubuntu

  committed
  cea25d2

• fix merge

  

  Ubuntu

  committed
  43252d9

• Merge pull request #2 from niuzheng168/vllm-project-main

  Show description for 0666697
  niuzheng168

  authored
  0666697

Commits on Aug 30, 2024

• fix broken llama

  

  Ubuntu

  committed
  dbf5f67

• fix broken llama

  

  Ubuntu

  committed
  7e98539

• fix break

  niuzheng168

  committed
  eff2cf0

Commits on Aug 31, 2024

• seperate emb

  niuzheng168

  committed
  350a758

• fix catpure run

  niuzheng168

  committed
  4b26392

Commits on Sep 3, 2024

• support output hidden

  niuzheng168

  committed
  df4ba99

Commits on Sep 4, 2024

• Enable repetition_penalties maybe work??

  niuzheng168

  committed
  ceea94d

Commits on Sep 5, 2024

• implement multihead sampler

  niuzheng168

  committed
  74a2edd

Commits on Sep 6, 2024

• for xptts

  niuzheng168

  committed
  76195a5

• fix llama

  niuzheng168

  committed
  91fea92

Commits on Sep 9, 2024

• fp32 done

  niuzheng168

  committed
  5c9d4a7

• update tokenizer

  

  Zheng Niu

  committed
  1eee089

• fix batch greater than 1

  niuzheng168

  committed
  7636836

Commits on Sep 10, 2024

• fix capture bug

  niuzheng168

  committed
  ee811bb

• update benchmark code

  niuzheng168

  committed
  a63f012

• update logits for first 2 tokens

  

  Zheng Niu

  committed
  120693a

• undo usless changes

  

  Zheng Niu

  committed
  b37a431

• undo usless changes

  

  Zheng Niu

  committed
  0e6701f

• Merge remote-tracking branch 'upstream/main' into fish_merge

  niuzheng168

  committed
  c6d051d

• fix merge failures for fish

  niuzheng168

  committed
  a620e33

• NOT FINISHED: num_scheduler_steps for multi head sampler

  niuzheng168

  committed
  52d49d4

Commits on Sep 12, 2024

• another fix

  niuzheng168

  committed
  2b53f49

Commits on Sep 13, 2024

• non fused mlp

  niuzheng168

  committed
  e2dbf85

• overall good, only kernal issue now

  niuzheng168

  committed
  64d8f54

• fix bug

  niuzheng168

  committed
  b79d49b

• udpate

  niuzheng168

  committed
  44fe04f

• fix bug

  niuzheng168

  committed
  bac660b

Commits on Sep 19, 2024

• clean up

  niuzheng168

  committed
  d1210e4

• cleanup

  niuzheng168

  committed
  c34c64f

• Merge pull request #3 from niuzheng168/fish_merge

  Show description for d91f9c7
  niuzheng168

  authored
  d91f9c7

• clean code

  niuzheng168

  committed
  9017387

• clean code

  niuzheng168

  committed
  a6321bd

• Merge pull request #4 from niuzheng168/fish_merge

  Show description for 069b591
  niuzheng168

  authored
  069b591

• Merge branch 'main' into dev

  niuzheng168

  committed
  985f54c

Commits on Sep 20, 2024

• replace torch layer to vllm layers

  niuzheng168

  committed
  9dd86bd

Commits on Sep 24, 2024

• optimize chattts convert code

  niuzheng168

  committed
  26a0169

Commits on Sep 26, 2024

• optimize chattts convert code

  niuzheng168

  committed
  00255ef

Commits on Sep 27, 2024

• e2e streaming

  

  Zheng Niu

  committed
  4ae3509

Commits on Sep 29, 2024

• update

  

  Zheng Niu

  committed
  1eadf24

Commits on Sep 30, 2024

• try add trt

  

  Zheng Niu

  committed
  06244eb

• trt work

  

  Zheng Niu

  committed
  d8f9a59

Commits on Dec 19, 2024

• Merge remote-tracking branch 'upstream/main' into zhn/fish-e2e-merge

  

  Zheng Niu

  committed
  0731554

• fish_tts_changes

  

  Zheng Niu

  committed
  81e66fb

Commits on Dec 23, 2024

• make e2e work after merge

  niuzheng168

  committed
  a2c67c3

• make e2e work after merge

  niuzheng168

  committed
  4d53ec8