Code

Add VLLM support for LM and CHAT#3

Code

Merged

ixaxaar merged 8 commits intomastergeniusrise/text:masterfrom feat/vllmgeniusrise/text:feat/vllmCopy head branch name to clipboardFeb 24, 2024

+1,005-40

Commits

Commits on Feb 21, 2024

• add vllm to chat

  ixaxaar

  committed
  3db92a6

• fix single thread inference

  ixaxaar

  committed
  daf6ae4

Commits on Feb 22, 2024

• vllm api working

  ixaxaar

  committed
  e3f6a7e

• vllm bulk working

  ixaxaar

  committed
  24761b3

• vllm bulk working

  ixaxaar

  committed
  7f79718

• add docs

  ixaxaar

  committed
  2d9fd00

Commits on Feb 23, 2024

• vllm lm api

  ixaxaar

  committed
  8cdcee3

Commits on Feb 24, 2024

• add vllm to lm

  ixaxaar

  committed
  1540162