Code

[Model] Support for fairseq2 Llama#11442

Code

Merged

ywang96 merged 8 commits intovllm-project:mainvllm-project/vllm:mainfrom MartinGleize:fairseq2_llamaMartinGleize/vllm:fairseq2_llamaCopy head branch name to clipboardJan 19, 2025

+197-21

Commits

Commits on Jan 14, 2025

• Add support for Fairseq2's Llama

  Show description for 522b5fc
  MartinGleize

  committed
  522b5fc

  Copy full SHA for 522b5fc

• Remove unnecessary method override

  Show description for 27dda0b
  MartinGleize

  committed
  27dda0b

  Copy full SHA for 27dda0b

• Add support for tp-sharded checkpoints

  Show description for 2c91406
  

  mgleize user

  authored and

  MartinGleize

  committed
  2c91406

  Copy full SHA for 2c91406

• Shorter implementation

  Show description for d059e38
  MartinGleize

  committed
  d059e38

  Copy full SHA for d059e38

• Flag params with sharded weights to prevent narrowing in Llama loading

  Show description for 2441115
  MartinGleize

  committed
  2441115

  Copy full SHA for 2441115

• Add weight loading test for fairseq2

  Show description for 1e8d7d3
  MartinGleize

  committed
  1e8d7d3

  Copy full SHA for 1e8d7d3

Commits on Jan 19, 2025

• Improve check on sharded embedding shape

  Show description for fd42679
  MartinGleize

  committed
  fd42679

  Copy full SHA for fd42679

• Add model to test registry, one test was failing because of it

  Show description for 0c40d96
  MartinGleize

  committed
  0c40d96

  Copy full SHA for 0c40d96