Code

[DO NOT MERGE] Ibm dev rebased#10873

Code

Closed

prashantgupta24 wants to merge 152 commits intovllm-project:mainvllm-project/vllm:mainfrom opendatahub-io:ibm-dev-rebasedopendatahub-io/vllm:ibm-dev-rebasedCopy head branch name to clipboard

+8,413-3,790

Commits

Commits on Sep 27, 2024

• chore: add fork OWNERS

  

  z103cb

  authored and

  dtrifiro

  committed
  bfa692e

  Copy full SHA for bfa692e

• add ubi Dockerfile

  dtrifiro

  committed
  b96ffe3

  Copy full SHA for b96ffe3

• Dockerfile.ubi: remove references to grpc/protos

  dtrifiro

  committed
  acbab07

  Copy full SHA for acbab07

• Dockerfile.ubi: use vllm-tgis-adapter

  dtrifiro

  committed
  d54bfce

  Copy full SHA for d54bfce

• gha: add sync workflow

  dtrifiro

  committed
  8065d82

  Copy full SHA for 8065d82

• Dockerfile.ubi: use distributed-executor-backend=mp as default

  dtrifiro

  committed
  a5b5eb0

  Copy full SHA for a5b5eb0

• Dockerfile.ubi: remove vllm-nccl workaround

  Show description for cab1bac
  dtrifiro

  committed
  cab1bac

  Copy full SHA for cab1bac

• Dockerfile.ubi: add missing requirements-*.txt bind mounts

  dtrifiro

  committed
  7c65254

  Copy full SHA for 7c65254

• add triton CustomCacheManger

  Show description for 9f11204
  

  2 peopleauthored and

  dtrifiro

  committed
  9f11204

  Copy full SHA for 9f11204

• gha: sync-with-upstream workflow create PRs as draft

  dtrifiro

  committed
  8914a32

  Copy full SHA for 8914a32

• add smoke/unit tests scripts

  dtrifiro

  committed
  1f8b826

  Copy full SHA for 1f8b826

• extras: exit unit tests on err

  dtrifiro

  committed
  1beb801

  Copy full SHA for 1beb801

• Dockerfile.ubi: misc improvements

  Show description for b102823
  dtrifiro

  committed
  b102823

  Copy full SHA for b102823

• update OWNERS

  dtrifiro

  committed
  c5e1313

  Copy full SHA for c5e1313

• Dockerfile.ubi: use tensorizer (#64)

  Show description for ff1cc50
  

  prashantgupta24

  and

  dtrifiro

  committed
  ff1cc50

  Copy full SHA for ff1cc50

• Dockerfile.ubi: pin vllm-tgis-adapter to 0.1.2

  dtrifiro

  committed
  129720a

  Copy full SHA for 129720a

• gha: fix fetch step in upstream sync workflow

  dtrifiro

  committed
  ee779e6

  Copy full SHA for ee779e6

• gha: always update sync workflow PR body/title

  dtrifiro

  committed
  160ddb8

  Copy full SHA for 160ddb8

• Dockerfile.ubi: bump vllm-tgis-adapter to 0.1.3

  dtrifiro

  committed
  2478277

  Copy full SHA for 2478277

• Dockerfile.ubi: get rid of --distributed-executor-backend=mp

  Show description for 9dc4dd3
  dtrifiro

  committed
  9dc4dd3

  Copy full SHA for 9dc4dd3

• Dockerfile.ubi: add flashinfer

  dtrifiro

  committed
  96b598b

  Copy full SHA for 96b598b

• pin adapter to 2.0.0

  

  prashantgupta24

  authored and

  dtrifiro

  committed
  4d6fd09

  Copy full SHA for 4d6fd09

• deps: bump flashinfer to 0.0.9

  dtrifiro

  committed
  ef7738d

  Copy full SHA for ef7738d

• Update OWNERS with IBM folks

  

  heyselbi

  authored and

  dtrifiro

  committed
  3972a7d

  Copy full SHA for 3972a7d

• Dockerfile.ubi: bind mount .git dir to allow inclusion of git commit hash

  dtrifiro

  committed
  9bac7b9

  Copy full SHA for 9bac7b9

• gha: remove reminder_comment

  dtrifiro

  committed
  97d24e4

  Copy full SHA for 97d24e4

• Dockerfile: bump vllm-tgis-adapter to 0.2.1

  dtrifiro

  committed
  c4aa1e3

  Copy full SHA for c4aa1e3

• fix: update setup.py to differentiate between fork and upstream

  Show description for e856dd3
  

  nathan-weinberg

  authored and

  dtrifiro

  committed
  e856dd3

  Copy full SHA for e856dd3

• Dockerfile.ubi: properly mount .git dir

  dtrifiro

  committed
  8ac5afb

  Copy full SHA for 8ac5afb

• Revert "[CI/Build] fix: update setup.py to differentiate between fork and upstream"

  dtrifiro

  committed
  58cbebb

  Copy full SHA for 58cbebb

• Dockerfile.ubi: bump vllm-tgis-adapter to 0.2.2

  dtrifiro

  committed
  d5373dd

  Copy full SHA for d5373dd

• gha: remove unused upstream workflows

  dtrifiro

  committed
  013813d

  Copy full SHA for 013813d

• deps: bump vllm-tgis-adapter to 0.2.3

  dtrifiro

  committed
  53f9489

  Copy full SHA for 53f9489

• Dockerfile.ubi: get rid of custom cache manager

  Show description for 0a20a57
  dtrifiro

  committed
  0a20a57

  Copy full SHA for 0a20a57

• Dockerfile.ubi: add missing dependency

  dtrifiro

  committed
  d67d8f7

  Copy full SHA for d67d8f7

• deps: bump vllm-tgis-adapter to 0.3.0

  dtrifiro

  committed
  dfe980d

  Copy full SHA for dfe980d

• Dockerfile.ubi: force using python-installed cuda runtime libraries

  dtrifiro

  committed
  c002b3f

  Copy full SHA for c002b3f

• Dockerfile: use uv pip everywhere (it's faster)

  dtrifiro

  committed
  857e618

  Copy full SHA for 857e618

• Dockerfile.ubi: bump flashinfer to 0.1.2

  dtrifiro

  committed
  75adb8a

  Copy full SHA for 75adb8a

• feat: allow long max seq length

  Show description for ce5c1bb
  

  tjohnson31415

  authored and

  dtrifiro

  committed
  ce5c1bb

  Copy full SHA for ce5c1bb

• smoke test: kill server on timeout

  dtrifiro

  committed
  94625bd

  Copy full SHA for 94625bd

• Dockerfile.ubi: set vllm_tgis_adapter unicorn log level to warning

  dtrifiro

  committed
  5c90a8b

  Copy full SHA for 5c90a8b

• fix: enable logprobs during spec decoding by default

  Show description for fe77683
  

  tjohnson31415

  authored and

  dtrifiro

  committed
  fe77683

  Copy full SHA for fe77683

• deps: bump vllm-tgis-adapter to 0.4.0 (#132)

  Show description for 3c5d24c
  

  vaibhavjainwiz

  authored and

  dtrifiro

  committed
  3c5d24c

  Copy full SHA for 3c5d24c

• Disable usage tracking

  Show description for a24dfae
  

  stevegrubb

  authored and

  dtrifiro

  committed
  a24dfae

  Copy full SHA for a24dfae

• Start by updating the image

  Show description for 6acc54f
  

  stevegrubb

  authored and

  dtrifiro

  committed
  6acc54f

  Copy full SHA for 6acc54f

• Update ROCm build for UBI

  

  Xaenalt

  authored and

  dtrifiro

  committed
  6d60952

  Copy full SHA for 6d60952

• Add sample chat template into vLLM container

  

  vaibhavjainwiz

  authored and

  dtrifiro

  committed
  d218479

  Copy full SHA for d218479

• Harden build of libsodium

  Show description for c7872e9
  

  stevegrubb

  authored and

  dtrifiro

  committed
  c7872e9

  Copy full SHA for c7872e9

• Update Dockerfile.ubi

  Show description for 09d0994
  

  RH-steve-grubb

  authored and

  dtrifiro

  committed
  09d0994

  Copy full SHA for 09d0994

• Update OWNERS file

  

  vaibhavjainwiz

  authored and

  dtrifiro

  committed
  9041883

  Copy full SHA for 9041883

• Dockerfile.rocm.ubi: cleanup

  Show description for d3f06b5
  dtrifiro

  committed
  d3f06b5

  Copy full SHA for d3f06b5

• add vllm-tgis-adapter layer

  dtrifiro

  committed
  3cc6ea4

  Copy full SHA for 3cc6ea4

• Dockerfile.ubi: bump python to 3.12

  dtrifiro

  committed
  b30f9ed

  Copy full SHA for b30f9ed

• Dockerfile.ubi: bump flashinfer to 0.1.6

  dtrifiro

  committed
  8238489

  Copy full SHA for 8238489

• Dockerfile.rocm.ubi: do not use nightly pytorch_triton

  dtrifiro

  committed
  67080c2

  Copy full SHA for 67080c2

• Dockerfile.ubi: fix PYTHON_VERSION arg usage

  Show description for 010c1bd
  dtrifiro

  committed
  010c1bd

  Copy full SHA for 010c1bd

• Dockerfile.rocm.ubi: move microdnf update in base stage

  dtrifiro

  committed
  f91432f

  Copy full SHA for f91432f

• Dockerfile.rocm.ubi: bump torch version to 2.5.0.dev20240912+rocm6.1

  dtrifiro

  committed
  b1b179f

  Copy full SHA for b1b179f

• Dockerfile.rocm.ubi: get rid of build triton stage

  Show description for cd4b748
  dtrifiro

  committed
  cd4b748

  Copy full SHA for cd4b748

• Dockerfile.rocm.ubi: add setuptools-scm build dependency

  dtrifiro

  committed
  38247ba

  Copy full SHA for 38247ba

• Dockerfile.ubi: add VLLM_FA_CMAKE_GPU_ARCHES

  dtrifiro

  committed
  451470c

  Copy full SHA for 451470c

• Dockerfile.ubi: use COPY . . to make repo available when building wheel

  dtrifiro

  committed
  81a8400

  Copy full SHA for 81a8400

• This sets the vllm build to a Release build type, builds libsodium,

  Show description for ec1f663
  

  stevegrubb

  authored and

  dtrifiro

  committed
  ec1f663

  Copy full SHA for ec1f663

• Move libsodium install

  Show description for d16bf47
  

  stevegrubb

  authored and

  dtrifiro

  committed
  d16bf47

  Copy full SHA for d16bf47

• Correct logging directory permissions

  Show description for f63fbdd
  

  stevegrubb

  authored and

  dtrifiro

  committed
  f63fbdd

  Copy full SHA for f63fbdd

• bump tgis adapter to v0.5.0

  

  NickLucche

  authored and

  dtrifiro

  committed
  902985d

  Copy full SHA for 902985d

Commits on Sep 30, 2024

• Dockerfile.ubi: remove adag dependency

  dtrifiro

  committed
  271763a

  Copy full SHA for 271763a

Commits on Oct 1, 2024

• bump tgis adapter to v0.5.1

  

  NickLucche

  authored and

  dtrifiro

  committed
  9adefcf

  Copy full SHA for 9adefcf

Commits on Oct 4, 2024

• Retrigger build

  Show description for b5aab06
  vaibhavjainwiz

  committed
  b5aab06

  Copy full SHA for b5aab06

• Merge pull request #179 from vaibhavjainwiz/retirgger_build

  Show description for 6a5d85f
  vaibhavjainwiz

  authored
  6a5d85f

  Copy full SHA for 6a5d85f

Commits on Oct 8, 2024

• add rsync to UBI images

  Show description for e141de1
  maxdebayser

  committed
  e141de1

  Copy full SHA for e141de1

Commits on Oct 14, 2024

• bump adapter to 0.5.2

  Show description for 0728fe4
  

  prashantgupta24

  authored and

  dtrifiro

  committed
  0728fe4

  Copy full SHA for 0728fe4

• bump adapter to 0.5.2

  

  prashantgupta24

  authored and

  dtrifiro

  committed
  7f844dc

  Copy full SHA for 7f844dc

Commits on Oct 15, 2024

• Sync with upstream @ v0.6.3

  dtrifiro

  committed
  1b2c224

  Copy full SHA for 1b2c224

• gha: remove sync with upstream workflow

  dtrifiro

  committed
  4df356c

  Copy full SHA for 4df356c

• bump vllm-tgis-adapter to 0.5.3 (#199)

  prashantgupta24

  authored
  62b70d8

  Copy full SHA for 62b70d8

• Merge pull request #201 from dtrifiro/sync-with-0.6.3

  Show description for e14c041
  dtrifiro

  authored
  e14c041

  Copy full SHA for e14c041

Commits on Oct 16, 2024

• Dockerfile*.ubi: install vllm and vllm-tgis-adapter in the same step to make sure the correct version is installed

  dtrifiro

  committed
  134c042

  Copy full SHA for 134c042

Commits on Oct 18, 2024

• github: remove ISSUE/PR templates

  dtrifiro

  committed
  0b6aa72

  Copy full SHA for 0b6aa72

Commits on Oct 23, 2024

• Update Dockerfile.rocm.ubi

  Show description for 58a20b7
  

  joerunde

  and

  dtrifiro

  authored
  58a20b7

  Copy full SHA for 58a20b7

• Merge branch 'main' into add_rsync

  joerunde

  authored
  aaab125

  Copy full SHA for aaab125

• Merge pull request #183 from maxdebayser/add_rsync

  Show description for 1db869a
  joerunde

  authored
  1db869a

  Copy full SHA for 1db869a

Commits on Oct 24, 2024

• Dockerfile.ubi: add env vars to prevent nbumba/outlines errors

  dtrifiro

  committed
  854cc79

  Copy full SHA for 854cc79

Commits on Nov 4, 2024

• Dockerfile.rocm.ubi: add --mount=type=cache to final pip install

  dtrifiro

  committed
  2b36599

  Copy full SHA for 2b36599

• Dockerfile.rocm.ubi: bump ROCm to 6.2.3

  dtrifiro

  committed
  9ca32ce

  Copy full SHA for 9ca32ce

• CMakeLists.txt: bump TORCH_SUPPORTED_VERSION_ROCM to 2.6.0

  dtrifiro

  committed
  92fd6a8

  Copy full SHA for 92fd6a8

• make packages explicit

  dtrifiro

  committed
  047c72a

  Copy full SHA for 047c72a

• libsodium: use -j$(nproc)

  dtrifiro

  committed
  00b49a4

  Copy full SHA for 00b49a4

• Dockerfile.ubi: cleanup flashattention build process

  dtrifiro

  committed
  5c2ae9f

  Copy full SHA for 5c2ae9f

• get rid of .github dir

  dtrifiro

  committed
  305186b

  Copy full SHA for 305186b

• add symlink to libroctx before starting vllm build

  dtrifiro

  committed
  655a28c

  Copy full SHA for 655a28c

• cleanup space

  dtrifiro

  committed
  4838a72

  Copy full SHA for 4838a72

• cleanup LD_LIBRARY_PATH usage

  dtrifiro

  committed
  f89b422

  Copy full SHA for f89b422

Commits on Nov 8, 2024

• Sync with [email protected]

  dtrifiro

  committed
  3f4e5bf

  Copy full SHA for 3f4e5bf

• Merge pull request #225 from dtrifiro/sync-with-0.6.3.post1

  Show description for 39c8fe0
  dtrifiro

  authored
  39c8fe0

  Copy full SHA for 39c8fe0

Commits on Nov 11, 2024

• Dockerfile.rocm.ubi: bump ROCm to 6.2.4

  dtrifiro

  committed
  460e2b3

  Copy full SHA for 460e2b3

• Dockerfile.rocm.ubi: bump torch to 20241107 nightly

  dtrifiro

  committed
  2ce32ad

  Copy full SHA for 2ce32ad

• Dockerfile.rocm.ubi: reduce image size by getting rid of system rocm

  Show description for b7d149b
  dtrifiro

  committed
  b7d149b

  Copy full SHA for b7d149b

• Dockerfile.rocm.ubi: install libdrm-amdgpu to avoid avoid errors when retrieving device information

  Show description for 9dfe77a
  dtrifiro

  committed
  9dfe77a

  Copy full SHA for 9dfe77a

• Dockerfile.rocm.ubi: add hsa-rocr-devel dependency

  dtrifiro

  committed
  227f802

  Copy full SHA for 227f802

• use PYTHON_VERSION arg where required

  dtrifiro

  committed
  3fc45d1

  Copy full SHA for 3fc45d1

Commits on Nov 13, 2024

• slim down final image

  dtrifiro

  committed
  bc65c0e

  Copy full SHA for bc65c0e

• Dockerfile.rocm.ubi: use BASE_UBI_IMAGE_TAG in AMD repo URL

  dtrifiro

  committed
  fbaab94

  Copy full SHA for fbaab94

• Dockerfile.rocm.ubi: make sure the venv's torch libraries are available

  Show description for 1024f99
  dtrifiro

  committed
  1024f99

  Copy full SHA for 1024f99

Commits on Nov 21, 2024

• Dockerfile.rocm.ubi: use composable kernel flash attention implementation

  dtrifiro

  committed
  b84363b

  Copy full SHA for b84363b

• Dockerfile.rocm.ubi: rollback to ROCm 6.2.3 (6.2.4 installation fails)

  dtrifiro

  committed
  e030ba2

  Copy full SHA for e030ba2

Commits on Nov 27, 2024

• Sync with [email protected]

  dtrifiro

  committed
  9a3f1ac

  Copy full SHA for 9a3f1ac

• Merge pull request #235 from dtrifiro/sync-with-0.6.4.post1

  Show description for 86932d7
  dtrifiro

  authored
  86932d7

  Copy full SHA for 86932d7

• extras: silence shellcheck complaint

  dtrifiro

  committed
  f835f2e

  Copy full SHA for f835f2e

Commits on Dec 2, 2024

• Dockerfile*.ubi: fix permissions for vllm user, cleanup

  dtrifiro

  committed
  997095b

  Copy full SHA for 997095b

Commits on Dec 3, 2024

• [Docs] Add Nebius as sponsors (vllm-project#10371)

  Show description for 42d3a81
  

  simon-mo

  authored and

  prashantgupta24

  committed
  42d3a81

  Copy full SHA for 42d3a81

• [Frontend] Add --version flag to CLI (vllm-project#10369)

  Show description for a18c4fb
  

  russellb

  authored and

  prashantgupta24

  committed
  a18c4fb

  Copy full SHA for a18c4fb

• [Doc] Move PR template content to docs (vllm-project#10159)

  Show description for 067dd2b
  

  russellb

  authored and

  prashantgupta24

  committed
  067dd2b

  Copy full SHA for 067dd2b

• [Docs] Misc updates to TPU installation instructions (vllm-project#10165)

  

  mikegre-google

  authored and

  prashantgupta24

  committed
  82be00f

  Copy full SHA for 82be00f

• [Frontend] Automatic detection of chat content format from AST (vllm-project#9919)

  Show description for 2ca5912
  

  DarkLight1337

  authored and

  prashantgupta24

  committed
  2ca5912

  Copy full SHA for 2ca5912

• [doc] add doc for the plugin system (vllm-project#10372)

  Show description for ea480a1
  

  youkaichao

  authored and

  prashantgupta24

  committed
  ea480a1

  Copy full SHA for ea480a1

• [misc][plugin] improve log messages (vllm-project#10386)

  Show description for 2e453bc
  

  youkaichao

  authored and

  prashantgupta24

  committed
  2e453bc

  Copy full SHA for 2e453bc

• [BugFix] [Kernel] Fix GPU SEGV occuring in fused_moe kernel (vllm-project#10385)

  Show description for 51813a4
  

  rasmith

  authored and

  prashantgupta24

  committed
  51813a4

  Copy full SHA for 51813a4

• [Misc] Update benchmark to support image_url file or http (vllm-project#10287)

  Show description for 6c45f56
  

  kakao-steve-ai

  authored and

  prashantgupta24

  committed
  6c45f56

  Copy full SHA for 6c45f56

• [Misc] Medusa supports custom bias (vllm-project#10361)

  

  skylee-01

  authored and

  prashantgupta24

  committed
  d93bde9

  Copy full SHA for d93bde9

• [Bugfix] Fix M-RoPE position calculation when chunked prefill is enabled (vllm-project#10388)

  Show description for 068451f
  

  imkero

  authored and

  prashantgupta24

  committed
  068451f

  Copy full SHA for 068451f

• [V1] Add code owners for V1 (vllm-project#10397)

  Show description for d49dacb
  

  WoosukKwon

  authored and

  prashantgupta24

  committed
  d49dacb

  Copy full SHA for d49dacb

• [2/N][torch.compile] make compilation cfg part of vllm cfg (vllm-project#10383)

  Show description for 11d2bbc
  

  youkaichao

  authored and

  prashantgupta24

  committed
  11d2bbc

  Copy full SHA for 11d2bbc

• [V1] Refactor model executable interface for all text-only language models (vllm-project#10374)

  Show description for 2ea854d
  

  ywang96

  authored and

  prashantgupta24

  committed
  2ea854d

  Copy full SHA for 2ea854d

• [CI/Build] Fix IDC hpu [Device not found] issue (vllm-project#10384)

  Show description for 2652ea1
  

  xuechendi

  authored and

  prashantgupta24

  committed
  2652ea1

  Copy full SHA for 2652ea1

• [Bugfix][CPU] Fix CPU embedding runner with tensor parallel (vllm-project#10394)

  Show description for 47325d5
  

  Isotr0py

  authored and

  prashantgupta24

  committed
  47325d5

  Copy full SHA for 47325d5

• [platforms] refactor cpu code (vllm-project#10402)

  Show description for e288d72
  

  youkaichao

  authored and

  prashantgupta24

  committed
  e288d72

  Copy full SHA for e288d72

• [Hardware] [HPU]add mark_step for hpu (vllm-project#10239)

  Show description for f6dc8be
  

  jikunshang

  authored and

  prashantgupta24

  committed
  f6dc8be

  Copy full SHA for f6dc8be

• [Bugfix] Fix mrope_position_delta in non-last prefill chunk (vllm-project#10403)

  Show description for dcccc62
  

  imkero

  authored and

  prashantgupta24

  committed
  dcccc62

  Copy full SHA for dcccc62

• [Misc] Enhance offline_inference to support user-configurable paramet… (vllm-project#10392)

  Show description for d97d269
  

  wchen61

  authored and

  prashantgupta24

  committed
  d97d269

  Copy full SHA for d97d269

• [Misc] Add uninitialized params tracking for AutoWeightsLoader (vllm-project#10327)

  Show description for d3fe99b
  

  Isotr0py

  authored and

  prashantgupta24

  committed
  d3fe99b

  Copy full SHA for d3fe99b

• [Bugfix] Ignore ray reinit error when current platform is ROCm or XPU (vllm-project#10375)

  Show description for 1f165b6
  

  HollowMan6

  authored and

  prashantgupta24

  committed
  1f165b6

  Copy full SHA for 1f165b6

• [4/N][torch.compile] clean up set_torch_compile_backend (vllm-project#10401)

  Show description for 56b9c49
  

  youkaichao

  authored and

  prashantgupta24

  committed
  56b9c49

  Copy full SHA for 56b9c49

• [VLM] Report multi_modal_placeholders in output (vllm-project#10407)

  Show description for 663fb57
  

  lk-chen

  authored and

  prashantgupta24

  committed
  663fb57

  Copy full SHA for 663fb57

• [Model] Remove redundant softmax when using PoolingType.STEP (vllm-project#10415)

  

  Maybewuss

  authored and

  prashantgupta24

  committed
  3c64fbb

  Copy full SHA for 3c64fbb

• [Model][LoRA]LoRA support added for glm-4v (vllm-project#10418)

  Show description for 20ea0c3
  

  B-201

  authored and

  prashantgupta24

  committed
  20ea0c3

  Copy full SHA for 20ea0c3

• [Model] Remove transformers attention porting in VITs (vllm-project#10414)

  Show description for b1d6a6a
  

  Isotr0py

  authored and

  prashantgupta24

  committed
  b1d6a6a

  Copy full SHA for b1d6a6a

• [Doc] Update doc for LoRA support in GLM-4V (vllm-project#10425)

  Show description for 5d6df78
  

  B-201

  authored and

  prashantgupta24

  committed
  5d6df78

  Copy full SHA for 5d6df78

• [5/N][torch.compile] torch.jit.script --> torch.compile (vllm-project#10406)

  Show description for b4c641f
  

  youkaichao

  authored and

  prashantgupta24

  committed
  b4c641f

  Copy full SHA for b4c641f

• [Doc] Add documentation for Structured Outputs (vllm-project#9943)

  Show description for c973945
  

  ismael-dm

  authored and

  prashantgupta24

  committed
  c973945

  Copy full SHA for c973945

• Fix open_collective value in FUNDING.yml (vllm-project#10426)

  Show description for e19e15a
  

  andrew

  authored and

  prashantgupta24

  committed
  e19e15a

  Copy full SHA for e19e15a

• [Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)

  Show description for a00d8c1
  

  mgoin

  authored and

  prashantgupta24

  committed
  a00d8c1

  Copy full SHA for a00d8c1

• [Hardware][XPU] AWQ/GPTQ support for xpu backend (vllm-project#10107)

  Show description for 472b9cf
  

  yma11

  authored and

  prashantgupta24

  committed
  472b9cf

  Copy full SHA for 472b9cf

• [Kernel] Explicitly specify other value in tl.load calls (vllm-project#9014)

  Show description for 9147b76
  

  angusYuhao

  authored and

  prashantgupta24

  committed
  9147b76

  Copy full SHA for 9147b76

• [Kernel] Initial Machete W4A8 support + Refactors (vllm-project#9855)

  Show description for ce83e18
  

  LucasWilkinson

  authored and

  prashantgupta24

  committed
  ce83e18

  Copy full SHA for ce83e18

• Squash 9522

  Show description for bf5bf24
  

  fialhocoelho

  authored and

  prashantgupta24

  committed
  bf5bf24

  Copy full SHA for bf5bf24

• Squash 6357

  Show description for 8b27172
  

  fialhocoelho

  authored and

  prashantgupta24

  committed
  8b27172

  Copy full SHA for 8b27172

• Squash 10235

  Show description for e8fcdee
  

  fialhocoelho

  authored and

  prashantgupta24

  committed
  e8fcdee

  Copy full SHA for e8fcdee

• Squash 10400

  Show description for 1e7f586
  

  fialhocoelho

  authored and

  prashantgupta24

  committed
  1e7f586

  Copy full SHA for 1e7f586

• Squash 10430

  Show description for 09f5b4a
  

  fialhocoelho

  authored and

  prashantgupta24

  committed
  09f5b4a

  Copy full SHA for 09f5b4a

• pin mistral and install adapter from branch 🚀

  Show description for 33c1553
  

  fialhocoelho

  authored and

  prashantgupta24

  committed
  33c1553

  Copy full SHA for 33c1553