Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DO NOT MERGE] Ibm dev rebased #10873

Closed
wants to merge 152 commits into from
Closed

[DO NOT MERGE] Ibm dev rebased #10873

wants to merge 152 commits into from

Conversation

prashantgupta24
Copy link
Contributor

@prashantgupta24 prashantgupta24 commented Dec 3, 2024 •
edited by github-actions bot
Loading

No description provided.

z103cb and others added 30 commits September 27, 2024 17:14
@z103cb @dtrifiro
chore: add fork OWNERS
bfa692e
@dtrifiro
add ubi Dockerfile
b96ffe3
@dtrifiro
Dockerfile.ubi: remove references to grpc/protos
acbab07
@dtrifiro
Dockerfile.ubi: use vllm-tgis-adapter
d54bfce
@dtrifiro
gha: add sync workflow
8065d82
@dtrifiro
Dockerfile.ubi: use distributed-executor-backend=mp as default
a5b5eb0
@dtrifiro
Dockerfile.ubi: remove vllm-nccl workaround
cab1bac 
Fixed upstream in vllm-project#5091
@dtrifiro
Dockerfile.ubi: add missing requirements-*.txt bind mounts
7c65254
@tdoublep @cyang49 @dtrifiro
add triton CustomCacheManger
9f11204 
fixes RHOAIENG-8043

Co-authored-by: Chih-Chieh-Yang <[email protected]>
Signed-off-by: Thomas Parnell <[email protected]>
@dtrifiro
gha: sync-with-upstream workflow create PRs as draft
8914a32
@dtrifiro
add smoke/unit tests scripts
1f8b826
@dtrifiro
extras: exit unit tests on err
1beb801
@dtrifiro
Dockerfile.ubi: misc improvements
b102823 
- get rid cuda-devel stage, use cuda 12.4
- add build flags
- remove useless installs
@dtrifiro
update OWNERS
c5e1313
@prashantgupta24 @dtrifiro
Dockerfile.ubi: use tensorizer (#64)
ff1cc50 
add libsodium for tensorizer encryption

---------

Signed-off-by: Prashant Gupta <[email protected]>
Co-authored-by: Daniele <[email protected]>
@dtrifiro
Dockerfile.ubi: pin vllm-tgis-adapter to 0.1.2
129720a
@dtrifiro
gha: fix fetch step in upstream sync workflow
ee779e6
@dtrifiro
gha: always update sync workflow PR body/title
160ddb8
@dtrifiro
Dockerfile.ubi: bump vllm-tgis-adapter to 0.1.3
2478277
@dtrifiro
Dockerfile.ubi: get rid of --distributed-executor-backend=mp
9dc4dd3 
this is the default when `--worker-use-ray` is not provided and
world-size > 1
@dtrifiro
Dockerfile.ubi: add flashinfer
96b598b
@prashantgupta24 @dtrifiro
pin adapter to 2.0.0
4d6fd09
@dtrifiro
deps: bump flashinfer to 0.0.9
ef7738d
@heyselbi @dtrifiro
Update OWNERS with IBM folks
3972a7d
@dtrifiro
Dockerfile.ubi: bind mount .git dir to allow inclusion of git commit …
9bac7b9 
…hash
@dtrifiro
gha: remove reminder_comment
97d24e4
@dtrifiro
Dockerfile: bump vllm-tgis-adapter to 0.2.1
c4aa1e3
@nathan-weinberg @dtrifiro
fix: update setup.py to differentiate between fork and upstream
e856dd3 
Signed-off-by: Nathan Weinberg <[email protected]>
@dtrifiro
Dockerfile.ubi: properly mount .git dir
8ac5afb
@dtrifiro
Revert "[CI/Build] fix: update setup.py to differentiate between fork…
58cbebb 
… and upstream"
youkaichao and others added 25 commits December 3, 2024 10:39
@youkaichao @prashantgupta24
[platforms] refactor cpu code (vllm-project#10402)
e288d72 
Signed-off-by: youkaichao <[email protected]>
@jikunshang @prashantgupta24
[Hardware] [HPU]add mark_step for hpu (vllm-project#10239)
f6dc8be 
Signed-off-by: Kunshang Ji <[email protected]>
@imkero @prashantgupta24
[Bugfix] Fix mrope_position_delta in non-last prefill chunk (vllm-pro…
dcccc62 
…ject#10403)

Signed-off-by: imkero <[email protected]>
@wchen61 @prashantgupta24
[Misc] Enhance offline_inference to support user-configurable paramet… (
d97d269 
vllm-project#10392)

Signed-off-by: wchen61 <[email protected]>
@Isotr0py @prashantgupta24
[Misc] Add uninitialized params tracking for AutoWeightsLoader (vll…
d3fe99b 
…m-project#10327)

Signed-off-by: Isotr0py <[email protected]>
@HollowMan6 @prashantgupta24
[Bugfix] Ignore ray reinit error when current platform is ROCm or XPU (…
1f165b6 
…vllm-project#10375)

Signed-off-by: Hollow Man <[email protected]>
@youkaichao @prashantgupta24
[4/N][torch.compile] clean up set_torch_compile_backend (vllm-project…
56b9c49 
…#10401)

Signed-off-by: youkaichao <[email protected]>
@lk-chen @prashantgupta24
[VLM] Report multi_modal_placeholders in output (vllm-project#10407)
663fb57 
Signed-off-by: Linkun Chen <[email protected]>
@Maybewuss @prashantgupta24
[Model] Remove redundant softmax when using PoolingType.STEP (vllm-pr…
3c64fbb 
…oject#10415)
@B-201 @prashantgupta24
[Model][LoRA]LoRA support added for glm-4v (vllm-project#10418)
20ea0c3 
Signed-off-by: B-201 <[email protected]>
@Isotr0py @prashantgupta24
[Model] Remove transformers attention porting in VITs (vllm-project#1…
b1d6a6a 
…0414)

Signed-off-by: Isotr0py <[email protected]>
@B-201 @prashantgupta24
[Doc] Update doc for LoRA support in GLM-4V (vllm-project#10425)
5d6df78 
Signed-off-by: B-201 <[email protected]>
@youkaichao @prashantgupta24
[5/N][torch.compile] torch.jit.script --> torch.compile (vllm-project…
b4c641f 
…#10406)

Signed-off-by: youkaichao <[email protected]>
@ismael-dm @prashantgupta24
[Doc] Add documentation for Structured Outputs (vllm-project#9943)
c973945 
Signed-off-by: ismael-dm <[email protected]>
@andrew @prashantgupta24
Fix open_collective value in FUNDING.yml (vllm-project#10426)
e19e15a 
Signed-off-by: Andrew Nesbitt <[email protected]>
@mgoin @prashantgupta24
[Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)
a00d8c1 
Signed-off-by: mgoin <[email protected]>
@yma11 @prashantgupta24
[Hardware][XPU] AWQ/GPTQ support for xpu backend (vllm-project#10107)
472b9cf 
Signed-off-by: yan ma <[email protected]>
@angusYuhao @prashantgupta24
[Kernel] Explicitly specify other value in tl.load calls (vllm-projec…
9147b76 
…t#9014)

Signed-off-by: Angus Wang <[email protected]>
@LucasWilkinson @prashantgupta24
[Kernel] Initial Machete W4A8 support + Refactors (vllm-project#9855)
ce83e18 
Signed-off-by: Lucas Wilkinson <[email protected]>
@fialhocoelho @prashantgupta24
Squash 9522
bf5bf24 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho @prashantgupta24
Squash 6357
8b27172 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho @prashantgupta24
Squash 10235
e8fcdee 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho @prashantgupta24
Squash 10400
1e7f586 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho @prashantgupta24
Squash 10430
09f5b4a 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho @prashantgupta24
pin mistral and install adapter from branch 🚀
33c1553 
Signed-off-by: Jefferson Fialho <[email protected]>
@github-actions GitHub Actions
Copy link

github-actions bot commented Dec 3, 2024

👋 Hi! Thank you for contributing to the vLLM project.
Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can do one of these:

  • Add ready label to the PR
  • Enable auto-merge.

🚀

@mergify mergify bot added documentation Improvements or additions to documentation ci/build frontend labels Dec 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mgoin mgoin Awaiting requested review from mgoin mgoin will be requested when the pull request is marked ready for review mgoin is a code owner

@robertgshaw2-redhat robertgshaw2-redhat Awaiting requested review from robertgshaw2-redhat robertgshaw2-redhat will be requested when the pull request is marked ready for review robertgshaw2-redhat is a code owner

@tlrmchlsmth tlrmchlsmth Awaiting requested review from tlrmchlsmth tlrmchlsmth will be requested when the pull request is marked ready for review tlrmchlsmth is a code owner

@WoosukKwon WoosukKwon Awaiting requested review from WoosukKwon WoosukKwon will be requested when the pull request is marked ready for review WoosukKwon is a code owner

@DarkLight1337 DarkLight1337 Awaiting requested review from DarkLight1337 DarkLight1337 will be requested when the pull request is marked ready for review DarkLight1337 is a code owner

@ywang96 ywang96 Awaiting requested review from ywang96 ywang96 will be requested when the pull request is marked ready for review ywang96 is a code owner

@simon-mo simon-mo Awaiting requested review from simon-mo simon-mo will be requested when the pull request is marked ready for review simon-mo is a code owner

@njhill njhill Awaiting requested review from njhill njhill will be requested when the pull request is marked ready for review njhill is a code owner

@comaniac comaniac Awaiting requested review from comaniac comaniac will be requested when the pull request is marked ready for review comaniac is a code owner

@alexm-redhat alexm-redhat Awaiting requested review from alexm-redhat alexm-redhat will be requested when the pull request is marked ready for review alexm-redhat is a code owner

@zhuohan123 zhuohan123 Awaiting requested review from zhuohan123 zhuohan123 will be requested when the pull request is marked ready for review zhuohan123 is a code owner

@youkaichao youkaichao Awaiting requested review from youkaichao youkaichao will be requested when the pull request is marked ready for review youkaichao is a code owner

Assignees
No one assigned
Labels
ci/build documentation Improvements or additions to documentation frontend
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.