Skip to content

Pull requests: neuralmagic/vllm

New pull request New
20 Open 28 Closed
20 Open 28 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[WIP] Working Grouped gemm with group ID
#48 opened Dec 17, 2024 by ElizaWszola • Draft
1
Add: Support for Sparse24Bitmask Compressed Models
#47 opened Dec 17, 2024 by rahul-tuli Loading…
1 task
@dsikka @Faraz9877 @robertgshaw2-neuralmagic
2
merged
#46 opened Dec 15, 2024 by robertgshaw2-neuralmagic Loading…
1
Logprobs
#45 opened Dec 15, 2024 by robertgshaw2-neuralmagic Loading…
1
Proto
#44 opened Dec 12, 2024 by robertgshaw2-neuralmagic Loading…
1
Cutlass grouped gemm
#42 opened Dec 10, 2024 by ElizaWszola Loading…
1
[DRAFT] use cutlass for 24
#33 opened Nov 15, 2024 by rahul-tuli • Draft
1
Semi structured v2
#32 opened Nov 13, 2024 by ilmarkov Loading…
6
[torch.compile] Dynamic fp8 + rms_norm fusion
#31 opened Nov 8, 2024 by ProExpertProg Loading…
7
Add hf_transfer to testing image
#29 opened Nov 6, 2024 by mgoin Loading…
1
Emulated dynamic MX quantization
#27 opened Nov 6, 2024 by mgoin • Draft
1
Hqq support
#21 opened Oct 14, 2024 by ElizaWszola • Draft
3
Add silu-mul to rms-norm fusion
#20 opened Oct 11, 2024 by ProExpertProg • Draft
6
Update cpu_extension.cmake stale
#12 opened Sep 23, 2024 by ProExpertProg Loading…
2
Dynamic group blocks in Marlin MoE
#11 opened Sep 20, 2024 by ElizaWszola • Draft
1
Add zero point support to Marlin MoE kernel
#10 opened Sep 17, 2024 by ElizaWszola • Draft
1
test
#7 opened Aug 28, 2024 by robertgshaw2-neuralmagic • Draft
1
Run metrics async
#6 opened Aug 10, 2024 by robertgshaw2-neuralmagic • Draft
1
[WIP, Kernel] (2/N) Machete - Integrate into GPTQMarlinLinearMethod and CompressedTensorsWNA16
#5 opened Aug 7, 2024 by LucasWilkinson • Draft
1
Add 2:4 sparsity as a quantization method
#1 opened Aug 1, 2024 by mgoin • Draft
1
ProTip! What’s not been updated in a month: updated:<2024-11-23.