Skip to content

Pull requests: HabanaAI/vllm-hpu-extension

New pull request New
12 Open 60 Closed
12 Open 60 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Update calibration readme link
#73 opened Jan 10, 2025 by michalkuligowski Loading…
Add flag to enable running softmax in fp32
#71 opened Jan 10, 2025 by madamczykhabana Loading…
Add renormalize parameter for FusedMOE's & modify experts_max arg of mixture_of_experts()
#70 opened Jan 9, 2025 by tangleintel Loading…
Remove repeat KV cache
#69 opened Jan 8, 2025 by iboiko-habana Loading…
Pad to bmin if value is less
#67 opened Jan 2, 2025 by mfylcek Loading…
allow lm_head quantization in calibration process
#65 opened Dec 23, 2024 by nirda7 Loading…
[WIP] Add option to do group sum on TPC instead of MME
#64 opened Dec 20, 2024 by mswiniarsk • Draft
Add exponential bucketing PoC
#61 opened Dec 17, 2024 by kzawora-intel • Draft
vLLM-Ext: Full enabling of ALiBi
#60 opened Dec 17, 2024 by tannervoas742 Loading…
Remove vllm.logger.init_logger dependency
#53 opened Dec 9, 2024 by kzawora-intel Loading…
1
Add AWQ class
#29 opened Nov 8, 2024 by maktukmak Loading…
3
Add GPTQ class
#28 opened Nov 8, 2024 by maktukmak Loading…
9
ProTip! Filter pull requests by the default branch with base:main.