Skip to content

Pull requests: sgl-project/sglang

New pull request New
25 Open 1,458 Closed
25 Open 1,458 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Update ModelRunner Weights From Distributed
#2248 opened Nov 29, 2024 by zhaochenyang20 Loading…
3 tasks done
4
move vllm distributed module (v0.6.4.post1) to sglang high priority
#2244 opened Nov 28, 2024 by yizhang2077 Loading…
5 tasks
@zhyncs
4
Support LoRA in Completion API
#2243 opened Nov 28, 2024 by bjmsong Loading…
3 tasks
Add a simple torch native attention backend
#2241 opened Nov 28, 2024 by YangQun1 Loading…
3 tasks
1
[benchmark] Add fused_moe_triton benchmark and tuning tools
#2225 opened Nov 27, 2024 by BBuf Loading…
@HaiShaw @ispobock
7
Update model_loader deps and qqq quantization deps high priority
#2220 opened Nov 27, 2024 by HandH1998 Loading…
@Ying1123 @ispobock @zhyncs
12
[FEAT] Support GGUF format
#2215 opened Nov 27, 2024 by zhengy001 Loading…
2 of 3 tasks
5
MoE Expert Parallel Impl enhancement New feature or request high priority
#2203 opened Nov 26, 2024 by xiaobochen123 Loading…
1 task
@ispobock @zhyncs
9
Support top n sigma sampling
#2192 opened Nov 26, 2024 by Snowdar Loading…
1 of 3 tasks
feat: add should_use_tensor_cores
#2179 opened Nov 25, 2024 by zhyncs • Draft
3 tasks
4
test select concurrency
#2165 opened Nov 24, 2024 by qeternity Loading…
5
Speculative EAGLE2 high priority
#2150 opened Nov 24, 2024 by yukavio Loading…
13
Byhsu/fairness router
#2149 opened Nov 24, 2024 by ByronHsu • Draft
3 tasks
feat: use cascade attention kernel (single level)
#2101 opened Nov 20, 2024 by james-p-xu • Draft
1 of 3 tasks
2
Add log input text when using openai chat api await-response
#2058 opened Nov 17, 2024 by ccjincong Loading…
3 tasks done
8
[TEST] flashinfer version upgrade to v0.2.0
#2054 opened Nov 17, 2024 by james-p-xu • Draft
3 tasks
9
Add support for GPT-J await-response
#2041 opened Nov 15, 2024 by danilotpnta • Draft
1
regex stopping condition
#2035 opened Nov 14, 2024 by jancervenka Loading…
3 tasks done
7
[WIP] Use FlashInfer RoPE
#2016 opened Nov 12, 2024 by james-p-xu Loading…
3 tasks done
2
Add model support for Phi 3.5 MoE await-response
#1948 opened Nov 7, 2024 by svaruag • Draft
3 tasks
@merrymercy
3
Debug studio await-response
#1831 opened Oct 29, 2024 by zolinthecow Loading…
3 tasks done
@ByronHsu
7
Granite and GraniteMoE models. await-response
#1818 opened Oct 27, 2024 by janimo • Draft
@merrymercy
2
Surpport kv cache int8/int4 for triton backend await-response
#1644 opened Oct 12, 2024 by yuguo-Jack Loading…
@merrymercy
17
[Feature] Add initial support for sequence parallelism
#1436 opened Sep 16, 2024 by Ying1123 • Draft
@Ying1123
1
Function calling for OpenAI backend
#573 opened Jun 29, 2024 by Yiyun-Liang Loading…
@Ying1123
19
ProTip! Add no:assignee to see everything that’s not assigned.