Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merge 0922 #6

Merged
merged 46 commits into from
Sep 23, 2023
Merged

Merge 0922 #6

merged 46 commits into from
Sep 23, 2023

Conversation

renning22
Copy link

Why are these changes needed?

Related issue number (if applicable)

Checks

  • I've run format.sh to lint the changes in this PR.
  • I've included any doc changes needed.
  • I've made sure the relevant tests are passing (if applicable).

Trangle and others added 30 commits August 31, 2023 18:34
@Trangle
Remove hardcode flash-attn disable setting (lm-sys#2342)
2264580
@nathanstitt
Document turning off proxy_buffering when api is streaming (lm-sys#2337)
24a8755
@merrymercy
Simplify huggingface api example (lm-sys#2355)
b039a66
@merrymercy
Update sponsor logos (lm-sys#2367)
ea045e6
@leiwen83 @wenlei03
if LOGDIR is empty, then don't try output log to local file (lm-sys#2357
85bec47 
)

Signed-off-by: Lei Wen <[email protected]>
Co-authored-by: Lei Wen <[email protected]>
@leiwen83 @wenlei03
add best_of and use_beam_search for completions interface (lm-sys#2348)
f99663c 
Signed-off-by: Lei Wen <[email protected]>
Co-authored-by: Lei Wen <[email protected]>
@merrymercy
Extract upvote/downvote from log files (lm-sys#2369)
3cf04c2
@merrymercy
Revert "add best_of and use_beam_search for completions interface" (l…
94f4dd6 
…m-sys#2370)
@merrymercy
Improve doc (lm-sys#2371)
dc3dd12
@leiwen83 @wenlei03
add best_of and use_beam_search for completions interface (lm-sys#2372)
a5e6abf 
Signed-off-by: Lei Wen <[email protected]>
Co-authored-by: Lei Wen <[email protected]>
@merrymercy
update monkey patch for llama2 (lm-sys#2379)
1d703b2
@merrymercy
Make E5 adapter more restrict to reduce mismatch (lm-sys#2381)
56744d1
@merrymercy
Update UI and sponsers (lm-sys#2387)
6af0a7c
@merrymercy
Use fsdp api for save save (lm-sys#2390)
9b3147e
@merrymercy
Release v0.2.27
a6167db
@jondurbin @j-durbin
Spicyboros + airoboros 2.2 template update. (lm-sys#2392)
7dcdafe 
Co-authored-by: Jon Durbin <[email protected]>
@Rayrtfr
bugfix of openai_api_server for fastchat.serve.vllm_worker (lm-sys#2398)
b921f16 
Co-authored-by: wuyongyu <[email protected]>
@merrymercy
Revert "bugfix of openai_api_server for fastchat.serve.vllm_worker" (l…
13f40b3 
…m-sys#2400)
@merrymercy
Revert "add best_of and use_beam_search for completions interface" (l…
77aa4df 
…m-sys#2401)
@merrymercy
Release a v0.2.28 with bug fixes and more test cases
11b05bb
@wangxiyuan
Fix model_worker error (lm-sys#2404)
a8088ba
@wangzhen263
Added google/flan models and fixed AutoModelForSeq2SeqLM when loading…
b49d789 
… T5 compression model (lm-sys#2402)
@karshPrime
Rename twitter to X (lm-sys#2406)
7dfcf1a
@merrymercy
Update huggingface_api.py (lm-sys#2409)
aa153d5
@obitoquilt
Add support for baichuan2 models (lm-sys#2408)
3149253
@Somezak1
Fixed character overlap issue when api streaming output (lm-sys#2431)
2e0e60b
@hi-jin
Support custom conversation template in multi_model_worker (lm-sys#2434)
c7e3e67
@zhangsibo1129
Add Ascend NPU support (lm-sys#2422)
c685951
@tobiabir
Add raw conversation template (lm-sys#2417) (lm-sys#2418)
54a8353
@merrymercy
Improve docs & UI (lm-sys#2436)
1119c51
jaywonchung and others added 16 commits September 17, 2023 18:53
@jaywonchung
Fix Salesforce xgen inference (lm-sys#2350)
658736f
@tobiabir @merrymercy
Add support for Phind-CodeLlama models (lm-sys#2415) (lm-sys#2416)
d26d9e7 
Co-authored-by: Lianmin Zheng <[email protected]>
@Btlmd
Add falcon 180B chat conversation template (lm-sys#2384)
0a5f503
@merrymercy
Improve docs (lm-sys#2438)
318d070
@Ying1123
add dtype and seed (lm-sys#2430)
9cf3c8b
@merrymercy
Data cleaning scripts for dataset release (lm-sys#2440)
24acac1
@wangzhen263
merge google/flan based adapters: T5Adapter, CodeT5pAdapter, FlanAdap…
30a6ffc 
…ter (lm-sys#2411)
@merrymercy
Fix docs
16be5cf
@merrymercy
Update UI (lm-sys#2446)
e4758da
@brandonbiggs
Add Optional SSL Support to controller.py (lm-sys#2448)
68f1fac
@merrymercy
Format & Improve docs
db8e271
@merrymercy
Release v0.2.29 (lm-sys#2450)
c4c195c
@merrymercy
Show terms of use as an JS alert (lm-sys#2461)
a040cdc
@dongxiaolong
vllm worker awq quantization update (lm-sys#2463)
bcb8076 
Co-authored-by: 董晓龙 <[email protected]>
@merrymercy
Fix falcon chat template (lm-sys#2464)
2855bf9
@renning22
Merge commit '2855bf9' into merge_0922
20cfb32
@renning22 renning22 merged commit a887de7 into main Sep 23, 2023
0 of 2 checks passed
@renning22 renning22 deleted the merge_0922 branch September 23, 2023 05:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.