Update default max_num_batch_tokens for chunked prefill #2766
Triggered via pull request
January 2, 2025 20:31
SachinVarghese
SachinVarghese
opened
#11694
Status
Success
Total duration
11s
Artifacts
–
reminder_comment.yml
on: pull_request_target
pr_reminder
2s
Annotations
1 warning
|
pr_reminder
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|