Update default max_num_batch_tokens for chunked prefill #2106
Triggered via pull request
January 2, 2025 20:31
SachinVarghese
SachinVarghese
opened
#11694
Status
Success
Total duration
13s
Artifacts
–
cleanup_pr_body.yml
on: pull_request_target
update-description
4s
Annotations
1 warning
|
update-description
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|