Skip to content

Update default max_num_batch_tokens for chunked prefill #5314

Update default max_num_batch_tokens for chunked prefill

Update default max_num_batch_tokens for chunked prefill #5314

Triggered via pull request January 2, 2025 20:31
Status Success
Total duration 18s
Artifacts

codespell.yml

on: pull_request
Matrix: codespell
Fit to window
Zoom out
Zoom in

Annotations

1 warning
codespell (3.12)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636