Skip to content
Cleanup PR Body

Disable spec-decode + chunked-prefill for draft models with tensor parallelism > 1 #50

Sign in to view logs

Disable spec-decode + chunked-prefill for draft models with tensor parallelism > 1

Disable spec-decode + chunked-prefill for draft models with tensor parallelism > 1 #50

Run time

Learn about OS pricing on GitHub Actions
Job Run time
update-description
4s
4s