[Speculative Decoding] Move indices to device before filtering output#10850

Merged

DarkLight1337 merged 1 commit intovllm-project:mainfrom zhengy001:zyang_spec

Dec 3, 2024

+6-3

Commits on Dec 3, 2024

[Speculative Decoding] Move indices to device before filtering output
Yang Zheng(SW)(Alex)
committed