Skip to content

Commit

Permalink
Small cleanup
Browse files Browse the repository at this point in the history
Signed-off-by: andoorve <[email protected]>
  • Loading branch information
andoorve committed Nov 12, 2024
1 parent 5000122 commit 25d0d7c
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions vllm/spec_decode/spec_decode_worker.py
Original file line number Diff line number Diff line change
Expand Up @@ -409,8 +409,10 @@ def execute_model(
execute_model_req)
num_lookahead_slots = execute_model_req.num_lookahead_slots

if (all(sgm.is_prompt
for sgm in execute_model_req.seq_group_metadata_list)):
all_prompt = (all(
sgm.is_prompt
for sgm in execute_model_req.seq_group_metadata_list))
if (all_prompt):
assert num_lookahead_slots == 0, (
"Prompt only runs should have num_lookahead_slots equal to 0. "
"This should never happen, please file a bug at "
Expand Down

0 comments on commit 25d0d7c

Please sign in to comment.