Adding cascade inference to vLLM #21974
Annotations
10 errors
|
Mypy:
vllm/attention/backends/flashinfer.py#L519
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
Mypy:
vllm/attention/backends/flashinfer.py#L520
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
Mypy:
vllm/attention/backends/flashinfer.py#L521
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
Mypy:
vllm/attention/backends/flashinfer.py#L532
Value of type "Any | None" is not indexable [index]
|
Mypy:
vllm/attention/backends/flashinfer.py#L534
Value of type "Any | None" is not indexable [index]
|
Mypy:
vllm/attention/backends/flashinfer.py#L538
Value of type "Any | None" is not indexable [index]
|
Mypy:
vllm/attention/backends/flashinfer.py#L554
Value of type "Any | None" is not indexable [index]
|
Mypy:
vllm/attention/backends/flashinfer.py#L558
Value of type "Any | None" is not indexable [index]
|
Mypy
The operation was canceled.
|
Loading