Adding cascade inference to vLLM #21974
raywanbAnnotations
39 errors
|
mypy (3.9):
vllm/attention/backends/flashinfer.py#L519
Item "None" of "Optional[Any]" has no attribute "to" [union-attr]
|
|
mypy (3.9):
vllm/attention/backends/flashinfer.py#L520
Item "None" of "Optional[Any]" has no attribute "to" [union-attr]
|
|
mypy (3.9):
vllm/attention/backends/flashinfer.py#L521
Item "None" of "Optional[Any]" has no attribute "to" [union-attr]
|
|
mypy (3.9):
vllm/attention/backends/flashinfer.py#L532
Value of type "Optional[Any]" is not indexable [index]
|
|
mypy (3.9):
vllm/attention/backends/flashinfer.py#L534
Value of type "Optional[Any]" is not indexable [index]
|
|
mypy (3.9):
vllm/attention/backends/flashinfer.py#L538
Value of type "Optional[Any]" is not indexable [index]
|
|
mypy (3.9):
vllm/attention/backends/flashinfer.py#L554
Value of type "Optional[Any]" is not indexable [index]
|
|
mypy (3.9):
vllm/attention/backends/flashinfer.py#L558
Value of type "Optional[Any]" is not indexable [index]
|
|
mypy (3.9)
Process completed with exit code 1.
|
|
mypy (3.11)
The job was canceled because "_3_9" failed.
|
|
mypy (3.11):
vllm/attention/backends/flashinfer.py#L519
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
mypy (3.11):
vllm/attention/backends/flashinfer.py#L520
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
mypy (3.11):
vllm/attention/backends/flashinfer.py#L521
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
mypy (3.11):
vllm/attention/backends/flashinfer.py#L532
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.11):
vllm/attention/backends/flashinfer.py#L534
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.11):
vllm/attention/backends/flashinfer.py#L538
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.11):
vllm/attention/backends/flashinfer.py#L554
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.11):
vllm/attention/backends/flashinfer.py#L558
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.11)
Process completed with exit code 1.
|
|
mypy (3.12)
The job was canceled because "_3_9" failed.
|
|
mypy (3.12):
vllm/attention/backends/flashinfer.py#L519
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
mypy (3.12):
vllm/attention/backends/flashinfer.py#L520
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
mypy (3.12):
vllm/attention/backends/flashinfer.py#L521
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
mypy (3.12):
vllm/attention/backends/flashinfer.py#L532
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.12):
vllm/attention/backends/flashinfer.py#L534
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.12):
vllm/attention/backends/flashinfer.py#L538
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.12):
vllm/attention/backends/flashinfer.py#L554
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.12):
vllm/attention/backends/flashinfer.py#L558
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.12)
The operation was canceled.
|
|
mypy (3.10)
The job was canceled because "_3_9" failed.
|
|
mypy (3.10):
vllm/attention/backends/flashinfer.py#L519
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
mypy (3.10):
vllm/attention/backends/flashinfer.py#L520
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
mypy (3.10):
vllm/attention/backends/flashinfer.py#L521
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
mypy (3.10):
vllm/attention/backends/flashinfer.py#L532
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.10):
vllm/attention/backends/flashinfer.py#L534
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.10):
vllm/attention/backends/flashinfer.py#L538
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.10):
vllm/attention/backends/flashinfer.py#L554
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.10):
vllm/attention/backends/flashinfer.py#L558
Value of type "Any | None" is not indexable [index]
|
|
mypy (3.10)
The operation was canceled.
|