[Core] Support global prefix caching #25165
Annotations
4 errors
|
|
|
Mypy:
vllm/core/block/prefix_caching_block.py#L185
Argument 1 to "checkExist" of "GlobalCache" has incompatible type "int | None"; expected "int" [arg-type]
|
|
Mypy:
vllm/core/block/prefix_caching_block.py#L186
"Block" has no attribute "global_computed" [attr-defined]
|
|
Mypy
The operation was canceled.
|
Loading