[Core] Support global prefix caching #25165
Annotations
4 errors
|
Mypy:
vllm/core/block/prefix_caching_block.py#L185
Argument 1 to "checkExist" of "GlobalCache" has incompatible type "int | None"; expected "int" [arg-type]
|
Mypy:
vllm/core/block/prefix_caching_block.py#L186
"Block" has no attribute "global_computed" [attr-defined]
|
Mypy
Process completed with exit code 1.
|
Loading