Skip to content

Commit

Permalink
Update docs/source/quantization/bitblas.rst
Browse files Browse the repository at this point in the history
Co-authored-by: Michael Goin <[email protected]>
  • Loading branch information
LeiWang1999 and mgoin authored Dec 19, 2024
1 parent d6586e7 commit 430ca44
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion docs/source/quantization/bitblas.rst
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,8 @@ Read bitblas format checkpoint.
llm = LLM(model=model_id, dtype=torch.bfloat16, trust_remote_code=True, quantization="bitblas")
Read gptq format checkpoint.
--------------------------
-------------------------------

.. code-block:: python
from vllm import LLM
Expand Down

0 comments on commit 430ca44

Please sign in to comment.