Popular repositories Loading

1. efficient-transformers efficient-transformers Public

   Forked from quic/efficient-transformers

   This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transformers library) into inference-ready formats that run efficien…

   Python

2. AutoGPTQ AutoGPTQ Public

   Forked from AutoGPTQ/AutoGPTQ

   An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

   Python

3. QLLM QLLM Public

   Forked from wejoncy/QLLM

   A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ, and export to onnx/onnx-runtime easily.

   Python