Skip to content

add a quantized arg for vllm to run awq models#77

Merged
wongjingping merged 4 commits intomainfrom rishabh/vllm-awqFeb 5, 2024

Commits

Commits on Feb 3, 2024