Skip to content
View basicv8vc's full-sized avatar
93 followers · 123 following

Achievements

Achievement: Pull Sharkx2Achievement: Starstruckx2Achievement: Arctic Code Vault Contributor

Achievements

Achievement: Pull Sharkx2Achievement: Starstruckx2Achievement: Arctic Code Vault Contributor

Organizations

@dmlc @slofast

Block or report basicv8vc

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Stars

LLM inference

2 repositories

predibase / lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Python 2,298 149 Updated Jan 11, 2025

neuralmagic / nm-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python 256 10 Updated Oct 11, 2024