Popular repositories Loading

1. ShawnD200 ShawnD200 Public

   Config files for my GitHub profile.

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. mlx mlx Public

   Forked from ml-explore/mlx

   MLX: An array framework for Apple silicon

   C++

4. flash-attention flash-attention Public

   Forked from Dao-AILab/flash-attention

   Fast and memory-efficient exact attention

   Python

5. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   LLM inference in C/C++

   C++

6. LMCache LMCache Public

   Forked from LMCache/LMCache

   Making Long-Context LLM Inference 10x Faster and 10x Cheaper

   Python