Pinned Loading

1. tllm tllm Public

   create your own llm inference server from scratch

   Python 10

2. ggerganov/llama.cpp ggerganov/llama.cpp Public

   LLM inference in C/C++

   C++ 68.7k 9.9k

3. wRPC wRPC Public

   this is a simple RPC

   C++ 4 1

4. ChunelFeng/CGraph ChunelFeng/CGraph Public

   【A common used C++ DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork & 交流

   C++ 1.8k 324

5. cuda_example cuda_example Public

   this repository is for cuda example

   Cuda

6. InternLM/Tutorial InternLM/Tutorial Public

   LLM&VLM Tutorial

   Python 1.6k 1.4k