I'm a PhD student @ UChicago, graduating, working in Large Language Model Inference. Check my home page for more about me!
- ๐ Working on vLLM project as vLLM team member. My contributions:
- Performance dashboard: perf.vllm.ai.
- Performance comparison with other LLM inference engines: the end of the blog.
- Features: Disaggregated prefilling and CPU offloading.
- ๐พ Contributing to the LMCache project, exploring fun ideas in KV caches.
- ๐ฎ Gaming: League of Legends, Stardew Valley, Go
- ๐ Street Dance: Locking main, but I also dance waacking.
- ๐ค Singing: Loch Lomond and ไผ ๅฅ Legend
- Email: [email protected]
- LinkedIn: Kuntai Du