Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 91.4k 22k

2. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 6.5k 1.2k

3. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 4.5k 753

4. VibeHPC/VibeGEMM VibeHPC/VibeGEMM Public

   The open-source leaderboard for high-performance GPU GEMM.

   Cuda 3 1