Pinned Loading

1. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 4.9k 577

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 24.1k 4.6k

3. LMCache/LMCache LMCache/LMCache Public

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python 7.5k 975

4. foyer-rs/foyer foyer-rs/foyer Public

   Hybrid in-memory and disk cache in Rust

   Rust 1.6k 75

5. novitalabs/pegaflow novitalabs/pegaflow Public

   Rust 20 6

6. pegainfer pegainfer Public

   Pure Rust + CUDA LLM inference engine

   Rust 156 12