Build Your Stack.
Tell us your hardware and your goal → get a tested, deployable open-source stack with copyable docker-compose.yml and README specs.
sgl-project / sglang • โ 36,141
What it is: Fast, flexible LLM serving framework engineered for high-concurrency complex prompts.
Why this week: Just released v0.3 with RadixAttention prefix caching, driving a +1,500 star spike in 48h.
What it replaces: vLLM & TGI for multi-turn batching on 16GBโ24GB+ hardware.
Curated Radar Leaderboard
Sorted by real architectural momentum and commit freshness.