sglang-router
Subscription: Developer
Active
Subscription: Developer
A high-performance Rust-based load balancer for SGLang inference servers, providing multiple routing algorithms including round-robin, random, and cache-aware strategies with prefill-decode disaggregation support for LLM serving workloads.