Inference Gateway & LLM Gateway Routing Strategy
kgateway + Bifrost/LiteLLM 2-Tier architecture with Cascade Routing, Semantic Router, and Hybrid Routing design patterns
2 docs tagged with "vllm-semantic-router"
View all tagsRequest Cascading — Intelligent Model Routing
Complexity-based automatic model routing — comparison of LLM Classifier, LiteLLM, and vLLM Semantic Router approaches, RouteLLM research reference, and cost savings