Skip to main content

#vllm-semantic-router

2

문서

0

카테고리

5k

단어

24

분 읽기

관련 카테고리: 없음

문서 목록

Complexity-based automatic model routing — comparison of LLM Classifier, LiteLLM, and vLLM Semantic Router approaches, RouteLLM research reference, and cost savings

kgateway + Bifrost/LiteLLM 2-Tier architecture with Cascade Routing, Semantic Router, and Hybrid Routing design patterns