HyperPod Inference Operator (Managed KV Cache and Intelligent Routing)
Comparing SageMaker HyperPod Inference Operator's managed KV cache, intelligent routing, and DPD with a Tiered Gateway, and clarifying its role and limitations as an L2 inference routing layer.