Custom Model Deployment Guide
Hands-on guide to deploying large open-source models on EKS, based on the GLM-5.1 experience
2 docs tagged with "lessons-learned"
View all tagsGPU Autoscaling & Large Model Deployment Operations
2-Tier GPU autoscaling (KEDA·Karpenter), DRA compatibility, and operational lessons learned from large MoE model (GLM-5·Kimi K2.5) deployments for LLM serving