跳到主要内容

EKS East-West Traffic Optimization Guide

Written: 2026-02-09 | Updated: 2026-02-14 | Reading time: ~21 min

Overview

This guide covers optimizing inter-service communication (East-West traffic) in Amazon EKS from latency minimization and cost efficiency perspectives. It progressively addresses scenarios from single cluster to multi-AZ, multi-cluster, and multi-account environments.

When East-West hops increase from 1 to 2, p99 latency grows by milliseconds. Cross-AZ traffic incurs AWS bandwidth charges ($0.01/GB). This guide analyzes layer-by-layer options from Kubernetes-native features (Topology Aware Routing, InternalTrafficPolicy) to Cilium ClusterMesh, AWS VPC Lattice, and Istio service mesh, with quantitative latency, overhead, and cost comparisons.

Key Benefits

ItemImprovement
Network LatencySame-AZ routing via Topology Aware Routing, sub-ms p99
Cost Savings~$100/month at 10TB/month by eliminating cross-AZ traffic
Operational SimplicityClusterIP-based inter-service optimization without LBs
DNS PerformanceNodeLocal DNSCache: ms → sub-ms DNS lookup
ScalabilityConsistent extension path to multi-cluster/account
🔀 Kubernetes 服务类型对比
East-West 流量的服务类型选择指南
ClusterIPL4默认推荐
集群内虚拟 IP,kube-proxy NAT 分发(iptables=随机,IPVS=轮询)
+ 简便,DNS 自动分配,无额外费用
- Cross-AZ 随机分发,NAT 开销
HeadlessL4
无 clusterIP,通过 DNS 直接暴露所有 Pod IP,不经过代理
+ 直连(最低延迟),gRPC DNS 轮询,StatefulSet 必需
- 需客户端 LB 逻辑,DNS 更新延迟
Internal NLBL4
AWS NLB Controller,L4 运行,Instance/IP 模式可选
+ 多 AZ 高可用,L4 超低延迟,固定 IP
- NLB 每小时费用,Instance 模式 cross-AZ 成本增加
Internal ALBL7
AWS ALB Controller,L7 运行,仅 IP 模式
+ L7 功能(路径路由、WAF、gRPC),Cross-Zone 免费
- ALB 每小时 + LCU 费用,数~数十ms 额外延迟
💡 选择指南: 默认:ClusterIP + Topology Aware Routing | StatefulSet:Headless | 需要 L7:Internal ALB(IP 模式)| L4 外部暴露:Internal NLB(IP 模式)

Implementation

  1. Topology Aware Routingservice.kubernetes.io/topology-mode: Auto
  2. InternalTrafficPolicy Local — Same-node-only traffic
  3. Pod Topology Spread Constraints — AZ-balanced distribution
  4. NodeLocal DNSCache — Local DNS caching per node
  5. Internal LB IP Mode — Direct Pod IP targeting
  6. Istio Service Mesh (optional) — mTLS, locality-aware routing

Multi-Cluster Connection Strategies

  • Cilium ClusterMesh: Lowest latency, Pod-to-Pod direct, eBPF-based
  • AWS VPC Lattice: Managed proxy, IAM auth, multi-account
  • Istio Multi-cluster: Full mesh features across clusters, mTLS
  • Route53 + ExternalDNS: Simplest, DNS-based
⚡ 各选项延迟与成本对比
East-West 流量路径的性能·成本定量对比
选项
延迟特性 / 成本结构
延迟
成本
ClusterIP
kube-proxy NAT 处理(µs~ms)。相比直连有微小开销
无额外费用。Cross-AZ 时 $0.01/GB
Headless
不经代理,几乎无额外延迟。仅 DNS 查询耗时
无额外费用。Cross-AZ 成本相同
Internal NLB (Instance)
数ms + NodePort 1 跳 + 可能额外 kube-proxy 跳
NLB 每小时 + 数据 GB + cross-AZ 成本增加
Internal NLB (IP)
数ms。直连 Pod,无 NodePort 跳转
NLB 费用,通过避免跨 AZ 流量节省成本
Internal ALB
数~数十ms(L7 规则处理,与请求大小/规则数成正比)
ALB 每小时($0.0225/h)+ LCU 费用。Cross-Zone 免费
Istio Sidecar
~5ms 增加(客户端+服务端 2 次代理)
开源,每代理 0.2 vCPU/60MB per 1000rps
Cilium ClusterMesh
Pod→Pod 直连。VXLAN 封装开销数十µs
无 AWS 服务费用。仅数据传输费
VPC Lattice
经托管代理,每 HTTP 请求数ms
$0.025/h + $0.025/GB + $0.1/1M req
💰 10 TB/月 East-West 流量成本模拟
同一区域 3-AZ EKS 集群,总计 10 TB(10,240 GB)服务间流量基准
InternalTrafficPolicy Local$0
节点本地通信,完全消除 cross-AZ
ClusterIP + Topology Hints~$30
cross-AZ 降至约 30%
ClusterIP(默认,无 AZ 感知)~$68
cross-AZ 约 66%(3-AZ 均匀分布)
经 Internal ALB~$98
ALB 每小时 + LCU + cross-AZ
VPC Lattice$400+
每服务每小时 + 每 GB + 每请求
🎯 按场景推荐矩阵
根据服务特性、安全需求和运维复杂度的推荐方案
🔧简单内部微服务(HTTP/gRPC,延迟敏感)Single Cluster
ClusterIP + Topology Aware Routing + NodeLocal DNSCache。必要时用 InternalTrafficPolicy(Local) 进行同节点优化
🗄️StatefulSet(DB 等 TCP,需要会话)Single Cluster
Headless 服务 + 客户端 DNS 轮询。在与客户端相同的 AZ 中调度 leader-follower
🌐大量 L7 流量(需路由/WAF)Single Cluster
Internal ALB(IP 模式)+ ClusterIP 服务连接。ALB 仅用于需要的服务
🔒安全敏感(mTLS/零信任必需)Single/Multi Cluster
Istio 服务网格。mTLS + AuthorizationPolicy。审查延迟要求和流量
💰多 AZ 成本优化(高流量,不使用 mesh)单集群
Topology Hints + IP 模式 LB + Pod Spread + NAT GW 按 AZ 分离
🔗多集群(同账户,低运维复杂度)多集群
Cilium ClusterMesh。Pod 直接通信,无额外费用低延迟
🏢多账户/组织(IAM 控制,运维人员少)多账户
AWS VPC Lattice。基于 IAM Policy 的访问控制,统一监控
🔄简单 DR 集群(低流量)DR
DNS + Internal NLB(Route53 + ExternalDNS)。DR 时 DNS 切换

References

  1. AWS ELB Pricing
  2. AWS Data Transfer Pricing
  3. Kubernetes Topology Aware Routing
  4. Cilium ClusterMesh
  5. AWS VPC Lattice Pricing