
Infrastructure9h ago
Introducing Amazon SageMaker HyperPod Inference Gateway
Amazon SageMaker HyperPod Inference Gateway is a Kubernetes-native, GPU-aware routing add-on for Amazon EKS that uses real-time GPU signals to optimize…
#AWS#Kubernetes#Inference#GPU#Amazon Web Services#LLM#Announced