TOPIC FOCUS
2 curated stories#Amazon Elastic Kubernetes Service News.
Curated coverage, model releases, technical papers, and engineering updates tagged with #Amazon Elastic Kubernetes Service.
/
Showing 2 stories tagged #Amazon Elastic Kubernetes Service
Scaling MoE reinforcement learning on Amazon EKS with EFA and DeepEP with 40% more throughput
Learn how to scale Mixture-of-Experts (MoE) reinforcement learning on Amazon EKS using Elastic Fabric Adapter (EFA) and DeepEP. This post presents an architecture that combines Amazon EKS, EFA, and Amazon S3 and increased aggregate reinforcement learning rollout throughput by 40% for large-scale RLHF and GRPO training.
Fault tolerant distributed training on Amazon EKS using NVRx
Integrate NVIDIA Resiliency Extension (NVRx) into PyTorch FSDP training on Amazon EKS to overlap checkpoint I/O with training and recover from GPU faults in seconds. This post covers async checkpointing, in-process restart, and ft_launcher in-job restart, with H100 benchmarks at 2 to 8 nodes showing 99%+ training effic...
You've reached the end of the dispatches.