NVIDIA DSX OS:配置、认证与运维 Kubernetes GPU 集群
Configure, Certify, and Operate Kubernetes GPU Clusters with NVIDIA DSX OS
NVIDIA 发布 DSX OS,用于配置、认证和运维 Kubernetes GPU 集群。单个性能不达标的 GPU 就可能拖慢整个分布式训练任务,而节点往往能通过基础健康检查并显示正常利用率,运维人员只能在工作负载运行后才发现问题。这类问题可能出现在集群生命周期的任何阶段,节点更换、驱动打补丁后,交接时通过就绪检查的 GPU 集群也会发生变化。
One underperforming GPU can slow an entire distributed training job. The node may pass basic health checks and show normal utilization, leaving operators to...
One underperforming GPU can slow an entire distributed training job. The node may pass basic health checks and show normal utilization, leaving operators to discover the problem only after the workload is running. These issues can appear at any point in a cluster’s lifecycle. A GPU cluster that passes readiness checks at handover changes as nodes are replaced, drivers are patched…
来源:NVIDIA Technical Blog · developer.nvidia.com