跳到正文
NVIDIA Technical Blog· Zhihan Jiang·· 1 天前AI 评分40

NVIDIA Vera Rubin NVL72 在 MLPerf Endpoints v1.0 上领跑智能体推理性能

NVIDIA Vera Rubin NVL72 Leads Agentic Inference Performance on MLPerf Endpoints v1.0

AI 导读

NVIDIA Vera Rubin NVL72 在 MLPerf Endpoints v1.0 智能体推理基准中取得领先性能。该基准通过 API 调用编码与企业工作流,评估推理系统在服务容量与响应速度之间的平衡,对应 AI 智能体跨轮次携带增长对话历史、混合生成推理、工具调用与回复的实际负载。

正文 · 原文

Two rows of black data center racks with gold-colored server components against a black background.Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool...Two rows of black data center racks with gold-colored server components against a black background.

Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool calls, and responses. Inference systems must support users at scale while remaining responsive. MLPerf Endpoints v1.0 evaluates this balance between serving capacity and responsiveness using coding and enterprise workflows through API…

Source

来源:NVIDIA Technical Blog · developer.nvidia.com