Artificial Analysis：DeepSeek V4.1 Flash 在 GB300 NVL72 上提速最高 1.5 倍

Artificial Analysis· @ArtificialAnlys · X·2026-11-07 04:33· 1 小时前AI 评分41

AI 导读

Artificial Analysis 测得 DeepSeek V4.1 Flash 在 GB300 NVL72 上的 AA-AgentPerf 速度一个月内提升最高 1.5 倍 tok/s/agent，单 agent 从 596 tok/s 升至 848 tok/s（1.42x）。

正文 · 原文

DeepSeek V4.1 Flash speeds on GB300 NVL72 have increased by up to 1.5x tok/s per agent over the past month on AA-AgentPerf, our benchmark of datacenter systems running realistic agentic coding workloads

This improvement comes from a newer vLLM version, new vLLM kernels for DeepSeek V4.1 on GB300, FlashInfer autotuning, fuller CUDA graph coverage, tuned speculative decoding, and running prefill and decode on the same GPUs in NVIDIA’s updated Dynamo + vLLM setup

➤ Faster speeds: 848 tok/s for a single agent, up from 596 (1.42x)

➤ Higher throughput: ~1.6x the throughput per GPU at ~80 tok/s per agent

来源：Artificial Analysis · x.com