跳到正文
arXiv cs.AI· Yan Shi, Kehua Chen, Jiarui Qi, Yihong Tang, Haichen Liao, Yinhai Wang·· 12 小时前AI 评分35

DriveMind:面向闭环自动驾驶的思维演化信念跟踪框架

DriveMind: Mind-Evolving Belief Tracking for Closed-Loop Autonomous Driving

AI 导读

DriveMind 是一个基于 MLLM 的闭环自动驾驶框架,借鉴粒子滤波思路,让多个场景假设同时存活并随新帧更新权重,避免每帧从零推理、过早锁定错误解释。在 Bench2Drive 上,同一驾驶流程加入信念跟踪后 Driving Score 从 68.50 提升至 81.37,Success Rate 从 41.36% 提升至 54.09%。

正文 · 原文

View PDF HTML (experimental)

Abstract:Recent multimodal large language models (MLLMs) can perceive a traffic scene, reason about it, and propose a driving action within a single model. However, existing MLLM-based drivers reason from scratch at each frame and commit to a single explanation, discarding earlier hypotheses about the scene. When the scene is ambiguous, the agent locks in on the wrong interpretation and acts on it before evidence accumulates. In this paper, we propose DriveMind, an MLLM-based driving framework that keeps several hypotheses about the scene alive at the same time and updates their weights as new frames arrive. Inspired by particle filtering, DriveMind propagates each hypothesis through a VLM, scores it against the current observation, and resamples to maintain diversity. On Bench2Drive, adding belief tracking to the same driving pipeline improves the Driving Score (DS) from 68.50 to 81.37 and the Success Rate (SR) from 41.36% to 54.09%. The largest gains occur on ambiguous scenarios such as unsignalized intersections (+20.0 DS) and oncoming-traffic interactions (+20.5 DS). Beyond the overall metrics, DriveMind also improves fine-grained interactive driving abilities such as merging, emergency braking, and give-way.
Comments: Accepted by Neurips 2026
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.32069 [cs.AI]
  (or arXiv:2610.32069v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2610.32069

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Yan Shi [view email]
[v1] Fri, 23 Oct 2026 02:13:50 UTC (1,331 KB)

来源:arXiv cs.AI · arxiv.org