跳到正文
arXiv cs.AI· Izzeddin Teeti, Vaibhav Kango, Nidhi Sridhar, Mohamed Moustafa·· 10 小时前AI 评分29

多模态图注意力实现道路封闭映射,精度超前沿视觉语言模型 28 个百分点

Multimodal Road Closure Mapping via Cross-Modal Graph Attention

AI 导读

研究者提出统一多模态多任务框架,在单一架构内联合完成道路封闭分类(无/部分/完全)与路段关联,融合图结构地图数据、卫星影像和街景图像,通过跨模态 Transformer 注意力显式推理视觉线索与路网拓扑。

正文 · 原文

View PDF HTML (experimental)

Abstract:Accurate and timely identification of road closures is critical for large-scale navigation and logistics systems, yet remains challenging due to the need to jointly reason over visual evidence, spatial context, and road network topology. Existing approaches either rely on manual map updates or focus on detecting closure-related objects without resolving which road segment is affected. In this work, we introduce a unified multimodal and multitask framework that jointly performs road closure classification (no, partial, complete) and road segment association within a single learning architecture. Our model integrates graph-structured map data, satellite imagery augmented with projected street-level detections, and street-view images using modality-specific encoders and cross-modal transformer attention, enabling explicit reasoning over visual cues and network topology. Evaluated on nearly 20K real-world scenarios collected from a large-scale commercial vehicle fleet, our approach achieves 72.7% closure classification accuracy and 60% road segment association accuracy, outperforming frontier vision-language models by over 28 percentage points on closure classification while being over 4,000x smaller and 100x faster at inference. Extensive ablations demonstrate the importance of cross-modal attention, edge-aware pooling, and graph message passing for accurate geospatial reasoning. This work establishes the first benchmark for joint road closure classification and segment-level attribution, and shows that task-specific architectural inductive biases substantially outperform general-purpose multimodal models for structured geospatial understanding.
Comments: Published at ACM SIGSPATIAL 2026. 11 pages, 4 figures
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
ACM classes: I.2.10; I.4.8; H.2.8
Cite as: arXiv:2611.13192 [cs.CV]
  (or arXiv:2611.13192v1 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2611.13192

arXiv-issued DOI via DataCite (pending registration)

Related DOI: https://doi.org/10.1145/3841645.3843276

DOI(s) linking to related resources

Submission history

From: Izzeddin Teeti [view email]
[v1] Mon, 9 Nov 2026 20:13:18 UTC (17,543 KB)

来源:arXiv cs.AI · arxiv.org