跳到正文
arXiv cs.AI· Jiang Wu, Sichao Wu, Yinsong Ma, Guangyuan Yu, Haoyuan Xu, Lifang Zheng, Jingliang Duan·· 10 小时前AI 评分31

MonitorVLM:面向采矿作业安全违规检测的视觉语言框架

MonitorVLM:A Vision Language Framework for Safety Violation Detection in Mining Operations

AI 导读

MonitorVLM 是一个从监控视频流直接检测安全违规的视觉语言框架,基于 9000 条覆盖 40 项高频采矿规程的 VQA 样本训练。其 clause filter 模块动态选取 Top-K 相关条款,降低推理延迟 13.56%;behavior magnifier 模块强化工人区域,精度和召回率分别再提升 3.45% 和 8.62%。

正文 · 原文

View PDF HTML (experimental)

Abstract:Industrial accidents, particularly in high-risk domains such as surface and underground mining, are frequently caused by unsafe worker behaviors. Traditional manual inspection remains labor-intensive, error-prone, and insufficient for large-scale, dynamic environments, highlighting the urgent need for intelligent and automated safety monitoring. In this paper, we present MonitorVLM, a novel vision--language framework designed to detect safety violations directly from surveillance video streams. MonitorVLM introduces three key innovations: (1) a domain-specific violation dataset comprising 9,000 vision--question--answer (VQA) samples across 40 high-frequency mining regulations, enriched with augmentation and auxiliary detection cues; (2) a clause filter (CF) module that dynamically selects the Top-$K$ most relevant clauses, reducing inference latency by 13.56% while maintaining accuracy; and (3) a behavior magnifier (BM) module that enhances worker regions to improve fine-grained action recognition, yielding additional gains of 3.45% in precision and 8.62% in recall. Experimental results demonstrate that MonitorVLM significantly outperforms baseline vision--language models, achieving improvements of 22.01% in precision, 34.22\% in recall, and 28.37% in F1 score over the 72B unfine-tuned baseline. A lightweight web-based interface further integrates MonitorVLM into practical workflows, enabling automatic violation reporting with video timestamping. This study highlights the potential of multimodal large models to enhance occupational safety monitoring in mining and beyond.
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as: arXiv:2510.03666 [cs.CV]
  (or arXiv:2510.03666v3 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2510.03666

arXiv-issued DOI via DataCite

Submission history

From: Jiang Wu [view email]
[v1] Sat, 4 Oct 2025 04:46:21 UTC (2,483 KB)
[v2] Wed, 11 Mar 2026 12:33:18 UTC (2,489 KB)
[v3] Wed, 18 Nov 2026 01:33:40 UTC (7,324 KB)

来源:arXiv cs.AI · arxiv.org