跳到正文
arXiv cs.AI· Shunyu Wu, Dan Li, Haozheng Ye, Weibin Feng, Jian Lou, Bo Zhang, Wenjie Feng, Chenjuan Guo, See-Kiong Ng·· 11 小时前AI 评分31

TSQAgent:用专用智能体推理为时间序列数据质量打分

TSQAgent: Rating Time Series Data Quality via Dedicated Agentic Reasoning

AI 导读

针对现有 LLM 时间序列质量评估依赖人工预设维度、纯文本推理的问题,研究者构建 TSQBench 基准并提出 TSQAgent 智能体框架,由 Perceiver 选维度、Inspector 做逐维度定量分析、Adjudicator 汇总裁决。

正文 · 原文

View PDF HTML (experimental)

Abstract:Assessing the quality of time series (TS) data is fundamental yet inherently challenging due to the multifaceted nature of quality dimensions. Recently, large language models (LLMs) have emerged as a promising paradigm for TS quality assessment via pairwise comparison and per-dimension evaluation. However, existing approaches rely on manually predefined quality dimensions and purely text-based reasoning, leaving it unknown whether LLMs can identify truly relevant quality dimensions or perform grounded and quantitative quality comparisons. To investigate this, we construct TSQBench, a dedicated benchmark for evaluating LLMs on two progressive capabilities: (i) understanding and identifying relevant quality dimensions, and (ii) performing quality comparison under specific dimensions. Our analysis reveals that current LLMs consistently struggle with both dimension identification and evidence-grounded quality comparison. To address these limitations, we propose TSQAgent, a novel agentic reasoning framework for TS quality rating consisting of three collaborative roles: Perceiver for focused dimension selection, Inspector for dimension-wise quantitative analysis, and Adjudicator that aggregates and refines the final judgment. In particular, we introduce an agentic reasoning strategy that instills the ability to identify and prioritize the most relevant quality dimensions, and further propose an agent workflow equipped with external analytical tools to enable precise quantitative comparisons over selected dimensions. Experiments on both the proposed benchmark and eleven real-world datasets demonstrate that our framework not only substantially improves LLMs' capabilities in quality understanding and quantitative comparison but also effectively translates these improvements into better quality-aware data selection, leading to enhanced downstream performance and data efficiency.
Comments: Accepted at NeurIPS 2026 (Spotlight)
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2606.03629 [cs.AI]
  (or arXiv:2606.03629v2 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2606.03629

arXiv-issued DOI via DataCite

Submission history

From: Shunyu Wu [view email]
[v1] Tue, 2 Jun 2026 13:28:17 UTC (3,647 KB)
[v2] Thu, 5 Nov 2026 02:51:47 UTC (11,498 KB)

来源:arXiv cs.AI · arxiv.org