arXiv cs.CL· Daeyong Kwon, Qiyu Wu, Shinobu Kuriya, Junghyun Koo, Shuyang Cui, Zhi Zhong, Wei-Hsiang Liao, Hiromi Wakaki, Yuki Mitsufuji·· 12 小时前AI 评分31
MusTBench：评测并提升音乐 LLM 的时间定位能力
MusTBench: Benchmarking and Advancing Temporal Grounding in Music LLMs
AI 导读
研究者推出 MusTBench，一个带分轨数据和音乐专家校验的基准，通过五类时间定位问答任务评测大型音频语言模型（LALM）的时间定位能力。配套提出四阶段训练方案 MusT，涵盖音乐编码器适配、LLM 适配、LLM 监督微调与基于 RL 的优化。实验显示现有 LALM 在精确时间定位上仍有困难，而 MusT 在不同 LALM 骨干和规模上均能稳定提升性能。
正文 · 原文
Abstract:Recent Large Audio-Language Models (LALMs) have demonstrated promising abilities in understanding musical content. However, whether their responses are grounded in the correct temporal regions of the audio remains underexplored. This limitation is particularly critical for music understanding, where key information often occurs as temporally localized events, such as instrument entries and rhythmic transitions. To address this gap, we introduce MusTBench, a reliable benchmark with stem-wise data and music-expert validation designed to evaluate temporal grounding in LALMs through five temporally grounded question-answering tasks. To further improve temporal grounding in existing models, we propose MusT, a novel four-stage temporal optimization recipe spanning music encoder adaptation, LLM adaptation, LLM supervised fine-tuning, and RL-based optimization. Experiments on MusTBench show that existing LALMs face challenges in precise temporal grounding, while MusT consistently improves performance across different LALM backbones and scales. These results highlight temporal grounding as an important challenge in current LALMs and provide a benchmark and training recipe that may support future research on temporally grounded music understanding.
| Comments: | Project page: this https URL | Github: this https URL |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD) |
| Cite as: | arXiv:2605.29300 [cs.CL] |
| (or arXiv:2605.29300v3 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2605.29300 arXiv-issued DOI via DataCite |
Submission history
From: Daeyong Kwon [view email]
[v1]
Thu, 28 May 2026 03:28:16 UTC (12,011 KB)
[v2]
Tue, 1 Sep 2026 15:58:50 UTC (12,003 KB)
[v3]
Wed, 4 Nov 2026 13:56:29 UTC (9,735 KB)
来源：arXiv cs.CL · arxiv.org