Qwen-Audio-3.1-ASR 技术报告发布
Qwen-Audio-3.1-ASR Technical Report
阿里发布 Qwen-Audio-3.1-ASR 系列音频语言模型，在前代 Qwen-Audio-3.0-ASR 基础上提升语音识别，并新增说话人分离转写与通用音频理解能力。该系列保留 30 种语言和 16 种中文方言支持，提供历史上下文条件、分层热词定制与原生转写润色等指令控制功能。模型包含异步文件转写、低延迟流式、交互式语音输入和非流式识别等变体，部分变体支持说话人分离转写与通用音频理解。
Computer Science > Sound
arXiv:2610.28711 (cs)
Authors:Chuanmeng Bian, Daren Chen, Peixin Chen, Zhigao Chen, Chong Deng, Zhiyun Fan, Zhifu Gao, Bo Gong, Qing Gu, Jiajun He, Yawei Hu, Yunjie Ji, Wei Ju, Jingbei Li, Xiangang Li, Xu Li, Zengxi Li, Zheng Li, Chengdong Liang, Baiji Liu, Yaming Liu, Ying Liu, Bin Ma, Yiping Peng, Yuezhang Peng, Zhendong Peng, Yu Pu, Yang Shi, Xin Shu, Jian Tang, Biao Tian, Peiyao Wang, Tianzi Wang, Wen Wang, Wupeng Wang, Cheng Wen, Yuzhong Wu, Zijian Xia, Yunchong Xiao, Nan Yang, Jianwei Yu, Jixing Yu, Binbin Zhang, Lei Zhang, Sitong Zhao, Guangdong Zhou, Yuan Zhou, Jianheng Zhuo
Abstract:We present Qwen-Audio-3.1-ASR, a family of audio-language models that builds upon its predecesor Qwen-Audio-3.0-ASR with improved speech recognition and expanded capabilities in speaker-diarized transcription and general audio understanding. The family retains support for 30 languages and 16 Chinese dialects, together with instruction-controlled capabilities including historical-context conditioning, hierarchical hotword customization, and native transcription polishing. Speaker-diarized ASR produces structured outputs containing speaker labels, timestamps, and recognized text, maintaining consistent speaker labels across turns and the representation of overlapping speech. The general audio understanding capabilities cover audio-, speech-, and music-captioning, temporal grounding and sound event detection, as well as audio question answering and multiple-choice reasoning. These tasks broaden the application scope from recognizing spoken words to interpreting speakers, acoustic events, and their temporal relations. To accommodate different deployment requirements, the family includes variants for asynchronous file transcription, low-latency streaming, interactive voice input, and non-streaming recognition, with speaker-diarized transcription and general audio understanding available in certain variants. Evaluations span conventional ASR, multilingual and dialectal speech, speaker-diarized transcription, and general audio understanding, demonstrating the capabilities of the Qwen-Audio-3.1-ASR family across transcription and broader audio analysis tasks.
| Comments: | 31 pages. Authors are listed in alphabetical order of last name. Project page: this https URL |
| Subjects: | Sound (cs.SD); Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.28711 [cs.SD] |
| (or arXiv:2610.28711v1 [cs.SD] for this version) | |
| https://doi.org/10.48550/arXiv.2610.28711 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Jiajun He [view email]
[v1]
Tue, 20 Oct 2026 17:08:12 UTC (2,819 KB)
Current browse context:
cs.SD
Change to browse by:
Bookmark
Bibliographic and Citation Tools
Code, Data and Media Associated with this Article
Demos
Recommenders and Search Tools
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
来源：arXiv cs.CL · arxiv.org