arXiv cs.AI· Wei Yang, Qing Ping, Youzhi Luo, Yawei Wang, Abhishek Kumar, Panpan Xu, Jun Huan·· 6 天前AI 评分24
EvoSyn:通过演化生成空间实现闭环学习的智能体数据合成
Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning
AI 导读
针对合成数据中反馈与决策脱节的问题,研究者提出 EvoSyn——一个由学习反馈驱动的多智能体框架,通过可修订状态组织合成过程,将学习者反馈转化为合成修订,并支持生成空间的扩展。在 τ²-Bench 和 CAR-Bench 上,EvoSyn 平均任务成功率较最强合成基线提升 13.3 个百分点,同时生成质量更高、结构更广的合成经验。
正文 · 原文
Abstract:The continued improvement of large language models increasingly depends on synthetic experience, yet effective data synthesis for interactive agents requires not only executable and verifiable trajectories, but also interactions that provide learning value for the current task agent. Existing methods increasingly incorporate environment feedback, data validation, or learner failures, but still face a feedback-to-decision gap: observed weaknesses do not directly specify how future synthesis should change, or whether they can be represented by the current synthesis space. To address this gap, we propose EvoSyn, a learning-feedback-driven multi-agent framework that organizes synthesis around a revisable state specifying what interaction factors can be deliberately generated and where synthesis effort should be allocated. A role-specialized multi-agent system translates learner feedback into synthesis revisions, while a Designer allocates synthesis directions and a Planner grounds them into executable experience. This process enables within-space adaptation toward weak or under-covered regions and synthesis-space expansion that promotes newly discovered factors into explicit generation controls. Experiments on $\tau^2$-Bench and CAR-Bench show that EvoSyn improves average task success by 13.3 points over the strongest synthesis baseline, while producing higher-quality and structurally broader synthetic experience and discovering controllable factors missed without learner feedback.
| Subjects: | Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA) |
| Cite as: | arXiv:2610.12593 [cs.AI] |
| (or arXiv:2610.12593v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.12593 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Wei Yang [view email]
[v1]
Thu, 8 Oct 2026 18:17:20 UTC (5,980 KB)
来源:arXiv cs.AI · arxiv.org