跳到正文
arXiv:cs.AI· Wei Yang, Qing Ping, Youzhi Luo, Yawei Wang, Abhishek Kumar, Panpan Xu, Jun Huan·· 11 小时前

EvoSyn:用演化生成空间实现闭环学习的智能体数据合成框架

Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning

AI 导读

研究者提出 EvoSyn,一个由学习反馈驱动的多智能体数据合成框架,通过可修订状态来组织合成过程。该框架用角色分工的多智能体系统将学习者的反馈转化为合成修订,由 Designer 分配合成方向、Planner 落地为可执行经验,从而在生成空间内适应薄弱区域并扩展生成空间。在 τ²-Bench 和 CAR-Bench 上,EvoSyn 的平均任务成功率比最强合成基线提升 13.3 个百分点。

正文

View PDF HTML (experimental)

Abstract:The continued improvement of large language models increasingly depends on synthetic experience, yet effective data synthesis for interactive agents requires not only executable and verifiable trajectories, but also interactions that provide learning value for the current task agent. Existing methods increasingly incorporate environment feedback, data validation, or learner failures, but still face a feedback-to-decision gap: observed weaknesses do not directly specify how future synthesis should change, or whether they can be represented by the current synthesis space. To address this gap, we propose EvoSyn, a learning-feedback-driven multi-agent framework that organizes synthesis around a revisable state specifying what interaction factors can be deliberately generated and where synthesis effort should be allocated. A role-specialized multi-agent system translates learner feedback into synthesis revisions, while a Designer allocates synthesis directions and a Planner grounds them into executable experience. This process enables within-space adaptation toward weak or under-covered regions and synthesis-space expansion that promotes newly discovered factors into explicit generation controls. Experiments on $\tau^2$-Bench and CAR-Bench show that EvoSyn improves average task success by 13.3 points over the strongest synthesis baseline, while producing higher-quality and structurally broader synthetic experience and discovering controllable factors missed without learner feedback.
Subjects: Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
Cite as: arXiv:2610.12593 [cs.AI]
  (or arXiv:2610.12593v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2610.12593

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Wei Yang [view email]
[v1] Thu, 8 Oct 2026 18:17:20 UTC (5,980 KB)

来源:arXiv:cs.AI · arxiv.org