跳到正文
arXiv cs.AI· Yuxiang Wang, Baojian Zhou, Qifang Zhao, Keyue Jiang, Yanghua Xiao, Xiaoxiao Xu·· 14 小时前AI 评分40

ProtAgent:用交互级信用分配后训练紧凑蛋白质工具智能体

ProtAgent: Post-Training Compact Protein Tool Agents with Interaction-Level Credit Assignment

AI 导读

ProtAgent 用两阶段后训练让紧凑模型学会调用真实生物信息学工具:先以 SFT 学习工具接口,再用 on-policy REINFORCE 优化交互策略,并把中间工具调用奖励与最终答案奖励按 step-level 回报分配给产生它们的动作。

正文 · 原文

View PDF HTML (experimental)

Abstract:Protein annotation agents must choose suitable bioinformatics tools, interpret their outputs, and use the resulting evidence in the final answer. Most existing systems rely on frontier-scale models. We ask whether a compact model can instead learn this behavior through post-training with real tool interaction. We present ProtAgent, a two-stage pipeline that uses supervised fine-tuning (SFT) to learn the tool interface and standard on-policy REINFORCE to improve the interaction policy. Intermediate tool calls receive action rewards, and the final response receives a terminal answer reward. Step-level returns assign these rewards to the responses that produced them and to preceding actions. The episode-level baseline instead assigns one episode return to every action. On a fixed closed-loop protocol with real bioinformatics tools, ProtAgent-8B achieves 61.00% success under the annotation-coverage metric, compared with 41.60% for DeepSeek-V3.2-Thinking 671B and 60.80% for the strongest evaluated frontier system. In the three-seed comparison, mean success is 42.70% with episode-level returns and 61.40% with step-level returns under identity return normalization; the corresponding group-relative results are 36.50% and 58.20%. The metric measures recovery of reference annotations under this protocol; it does not by itself establish biological correctness or complete evidence grounding.
Comments: 20 pages, 2 figures
Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.33746 [q-bio.QM]
  (or arXiv:2610.33746v1 [q-bio.QM] for this version)
  https://doi.org/10.48550/arXiv.2610.33746

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Yuxiang Wang [view email]
[v1] Sat, 24 Oct 2026 15:42:13 UTC (270 KB)

来源:arXiv cs.AI · arxiv.org