arXiv cs.AI· Yuchen Zhang·· 12 小时前AI 评分26
CausalEvo:面向健康 LLM 智能体的因果技能自进化方法
CausalEvo: Causal Skill Self-Evolution for Health LLM Agents
AI 导读
CausalEvo 通过估计刻意变更技能集的相对效应来实现健康 LLM 智能体的技能自进化,在 6 项 MedCalc-Bench-Verified 任务、120 个留出案例上达到 60.00% 准确率,高于 SkillOpt 的 55.83% 和无技能基线的 51.67%。
正文 · 原文
Abstract:Large language model (LLM) agents for health can accumulate reusable textual skills from task feedback, such as calculation criteria, measurement time points, and formula units. Deciding which skills to retain is consequential: useful rules improve later answers, while faulty generalizations propagate errors. We propose CausalEvo, a method for causal skill self-evolution that estimates the relative effects of deliberately changed skill sets while holding the model weights, feedback cases, and rule count fixed. At each evolution step, a frozen LLM proposes candidate rules, which are pooled with the incumbent skills so that the current skill set remains a feasible choice. Paired skill replacements against shared background rules are scored on the same feedback cases; least squares converts the score differences into relative skill values, and the top-ranked rules are retained, favoring incumbents on ties. A decision-loss bound separates candidate support, approximation, and estimation errors. On six MedCalc-Bench-Verified tasks with 120 held-out cases, CausalEvo achieves 60.00% accuracy, compared with 55.83% for SkillOpt and 51.67% without skills. Across the recorded training configurations, which use different optimization budgets, it consumes 55.6% fewer training tokens than SkillOpt. Gains concentrate in particular calculations alongside regressions on others, and paired accuracy intervals include zero. CausalEvo turns task feedback into controlled decisions about skill retention and replacement. Project repository: this https URL
| Comments: | GenAI for Health Workshop @ NeurIPS 2026, Sydney |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.21016 [cs.LG] |
| (or arXiv:2610.21016v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.21016 arXiv-issued DOI via DataCite |
Submission history
From: Yuchen Zhang [view email]
[v1]
Wed, 14 Oct 2026 23:23:52 UTC (225 KB)
来源:arXiv cs.AI · arxiv.org