跳到正文
arXiv cs.CL· Yue Leng, Shengtao Wen, Xiang Chen, Xinyi Zeng, Yu Tian, Sheng-Jun Huang·· 11 小时前AI 评分26

CREDO:面向时序推理智能体的证据条件化信用分配方法

CREDO: Evidence-Conditioned Credit Assignment for Temporal Reasoning Agents

AI 导读

CREDO 通过中间证据恢复局部监督信号,解决 GRPO 轨迹级奖励无法区分中间决策质量的问题,在全部失败组中也能重新分配信用。在 MultiTQ 上,CREDO 将 Overall 准确率从 78.0% 提升至 82.4%,Multiple 准确率从 55.0% 提升至 65.6%;在 TimelineKGQA 上,跨 KG 准确率从 30.9% 提升至 36.4%。

正文 · 原文

View PDF HTML (experimental)

Abstract:Temporal Knowledge Graph Question Answering (TKGQA) requires language model agents to retrieve evidence, select relevant facts, and perform multi-step temporal reasoning. However, the trajectory-level outcome signal in GRPO does not explicitly distinguish the quality of intermediate decisions: downstream failures can penalize useful evidence acquisition, while identical rewards in all-failed groups eliminate the relative outcome signal despite differences in intermediate progress. We propose Credit Redistribution with Evidence-Driven Opportunities (CREDO), which uses intermediate evidence to recover local supervision, including in all-failed groups, and determine where outcome supervision acts. CREDO assigns positive stage-level credit through comparisons among rollouts of the same question and uses retained answer overlap as an opportunity proxy to shift part of the outcome-policy weight toward reasoning and answering. The framework preserves terminal rewards and trajectory-level advantages, while redistribution conserves total outcome-policy weight per trajectory. Following the public evaluation protocol of prior work, CREDO raises Overall accuracy from 78.0% to 82.4% and Multiple accuracy from 55.0% to 65.6% on MultiTQ relative to the strongest published baseline in our comparison. On TimelineKGQA, it raises cross-KG accuracy from 30.9% to 36.4% relative to our reproduced baseline via direct transfer to ICEWS Actor under matched training and evaluation settings.
Comments: Code available at this https URL
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
Cite as: arXiv:2611.01643 [cs.LG]
  (or arXiv:2611.01643v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2611.01643

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Shengtao Wen [view email]
[v1] Sun, 1 Nov 2026 06:46:51 UTC (733 KB)

来源:arXiv cs.CL · arxiv.org