跳到正文
arXiv cs.CL· Jiapu Wang·· 12 小时前AI 评分26

TEPCA:面向时序知识图谱 LLM 推理的证据-参数协同对齐框架

Temporal Evidence-Parameter Co-Alignment for LLM Reasoning over Temporal Knowledge Graphs

AI 导读

研究者提出 TEPCA 框架,在证据与参数两个层面将 LLM 推理与时序知识对齐。证据层用时间约束的动态相关性引导路径(DRGP)剪枝与互信息剪枝保留时序连贯路径,参数层引入时间戳条件化的 Dynamic-Gated LoRA(DG-LoRA)动态调整低秩适配子空间。在两个 TKG 基准上取得 SOTA,DG-LoRA 在八个常识 QA 数据集上验证了输入自适应能力与跨 LLM 主干的可扩展性。

正文 · 原文

View PDF HTML (experimental)

Abstract:Large Language Models (LLMs) often struggle with temporally grounded reasoning because their static parametric memory is misaligned with the dynamic evolution of real-world knowledge. Although RAG and Parameter-Efficient Fine-Tuning (PEFT) provide practical ways to enhance LLMs, they remain insufficient for temporal reasoning. Existing retrieval methods typically prioritize semantic relevance while overlooking temporal validity, event order, and evolutionary dependencies, resulting in evidence that is relevant in isolation but temporally fragmented. Meanwhile, conventional PEFT methods usually employ fixed and input-agnostic low-rank updates, making it difficult to capture time-dependent entity semantics and relation drift. To address these limitations, we propose Temporal Evidence-Parameter Co-Alignment (TEPCA), a framework for LLM reasoning over TKGs. TEPCA aligns LLM reasoning with temporal knowledge at both the evidence and parameter levels. At the evidence level, it introduces time-constrained Dynamic Relevance-Guided Path (DRGP) pruning to preserve globally coherent temporal paths, together with Mutual-Information (MI)-based pruning to retain query-informative local facts under temporal constraints. At the parameter level, it integrates Dynamic-Gated LoRA (DG-LoRA), a timestamp-conditioned low-rank adaptation mechanism that dynamically modulates the effective adaptation subspace according to temporal context. This design enables LLMs to better capture fine-grained entity evolution and time-dependent relation semantics while preserving parameter efficiency. Experimental results on two TKG benchmarks demonstrate that TEPCA achieves state-of-the-art performance. Additional evaluations of DG-LoRA on eight commonsense QA datasets further verify its general input-adaptive capacity, scalability across LLM backbones, and interpretability.
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.28176 [cs.CL]
  (or arXiv:2610.28176v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2610.28176

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Jiapu Wang [view email]
[v1] Tue, 20 Oct 2026 13:16:17 UTC (3,792 KB)

来源:arXiv cs.CL · arxiv.org