跳到正文
arXiv cs.AI· Aniruddha Chattopadhyay, Kanishka Halder, Partha Sarathi Roy·· 12 小时前AI 评分35

SchemaShield-Lite:无需重训的 LLM 智能体函数调用接口漂移修复层

Robust Function Calling for LLM Agents Under Interface Drift

AI 导读

SchemaShield-Lite 是一种无需训练的修复层,用于应对 LLM 智能体部署后工具描述、参数 schema 与候选工具列表变化引发的接口漂移问题。在 Qwen3.5-9B 上,它将 DICE-300 准确率从 0.717 提升至 0.813,BFCL-200 从 0.580 提升至 0.805,分别挽回 19/22 和 33/45 的漂移致失败且未观察到修复损害。

正文 · 原文

View PDF HTML (experimental)

Abstract:Tool-augmented language-model agents rely on interface text: tool descriptions, argument schemas, and the candidate tool list shown at inference time. These interfaces often change after deployment even when the underlying tool semantics remain fixed, creating a practical reliability problem for function-calling systems. We study this failure mode as interface drift and evaluate whether a lightweight, training-free repair layer can recover robustness without retraining the base model. Our method, SchemaShield-Lite, combines schema validation, candidate-set retry for missing tool names, and one-shot constrained repair. On Qwen3.5-9B, it raises DICE-300 accuracy from 0.717 to 0.813 and BFCL-200 accuracy from 0.580 to 0.805, recovering 19/22 and 33/45 drift-induced failures with no observed repair harms. Naive retry does not explain the gains. Ablations show that candidate-set drift, especially distractor tools, accounts for most observed damage, while description and schema edits alone are less harmful. The results position validation-and-repair as a practical robustness layer for deployed LLM-agent tool use.
Comments: 16 pages, 1 figure, 6 tables. Peer-reviewed and accepted at NGEN-AI 2026 (International Conference on Next Generation AI Systems). This is the pre-review submitted version
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
Cite as: arXiv:2610.23342 [cs.AI]
  (or arXiv:2610.23342v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2610.23342

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Aniruddha Chattopadhyay [view email]
[v1] Fri, 16 Oct 2026 11:49:37 UTC (35 KB)

来源:arXiv cs.AI · arxiv.org