约束感知影响估计：面向深度约束学习的 Directional Influence Function

View PDF HTML (experimental)

Abstract:Constrained learning has been increasingly applied to various domains to ensure explicit feasibility requirements due to fairness, safety, robustness, regularization, and physics or logic constraints. Understanding how training samples influence the solution (e.g., learned parameters) of constrained learning is crucial for interpretability and robustness. The classical influence function may become unreliable in constrained settings: data perturbations can reshape both the objective and the feasible region, leading to estimates that violate feasibility. In response, we propose the Directional Influence Function (DIF), a new estimator that explicitly incorporates the constraints into influence estimation. DIF formulates the optimality conditions of constrained learning as a variational inequality (VI) and analyzes how perturbing training data affects this VI. We validate DIF in constrained linear regression and demonstrate that it recovers leave-one-out retraining results, whereas IF and penalty-based IF exhibit significant bias. We further apply DIF to fairness-constrained CNNs, where DIF accurately predicts test loss changes under data removal and aligns closely with actual retraining. Our results establish DIF as an efficient and reliable tool for data attribution in constrained learning.

Submission history

From: Xin Wang [view email]
[v1] Sat, 25 Jul 2026 22:50:09 UTC (170 KB)
[v2] Tue, 28 Jul 2026 03:42:07 UTC (1 KB) (withdrawn)
[v3] Wed, 29 Jul 2026 01:25:56 UTC (170 KB)
[v4] Tue, 13 Oct 2026 17:08:40 UTC (515 KB)