arXiv cs.AI· Michael Obermayr, Robert Peharz·· 9 天前AI 评分18
如何发现并修复 Bayesian PINN 中的对撞偏差
Uncovering and Fixing Collider Bias in Bayesian PINNs
AI 导读
研究揭示 Bayesian PINNs(B-PINNs)常用的对撞结构会引发物理参数后验的严重系统性偏差,即使先验以真值为中心,后验仍会漂移并远离真值。作者提出层级链模型(物理生成轨迹、轨迹生成观测)来规避该偏差,并通过离散化随机动力学后用 particle MCMC 精确采样,解决了由此带来的 doubly intractable 推断难题。实验证实了预测的偏差,并表明链式建模能成功避免该问题。
正文 · 原文
Abstract:Bayesian physics-informed neural networks (B-PINNs) are a popular framework for parameter and state inference from sparse or noisy observations. They are commonly formulated via a collider structure, in which physical and trajectory parameters are assumed to be a priori independent and become coupled through virtual likelihoods on differential-equation residuals that enforce physical consistency. We show that this modeling choice can induce severe systematic bias in the posterior over physical parameters: even when the prior is favorably centered on the ground-truth parameters, the resulting posterior can drift away and concentrate far from them. As a remedy, we advocate a hierarchical chain model in which physics generates trajectories, which in turn generate observations. The chain model does not suffer from this posterior bias, but it poses a harder, so-called doubly intractable, inference problem due to a physics-dependent normalization constant. This challenge can be resolved by discretizing the underlying stochastic dynamics, after which the chain posterior can be sampled exactly with particle MCMC. We identify two distinct mechanisms characterizing the collider bias, derive analytical approximations of their magnitudes, and establish diagnostic criteria for predicting when standard B-PINNs remain reliable. Experiments confirm the predicted bias and show that the chain formulation successfully avoids it.
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.11737 [cs.LG] |
| (or arXiv:2610.11737v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.11737 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Robert Peharz [view email]
[v1]
Thu, 8 Oct 2026 11:31:19 UTC (185 KB)
来源:arXiv cs.AI · arxiv.org