RadarAI· Umesh Tharuka Malaviarachchi·· 12 小时前AI 评分20
频谱偏差:为什么神经网络先学习低频
AI 导读
神经网络存在频谱偏差,即拟合目标函数低频成分(平滑趋势)的速度远快于高频成分(剧烈波动)。这是梯度下降动力学的固有属性,而非训练缺陷。
正文 · 原文
Neural networks exhibit spectral bias, meaning they fit low-frequency components (smooth trends) of a target function much faster than high-frequency components (sharp wiggles), which is a fundamental property of gradient descent dynamics rather than a training bug.
来源:RadarAI · bestblogs.dev