Sequential Fitting: A Different Perspective on the Spectral Bias of Neural Networks
Towards Data Science3803 字 (约 16 分钟)
85
Neural networks exhibit a 'spectral bias' when fitting high-frequency functions, fitting low-frequency components first, which leads to inefficient training. This article analyzes this phenomenon from different perspectives and provides explanations.
入选理由：神经网络在拟合高频率函数时需要更多训练轮次，导致效率低下。
FeaturedArticle#Neural Networks#Spectral Bias#Machine Learning#Activation Functions英文