On the Activation Function Dependence of the Spectral Bias of Neural Networks

Speaker: Qinguo Hong (Missouri S&T) Dates: 2024/03/22 Location: MW 154 Abstract: Neural networks are universal function approximators which are known to generalize well despite being dramatically overparameterized. We study this phenomenon from the point of view of the spectral bias…