Understanding training and generalization in deep learning by Fourier analysis

13 August 2018

Papers citing "Understanding training and generalization in deep learning by Fourier analysis"

13 / 13 papers shown

Title
Implicit Neural Representations with Fourier Kolmogorov-Arnold Networks Ali Mehrabian Parsa Mojarad Adi Moein Heidari I. Hacihaliloglu 36 3 0 14 Sep 2024
On the Activation Function Dependence of the Spectral Bias of Neural Networks Q. Hong Jonathan W. Siegel Qinyan Tan Jinchao Xu 32 22 0 09 Aug 2022
Explanation-based Counterfactual Retraining(XCR): A Calibration Method for Black-box Models Liu Zhendong Wenyu Jiang Yan Zhang Chongjun Wang CML 6 0 0 22 Jun 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Yaoyu Zhang Tao Luo FaML 25 65 0 19 Jan 2022
Discovering and Explaining the Representation Bottleneck of DNNs Huiqi Deng Qihan Ren Hao Zhang Quanshi Zhang 32 59 0 11 Nov 2021
Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networks S. Maddu D. Sturm Christian L. Müller I. Sbalzarini AI4CE 13 80 0 02 Jul 2021
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 22 79 0 17 Sep 2020
Towards Understanding the Spectral Bias of Deep Learning Yuan Cao Zhiying Fang Yue Wu Ding-Xuan Zhou Quanquan Gu 16 214 0 03 Dec 2019
A Phase Shift Deep Neural Network for High Frequency Approximation and Wave Problems Wei Cai Xiaoguang Li Lizuo Liu 9 84 0 23 Sep 2019
Theory of the Frequency Principle for General Deep Neural Networks Tao Luo Zheng Ma Zhi-Qin John Xu Yaoyu Zhang 16 78 0 21 Jun 2019
A type of generalization error induced by initialization in deep neural networks Yaoyu Zhang Zhi-Qin John Xu Tao Luo Zheng Ma 9 49 0 19 May 2019
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min-Bin Lin Fred Hamprecht Yoshua Bengio Aaron Courville 28 1,384 0 22 Jun 2018
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,886 0 15 Sep 2016