On the Spectral Bias of Neural Networks

22 June 2018

Aaron Courville

Papers citing "On the Spectral Bias of Neural Networks"

26 / 126 papers shown

Title
A Structured Dictionary Perspective on Implicit Neural Representations Gizem Yüce Guillermo Ortiz-Jiménez Beril Besbinar P. Frossard 16 85 0 03 Dec 2021
Hierarchical Learning to Solve Partial Differential Equations Using Physics-Informed Neural Networks Jihun Han Yoonsang Lee AI4CE 14 10 0 02 Dec 2021
ISNAS-DIP: Image-Specific Neural Architecture Search for Deep Image Prior Metin Ersin Arican Ozgur Kara G. Bredell E. Konukoglu 12 17 0 27 Nov 2021
PointMixer: MLP-Mixer for Point Cloud Understanding Jaesung Choe Chunghyun Park François Rameau Jaesik Park In So Kweon 3DPC 21 98 0 22 Nov 2021
Towards Lightweight Controllable Audio Synthesis with Conditional Implicit Neural Representations Jan Zuiderveld Marco Federici Erik J. Bekkers AI4CE 23 6 0 14 Nov 2021
Mesh Draping: Parametrization-Free Neural Mesh Transfer Amir Hertz Or Perel Raja Giryes O. Sorkine-Hornung Daniel Cohen-Or 3DH AI4CE 11 4 0 11 Oct 2021
3D Infomax improves GNNs for Molecular Property Prediction Hannes Stärk Dominique Beaini Gabriele Corso Prudencio Tossou Christian Dallago Stephan Günnemann Pietro Lió AI4CE 13 202 0 08 Oct 2021
Neural Knitworks: Patched Neural Implicit Representation Networks Mikolaj Czerkawski Javier Cardona Robert C. Atkinson W. Michie I. Andonovic C. Clemente Christos Tachtatzis 14 11 0 29 Sep 2021
MLReal: Bridging the gap between training on synthetic data and real data applications in machine learning T. Alkhalifah Hanchen Wang O. Ovcharenko OOD 28 63 0 11 Sep 2021
imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Pose Thiemo Alldieck Hongyi Xu C. Sminchisescu 3DH 24 116 0 24 Aug 2021
A neural anisotropic view of underspecification in deep learning Guillermo Ortiz-Jiménez I. Salazar-Reque Apostolos Modas Seyed-Mohsen Moosavi-Dezfooli P. Frossard 18 6 0 29 Apr 2021
Exact imposition of boundary conditions with distance functions in physics-informed deep neural networks N. Sukumar Ankit Srivastava PINN AI4CE 34 239 0 17 Apr 2021
COTR: Correspondence Transformer for Matching Across Images Wei Jiang Eduard Trulls J. Hosang Andrea Tagliasacchi K. M. Yi ViT 17 256 0 25 Mar 2021
Fighting deepfakes by detecting GAN DCT anomalies O. Giudice Luca Guarnera S. Battiato 8 85 0 24 Jan 2021
FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training Y. Fu Haoran You Yang Katie Zhao Yue Wang Chaojian Li K. Gopalakrishnan Zhangyang Wang Yingyan Lin MQ 19 32 0 24 Dec 2020
Unsupervised part representation by Flow Capsules S. Sabour Andrea Tagliasacchi S. Yazdani Geoffrey E. Hinton David J. Fleet 3DPC OCL 14 36 0 27 Nov 2020
Gradient Starvation: A Learning Proclivity in Neural Networks Mohammad Pezeshki Sekouba Kaba Yoshua Bengio Aaron Courville Doina Precup Guillaume Lajoie MLT 24 257 0 18 Nov 2020
Whitening and second order optimization both make information in the dataset unusable during training, and can reduce or prevent generalization Neha S. Wadia Daniel Duckworth S. Schoenholz Ethan Dyer Jascha Narain Sohl-Dickstein 6 13 0 17 Aug 2020
Learning Implicit Surface Light Fields Michael Oechsle Michael Niemeyer L. Mescheder Thilo Strauss Andreas Geiger 3DH 3DV 16 43 0 27 Mar 2020
Frequency Bias in Neural Networks for Input of Non-Uniform Density Ronen Basri Meirav Galun Amnon Geifman David Jacobs Yoni Kasten S. Kritchman 16 182 0 10 Mar 2020
Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks Blake Bordelon Abdulkadir Canatar C. Pehlevan 125 199 0 07 Feb 2020
Implicit Regularization in Deep Matrix Factorization Sanjeev Arora Nadav Cohen Wei Hu Yuping Luo AI4CE 11 491 0 31 May 2019
A type of generalization error induced by initialization in deep neural networks Yaoyu Zhang Zhi-Qin John Xu Tao Luo Zheng Ma 9 49 0 19 May 2019
On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Models Erik Nijkamp Mitch Hill Tian Han Song-Chun Zhu Ying Nian Wu 9 150 0 29 Mar 2019
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,696 0 15 Sep 2016
Benefits of depth in neural networks Matus Telgarsky 121 600 0 14 Feb 2016