Spectral Bias in Practice: The Role of Function Frequency in Generalization

6 October 2021

Papers citing "Spectral Bias in Practice: The Role of Function Frequency in Generalization"

21 / 21 papers shown

Title
Gradient Descent as a Shrinkage Operator for Spectral Bias Simon Lucey 38 0 0 25 Apr 2025
Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild Damien Teney Liangze Jiang Florin Gogianu Ehsan Abbasnejad 133 0 0 13 Mar 2025
Quantum Circuit Training with Growth-Based Architectures Callum Duffy Smit Chaudhary Gergana V. Velikova 66 0 0 25 Nov 2024
On the expressiveness and spectral bias of KANs Yixuan Wang Jonathan W. Siegel Ziming Liu Thomas Y. Hou 32 9 0 02 Oct 2024
The Clever Hans Effect in Unsupervised Learning Jacob R. Kauffmann Jonas Dippel Lukas Ruff Wojciech Samek Klaus-Robert Müller G. Montavon SSL CML HAI 24 1 0 15 Aug 2024
Learning to Enhance Aperture Phasor Field for Non-Line-of-Sight Imaging In Cho Hyunbo Shim Seon Joo Kim 21 1 0 26 Jul 2024
Exploring connections of spectral analysis and transfer learning in medical imaging Yucheng Lu Dovile Juodelyte Jonathan Victor V. Cheplygina 27 1 0 16 Jul 2024
Parametric Encoding with Attention and Convolution Mitigate Spectral Bias of Neural Partial Differential Equation Solvers Mehdi Shishehbor Shirin Hosseinmardi Ramin Bostanabad AI4CE 32 5 0 22 Mar 2024
SETA: Semantic-Aware Token Augmentation for Domain Generalization Jintao Guo Lei Qi Yinghuan Shi Yang Gao ViT 34 1 0 18 Mar 2024
Why are Sensitive Functions Hard for Transformers? Michael Hahn Mark Rofin 27 23 0 15 Feb 2024
An Information Theoretic Approach to Machine Unlearning Jack Foster Kyle Fogarty Stefan Schoepf Cengiz Öztireli Alexandra Brintrup MU 31 4 0 02 Feb 2024
Spectral Co-Distillation for Personalized Federated Learning Zihan Chen Howard H. Yang Tony Q. S. Quek Kai Fong Ernest Chong OOD FedML 11 13 0 29 Jan 2024
Towards Architecture-Agnostic Untrained Network Priors for Image Reconstruction with Frequency Regularization Yilin Liu Yunkui Pang Jiang-Ping Li Yong Chen P. Yap 29 0 0 15 Dec 2023
Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum Amnon Geifman Daniel Barzilai Ronen Basri Meirav Galun 24 4 0 26 Jul 2023
In-Context Learning through the Bayesian Prism Madhuri Panwar Kabir Ahuja Navin Goyal BDL 25 38 0 08 Jun 2023
Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEs Robert Joseph George Jiawei Zhao Jean Kossaifi Zong-Yi Li Anima Anandkumar AI4CE 11 9 0 28 Nov 2022
On the Activation Function Dependence of the Spectral Bias of Neural Networks Q. Hong Jonathan W. Siegel Qinyan Tan Jinchao Xu 30 22 0 09 Aug 2022
SKDCGN: Source-free Knowledge Distillation of Counterfactual Generative Networks using cGANs Sameer Ambekar Matteo Tafuro Ankit Ankit Diego van der Mast Mark Alence C. Athanasiadis GAN 21 4 0 08 Aug 2022
Models Out of Line: A Fourier Lens on Distribution Shift Robustness Sara Fridovich-Keil Brian Bartoldson James Diffenderfer B. Kailkhura P. Bremer OOD 54 0 0 08 Jul 2022
Globally-Robust Neural Networks Klas Leino Zifan Wang Matt Fredrikson AAML OOD 80 125 0 16 Feb 2021
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,886 0 15 Sep 2016