Overview frequency principle/spectral bias in deep learning

19 January 2022

Papers citing "Overview frequency principle/spectral bias in deep learning"

40 / 40 papers shown

Title
An overview of condensation phenomenon in deep learning Zhi-Qin John Xu Yaoyu Zhang Zhangchen Zhou AI4CE 22 0 0 13 Apr 2025
Scalable physics-informed deep generative model for solving forward and inverse stochastic differential equations Shaoqian Zhou Wen You Ling Guo Xuhui Meng DiffM MedIm 51 0 0 23 Mar 2025
Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild Damien Teney Liangze Jiang Florin Gogianu Ehsan Abbasnejad 79 0 0 13 Mar 2025
ReFocus: Reinforcing Mid-Frequency and Key-Frequency Modeling for Multivariate Time Series Forecasting Guoqi Yu Yaoming Li Juncheng Wang Xiaoyu Guo Angelica I. Aviles-Rivero Tong Yang Shujun Wang AI4TS 44 0 0 24 Feb 2025
Hypernym Bias: Unraveling Deep Classifier Training Dynamics through the Lens of Class Hierarchy Roman Malashin Valeria Yachnaya Alexander Mullin 31 1 0 17 Feb 2025
Learn Sharp Interface Solution by Homotopy Dynamics Chuqi Chen Yahong Yang Yang Xiang Wenrui Hao ODL 57 1 0 01 Feb 2025
Addressing Spectral Bias of Deep Neural Networks by Multi-Grade Deep Learning Ronglong Fang Yuesheng Xu 19 0 0 21 Oct 2024
GlobalMamba: Global Image Serialization for Vision Mamba Chengkun Wang Wenzhao Zheng Jie Zhou Jiwen Lu Mamba 31 0 0 14 Oct 2024
Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precision Jakin Ng Yongjian Wang Ching-Yao Lai 33 0 0 24 Jul 2024
DenoDet: Attention as Deformable Multi-Subspace Feature Denoising for Target Detection in SAR Images Yimian Dai Minrui Zou Yuxuan Li Xiang Li Kang Ni Jian Yang 16 4 0 05 Jun 2024
A rationale from frequency perspective for grokking in training neural network Zhangchen Zhou Yaoyu Zhang Z. Xu 28 2 0 24 May 2024
Loss Jump During Loss Switch in Solving PDEs with Neural Networks Zhiwei Wang Lulu Zhang Zhongwang Zhang Z. Xu 16 0 0 06 May 2024
Architectural Strategies for the optimization of Physics-Informed Neural Networks Hemanth Saratchandran Shin-Fang Chng Simon Lucey AI4CE 15 0 0 05 Feb 2024
Spectral Co-Distillation for Personalized Federated Learning Zihan Chen Howard H. Yang Tony Q. S. Quek Kai Fong Ernest Chong OOD FedML 6 13 0 29 Jan 2024
Anchor function: a type of benchmark functions for studying language models Zhongwang Zhang Zhiwei Wang Junjie Yao Zhangchen Zhou Xiaolong Li E. Weinan Z. Xu 26 5 0 16 Jan 2024
Frequency Domain-based Dataset Distillation DongHyeok Shin Seungjae Shin Il-Chul Moon DD 20 18 0 15 Nov 2023
Partition Speeds Up Learning Implicit Neural Representations Based on Exponential-Increase Hypothesis Ke Liu Feng Liu Haishuai Wang Ning Ma Jiajun Bu Bo Han 11 11 0 22 Oct 2023
Interpretable structural model error discovery from sparse assimilation increments using spectral bias-reduced neural networks: A quasi-geostrophic turbulence test case R. Mojgani A. Chattopadhyay P. Hassanzadeh 15 6 0 22 Sep 2023
Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum Amnon Geifman Daniel Barzilai Ronen Basri Meirav Galun 14 4 0 26 Jul 2023
Towards Building More Robust Models with Frequency Bias Qingwen Bu Dong Huang Heming Cui AAML 8 10 0 19 Jul 2023
Loss Spike in Training Neural Networks Zhongwang Zhang Z. Xu 15 4 0 20 May 2023
Temporal Subsampling Diminishes Small Spatial Scales in Recurrent Neural Network Emulators of Geophysical Turbulence T. A. Smith S. Penny Jason A. Platt Tse-Chun Chen 15 5 0 28 Apr 2023
Do deep neural networks have an inbuilt Occam's razor? Chris Mingard Henry Rees Guillermo Valle Pérez A. Louis UQCV BDL 19 15 0 13 Apr 2023
Multi-Grade Deep Learning Yuesheng Xu 13 4 0 01 Feb 2023
A Mathematical Framework for Learning Probability Distributions Hongkang Yang 11 7 0 22 Dec 2022
QFF: Quantized Fourier Features for Neural Field Representations Jae Yong Lee Yuqun Wu Chuhang Zou Shenlong Wang Derek Hoiem MQ 25 4 0 02 Dec 2022
On the Activation Function Dependence of the Spectral Bias of Neural Networks Q. Hong Jonathan W. Siegel Qinyan Tan Jinchao Xu 17 22 0 09 Aug 2022
Implicit regularization of dropout Zhongwang Zhang Zhi-Qin John Xu 14 21 0 13 Jul 2022
Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow Adam Subel Yifei Guan A. Chattopadhyay P. Hassanzadeh AI4CE 11 35 0 07 Jun 2022
Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width Hanxu Zhou Qixuan Zhou Zhenyuan Jin Tao Luo Yaoyu Zhang Zhi-Qin John Xu 12 20 0 24 May 2022
The Devil is in the Frequency: Geminated Gestalt Autoencoder for Self-Supervised Visual Pre-Training Hao Liu Xinghua Jiang Xin Li Antai Guo Deqiang Jiang Bo Ren 11 36 0 18 Apr 2022
Limitation of Characterizing Implicit Regularization by Data-independent Functions Leyang Zhang Z. Xu Tao Luo Yaoyu Zhang 6 0 0 28 Jan 2022
Frequency Principle in Deep Learning Beyond Gradient-descent-based Training Yuheng Ma Zhi-Qin John Xu Jiwei Zhang 14 7 0 04 Jan 2021
Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans Sida Peng Yuanqing Zhang Yinghao Xu Qianqian Wang Qing Shuai Hujun Bao Xiaowei Zhou 3DH 189 681 0 31 Dec 2020
On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks Sifan Wang Hanwen Wang P. Perdikaris 126 435 0 18 Dec 2020
$NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation framework$ NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation framework O. Hennigh S. Narasimhan M. A. Nabian Akshay Subramaniam Kaustubh Tangsali M. Rietmann J. Ferrandis Wonmin Byeon Z. Fang S. Choudhry PINN AI4CE 85 112 0 14 Dec 2020
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 197 2,254 0 18 Oct 2020
Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains Ziqi Liu Wei Cai Zhi-Qin John Xu AI4CE 112 122 0 22 Jul 2020
Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks Blake Bordelon Abdulkadir Canatar C. Pehlevan 128 199 0 07 Feb 2020
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 175 1,182 0 30 Nov 2014