On the Spectral Bias of Neural Networks

22 June 2018

Aaron Courville

Papers citing "On the Spectral Bias of Neural Networks"

50 / 86 papers shown

Title
Attention to Detail: Fine-Scale Feature Preservation-Oriented Geometric Pre-training for AI-Driven Surrogate Modeling Yu-Hsuan Chen Jing Bi Cyril Ngo Ngoc Victor Oancea Jonathan Cagan L. Kara AI4CE 19 0 0 27 Apr 2025
QFGN: A Quantum Approach to High-Fidelity Implicit Neural Representations Hongni Jin Gurinder Singh Kenneth M. Merz Jr 33 0 0 26 Apr 2025
Physics-Driven Neural Compensation For Electrical Impedance Tomography Chuyu Wang Huiting Deng Dong Liu 19 0 0 25 Apr 2025
Spectral Bias Correction in PINNs for Myocardial Image Registration of Pathological Data Bastien C. Baluyot Marta Varela Chen Qin 14 0 0 24 Apr 2025
Frequency-Compensated Network for Daily Arctic Sea Ice Concentration Prediction Jialiang Zhang Feng Gao Yanhai Gan Junyu Dong Q. Du 17 0 0 23 Apr 2025
Generalization through variance: how noise shapes inductive biases in diffusion models John J. Vastola DiffM 45 1 0 16 Apr 2025
FANeRV: Frequency Separation and Augmentation based Neural Representation for Video Li Yu Zhihui Li Chao Yao Jimin Xiao M. Gabbouj 23 0 0 09 Apr 2025
Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Exploration Yi-Tang Chen Haoyu Li Neng Shi Xihaier Luo Wei-ping Xu Han-Wei Shen 34 0 0 01 Apr 2025
FREAK: Frequency-modulated High-fidelity and Real-time Audio-driven Talking Portrait Synthesis Ziqi Ni Ao Fu Yi Zhou 54 0 0 06 Mar 2025
Towards Lossless Implicit Neural Representation via Bit Plane Decomposition Woo Kyoung Han Byeonghun Lee Hyunmin Cho Sunghoon Im Kyong Hwan Jin MQ 39 0 0 28 Feb 2025
A distributional simplicity bias in the learning dynamics of transformers Riccardo Rende Federica Gerace A. Laio Sebastian Goldt 60 7 0 17 Feb 2025
EEG Artifact Detection and Correction with Deep Autoencoders David Aquilué-Llorens Aureli Soria-Frisch 30 0 0 12 Feb 2025
ViSIR: Vision Transformer Single Image Reconstruction Method for Earth System Models Ehsan Zeraatkar Salah Faroughi Jelena Tešić 95 0 0 10 Feb 2025
STAF: Sinusoidal Trainable Activation Functions for Implicit Neural Representation Alireza Morsali MohammadJavad Vaez Hossein Soltani A. Kazerouni Babak Taati Morteza Mohammad-Noori 63 1 0 02 Feb 2025
A theoretical framework for overfitting in energy-based modeling Giovanni Catania A. Decelle Cyril Furtlehner Beatriz Seoane 52 1 0 31 Jan 2025
Enhancing Implicit Neural Representations via Symmetric Power Transformation Weixiang Zhang Shuzhao Xie Chengwei Ren Shijia Ge Mingzi Wang Zhi Wang 64 2 0 12 Dec 2024
Black Swan: Abductive and Defeasible Video Reasoning in Unpredictable Events Aditya Chinchure Sahithya Ravi R. Ng Vered Shwartz Boyang Albert Li Leonid Sigal ReLM LRM VLM 69 2 0 07 Dec 2024
Continuous K-space Recovery Network with Image Guidance for Fast MRI Reconstruction Yucong Meng Zhiwei Yang Minghong Duan Yonghong Shi Zhijian Song 23 1 0 18 Nov 2024
SIGMA: Single Interpolated Generative Model for Anomalies Ranit Das David Shih DiffM 22 2 0 27 Oct 2024
Transfer Learning on Multi-Dimensional Data: A Novel Approach to Neural Network-Based Surrogate Modeling Adrienne M. Propp Daniel M. Tartakovsky AI4CE 18 2 0 16 Oct 2024
SHAP values via sparse Fourier representation Ali Gorji Andisheh Amrollahi A. Krause FAtt 25 0 0 08 Oct 2024
Fast Training of Sinusoidal Neural Fields via Scaling Initialization Taesun Yeom Sangyoon Lee Jaeho Lee 31 2 0 07 Oct 2024
Fourier PINNs: From Strong Boundary Conditions to Adaptive Fourier Bases Madison Cooley Varun Shankar Robert M. Kirby Shandian Zhe 22 2 0 04 Oct 2024
On the expressiveness and spectral bias of KANs Yixuan Wang Jonathan W. Siegel Ziming Liu Thomas Y. Hou 22 9 0 02 Oct 2024
LaDTalk: Latent Denoising for Synthesizing Talking Head Videos with High Frequency Details Jian Yang Xukun Wang Wentao Wang Guoming Li Qihang Fang Ruihong Yuan Tianyang Wang Jason Zhaoxin Fan Yeying Jin Zhaoxin Fan VGen 28 1 0 01 Oct 2024
Scientific Machine Learning Seismology Tomohisa Okazaki PINN AI4CE 41 0 0 27 Sep 2024
Moner: Motion Correction in Undersampled Radial MRI with Unsupervised Neural Representation Qing Wu Chenhe Du Xuanyu Tian Jingyi Yu Yuyao Zhang Hongjiang Wei 11 0 0 25 Sep 2024
Implicit Neural Representations with Fourier Kolmogorov-Arnold Networks Ali Mehrabian Parsa Mojarad Adi Moein Heidari I. Hacihaliloglu 13 3 0 14 Sep 2024
Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precision Jakin Ng Yongjian Wang Ching-Yao Lai 20 0 0 24 Jul 2024
Attention Beats Linear for Fast Implicit Neural Representation Generation Shuyi Zhang Ke Liu Jingjun Gu Xiaoxu Cai Zhihua Wang Jiajun Bu Haishuai Wang 18 1 0 22 Jul 2024
Many Perception Tasks are Highly Redundant Functions of their Input Data Rahul Ramesh Anthony Bisulco Ronald W. DiTullio Linran Wei Vijay Balasubramanian Kostas Daniilidis Pratik Chaudhari 23 1 0 18 Jul 2024
Deep Learning without Global Optimization by Random Fourier Neural Networks Owen Davis Gianluca Geraci Mohammad Motamed BDL 35 0 0 16 Jul 2024
Frequency and Generalisation of Periodic Activation Functions in Reinforcement Learning Augustine N. Mavor-Parker Matthew J. Sargent Caswell Barry Lewis D. Griffin Clare Lyle 29 2 0 09 Jul 2024
Exploring Cross-Domain Few-Shot Classification via Frequency-Aware Prompting Tiange Zhang Qing Cai Feng Gao Lin Qi Junyu Dong 14 1 0 24 Jun 2024
An Advanced Physics-Informed Neural Operator for Comprehensive Design Optimization of Highly-Nonlinear Systems: An Aerospace Composites Processing Case Study Milad Ramezankhani A. Deodhar Rishi Parekh Dagnachew Birru AI4CE 18 3 0 20 Jun 2024
Model-based learning for multi-antenna multi-frequency location-to-channel mapping Baptiste Chatelier Vincent Corlay M. Crussiére Luc Le Magoarou 19 1 0 17 Jun 2024
Grounding Continuous Representations in Geometry: Equivariant Neural Fields David R. Wessels David M. Knigge Samuele Papa Riccardo Valperga Sharvaree P. Vadgama E. Gavves Erik J. Bekkers 28 7 0 09 Jun 2024
Quantum Implicit Neural Representations Jiaming Zhao Wenbo Qiao Peng Zhang Hui Gao 31 3 0 06 Jun 2024
BANF: Band-limited Neural Fields for Levels of Detail Reconstruction Ahan Shabanov Shrisudhan Govindarajan Cody Reading Lily Goli Daniel Rebain Kwang Moo Yi Andrea Tagliasacchi 20 5 0 19 Apr 2024
O2V-Mapping: Online Open-Vocabulary Mapping with Neural Implicit Representation Muer Tie Julong Wei Zhengjun Wang Ke Wu Shansuai Yuan Kaizhao Zhang Jie Jia Jieru Zhao Zhongxue Gan Wenchao Ding 26 7 0 10 Apr 2024
Federated Multi-Agent Mapping for Planetary Exploration Tiberiu-Ioan Szatmari Abhishek Cauligi FedML AI4CE 16 0 0 02 Apr 2024
Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations GuanWen Qiu Da Kuang Surbhi Goel 18 8 0 05 Mar 2024
Neural Redshift: Random Networks are not Random Functions Damien Teney A. Nicolicioiu Valentin Hartmann Ehsan Abbasnejad 86 18 0 04 Mar 2024
Hybrid Neural Representations for Spherical Data Hyomin Kim Yunhui Jang Jaeho Lee Sungsoo Ahn 14 3 0 05 Feb 2024
Dream360: Diverse and Immersive Outdoor Virtual Scene Creation via Transformer-Based 360 Image Outpainting Hao Ai Zidong Cao H. Lu Chen Chen Jiancang Ma Pengyuan Zhou Tae-Kyun Kim Pan Hui Lin Wang 22 3 0 19 Jan 2024
Exploring 3D-aware Lifespan Face Aging via Disentangled Shape-Texture Representations Qianrui Teng Rui Wang Xing Cui Peipei Li Zhaofeng He 19 3 0 28 Dec 2023
Inferring Hybrid Neural Fluid Fields from Videos Hong-Xing Yu Yang Zheng Yuan Gao Yitong Deng Bo Zhu Jiajun Wu 3DH 14 15 0 11 Dec 2023
Spectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction Huan Chen Wangcai Zhao Tingfa Xu Shiyun Zhou Peifu Liu Jianan Li 22 20 0 02 Dec 2023
In Search of a Data Transformation That Accelerates Neural Field Training Junwon Seo Sangyoon Lee Kwang In Kim Jaeho Lee 9 3 0 28 Nov 2023
IMJENSE: Scan-specific Implicit Representation for Joint Coil Sensitivity and Image Estimation in Parallel MRI Rui-jun Feng Qing Wu Jie Feng Huajun She Chunlei Liu Yuyao Zhang Hongjiang Wei 8 21 0 21 Nov 2023