Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 2,148 papers shown

Title
Can Diffusion Models Disentangle? A Theoretical Perspective Liming Wang Muhammad Jehanzeb Mirza Yishu Gong Yuan Gong Jiaqi Zhang Brian Tracey Katerina Placek Marco Vilela James Glass DiffM CoGe 87 0 0 31 Mar 2025
Enhancing Physics-Informed Neural Networks with a Hybrid Parallel Kolmogorov-Arnold and MLP Architecture Zuyu Xu Bin Lv 41 0 0 30 Mar 2025
Towards Understanding the Optimization Mechanisms in Deep Learning Binchuan Qi Wei Gong Li Li 52 0 0 29 Mar 2025
ReLU Networks as Random Functions: Their Distribution in Probability Space Shreyas Chaudhari J. M. F. Moura 34 0 0 28 Mar 2025
CAE: Repurposing the Critic as an Explorer in Deep Reinforcement Learning Yexin Li Pring Wong Hanfang Zhang Shuo Chen Siyuan Qi OffRL 54 0 0 23 Mar 2025
Feature Learning beyond the Lazy-Rich Dichotomy: Insights from Representational Geometry Chi-Ning Chou Hang Le Yichen Wang SueYeon Chung 53 0 0 23 Mar 2025
NeuroSep-CP-LCB: A Deep Learning-based Contextual Multi-armed Bandit Algorithm with Uncertainty Quantification for Early Sepsis Prediction Anni Zhou Raheem Beyah Rishikesan Kamaleswaran 43 0 0 20 Mar 2025
Sparse Nonparametric Contextual Bandits Hamish Flynn Julia Olkhovskaya Paul Rognon-Vael 51 0 0 20 Mar 2025
On the Cone Effect in the Learning Dynamics Zhanpeng Zhou Yongyi Yang Jie Ren Mahito Sugiyama Junchi Yan 53 0 0 20 Mar 2025
LIFT: Latent Implicit Functions for Task- and Data-Agnostic Encoding A. Kazerouni Soroush Mehraban Michael Brudno Babak Taati 46 0 0 19 Mar 2025
Changing Base Without Losing Pace: A GPU-Efficient Alternative to MatMul in DNNs Nir Ailon Akhiad Bercovich Omri Weinstein 57 0 0 15 Mar 2025
Contextual Similarity Distillation: Ensemble Uncertainties with a Single Model Moritz A. Zanger Pascal R. van der Vaart Wendelin Bohmer M. Spaan UQCV BDL 149 0 0 14 Mar 2025
Neural Tangent Kernel of Neural Networks with Loss Informed by Differential Operators Weiye Gan Yicheng Li Q. Lin Zuoqiang Shi 39 0 0 14 Mar 2025
Global Convergence and Rich Feature Learning in $L$ -Layer Infinite-Width Neural Networks under $μ$ P Parametrization Zixiang Chen Greg Yang Qingyue Zhao Q. Gu MLT 50 0 0 12 Mar 2025
Learning richness modulates equality reasoning in neural networks William L. Tong C. Pehlevan 47 0 0 12 Mar 2025
Context-aware Biases for Length Extrapolation Ali Veisi Amir Mansourian 55 0 0 11 Mar 2025
Parametric Value Approximation for General-sum Differential Games with State Constraints Lei Zhang Mukesh Ghimire Wenlong Zhang Z. Xu Yi Ren 36 0 0 10 Mar 2025
Non-vacuous Generalization Bounds for Deep Neural Networks without any modification to the trained models Khoat Than Dat Phan BDL AAML VLM 60 0 0 10 Mar 2025
PIED: Physics-Informed Experimental Design for Inverse Problems Apivich Hemachandra Gregory Kang Ruey Lau Szu Hui Ng Bryan Kian Hsiang Low PINN 48 0 0 10 Mar 2025
Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks Devon Jarvis Richard Klein Benjamin Rosman Andrew M. Saxe MLT 66 1 0 08 Mar 2025
Uncertainty Quantification From Scaling Laws in Deep Neural Networks Ibrahim Elsharkawy Yonatan Kahn Benjamin Hooberman UQCV 50 0 0 07 Mar 2025
Generalizability of Neural Networks Minimizing Empirical Risk Based on Expressive Ability Lijia Yu Yibo Miao Yifan Zhu Xiao-Shan Gao Lijun Zhang 51 0 0 06 Mar 2025
A Theory of Initialisation's Impact on Specialisation Devon Jarvis Sebastian Lee Clémentine Dominé Andrew M. Saxe Stefano Sarao Mannelli CLL 75 2 0 04 Mar 2025
A Near Complete Nonasymptotic Generalization Theory For Multilayer Neural Networks: Beyond the Bias-Variance Tradeoff Hao Yu Xiangyang Ji AI4CE 60 0 0 03 Mar 2025
Multi-Level Collaboration in Model Merging Qi Li Runpeng Yu Xinchao Wang MoMe FedML 93 0 0 03 Mar 2025
Scaling Law Phenomena Across Regression Paradigms: Multiple and Kernel Approaches Yifang Chen Xuyang Guo Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao-quan Song 70 3 0 03 Mar 2025
Asymptotic Analysis of Two-Layer Neural Networks after One Gradient Step under Gaussian Mixtures Data with Structure Samet Demir Zafer Dogan MLT 34 0 0 02 Mar 2025
On the Saturation Effects of Spectral Algorithms in Large Dimensions Weihao Lu Haobo Zhang Yicheng Li Q. Lin 42 1 0 01 Mar 2025
Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking) Yoonsoo Nam Seok Hyeong Lee Clementine Domine Yea Chan Park Charles London Wonyl Choi Niclas Goring Seungjai Lee AI4CE 38 0 0 28 Feb 2025
Variational Bayesian Pseudo-Coreset Hyungi Lee S. Lee Juho Lee BDL 38 0 0 28 Feb 2025
Training Large Neural Networks With Low-Dimensional Error Feedback Maher Hanut Jonathan Kadmon 42 1 0 27 Feb 2025
Variation Matters: from Mitigating to Embracing Zero-Shot NAS Ranking Function Variation P. Rumiantsev Mark Coates 55 0 0 27 Feb 2025
Physics-Informed Neural Networks for Optimal Vaccination Plan in SIR Epidemic Models Minseok Kim Yeongjong Kim Yeoneung Kim PINN 85 0 0 27 Feb 2025
Automatic Prompt Optimization via Heuristic Search: A Survey Wendi Cui Jiaxin Zhang ZeLin Li Hao Sun Damien Lopez Kamalika Das Bradley Malin Sricharan Kumar 34 1 0 26 Feb 2025
Convergence of Shallow ReLU Networks on Weakly Interacting Data Léo Dana Francis R. Bach Loucas Pillaud-Vivien MLT 54 1 0 24 Feb 2025
Exact Learning of Permutations for Nonzero Binary Inputs with Logarithmic Training Size and Quadratic Ensemble Complexity George Giapitzakis Artur Back de Luca K. Fountoulakis 64 0 0 24 Feb 2025
Feature maps for the Laplacian kernel and its generalizations Sudhendu Ahir Parthe Pandit 62 0 0 24 Feb 2025
Low-rank bias, weight decay, and model merging in neural networks Ilja Kuzborskij Yasin Abbasi-Yadkori 52 0 0 24 Feb 2025
FACTR: Force-Attending Curriculum Training for Contact-Rich Policy Learning Jason Jingzhou Liu Yulong Li Kenneth Shaw Tony Tao Ruslan Salakhutdinov Deepak Pathak OffRL 62 1 0 24 Feb 2025
Explainable Neural Networks with Guarantees: A Sparse Estimation Approach Antoine Ledent Peng Liu FAtt 107 0 0 20 Feb 2025
Escaping from the Barren Plateau via Gaussian Initializations in Deep Variational Quantum Circuits Kaining Zhang Liu Liu Min-hsiu Hsieh Dacheng Tao 62 60 0 20 Feb 2025
Feature Learning Beyond the Edge of Stability Dávid Terjék MLT 46 0 0 18 Feb 2025
Generalized Kernel Inducing Points by Duality Gap for Dataset Distillation Tatsuya Aoyama Hanting Yang Hiroyuki Hanada Satoshi Akahane Tomonari Tanaka ... Noriaki Hashimoto Taro Murayama Hanju Lee Shinya Kojima Ichiro Takeuchi 72 0 0 18 Feb 2025
Fishing For Cheap And Efficient Pruners At Initialization Ivo Gollini Navarrete Nicolas Mauricio Cuadrado Jose Renato Restom Martin Takáč Samuel Horvath 49 0 0 17 Feb 2025
Linear Mode Connectivity in Differentiable Tree Ensembles Ryuichi Kanoh M. Sugiyama 72 1 0 17 Feb 2025
EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Networks Michael Arbel David Salinas Frank Hutter 73 2 0 10 Feb 2025
Parameter Symmetry Breaking and Restoration Determines the Hierarchical Learning in AI Systems Liu Ziyin Yizhou Xu T. Poggio Isaac Chuang 50 4 0 07 Feb 2025
Online Clustering of Dueling Bandits Zhiyong Wang Jiahang Sun Mingze Kong Jize Xie Qinghua Hu J. C. Lui Zhongxiang Dai 83 0 0 04 Feb 2025
Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer Blake Bordelon C. Pehlevan AI4CE 64 1 0 04 Feb 2025
Observation Noise and Initialization in Wide Neural Networks Sergio Calvo-Ordoñez Jonathan Plenk Richard Bergna Alvaro Cartea Jose Miguel Hernandez-Lobato Konstantina Palla Kamil Ciosek 56 1 0 03 Feb 2025