Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 2,148 papers shown

Title
An Application of the Holonomic Gradient Method to the Neural Tangent Kernel Akihiro Sakoda Nobuki Takayama 16 0 0 31 Oct 2024
Kernel-Based Function Approximation for Average Reward Reinforcement Learning: An Optimist No-Regret Algorithm Sattar Vakili Julia Olkhovskaya 31 0 0 30 Oct 2024
Understanding Representation of Deep Equilibrium Models from Neural Collapse Perspective Haixiang Sun Ye Shi 42 0 0 30 Oct 2024
Estimating Neural Network Robustness via Lipschitz Constant and Architecture Sensitivity Abulikemu Abuduweili Changliu Liu 24 1 0 30 Oct 2024
Predicting the Encoding Error of SIRENs Jeremy Vonderfecht Feng Liu AI4CE 40 3 0 29 Oct 2024
Modular Duality in Deep Learning Jeremy Bernstein Laker Newhouse 22 2 0 28 Oct 2024
Plastic Learning with Deep Fourier Features Alex Lewandowski Dale Schuurmans Marlos C. Machado CLL 42 3 0 27 Oct 2024
Emergence of Globally Attracting Fixed Points in Deep Neural Networks With Nonlinear Activations Amir Joudaki Thomas Hofmann MLT 18 0 0 26 Oct 2024
Connecting Joint-Embedding Predictive Architecture with Contrastive Self-supervised Learning Shentong Mo Shengbang Tong 40 1 0 25 Oct 2024
A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities Yatin Dandi Luca Pesce Hugo Cui Florent Krzakala Yue M. Lu Bruno Loureiro MLT 37 1 0 24 Oct 2024
Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Models Jinxu Lin Linwei Tao Minjing Dong Chang Xu TDI 41 2 0 24 Oct 2024
Rethinking generalization of classifiers in separable classes scenarios and over-parameterized regimes Julius Martinetz C. Linse Thomas Martinetz 26 0 0 22 Oct 2024
Theoretical Limitations of Ensembles in the Age of Overparameterization Niclas Dern John P. Cunningham Geoff Pleiss BDL UQCV 34 0 0 21 Oct 2024
Robust Feature Learning for Multi-Index Models in High Dimensions Alireza Mousavi-Hosseini Adel Javanmard Murat A. Erdogdu OOD AAML 44 1 0 21 Oct 2024
Offline-to-online Reinforcement Learning for Image-based Grasping with Scarce Demonstrations Bryan Chan Anson Leung James Bergstra OffRL OnRL 59 0 0 19 Oct 2024
A Lipschitz spaces view of infinitely wide shallow neural networks Francesca Bartolucci Marcello Carioni José A. Iglesias Yury Korolev Emanuele Naldi S. Vigogna 23 0 0 18 Oct 2024
SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery Enneng Yang Li Shen Zhenyi Wang G. Guo Xingwei Wang Xiaocun Cao Jie Zhang Dacheng Tao MoMe 37 4 0 18 Oct 2024
Generalization for Least Squares Regression With Simple Spiked Covariances Jiping Li Rishi Sonthalia 28 0 0 17 Oct 2024
Analyzing Deep Transformer Models for Time Series Forecasting via Manifold Learning Ilya Kaufman Omri Azencot AI4TS 31 2 0 17 Oct 2024
Inductive Gradient Adjustment For Spectral Bias In Implicit Neural Representations Kexuan Shi Hai Chen Leheng Zhang Shuhang Gu 33 1 0 17 Oct 2024
Loss Landscape Characterization of Neural Networks without Over-Parametrization Rustem Islamov Niccolò Ajroldi Antonio Orvieto Aurelien Lucchi 35 4 0 16 Oct 2024
Towards Neural Scaling Laws for Time Series Foundation Models Qingren Yao Chao-Han Huck Yang Renhe Jiang Yuxuan Liang Ming Jin Shirui Pan AI4TS AI4CE 42 7 0 16 Oct 2024
LLM-Mixer: Multiscale Mixing in LLMs for Time Series Forecasting Md. Kowsher Md. Shohanur Islam Sobuj Nusrat Jahan Prottasha E. Alejandro Alanis O. Garibay Niloofar Yousefi AI4TS 29 0 0 15 Oct 2024
Calabi-Yau metrics through Grassmannian learning and Donaldson's algorithm Carl Henrik Ek Oisin Kim Challenger Mishra 16 2 0 15 Oct 2024
Geometric Inductive Biases of Deep Networks: The Role of Data and Architecture Sajad Movahedi Antonio Orvieto Seyed-Mohsen Moosavi-Dezfooli AI4CE AAML 142 0 0 15 Oct 2024
RoCoFT: Efficient Finetuning of Large Language Models with Row-Column Updates Md. Kowsher Tara Esmaeilbeig Chun-Nam Yu Mojtaba Soltanalian Niloofar Yousefi 27 0 0 14 Oct 2024
Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods Hossein Taheri Christos Thrampoulidis Arya Mazumdar MLT 36 0 0 13 Oct 2024
Magnituder Layers for Implicit Neural Representations in 3D Sang Min Kim Byeongchan Kim Arijit Sehanobish Krzysztof Choromanski Dongseok Shim Avinava Dubey Min Hwan Oh AI4CE 39 0 0 13 Oct 2024
MUSO: Achieving Exact Machine Unlearning in Over-Parameterized Regimes Ruikai Yang M. He Zhengbao He Youmei Qiu X. Huang MU BDL 39 1 0 11 Oct 2024
Deeper Insights into Deep Graph Convolutional Networks: Stability and Generalization Guangrui Yang Ming Li Han Feng Xiaosheng Zhuang GNN OOD BDL 35 2 0 11 Oct 2024
Adversarial Training Can Provably Improve Robustness: Theoretical Analysis of Feature Learning Process Under Structured Data Binghui Li Yuanzhi Li OOD 30 2 0 11 Oct 2024
Correspondence of NNGP Kernel and the Matern Kernel Amanda Muyskens Benjamin W. Priest I. Goumiri M. Schneider BDL 18 1 0 10 Oct 2024
Identifiability and Sensitivity Analysis of Kriging Weights for the Matern Kernel Amanda Muyskens Benjamin W. Priest I. Goumiri M. Schneider 26 0 0 10 Oct 2024
Features are fate: a theory of transfer learning in high-dimensional regression Javan Tahir Surya Ganguli Grant M. Rotskoff 34 1 0 10 Oct 2024
Generalization Bounds and Model Complexity for Kolmogorov-Arnold Networks Xianyang Zhang Huijuan Zhou 32 1 0 10 Oct 2024
Nesterov acceleration in benignly non-convex landscapes Kanan Gupta Stephan Wojtowytsch 36 2 0 10 Oct 2024
More Experts Than Galaxies: Conditionally-overlapping Experts With Biologically-Inspired Fixed Routing Sagi Shaier Francisco Pereira K. Wense Lawrence E Hunter Matt Jones MoE 46 0 0 10 Oct 2024
Collective variables of neural networks: empirical time evolution and scaling laws S. Tovey Sven Krippendorf M. Spannowsky Konstantin Nikolaou Christian Holm 22 0 0 09 Oct 2024
Task-oriented Time Series Imputation Evaluation via Generalized Representers Zhixian Wang Linxiao Yang Liang Sun Qingsong Wen Yi Wang AI4TS 31 0 0 09 Oct 2024
Stochastic Kernel Regularisation Improves Generalisation in Deep Kernel Machines Edward Milsom Ben Anson Laurence Aitchison 28 0 0 08 Oct 2024
On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory Guhan Chen Yicheng Li Qian Lin AAML 38 1 0 08 Oct 2024
FLOPS: Forward Learning with OPtimal Sampling Tao Ren Zishi Zhang Jinyang Jiang Guanghao Li Zeliang Zhang Mingqian Feng Yijie Peng 37 1 0 08 Oct 2024
SHAP values via sparse Fourier representation Ali Gorji Andisheh Amrollahi A. Krause FAtt 35 0 0 08 Oct 2024
Extended convexity and smoothness and their applications in deep learning Binchuan Qi Wei Gong Li Li 61 0 0 08 Oct 2024
Active Fine-Tuning of Generalist Policies Marco Bagatella Jonas Hübotter Georg Martius Andreas Krause 32 0 0 07 Oct 2024
Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse Arthur Jacot Peter Súkeník Zihan Wang Marco Mondelli 31 1 0 07 Oct 2024
Strong Model Collapse Elvis Dohmatob Yunzhen Feng Arjun Subramonian Julia Kempe 28 9 0 07 Oct 2024
Fast Training of Sinusoidal Neural Fields via Scaling Initialization Taesun Yeom Sangyoon Lee Jaeho Lee 58 2 0 07 Oct 2024
The Optimization Landscape of SGD Across the Feature Learning Strength Alexander B. Atanasov Alexandru Meterez James B. Simon C. Pehlevan 43 2 0 06 Oct 2024
Fundamental Limitations on Subquadratic Alternatives to Transformers Josh Alman Hantao Yu 23 1 0 05 Oct 2024