Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 2,148 papers shown

Title
SGD with memory: fundamental properties and stochastic acceleration Dmitry Yarotsky Maksim Velikanov 38 1 0 05 Oct 2024
Simplicity bias and optimization threshold in two-layer ReLU networks Etienne Boursier Nicolas Flammarion 31 2 0 03 Oct 2024
Towards Better Generalization: Weight Decay Induces Low-rank Bias for Neural Networks Ke Chen Chugang Yi Haizhao Yang MLT 33 0 0 03 Oct 2024
EAB-FL: Exacerbating Algorithmic Bias through Model Poisoning Attacks in Federated Learning Syed Irfan Ali Meerza Jian-Dong Liu 37 2 0 02 Oct 2024
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu S. H. Lim Michael W. Mahoney N. Benjamin Erichson 47 3 0 02 Oct 2024
NTK-DFL: Enhancing Decentralized Federated Learning in Heterogeneous Settings via Neural Tangent Kernel Gabriel Thompson Kai Yue Chau-Wai Wong H. Dai FedML 23 0 0 02 Oct 2024
Ensembles provably learn equivariance through data augmentation Oskar Nordenfors Axel Flinth MLT 31 3 0 02 Oct 2024
Deep Kernel Posterior Learning under Infinite Variance Prior Weights Jorge Loría A. Bhadra BDL UQCV 61 0 0 02 Oct 2024
Investigating the Impact of Model Complexity in Large Language Models Jing Luo Huiyuan Wang Weiran Huang 39 0 0 01 Oct 2024
LaDTalk: Latent Denoising for Synthesizing Talking Head Videos with High Frequency Details Jian Yang Xukun Wang Wentao Wang Guoming Li Qihang Fang Ruihong Yuan Tianyang Wang Jason Zhaoxin Fan Yeying Jin Zhaoxin Fan VGen 47 1 0 01 Oct 2024
Frequency-adaptive Multi-scale Deep Neural Networks Jizu Huang Rukang You Tao Zhou AI4CE 33 1 0 28 Sep 2024
Sequencing the Neurome: Towards Scalable Exact Parameter Reconstruction of Black-Box Neural Networks Judah Goldfeder Quinten Roets Gabe Guo John Wright Hod Lipson 38 1 0 27 Sep 2024
On The Specialization of Neural Modules Devon Jarvis Richard Klein Benjamin Rosman Andrew M. Saxe 61 12 0 23 Sep 2024
Peer-to-Peer Learning Dynamics of Wide Neural Networks Shreyas Chaudhari Srinivasa Pranav Emile Anand José M. F. Moura 39 3 0 23 Sep 2024
From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks Clémentine Dominé Nicolas Anguita A. Proca Lukas Braun D. Kunin P. Mediano Andrew M. Saxe 38 3 0 22 Sep 2024
Unraveling the Hessian: A Key to Smooth Convergence in Loss Function Landscapes Nikita Kiselev Andrey Grabovoy 54 1 0 18 Sep 2024
Monomial Matrix Group Equivariant Neural Functional Networks Hoang V. Tran Thieu N. Vo Tho H. Tran An T. Nguyen Tan M. Nguyen 54 5 0 18 Sep 2024
Propulsion: Steering LLM with Tiny Fine-Tuning Md. Kowsher Nusrat Jahan Prottasha Prakash Bhat 48 4 0 17 Sep 2024
Realistic Extreme Behavior Generation for Improved AV Testing Robert Dyro Matthew Foutter Ruolin Li L. D. Lillo Edward Schmerling Xilin Zhou Marco Pavone AAML 36 1 0 16 Sep 2024
The Optimality of (Accelerated) SGD for High-Dimensional Quadratic Optimization Haihan Zhang Yuanshi Liu Qianwen Chen Cong Fang 38 0 0 15 Sep 2024
Learning Transferable Features for Implicit Neural Representations Kushal Vyas Ahmed Imtiaz Humayun Aniket Dashpute Richard G. Baraniuk Ashok Veeraraghavan Guha Balakrishnan OOD 99 1 0 15 Sep 2024
Transformed Physics-Informed Neural Networks for The Convection-Diffusion Equation Jiajing Guan Howard Elman 29 0 0 12 Sep 2024
AC-IND: Sparse CT reconstruction based on attenuation coefficient estimation and implicit neural distribution Wangduo Xie Richard Schoonhoven Tristan van Leeuwen Matthew B. Blaschko OOD 45 0 0 11 Sep 2024
Variational Search Distributions Daniel M. Steinberg Rafael Oliveira Cheng Soon Ong Edwin V. Bonilla 33 0 0 10 Sep 2024
Input Space Mode Connectivity in Deep Neural Networks Jakub Vrabel Ori Shem-Ur Yaron Oz David Krueger 56 1 0 09 Sep 2024
Unified Neural Network Scaling Laws and Scale-time Equivalence Akhilan Boopathy Ila Fiete 40 0 0 09 Sep 2024
On the Convergence Analysis of Over-Parameterized Variational Autoencoders: A Neural Tangent Kernel Perspective Li Wang Wei Huang DRL 21 0 0 09 Sep 2024
Breaking Neural Network Scaling Laws with Modularity Akhilan Boopathy Sunshine Jiang William Yue Jaedong Hwang Abhiram Iyer Ila Fiete OOD 41 2 0 09 Sep 2024
Efficient Training of Large Vision Models via Advanced Automated Progressive Learning Changlin Li Jiawei Zhang Sihao Lin Zongxin Yang Junwei Liang Xiaodan Liang Xiaojun Chang VLM 30 0 0 06 Sep 2024
Epistemic Uncertainty and Observation Noise with the Neural Tangent Kernel Sergio Calvo-Ordoñez Konstantina Palla Kamil Ciosek 42 1 0 06 Sep 2024
MDNF: Multi-Diffusion-Nets for Neural Fields on Meshes Avigail Cohen Rimon Tal Shnitzer Mirela Ben Chen 31 0 0 04 Sep 2024
Robust Fourier Neural Networks Halyun Jeong Jihun Han OOD 24 0 0 03 Sep 2024
Dataset Distillation from First Principles: Integrating Core Information Extraction and Purposeful Learning Vyacheslav Kungurtsev Yuanfang Peng Jianyang Gu Saeed Vahidian Anthony Quinn Fadwa Idlahcen Yiran Chen FedML DD 50 2 0 02 Sep 2024
On the Pinsker bound of inner product kernel regression in large dimensions Weihao Lu Jialin Ding Haobo Zhang Qian Lin 55 0 0 02 Sep 2024
Improving Adaptivity via Over-Parameterization in Sequence Models Yicheng Li Qian Lin 29 1 0 02 Sep 2024
Multi-Task Combinatorial Bandits for Budget Allocation Lin Ge Yang Xu Jianing Chu David Cramer Fuhong Li Kelly Paulson Rui Song 30 0 0 31 Aug 2024
Continual learning with the neural tangent ensemble Ari S. Benjamin Christian Pehle Kyle Daruwalla UQCV 70 0 0 30 Aug 2024
Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning Mohammadamin Banayeeanzade Mahdi Soltanolkotabi Mohammad Rostami CLL LRM 103 1 0 29 Aug 2024
Implicit Regularization Paths of Weighted Neural Representations Jin-Hong Du Pratik Patil 29 0 0 28 Aug 2024
General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equations Sen Wang Peizhi Zhao Qinglong Ma Tao Song PINN 28 3 0 27 Aug 2024
MONAS: Efficient Zero-Shot Neural Architecture Search for MCUs Ye Qiao Haocheng Xu Yifan Zhang Sitao Huang 46 0 0 26 Aug 2024
Function-Space MCMC for Bayesian Wide Neural Networks Lucia Pezzetti Stefano Favaro Stefano Peluchetti BDL 135 0 0 26 Aug 2024
Dynamics of Meta-learning Representation in the Teacher-student Scenario Hui Wang Cho Tung Yip Bo Li 43 0 0 22 Aug 2024
Approaching Deep Learning through the Spectral Dynamics of Weights David Yunis Kumar Kshitij Patel Samuel Wheeler Pedro H. P. Savarese Gal Vardi Karen Livescu Michael Maire Matthew R. Walter 52 3 0 21 Aug 2024
Towards Aligned Data Removal via Twin Machine Unlearning Zheng Lin Zheng Lin Yuyao Sun Rong Jin Yuhang Wang Haichang Gao Zhenxing Niu MU 32 0 0 21 Aug 2024
SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models Anke Tang Li Shen Yong Luo Shuai Xie Han Hu Lefei Zhang Bo Du Dacheng Tao MoMe 42 4 0 19 Aug 2024
Understanding Generative AI Content with Embedding Models Max Vargas Reilly Cannon A. Engel Anand D. Sarwate Tony Chiang 52 3 0 19 Aug 2024
A Mean Field Ansatz for Zero-Shot Weight Transfer Xingyuan Chen Wenwei Kuang Lei Deng Wei Han Bo Bai Goncalo dos Reis 39 1 0 16 Aug 2024
Generative Dataset Distillation Based on Diffusion Model Duo Su Junjie Hou Guang Li Ren Togo Rui Song Takahiro Ogawa Miki Haseyama VGen DD 35 4 0 16 Aug 2024
Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamics Alireza Mousavi-Hosseini Denny Wu Murat A. Erdogdu MLT AI4CE 35 6 0 14 Aug 2024