Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 2,148 papers shown

Title
Operator Learning Using Random Features: A Tool for Scientific Computing Nicholas H. Nelsen Andrew M. Stuart 45 12 0 12 Aug 2024
Meta Clustering of Neural Bandits Yikun Ban Yunzhe Qi Tianxin Wei Lihui Liu Jingrui He 42 2 0 10 Aug 2024
Risk and cross validation in ridge regression with correlated samples Alexander B. Atanasov Jacob A. Zavatone-Veth Cengiz Pehlevan 27 4 0 08 Aug 2024
Gradient flow in parameter space is equivalent to linear interpolation in output space Thomas Chen Patrícia Muñoz Ewald 38 1 0 02 Aug 2024
Hybrid Coordinate Descent for Efficient Neural Network Learning Using Line Search and Gradient Descent Yen-Che Hsiao Abhishek Dutta 18 0 0 02 Aug 2024
TASI Lectures on Physics for Machine Learning Jim Halverson 33 1 0 31 Jul 2024
Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning Dennis Chemnitz Maximilian Engel 33 0 0 29 Jul 2024
Aero-Nef: Neural Fields for Rapid Aircraft Aerodynamics Simulations Giovanni Catalani Siddhant Agarwal Xavier Bertrand Frédéric Tost Michaël Bauerheim Joseph Morlier AI4CE 49 4 0 29 Jul 2024
FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representation Hao Zhu Zhen Liu Qi Zhang Jingde Fu Weibing Deng Zhan Ma Yanwen Guo Xun Cao 72 1 0 28 Jul 2024
A spring-block theory of feature learning in deep neural networks Chengzhi Shi Liming Pan Ivan Dokmanić AI4CE 40 1 0 28 Jul 2024
Finite Neural Networks as Mixtures of Gaussian Processes: From Provable Error Bounds to Prior Selection Steven Adams A. Patané Morteza Lahijanian Luca Laurenti BDL 36 2 0 26 Jul 2024
Towards the Spectral bias Alleviation by Normalizations in Coordinate Networks Zhicheng Cai Hao Zhu Qiu Shen Xinran Wang Xun Cao 41 0 0 25 Jul 2024
Revisiting Machine Unlearning with Dimensional Alignment Seonguk Seo Dongwan Kim Bohyung Han MU 37 0 0 25 Jul 2024
$u-$\mu$P: The Unit-Scaled Maximal Update Parametrization$ u- $\mu$ P: The Unit-Scaled Maximal Update Parametrization Charlie Blake C. Eichenberg Josef Dean Lukas Balles Luke Y. Prince Bjorn Deiseroth Andres Felipe Cruz Salinas Carlo Luschi Samuel Weinbach Douglas Orr 55 9 0 24 Jul 2024
Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precision Jakin Ng Yongjian Wang Ching-Yao Lai 38 1 0 24 Jul 2024
Neural Dueling Bandits: Preference-Based Optimization with Human Feedback Arun Verma Zhongxiang Dai Xiaoqiang Lin P. Jaillet K. H. Low 37 5 0 24 Jul 2024
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective Jingren Liu Zhong Ji Yunlong Yu Jiale Cao Yanwei Pang Jungong Han X. Li CLL 42 3 0 24 Jul 2024
Local vs Global continual learning Giulia Lanzillotta Sidak Pal Singh Benjamin Grewe Thomas Hofmann CLL 42 0 0 23 Jul 2024
Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition Mohamad Amin Mohamadi Zhiyuan Li Lei Wu Danica J. Sutherland 48 9 0 17 Jul 2024
Deep Learning without Global Optimization by Random Fourier Neural Networks Owen Davis Gianluca Geraci Mohammad Motamed BDL 60 0 0 16 Jul 2024
Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attacks Lukas Gosch Mahalakshmi Sabanayagam D. Ghoshdastidar Stephan Günnemann AAML 40 3 0 15 Jul 2024
Data-Guided Physics-Informed Neural Networks for Solving Inverse Problems in Partial Differential Equations Wei Zhou Y. F. Xu AI4CE PINN 29 1 0 15 Jul 2024
FYI: Flip Your Images for Dataset Distillation Byunggwan Son Youngmin Oh Donghyeon Baek Bumsub Ham DD 41 3 0 11 Jul 2024
Stochastic Gradient Descent for Two-layer Neural Networks Dinghao Cao Zheng-Chu Guo Lei Shi MLT 21 0 0 10 Jul 2024
A Generalization Bound for Nearly-Linear Networks Eugene Golikov 31 0 0 09 Jul 2024
Frequency and Generalisation of Periodic Activation Functions in Reinforcement Learning Augustine N. Mavor-Parker Matthew J. Sargent Caswell Barry Lewis D. Griffin Clare Lyle 47 2 0 09 Jul 2024
Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning Yijun Dong Hoang Phan Xiang Pan Qi Lei 48 5 0 08 Jul 2024
A Survey on LoRA of Large Language Models Yuren Mao Yuhang Ge Yijiang Fan Wenyi Xu Yu Mi Zhonghao Hu Yunjun Gao ALM 54 24 0 08 Jul 2024
How DNNs break the Curse of Dimensionality: Compositionality and Symmetry Learning Arthur Jacot Seok Hoan Choi Yuxiao Wen AI4CE 91 2 0 08 Jul 2024
Neural varifolds: an aggregate representation for quantifying the geometry of point clouds Juheon Lee Xiaohao Cai Carola-Bibian Schönlieb Simon Masnou 3DPC 52 0 0 05 Jul 2024
Exploiting the equivalence between quantum neural networks and perceptrons Chris Mingard Jessica Pointing Charles London Yoonsoo Nam Ard A. Louis 35 2 0 05 Jul 2024
Geometrically Inspired Kernel Machines for Collaborative Learning Beyond Gradient Descent Mohit Kumar Alexander Valentinitsch Magdalena Fuchs Mathias Brucker Juliana Bowles Adnan Husaković Ali Abbas Bernhard A. Moser 21 0 0 05 Jul 2024
Wide stable neural networks: Sample regularity, functional convergence and Bayesian inverse problems Tomás Soto 37 0 0 04 Jul 2024
Foundations and Frontiers of Graph Learning Theory Yu Huang Min Zhou Menglin Yang Zhen Wang Muhan Zhang Jie Wang Hong Xie Hao Wang Defu Lian Enhong Chen AI4CE GNN 55 2 0 03 Jul 2024
Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent Adrien Schertzer Loucas Pillaud-Vivien 31 0 0 02 Jul 2024
MALT Powers Up Adversarial Attacks Odelia Melamed Gilad Yehudai Adi Shamir AAML 36 0 0 02 Jul 2024
Analytical Solution of a Three-layer Network with a Matrix Exponential Activation Function Kuo Gai Shihua Zhang FAtt 43 0 0 02 Jul 2024
Normalization and effective learning rates in reinforcement learning Clare Lyle Zeyu Zheng Khimya Khetarpal James Martens H. V. Hasselt Razvan Pascanu Will Dabney 19 7 0 01 Jul 2024
Towards Stable and Storage-efficient Dataset Distillation: Matching Convexified Trajectory Wenliang Zhong Haoyu Tang Qinghai Zheng Mingzhu Xu Yupeng Hu Liqiang Nie DD 54 2 0 28 Jun 2024
Infinite Width Models That Work: Why Feature Learning Doesn't Matter as Much as You Think Luke Sernau 16 0 0 27 Jun 2024
Local Linear Recovery Guarantee of Deep Neural Networks at Overparameterization Yaoyu Zhang Leyang Zhang Zhongwang Zhang Zhiwei Bai 25 0 0 26 Jun 2024
Early learning of the optimal constant solution in neural networks and humans Jirko Rubruck Jan P. Bauer Andrew M. Saxe Christopher Summerfield 33 1 0 25 Jun 2024
WARP: On the Benefits of Weight Averaged Rewarded Policies Alexandre Ramé Johan Ferret Nino Vieillard Robert Dadashi Léonard Hussenot Pierre-Louis Cedoz Pier Giuseppe Sessa Sertan Girgin Arthur Douillard Olivier Bachem 62 14 0 24 Jun 2024
Privacy Preserving Federated Learning in Medical Imaging with Uncertainty Estimation Nikolas Koutsoubis Yasin Yilmaz Ravi P. Ramachandran M. Schabath Ghulam Rasool 34 8 0 18 Jun 2024
The Heterophilic Snowflake Hypothesis: Training and Empowering GNNs for Heterophilic Graphs Kun Wang Guibin Zhang Xinnan Zhang Fan Zhang Xun Wu Guohao Li Shirui Pan Wei-Ming Huang Yuxuan Liang 38 4 0 18 Jun 2024
MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic Yuyan Zhou Liang Song Bingning Wang Weipeng Chen MoMe 30 16 0 17 Jun 2024
Neural Lineage Runpeng Yu Xinchao Wang 34 4 0 17 Jun 2024
Two-level overlapping additive Schwarz preconditioner for training scientific machine learning applications Youngkyu Lee Alena Kopanicáková George Karniadakis AI4CE 49 0 0 16 Jun 2024
Graph Neural Thompson Sampling Shuang Wu Arash A. Amini 51 0 0 15 Jun 2024
Why Warmup the Learning Rate? Underlying Mechanisms and Improvements Dayal Singh Kalra M. Barkeshli 49 7 0 13 Jun 2024