Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

50 / 2,148 papers shown

Title
STAF: Sinusoidal Trainable Activation Functions for Implicit Neural Representation Alireza Morsali MohammadJavad Vaez Hossein Soltani A. Kazerouni Babak Taati Morteza Mohammad-Noori 138 1 0 02 Feb 2025
On the study of frequency control and spectral bias in Wavelet-Based Kolmogorov Arnold networks: A path to physics-informed KANs Juan Daniel Meshir Abel Palafox Edgar Alejandro Guerrero 65 3 0 01 Feb 2025
GraphMinNet: Learning Dependencies in Graphs with Light Complexity Minimal Architecture Md. Atik Ahamed Andrew Cheng Q. Ye Q. Cheng GNN 53 0 0 01 Feb 2025
Position: Curvature Matrices Should Be Democratized via Linear Operators Felix Dangel Runa Eschenhagen Weronika Ormaniec Andres Fernandez Lukas Tatzel Agustinus Kristiadi 58 3 0 31 Jan 2025
An Invitation to Neuroalgebraic Geometry G. Marchetti V. Shahverdi Stefano Mereta Matthew Trager Kathlén Kohn 119 2 0 31 Jan 2025
Scanning Trojaned Models Using Out-of-Distribution Samples Hossein Mirzaei Ali Ansari Bahar Dibaei Nia Mojtaba Nafez Moein Madadi ... Kian Shamsaie Mahdi Hajialilue Jafar Habibi Mohammad Sabokrou M. Rohban OODD 61 2 0 28 Jan 2025
Task Arithmetic in Trust Region: A Training-Free Model Merging Approach to Navigate Knowledge Conflicts Wenju Sun Qingyong Li Wen Wang Yangli-ao Geng Boyang Li 44 2 0 28 Jan 2025
MILP initialization for solving parabolic PDEs with PINNs Sirui Li Federica Bragone Matthieu Barreau Kateryna Morozovska 33 0 0 28 Jan 2025
On Learning Representations for Tabular Data Distillation Inwon Kang Parikshit Ram Yi Zhou Horst Samulowitz O. Seneviratne DD 69 0 0 23 Jan 2025
Physics of Skill Learning Ziming Liu Yizhou Liu Eric J. Michaud Jeff Gore Max Tegmark 46 1 0 21 Jan 2025
Generating visual explanations from deep networks using implicit neural representations Michal Byra Henrik Skibbe GAN FAtt 29 0 0 20 Jan 2025
Issues with Neural Tangent Kernel Approach to Neural Networks Haoran Liu Anthony S. Tai David J. Crandall Chunfeng Huang 42 0 0 19 Jan 2025
Flexible task abstractions emerge in linear networks with fast and bounded units Kai Sandbrink Jan P. Bauer A. Proca Andrew M. Saxe Christopher Summerfield Ali Hummos 63 2 0 17 Jan 2025
Globally Convergent Variational Inference Declan McNamara J. Loper Jeffrey Regier 53 0 0 14 Jan 2025
Derivation of effective gradient flow equations and dynamical truncation of training data in Deep Learning Thomas Chen 34 0 0 13 Jan 2025
Geometry and Optimization of Shallow Polynomial Networks Yossi Arjevani Joan Bruna Joe Kileel Elzbieta Polak Matthew Trager 36 1 0 10 Jan 2025
Time Transfer: On Optimal Learning Rate and Batch Size In The Infinite Data Limit Oleg Filatov Jan Ebert Jiangtao Wang Stefan Kesselheim 36 3 0 10 Jan 2025
Mean-Field Analysis for Learning Subspace-Sparse Polynomials with Gaussian Input Ziang Chen Rong Ge MLT 61 1 0 10 Jan 2025
Understanding How Nonlinear Layers Create Linearly Separable Features for Low-Dimensional Data Alec S. Xu Can Yaras Peng Wang Q. Qu 30 0 0 04 Jan 2025
Functional Risk Minimization Ferran Alet Clement Gehring Tomás Lozano-Pérez Kenji Kawaguchi Joshua B. Tenenbaum Leslie Pack Kaelbling OffRL 60 0 0 31 Dec 2024
Gauss-Newton Dynamics for Neural Networks: A Riemannian Optimization Perspective Semih Cayci 74 0 0 18 Dec 2024
On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory Andrea Perin Stéphane Deny 93 1 0 16 Dec 2024
ANaGRAM: A Natural Gradient Relative to Adapted Model for efficient PINNs learning Nilo Schwencke Cyril Furtlehner 69 1 0 14 Dec 2024
Enhancing Implicit Neural Representations via Symmetric Power Transformation Weixiang Zhang Shuzhao Xie Chengwei Ren Shijia Ge Mingzi Wang Zhi Wang 79 2 0 12 Dec 2024
Is the neural tangent kernel of PINNs deep learning general partial differential equations always convergent ? Zijian Zhou Zhenya Yan 103 10 0 09 Dec 2024
GradAlign for Training-free Model Performance Inference Yuxuan Li Yunhui Guo 62 0 0 29 Nov 2024
FairDD: Fair Dataset Distillation via Synchronized Matching Qihang Zhou Shenhao Fang Shibo He Wenchao Meng Jiming Chen FedML DD 79 1 0 29 Nov 2024
Random Feature Models with Learnable Activation Functions Zailin Ma Jiansheng Yang Yaodong Yang 77 0 0 29 Nov 2024
Supervised Learning-enhanced Multi-Group Actor Critic for Live Stream Allocation in Feed Jingxin Liu Xiang Gao Yisha Li Xin Li Haiyang Lu Ben Wang OffRL 72 0 0 28 Nov 2024
What do physics-informed DeepONets learn? Understanding and improving training for scientific computing applications Emily Williams Amanda A. Howard B. Meuris P. Stinis AI4CE 71 0 0 27 Nov 2024
ExpTest: Automating Learning Rate Searching and Tuning with Insights from Linearized Neural Networks Zan Chaudhry Naoko Mizuno 76 0 0 25 Nov 2024
Fast training of large kernel models with delayed projections Amirhesam Abedsoltan Siyuan Ma Parthe Pandit Mikhail Belkin 69 0 0 25 Nov 2024
Proportional infinite-width infinite-depth limit for deep linear neural networks Federico Bassetti Lucia Ladelli P. Rotondo 75 1 0 22 Nov 2024
Accelerated zero-order SGD under high-order smoothness and overparameterized regime Georgii Bychkov D. Dvinskikh Anastasia Antsiferova Alexander Gasnikov Aleksandr Lobanov 61 0 0 21 Nov 2024
Superpixel-informed Implicit Neural Representation for Multi-Dimensional Data Jiayi Li Xile Zhao Jianli Wang Chao Wang Min Wang 74 1 0 18 Nov 2024
Infinite Width Limits of Self Supervised Neural Networks Maximilian Fleissner Gautham Govind Anil D. Ghoshdastidar SSL 148 0 0 17 Nov 2024
Continual Memorization of Factoids in Language Models Howard Chen Jiayi Geng Adithya Bhaskar Dan Friedman Danqi Chen KELM 54 1 0 11 Nov 2024
Variance-Aware Linear UCB with Deep Representation for Neural Contextual Bandits H. Bui Enrique Mallada Anqi Liu 111 0 0 08 Nov 2024
Boosting Latent Diffusion with Perceptual Objectives Tariq Berrada Pietro Astolfi Jakob Verbeek Melissa Hall Marton Havasi M. Drozdzal Yohann Benchetrit Adriana Romero Soriano Karteek Alahari 48 0 0 06 Nov 2024
Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex Tanishq Kumar Blake Bordelon C. Pehlevan Venkatesh N. Murthy Samuel Gershman OOD CLL SSL 50 0 0 05 Nov 2024
Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression Yingzhen Yang Ping Li MLT 37 0 0 05 Nov 2024
TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection Wei Yu Wu Zhuoshi Pan Chao Wang L. Chen Y. Bai Kun Fu Zehua Wang Hui Xiong Hui Xiong LLMAG 34 5 0 05 Nov 2024
Pseudo-Probability Unlearning: Towards Efficient and Privacy-Preserving Machine Unlearning Zihao Zhao Yijiang Li Yuqing Yang Wenqing Zhang Nuno Vasconcelos Yinzhi Cao MU 28 1 0 04 Nov 2024
Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation Satoki Ishikawa Rio Yokota Ryo Karakida 46 0 0 04 Nov 2024
Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks Jim Zhao Sidak Pal Singh Aurelien Lucchi AI4CE 45 0 0 04 Nov 2024
PageRank Bandits for Link Prediction Yikun Ban Jiaru Zou Zihao Li Yunzhe Qi Dongqi Fu Jian Kang Hanghang Tong Jingrui He 39 2 0 03 Nov 2024
CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networks Miria Feng Zachary Frangella Mert Pilanci BDL 46 1 0 02 Nov 2024
Private, Augmentation-Robust and Task-Agnostic Data Valuation Approach for Data Marketplace Tayyebeh Jahani-Nezhad Parsa Moradi M. Maddah-ali Giuseppe Caire 29 0 0 01 Nov 2024
Improving self-training under distribution shifts via anchored confidence with theoretical guarantees Taejong Joo Diego Klabjan UQCV 49 0 0 01 Nov 2024
Local Superior Soups: A Catalyst for Model Merging in Cross-Silo Federated Learning Minghui Chen Meirui Jiang Xin Zhang Qi Dou Zehua Wang Xiaoxiao Li MoMe FedML 48 2 0 31 Oct 2024