Spectrally-normalized margin bounds for neural networks

26 June 2017

Papers citing "Spectrally-normalized margin bounds for neural networks"

50 / 803 papers shown

Title
On Size-Independent Sample Complexity of ReLU Networks Mark Sellke 17 5 0 03 Jun 2023
Robust low-rank training via approximate orthonormal constraints Dayana Savostianova Emanuele Zangrando Gianluca Ceruti Francesco Tudisco 24 9 0 02 Jun 2023
Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression Runtian Zhai Bing Liu Andrej Risteski Zico Kolter Pradeep Ravikumar SSL 28 9 0 01 Jun 2023
(Almost) Provable Error Bounds Under Distribution Shift via Disagreement Discrepancy Elan Rosenfeld Saurabh Garg UQCV 32 4 0 01 Jun 2023
What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization Yufeng Zhang Fengzhuo Zhang Zhuoran Yang Zhaoran Wang BDL 36 62 0 30 May 2023
Deep Clustering with Incomplete Noisy Pairwise Annotations: A Geometric Regularization Approach Tri Nguyen Shahana Ibrahim Xiao Fu 22 5 0 30 May 2023
Generalization Bounds for Magnitude-Based Pruning via Sparse Matrix Sketching E. Guha Prasanjit Dubey X. Huo MLT 32 1 0 30 May 2023
On the Role of Noise in the Sample Complexity of Learning Recurrent Neural Networks: Exponential Gaps for Long Sequences A. F. Pour H. Ashtiani 19 0 0 28 May 2023
Toward Understanding Generative Data Augmentation Chenyu Zheng Guoqiang Wu Chongxuan Li 29 25 0 27 May 2023
Learning Capacity: A Measure of the Effective Dimensionality of a Model Daiwei Chen Wei-Di Chang Pratik Chaudhari 29 3 0 27 May 2023
Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks Puyu Wang Yunwen Lei Di Wang Yiming Ying Ding-Xuan Zhou MLT 27 3 0 26 May 2023
On the Generalization and Approximation Capacities of Neural Controlled Differential Equations Linus Bleistein Agathe Guilloux 35 1 0 26 May 2023
Initialization-Dependent Sample Complexity of Linear Predictors and Neural Networks Roey Magen Ohad Shamir 19 0 0 25 May 2023
DP-SGD Without Clipping: The Lipschitz Neural Network Way Louis Bethune Thomas Massena Thibaut Boissin Yannick Prudent Corentin Friedrich Franck Mamalet A. Bellet M. Serrurier David Vigouroux 34 9 0 25 May 2023
Efficient Bound of Lipschitz Constant for Convolutional Layers by Gram Iteration Blaise Delattre Quentin Barthélemy Alexandre Araujo A. Allauzen 12 13 0 25 May 2023
Reverse Engineering Self-Supervised Learning Ido Ben-Shaul Ravid Shwartz-Ziv Tomer Galanti S. Dekel Yann LeCun SSL 23 34 0 24 May 2023
On progressive sharpening, flat minima and generalisation L. MacDonald Jack Valmadre Simon Lucey 25 4 0 24 May 2023
Deep Learning with Kernels through RKHM and the Perron-Frobenius Operator Yuka Hashimoto Masahiro Ikeda Hachem Kadri 27 8 0 23 May 2023
Statistical Guarantees of Group-Invariant GANs Ziyu Chen M. Katsoulakis Luc Rey-Bellet Wei-wei Zhu 42 2 0 22 May 2023
On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training Jieyu Zhang Bohan Wang Zhengyu Hu Pang Wei Koh Alexander Ratner 25 10 0 20 May 2023
Implicit Bias of Gradient Descent for Logistic Regression at the Edge of Stability Jingfeng Wu Vladimir Braverman Jason D. Lee 24 17 0 19 May 2023
Exploring the Complexity of Deep Neural Networks through Functional Equivalence Guohao Shen 22 2 0 19 May 2023
Generalization Bounds for Neural Belief Propagation Decoders S. Adiga Xin Xiao Ravi Tandon Bane V. Vasic Tamal Bose BDL AI4CE 22 4 0 17 May 2023
Uncertainty Estimation and Out-of-Distribution Detection for Deep Learning-Based Image Reconstruction using the Local Lipschitz D. Bhutto Bo Zhu J. Liu Neha Koonjoo H. Li Bruce Rosen M. Rosen UQCV OOD 15 2 0 12 May 2023
Fisher Information Embedding for Node and Graph Learning Dexiong Chen Paolo Pellizzoni Karsten M. Borgwardt GNN 18 2 0 12 May 2023
Generalization bounds for neural ordinary differential equations and deep residual networks P. Marion 30 18 0 11 May 2023
The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold J. Mao Itay Griniasty H. Teoh Rahul Ramesh Rubing Yang M. Transtrum J. Sethna Pratik Chaudhari 3DPC 39 15 0 02 May 2023
Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Renyi's Entropy Perspective Yuxin Dong Tieliang Gong H. Chen Chen Li 23 4 0 02 May 2023
Differentiable Neural Networks with RePU Activation: with Applications to Score Estimation and Isotonic Regression Guohao Shen Yuling Jiao Yuanyuan Lin Jian Huang 48 3 0 01 May 2023
$Toward $L_\infty$-recovery of Nonlinear Functions: A Polynomial Sample Complexity Bound for Gaussian Random Fields$ Toward $L_\infty$ -recovery of Nonlinear Functions: A Polynomial Sample Complexity Bound for Gaussian Random Fields Kefan Dong Tengyu Ma 35 4 0 29 Apr 2023
Generalization for slowly mixing processes Andreas Maurer 37 1 0 28 Apr 2023
Fundamental Tradeoffs in Learning with Prior Information Anirudha Majumdar 32 0 0 26 Apr 2023
Certifying Ensembles: A General Certification Theory with S-Lipschitzness Aleksandar Petrov Francisco Eiras Amartya Sanyal Philip H. S. Torr Adel Bibi UQCV 32 1 0 25 Apr 2023
Generalization and Estimation Error Bounds for Model-based Neural Networks Avner Shultzman Eyar Azar M. Rodrigues Yonina C. Eldar 16 7 0 19 Apr 2023
A Comprehensive Survey on Deep Graph Representation Learning Wei Ju Zheng Fang Yiyang Gu Zequn Liu Qingqing Long ... Jingyang Yuan Yusheng Zhao Yifan Wang Xiao Luo Ming Zhang GNN AI4TS 46 141 0 11 Apr 2023
Heavy-Tailed Regularization of Weight Matrices in Deep Neural Networks Xuanzhe Xiao Zengyi Li Chuanlong Xie Fengwei Zhou 21 3 0 06 Apr 2023
Optimal rates of approximation by shallow ReLU $^k$ neural networks and applications to nonparametric regression Yunfei Yang Ding-Xuan Zhou 34 19 0 04 Apr 2023
Identification of Negative Transfers in Multitask Learning Using Surrogate Models Dongyue Li Huy Le Nguyen Hongyang R. Zhang 36 12 0 25 Mar 2023
Uniform Risk Bounds for Learning with Dependent Data Sequences Fabien Lauer 20 1 0 21 Mar 2023
Online Learning for Equilibrium Pricing in Markets under Incomplete Information Devansh Jalota Haoyuan Sun Navid Azizan 21 2 0 21 Mar 2023
Bayes Complexity of Learners vs Overfitting Grzegorz Gluch R. Urbanke UQCV BDL 11 0 0 13 Mar 2023
Generalization analysis of an unfolding network for analysis-based Compressed Sensing Vicky Kouni Yannis Panagakis MLT 26 0 0 09 Mar 2023
Provable Pathways: Learning Multiple Tasks over Multiple Paths Yingcong Li Samet Oymak MoE 26 4 0 08 Mar 2023
Benign Overfitting for Two-layer ReLU Convolutional Neural Networks Yiwen Kou Zi-Yuan Chen Yuanzhou Chen Quanquan Gu MLT 49 12 0 07 Mar 2023
Quantized Radio Map Estimation Using Tensor and Deep Generative Models Subash Timilsina Sagar Shrestha Xiao Fu 18 7 0 03 Mar 2023
An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization Ravid Shwartz-Ziv Randall Balestriero Kenji Kawaguchi Tim G. J. Rudner Yann LeCun 32 23 0 01 Mar 2023
Generalization Error Bounds for Noisy, Iterative Algorithms via Maximal Leakage Ibrahim Issa A. Esposito Michael C. Gastpar 29 2 0 28 Feb 2023
Amortised Invariance Learning for Contrastive Self-Supervision Ruchika Chavhan H. Gouk Jan Stuehmer Calum Heggan Mehrdad Yaghoobi Timothy M. Hospedales SSL 35 11 0 24 Feb 2023
Learning to Generalize Provably in Learning to Optimize Junjie Yang Tianlong Chen Mingkang Zhu Fengxiang He Dacheng Tao Yitao Liang Zhangyang Wang 31 6 0 22 Feb 2023
Some Fundamental Aspects about Lipschitz Continuity of Neural Networks Grigory Khromov Sidak Pal Singh 29 7 0 21 Feb 2023