Spectral Norm Regularization for Improving the Generalizability of Deep Learning

31 May 2017

Papers citing "Spectral Norm Regularization for Improving the Generalizability of Deep Learning"

50 / 69 papers shown

Title
Approximation theory for 1-Lipschitz ResNets Davide Murari Takashi Furuya Carola-Bibiane Schönlieb 9 0 0 17 May 2025
Evidence on the Regularisation Properties of Maximum-Entropy Reinforcement Learning Rémy Hosseinkhan Boucher Onofrio Semeraro L. Mathelin 82 0 0 28 Jan 2025
Learn A Flexible Exploration Model for Parameterized Action Markov Decision Processes Zijian Wang Bin Wang Mingwen Shao Hongbo Dou Boxiang Tao 36 0 0 06 Jan 2025
Mitigating Memorization In Language Models Mansi Sakarvadia Aswathy Ajith Arham Khan Nathaniel Hudson Caleb Geniesse Kyle Chard Yaoqing Yang Ian Foster Michael W. Mahoney KELM MU 58 1 0 03 Oct 2024
Learning Causally Invariant Reward Functions from Diverse Demonstrations Ivan Ovinnikov Eugene Bykovets J. M. Buhmann CML 40 0 0 12 Sep 2024
Do Sharpness-based Optimizers Improve Generalization in Medical Image Analysis? Mohamed Hassan Aleksandar Vakanski Min Xian AAML MedIm 41 1 0 07 Aug 2024
BECAUSE: Bilinear Causal Representation for Generalizable Offline Model-based Reinforcement Learning Hao-ming Lin Wenhao Ding Jian Chen Laixi Shi Jiacheng Zhu Bo-wen Li Ding Zhao OffRL CML 54 0 0 15 Jul 2024
1-Lipschitz Neural Distance Fields Guillaume Coiffier Louis Bethune 43 3 0 14 Jun 2024
Spectral regularization for adversarially-robust representation learning Sheng Yang Jacob A. Zavatone-Veth Cengiz Pehlevan AAML OOD 49 0 0 27 May 2024
Ferrari: Federated Feature Unlearning via Optimizing Feature Sensitivity Hanlin Gu W. Ong Chee Seng Chan Lixin Fan MU 39 7 0 23 May 2024
How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspective Siyi Lin Chongming Gao Jiawei Chen Sheng Zhou Binbin Hu Yan Feng Chun-Yen Chen Can Wang 31 8 0 18 Apr 2024
K-percent Evaluation for Lifelong RL Golnaz Mesbahi Parham Mohammad Panahi Olya Mastikhina Martha White Adam White CLL OffRL 39 0 0 02 Apr 2024
Linearly Constrained Weights: Reducing Activation Shift for Faster Training of Neural Networks Takuro Kutsuna LLMSV 32 1 0 08 Mar 2024
Log Neural Controlled Differential Equations: The Lie Brackets Make a Difference Benjamin Walker Andrew D. McLeod Tiexin Qin Yichuan Cheng Haoliang Li Terry Lyons 44 6 0 28 Feb 2024
Flat Minima in Linear Estimation and an Extended Gauss Markov Theorem Simon Segert 32 0 0 18 Nov 2023
DP-SGD with weight clipping Antoine Barczewski Jan Ramon 11 1 0 27 Oct 2023
FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fields Sung Ju Hwang J. Hyung Daejin Kim Minjeong Kim Jaegul Choo 3DH CLIP CVBM 70 11 0 21 Jul 2023
Why Does Little Robustness Help? Understanding and Improving Adversarial Transferability from Surrogate Training Yechao Zhang Shengshan Hu Leo Yu Zhang Junyu Shi Minghui Li Xiaogeng Liu Wei Wan Hai Jin AAML 27 21 0 15 Jul 2023
High Fidelity Image Synthesis With Deep VAEs In Latent Space Troy Luhman Eric Luhman DRL 3DV 31 7 0 23 Mar 2023
ABCAS: Adaptive Bound Control of spectral norm as Automatic Stabilizer Shota Hirose Shiori Maki Naoki Wada Heming Sun J. Katto 35 0 0 12 Nov 2022
Spectral Regularization Allows Data-frugal Learning over Combinatorial Spaces Amirali Aghazadeh Nived Rajaraman Tony Tu Kannan Ramchandran 22 2 0 05 Oct 2022
Why neural networks find simple solutions: the many regularizers of geometric complexity Benoit Dherin Michael Munn M. Rosca David Barrett 57 31 0 27 Sep 2022
Data-free Backdoor Removal based on Channel Lipschitzness Runkai Zheng Rong Tang Jianze Li Li Liu AAML 23 104 0 05 Aug 2022
Contrastive Adapters for Foundation Model Group Robustness Michael Zhang Christopher Ré VLM 18 62 0 14 Jul 2022
Lipschitz Continuity Retained Binary Neural Network Yuzhang Shang Dan Xu Bin Duan Ziliang Zong Liqiang Nie Yan Yan 16 19 0 13 Jul 2022
Exact Spectral Norm Regularization for Neural Networks Anton Johansson Claes Strannegård Niklas Engsner P. Mostad AAML 25 2 0 27 Jun 2022
On the Role of Generalization in Transferability of Adversarial Examples Yilin Wang Farzan Farnia AAML 24 10 0 18 Jun 2022
Random matrix analysis of deep neural network weight matrices M. Thamm Max Staats B. Rosenow 37 12 0 28 Mar 2022
Controlling the Complexity and Lipschitz Constant improves polynomial nets Zhenyu Zhu Fabian Latorre Grigorios G. Chrysos V. Cevher 24 10 0 10 Feb 2022
Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning Yang Zhao Hao Zhang Xiuyuan Hu 38 116 0 08 Feb 2022
Deep Equilibrium Models for Video Snapshot Compressive Imaging Yaping Zhao Siming Zheng Xin Yuan 53 19 0 18 Jan 2022
Hybrid Spectrogram and Waveform Source Separation Alexandre Défossez 24 162 0 05 Nov 2021
RoMA: Robust Model Adaptation for Offline Model-based Optimization Sihyun Yu Sungsoo Ahn Le Song Jinwoo Shin OffRL 30 31 0 27 Oct 2021
An automatic differentiation system for the age of differential privacy Dmitrii Usynin Alexander Ziller Moritz Knolle Andrew Trask Kritika Prakash Daniel Rueckert Georgios Kaissis 30 3 0 22 Sep 2021
Coordinate descent on the orthogonal group for recurrent neural network training E. Massart V. Abrol 37 10 0 30 Jul 2021
Noise Stability Regularization for Improving BERT Fine-tuning Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 19 43 0 10 Jul 2021
Stochastic Whitening Batch Normalization Shengdong Zhang E. Nezhadarya H. Fashandi Jiayi Liu Darin Graham Mohak Shah 21 10 0 03 Jun 2021
A Universal Law of Robustness via Isoperimetry Sébastien Bubeck Mark Sellke 13 213 0 26 May 2021
Spectral Normalisation for Deep Reinforcement Learning: an Optimisation Perspective Florin Gogianu Tudor Berariu Mihaela Rosca Claudia Clopath L. Buşoniu Razvan Pascanu 24 53 0 11 May 2021
The Low-Rank Simplicity Bias in Deep Networks Minyoung Huh H. Mobahi Richard Y. Zhang Brian Cheung Pulkit Agrawal Phillip Isola 27 109 0 18 Mar 2021
Learning with Hyperspherical Uniformity Weiyang Liu Rongmei Lin Zhen Liu Li Xiong Bernhard Schölkopf Adrian Weller 37 35 0 02 Mar 2021
A case for new neural network smoothness constraints Mihaela Rosca T. Weber Arthur Gretton S. Mohamed AAML 35 48 0 14 Dec 2020
Denoising Score-Matching for Uncertainty Quantification in Inverse Problems Zaccharie Ramzi B. Remy F. Lanusse Jean-Luc Starck P. Ciuciu UQCV MedIm 36 14 0 16 Nov 2020
DL-Reg: A Deep Learning Regularization Technique using Linear Regression Maryam Dialameh A. Hamzeh Hossein Rahmani 26 3 0 31 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 36 79 0 17 Sep 2020
Analysis of Generalizability of Deep Neural Networks Based on the Complexity of Decision Boundary Shuyue Guan Murray H. Loew 27 25 0 16 Sep 2020
Adversarially Robust Neural Architectures Minjing Dong Yanxi Li Yunhe Wang Chang Xu AAML OOD 42 48 0 02 Sep 2020
Asymptotic Singular Value Distribution of Linear Convolutional Layers Xinping Yi 9 3 0 12 Jun 2020
Stable and expressive recurrent vision models Drew Linsley A. Ashok L. Govindarajan Rex G Liu Thomas Serre 19 45 0 22 May 2020
Regularization Methods for Generative Adversarial Networks: An Overview of Recent Studies Minhyeok Lee Junhee Seok GAN 27 25 0 19 May 2020