The Singular Values of Convolutional Layers

26 May 2018

Papers citing "The Singular Values of Convolutional Layers"

50 / 128 papers shown

Title
On the Surprising Effectiveness of Spectrum Clipping in Learning Stable Linear Dynamics Hanyao Guo Yunhai Han H. Ravichandar 76 0 0 20 May 2025
Data-Free Universal Attack by Exploiting the Intrinsic Vulnerability of Deep Models YangTian Yan Jinyu Tian AAML FedML 70 0 0 28 Mar 2025
Parameter Expanded Stochastic Gradient Markov Chain Monte Carlo Hyunsu Kim G. Nam Chulhee Yun Hongseok Yang Juho Lee BDL UQCV 57 0 0 02 Mar 2025
Unitary convolutions for learning on graphs and groups B. Kiani Lukas Fesser Melanie Weber GNN 40 1 0 07 Oct 2024
LOTOS: Layer-wise Orthogonalization for Training Robust Ensembles A. Boroojeny Hari Sundaram Varun Chandrasekaran AAML 34 1 0 07 Oct 2024
Tight and Efficient Upper Bound on Spectral Norm of Convolutional Layers Ekaterina Grishina Mikhail Gorbunov Maxim Rakhuba AAML 22 2 0 18 Sep 2024
Spectral regularization for adversarially-robust representation learning Sheng Yang Jacob A. Zavatone-Veth C. Pehlevan AAML OOD 46 0 0 27 May 2024
Time-series Initialization and Conditioning for Video-agnostic Stabilization of Video Super-Resolution using Recurrent Networks Hiroshi Mori Norimichi Ukita 35 0 0 23 Mar 2024
Graph Unitary Message Passing Haiquan Qiu Yatao Bian Quanming Yao 34 2 0 17 Mar 2024
Spectrum Extraction and Clipping for Implicitly Linear Layers A. Boroojeny Matus Telgarsky Hari Sundaram MLT 32 5 0 25 Feb 2024
Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods Akira Ito Masanori Yamada Atsutoshi Kumagai MoMe 61 5 0 06 Feb 2024
Spectral Norm of Convolutional Layers with Circular and Zero Paddings Blaise Delattre Quentin Barthélemy Alexandre Allauzen 34 2 0 31 Jan 2024
Computing excited states of molecules using normalizing flows Yahya Saleh Álvaro Fernández Corral Emil Vogt Armin Iske J. Küpper A. Yachmenev 22 7 0 31 Aug 2023
Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithms Alexis Goujon Sebastian Neumayer M. Unser 41 23 0 21 Aug 2023
Decomposition Ascribed Synergistic Learning for Unified Image Restoration Jinghao Zhang Fengmei Zhao 21 2 0 01 Aug 2023
Adversarial Likelihood Estimation With One-Way Flows Omri Ben-Dov Pravir Singh Gupta Victoria Fernandez-Abrevaya Michael J. Black Partha Ghosh GAN DRL 32 0 0 19 Jul 2023
On the Matrix Form of the Quaternion Fourier Transform and Quaternion Convolution Quaternion Convolution Giorgos Sfikas 15 0 0 04 Jul 2023
Catching Image Retrieval Generalization Maksim Zhdanov I. Karpukhin VLM 19 0 0 23 Jun 2023
Lightweight Attribute Localizing Models for Pedestrian Attribute Recognition Ashish Jha Dimitrii Ermilov Konstantin Sobolev Anh-Huy Phan S. Ahmadi-Asl ... Imran N. Junejo Z. Aghbari Thar Baker A. Khedr A. Cichocki CVBM 17 1 0 16 Jun 2023
Efficient Bound of Lipschitz Constant for Convolutional Layers by Gram Iteration Blaise Delattre Quentin Barthélemy Alexandre Araujo A. Allauzen 12 13 0 25 May 2023
Layer-adaptive Structured Pruning Guided by Latency Siyuan Pan Linna Zhang Jie M. Zhang Xiaoshuang Li Liang Hou Xiaobing Tu 29 0 0 23 May 2023
The Hessian perspective into the Nature of Convolutional Neural Networks Sidak Pal Singh Thomas Hofmann Bernhard Schölkopf 33 10 0 16 May 2023
On the Adversarial Inversion of Deep Biometric Representations Gioacchino Tangari Shreesh Keskar H. Asghar Dali Kaafar AAML 31 2 0 12 Apr 2023
Graph Enabled Cross-Domain Knowledge Transfer S. Yao 13 0 0 07 Apr 2023
Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies Hannah Pinson Joeri Lenaerts V. Ginis 19 3 0 03 Mar 2023
CQnet: convex-geometric interpretation and constraining neural-network trajectories B. Peters 29 0 0 09 Feb 2023
GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restoration Naoki Murata Koichi Saito Chieh-Hsin Lai Yuhta Takida Toshimitsu Uesaka Yuki Mitsufuji Stefano Ermon DiffM 56 49 0 30 Jan 2023
Asymptotic Analysis of Deep Residual Networks R. Cont Alain Rossier Renyuan Xu 24 4 0 15 Dec 2022
Orthogonal SVD Covariance Conditioning and Latent Disentanglement Yue Song N. Sebe Wei Wang 26 6 0 11 Dec 2022
Proximal Residual Flows for Bayesian Inverse Problems J. Hertrich BDL TPM 33 4 0 30 Nov 2022
Towards Practical Control of Singular Values of Convolutional Layers Alexandra Senderovich Ekaterina Bulatova Anton Obukhov M. Rakhuba AAML 16 9 0 24 Nov 2022
Improved techniques for deterministic l2 robustness Sahil Singla S. Feizi AAML 23 9 0 15 Nov 2022
Deep equilibrium models as estimators for continuous latent variables Russell Tsuchida Cheng Soon Ong 30 8 0 11 Nov 2022
$LOT: Layer-wise Orthogonal Training on Improving $\ell_2$ Certified Robustness$ LOT: Layer-wise Orthogonal Training on Improving $\ell_2$ Certified Robustness Xiaojun Xu Linyi Li Bo-wen Li OOD AAML 33 33 0 20 Oct 2022
Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise Yihao Xue Kyle Whitecross Baharan Mirzasoleiman NoLa 25 1 0 17 Aug 2022
The SVD of Convolutional Weights: A CNN Interpretability Framework Brenda Praggastis Davis Brown Carlos Ortiz Marrero Emilie Purvine Madelyn Shapiro Bei Wang FAtt 32 9 0 14 Aug 2022
Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networks Bernd Prach Christoph H. Lampert 32 35 0 05 Aug 2022
Lipschitz Bound Analysis of Neural Networks S. Bose AAML 24 0 0 14 Jul 2022
Improving Covariance Conditioning of the SVD Meta-layer by Orthogonality Yue Song N. Sebe Wei Wang 16 8 0 05 Jul 2022
LED: Latent Variable-based Estimation of Density Omri Ben-Dov Pravir Singh Gupta Victoria Fernandez-Abrevaya Michael J. Black Partha Ghosh GAN DRL 17 0 0 23 Jun 2022
Singular Value Fine-tuning: Few-shot Segmentation requires Few-parameters Fine-tuning Yanpeng Sun Qiang Chen Xiangyu He Jian Wang Haocheng Feng Junyu Han Errui Ding Jian Cheng Zechao Li Jingdong Wang 23 56 0 13 Jun 2022
Few-Shot Learning by Dimensionality Reduction in Gradient Space M. Gauch M. Beck Thomas Adler D. Kotsur Stefan Fiel ... Markus Holzleitner Werner Zellinger D. Klotz Sepp Hochreiter Sebastian Lehner 35 9 0 07 Jun 2022
Approximation of Lipschitz Functions using Deep Spline Neural Networks Sebastian Neumayer Alexis Goujon Pakshal Bohra M. Unser 24 15 0 13 Apr 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 36 32 0 10 Mar 2022
On Measuring Excess Capacity in Neural Networks Florian Graf Sebastian Zeng Bastian Alexander Rieck Marc Niethammer Roland Kwitt 14 9 0 16 Feb 2022
Analytic Learning of Convolutional Neural Network For Pattern Recognition Huiping Zhuang Zhiping Lin Yimin Yang Kar-Ann Toh 11 2 0 14 Feb 2022
Backpropagation Clipping for Deep Learning with Differential Privacy Timothy Stevens Ivoline C. Ngong David Darais Calvin Hirsch David Slater Joseph P. Near 16 9 0 10 Feb 2022
Neural network training under semidefinite constraints Patricia Pauli Niklas Funcke Dennis Gramlich Mohamed Amine Msalmi Frank Allgöwer GAN 18 13 0 03 Jan 2022
Stable Long-Term Recurrent Video Super-Resolution Benjamin Naoto Chiche Arnaud Woiselle J. Frontera-Pons Jean-Luc Starck SupR 22 6 0 16 Dec 2021
On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversion Chengyuan Deng Youzuo Lin OOD 20 2 0 28 Nov 2021