Can We Gain More from Orthogonality Regularizations in Training Deep CNNs?

22 October 2018

ArXiv (abs)PDF HTML Github (129★)

Papers citing "Can We Gain More from Orthogonality Regularizations in Training Deep CNNs?"

50 / 107 papers shown

Title
NaroNet: Discovery of tumor microenvironment elements from highly multiplexed images Daniel Jiménez Sánchez M. Ariz Hang Chang X. Matías-Guiu C. E. Andrea Carlos Ortiz-de-Solórzano 42 0 0 09 Mar 2021
Estimating and Improving Fairness with Adversarial Learning Xiaoxiao Li Ziteng Cui Yifan Wu Li Gu Tatsuya Harada MedIm 61 41 0 07 Mar 2021
Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training Sheng Liu Xiao Li Yuexiang Zhai Chong You Zhihui Zhu C. Fernandez‐Granda Qing Qu 52 26 0 01 Mar 2021
Interpreting the Latent Space of Generative Adversarial Networks using Supervised Learning Toan Pham Van Tam Minh Nguyen Ngoc N. Tran Hoai Viet Nguyen Linh Doan Bao Huy Dao Quang Ta Minh Thanh GAN SSL 38 10 0 24 Feb 2021
Self-Domain Adaptation for Face Anti-Spoofing Jingjing Wang Jingyi Zhang Ying Bian Youyi Cai Chunmao Wang Shiliang Pu OOD TTA 69 96 0 24 Feb 2021
Fast and accurate optimization on the orthogonal manifold without retraction Pierre Ablin Gabriel Peyré 115 30 0 15 Feb 2021
Quadric Hypersurface Intersection for Manifold Learning in Feature Space Fedor Pavutnitskiy Sergei Ivanov E. Abramov Viacheslav Borovitskiy Artem Klochkov V. Vialov A. Zaikovskii Aleksandr Petiushko 31 1 0 11 Feb 2021
SuperFront: From Low-resolution to High-resolution Frontal Face Synthesis Yu Yin Joseph P. Robinson Songyao Jiang Yue Bai Can Qin Y. Fu CVBM 67 7 0 07 Dec 2020
Supercharging Imbalanced Data Learning With Energy-based Contrastive Representation Transfer Zidi Xiu Junya Chen Ricardo Henao B. Goldstein Lawrence Carin Chenyang Tao 51 10 0 25 Nov 2020
Towards Robust Neural Networks via Orthogonal Diversity Kun Fang Qinghua Tao Yingwen Wu Tao Li Jia Cai Feipeng Cai Xiaolin Huang Jie Yang AAML 80 8 0 23 Oct 2020
One Reflection Suffice Alexander Mathiasen Frederik Hvilshoj 21 0 0 30 Sep 2020
Normalization Techniques in Training DNNs: Methodology, Analysis and Application Lei Huang Jie Qin Yi Zhou Fan Zhu Li Liu Ling Shao AI4CE 176 272 0 27 Sep 2020
Role of Orthogonality Constraints in Improving Properties of Deep Networks for Image Classification Hongjun Choi Anirudh Som Pavan Turaga 49 8 0 22 Sep 2020
Finite-Sample Guarantees for Wasserstein Distributionally Robust Optimization: Breaking the Curse of Dimensionality Rui Gao 72 94 0 09 Sep 2020
Unsupervised Deep Metric Learning via Orthogonality based Probabilistic Loss U. Dutta Mehrtash Harandi C. Sekhar SSL 41 16 0 22 Aug 2020
Functional Regularization for Representation Learning: A Unified Theoretical Perspective Siddhant Garg Yingyu Liang SSL 81 20 0 06 Aug 2020
Self domain adapted network Yufan He A. Carass Lianrui Zuo Blake E. Dewey Jerry L. Prince OOD 74 30 0 07 Jul 2020
Data-driven Regularization via Racecar Training for Generalizing Neural Networks You Xie Nils Thuerey 14 0 0 30 Jun 2020
Deep Isometric Learning for Visual Recognition Haozhi Qi Chong You Xinyu Wang Yi-An Ma Jitendra Malik VLM 102 55 0 30 Jun 2020
Self-Supervised Learning of a Biologically-Inspired Visual Texture Model Nikhil Parthasarathy Eero P. Simoncelli 81 7 0 30 Jun 2020
Graph Clustering with Graph Neural Networks Anton Tsitsulin John Palowitch Bryan Perozzi Emmanuel Müller GNN AI4CE 121 269 0 30 Jun 2020
An Ode to an ODE K. Choromanski Jared Davis Valerii Likhosherstov Xingyou Song Jean-Jacques E. Slotine Jacob Varley Honglak Lee Adrian Weller Vikas Sindhwani 87 31 0 19 Jun 2020
Model-Aware Regularization For Learning Approaches To Inverse Problems Jaweria Amjad Zhaoyang Lyu M. Rodrigues MedIm 18 0 0 18 Jun 2020
Constraint-Based Regularization of Neural Networks Benedict Leimkuhler Timothée Pouchon Tiffany J. Vlaar Amos Storkey 32 10 0 17 Jun 2020
Passive Batch Injection Training Technique: Boosting Network Performance by Injecting Mini-Batches from a different Data Distribution Pravendra Singh Pratik Mazumder Vinay P. Namboodiri 24 0 0 08 Jun 2020
Do We Need Fully Connected Output Layers in Convolutional Networks? Zhongchao Qian Tyler L. Hayes Kushal Kafle Christopher Kanan 49 9 0 28 Apr 2020
OSLNet: Deep Small-Sample Classification with an Orthogonal Softmax Layer Xiaoxu Li Dongliang Chang Zhanyu Ma Zheng-Hua Tan Jing-Hao Xue Jie Cao Jingyi Yu Jun Guo 104 32 0 20 Apr 2020
CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices Valerii Likhosherstov Jared Davis K. Choromanski Adrian Weller 38 4 0 18 Apr 2020
Orthogonal Over-Parameterized Training Weiyang Liu Rongmei Lin Zhen Liu James M. Rehg Liam Paull Li Xiong Le Song Adrian Weller 82 45 0 09 Apr 2020
Controllable Orthogonalization in Training DNNs Lei Huang Li Liu Fan Zhu Diwen Wan Zehuan Yuan Bo Li Ling Shao 78 44 0 02 Apr 2020
Stochastic Flows and Geometric Optimization on the Orthogonal Group K. Choromanski David Cheikhi Jared Davis Valerii Likhosherstov Achille Nazaret ... Yuan Gao Aldo Pacchiano Tamás Sarlós Adrian Weller Vikas Sindhwani AI4CE 27 7 0 30 Mar 2020
On Isometry Robustness of Deep 3D Point Cloud Models under Adversarial Attacks Yue Zhao Yuwei Wu Caihua Chen A. Lim 3DPC 97 72 0 27 Feb 2020
Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transform Jun Li Fuxin Li S. Todorovic 83 107 0 04 Feb 2020
Self-Orthogonality Module: A Network Architecture Plug-in for Learning Orthogonal Filters Ziming Zhang Wenchi Ma Yuanwei Wu Guanghui Wang 85 10 0 05 Jan 2020
Orthogonal Wasserstein GANs J. Müller Reinhard Klein Michael Weinmann 113 9 0 29 Nov 2019
Orthogonal Convolutional Neural Networks Jiayun Wang Yubei Chen Rudrasis Chakraborty Stella X. Yu 89 190 0 27 Nov 2019
Approximated Orthonormal Normalisation in Training Neural Networks Guoqiang Zhang Kenta Niwa W. Kleijn 54 3 0 21 Nov 2019
Learning to Optimize in Swarms Yue Cao Tianlong Chen Zhangyang Wang Yang Shen 104 56 0 09 Nov 2019
HUBERT Untangles BERT to Improve Transfer across NLP Tasks M. Moradshahi Hamid Palangi M. Lam P. Smolensky Jianfeng Gao 137 16 0 25 Oct 2019
Decoder Choice Network for Meta-Learning Jialin Liu Chia-Wen Lin Longzhi Yang Chih-Min Lin Q. Shen 31 9 0 25 Sep 2019
Push for Center Learning via Orthogonalization and Subspace Masking for Person Re-Identification Weinong Wang Wenjie Pei Qiong Cao Shu Liu Yu-Wing Tai 17 1 0 28 Aug 2019
ABD-Net: Attentive but Diverse Person Re-Identification Tianlong Chen Shaojin Ding Jingyi Xie Ye Yuan Wuyang Chen Yang Zhou Ren Zhangyang Wang 134 480 0 03 Aug 2019
Filter Bank Regularization of Convolutional Neural Networks Seyed Mehdi Ayyoubzadeh Xiaolin Wu 16 0 0 25 Jul 2019
Regularizing Neural Networks via Minimizing Hyperspherical Energy Rongmei Lin Weiyang Liu Zhen Liu Chen Feng Zhiding Yu James M. Rehg Li Xiong Le Song 98 39 0 12 Jun 2019
OOGAN: Disentangling GAN with One-Hot Sampling and Orthogonal Regularization Bingchen Liu Yizhe Zhu Zuohui Fu Gerard de Melo Ahmed Elgammal CML 115 43 0 26 May 2019
How degenerate is the parametrization of neural networks with the ReLU activation function? Julius Berner Dennis Elbrächter Philipp Grohs ODL 84 28 0 23 May 2019
Orthogonal Deep Neural Networks Kui Jia Shuai Li Yuxin Wen Tongliang Liu Dacheng Tao 93 134 0 15 May 2019
Plug-and-Play Methods Provably Converge with Properly Trained Denoisers Ernest K. Ryu Jialin Liu Sicheng Wang Xiaohan Chen Zhangyang Wang W. Yin AI4CE 86 354 0 14 May 2019
Incremental multi-domain learning with network latent tensor factorization Adrian Bulat Jean Kossaifi Georgios Tzimiropoulos Maja Pantic CLL 60 34 0 12 Apr 2019
Deep Learning for Inverse Problems: Bounds and Regularizers Jaweria Amjad Zhaoyang Lyu M. Rodrigues 38 4 0 31 Jan 2019