Reducing Overfitting in Deep Networks by Decorrelating Representations

19 November 2015

Papers citing "Reducing Overfitting in Deep Networks by Decorrelating Representations"

50 / 60 papers shown

Title
Gramian Attention Heads are Strong yet Efficient Vision Learners Jongbin Ryu Dongyoon Han J. Lim 32 1 0 25 Oct 2023
Group Orthogonalization Regularization For Vision Models Adaptation and Robustness Yoav Kurtz Noga Bar Raja Giryes 26 0 0 16 Jun 2023
Rec4Ad: A Free Lunch to Mitigate Sample Selection Bias for Ads CTR Prediction in Taobao Jingyue Gao Shuguang Han Ziru Xu Siran Yang Yuning Jiang Jian Xu Bo Zheng 33 11 0 06 Jun 2023
Curve Your Enthusiasm: Concurvity Regularization in Differentiable Generalized Additive Models Julien N. Siems Konstantin Ditschuneit Winfried Ripken Alma Lindborg Maximilian Schambach Johannes Otterbach Martin Genzel 19 6 0 19 May 2023
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution Jaeill Kim Suhyun Kang Duhun Hwang Jungwook Shin Wonjong Rhee DRL 13 21 0 04 Apr 2023
Generalizing and Decoupling Neural Collapse via Hyperspherical Uniformity Gap Weiyang Liu L. Yu Adrian Weller Bernhard Schölkopf 37 17 0 11 Mar 2023
Improving Self-Supervised Learning for Audio Representations by Feature Diversity and Decorrelation Bac Nguyen Stefan Uhlich Fabien Cardinaux SSL 42 3 0 07 Mar 2023
DECOR-NET: A COVID-19 Lung Infection Segmentation Network Improved by Emphasizing Low-level Features and Decorrelating Features Jiesi Hu Yanwu Yang Xutao Guo Tingxia Ma 12 2 0 28 Feb 2023
Look Beyond Bias with Entropic Adversarial Data Augmentation Thomas Duboudin Emmanuel Dellandréa Corentin Abgrall Gilles Hénaff Liming Luke Chen CML 35 4 0 10 Jan 2023
WLD-Reg: A Data-dependent Within-layer Diversity Regularizer Firas Laakom Jenni Raitoharju Alexandros Iosifidis Moncef Gabbouj AI4CE 29 7 0 03 Jan 2023
Learning Cross-view Geo-localization Embeddings via Dynamic Weighted Decorrelation Regularization Ting Wang Zhedong Zheng Zunjie Zhu Yuhan Gao Yi Yang Chenggang Yan 25 34 0 10 Nov 2022
A Detailed Study of Interpretability of Deep Neural Network based Top Taggers Ayush Khot Mark S. Neubauer Avik Roy AAML 33 16 0 09 Oct 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations Grégoire Mialon Randall Balestriero Yann LeCun 32 9 0 29 Sep 2022
Efficient CNN with uncorrelated Bag of Features pooling Firas Laakom Jenni Raitoharju Alexandros Iosifidis Moncef Gabbouj 35 2 0 22 Sep 2022
Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networks Bernd Prach Christoph H. Lampert 32 35 0 05 Aug 2022
FeaRLESS: Feature Refinement Loss for Ensembling Self-Supervised Learning Features in Robust End-to-end Speech Recognition Szu-Jui Chen Jiamin Xie John H. L. Hansen 37 8 0 30 Jun 2022
Feature Overcorrelation in Deep Graph Neural Networks: A New Perspective Wei Jin Xiaorui Liu Yao Ma Charu C. Aggarwal Jiliang Tang 30 42 0 15 Jun 2022
Riemannian Hamiltonian methods for min-max optimization on manifolds Andi Han Bamdev Mishra Pratik Jawanpuria Pawan Kumar Junbin Gao 32 17 0 25 Apr 2022
Concept Evolution in Deep Learning Training: A Unified Interpretation Framework and Discoveries Haekyu Park Seongmin Lee Benjamin Hoover Austin P. Wright Omar Shaikh Rahul Duggal Nilaksh Das Kevin Li Judy Hoffman Duen Horng Chau 24 2 0 30 Mar 2022
Constrained Parameter Inference as a Principle for Learning Nasir Ahmad Ellen Schrader Marcel van Gerven 18 10 0 22 Mar 2022
Reducing Redundancy in the Bottleneck Representation of the Autoencoders Firas Laakom Jenni Raitoharju Alexandros Iosifidis Moncef Gabbouj 27 10 0 09 Feb 2022
Debiased Graph Neural Networks with Agnostic Label Selection Bias Shaohua Fan Xiao Wang Chuan Shi Kun Kuang Nian Liu Bai Wang AI4CE 44 38 0 19 Jan 2022
Spatial-Temporal-Fusion BNN: Variational Bayesian Feature Layer Shiye Lei Zhuozhuo Tu Leszek Rutkowski Feng Zhou Li Shen Fengxiang He Dacheng Tao BDL 23 2 0 12 Dec 2021
Quality-Aware Multimodal Biometric Recognition Sobhan Soleymani Ali Dabouei Fariborz Taherkhani Seyed Mehdi Iranmanesh J. Dawson Nasser M. Nasrabadi CVBM 30 3 0 10 Dec 2021
OOD-GNN: Out-of-Distribution Generalized Graph Neural Network Haoyang Li Xin Wang Ziwei Zhang Wenwu Zhu OODD OOD 29 97 0 07 Dec 2021
Learning distinct features helps, provably Firas Laakom Jenni Raitoharju Alexandros Iosifidis Moncef Gabbouj MLT 36 6 0 10 Jun 2021
Stochastic Whitening Batch Normalization Shengdong Zhang E. Nezhadarya H. Fashandi Jiayi Liu Darin Graham Mohak Shah 13 10 0 03 Jun 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 133 187 0 02 May 2021
Unsupervised Information Obfuscation for Split Inference of Neural Networks Mohammad Samragh H. Hosseini Aleksei Triastcyn K. Azarian Joseph B. Soriaga F. Koushanfar 22 11 0 23 Apr 2021
Knowledge Evolution in Neural Networks Ahmed Taha Abhinav Shrivastava L. Davis 47 21 0 09 Mar 2021
Learning with Hyperspherical Uniformity Weiyang Liu Rongmei Lin Zhen Liu Li Xiong Bernhard Schölkopf Adrian Weller 37 35 0 02 Mar 2021
Anti-Distillation: Improving reproducibility of deep networks G. Shamir Lorenzo Coviello 42 20 0 19 Oct 2020
No-reference Screen Content Image Quality Assessment with Unsupervised Domain Adaptation Baoliang Chen Haoliang Li Hongfei Fan Shiqi Wang 22 32 0 19 Aug 2020
Multi-Temporal Scene Classification and Scene Change Detection with Correlation based Fusion Lixiang Ru Bo Du Chen Wu 15 72 0 03 Jun 2020
Transfer Learning via Contextual Invariants for One-to-Many Cross-Domain Recommendation A. Krishnan Mahashweta Das M. Bendre Hao Yang Hari Sundaram 19 64 0 21 May 2020
HERS: Homomorphically Encrypted Representation Search Joshua J. Engelsma Anil K. Jain Vishnu Naresh Boddeti 38 50 0 27 Mar 2020
Topologically Densified Distributions Christoph Hofer Florian Graf Marc Niethammer Roland Kwitt 27 15 0 12 Feb 2020
Concept Whitening for Interpretable Image Recognition Zhi Chen Yijie Bei Cynthia Rudin FAtt 31 314 0 05 Feb 2020
Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transform Jun Li Fuxin Li S. Todorovic 24 102 0 04 Feb 2020
Tuning-Free Disentanglement via Projection Yue Bai L. Duan 13 3 0 27 Jun 2019
Deep Multi-View Learning using Neuron-Wise Correlation-Maximizing Regularizers Kui Jia Jiehong Lin Mingkui Tan Dacheng Tao 3DV 25 32 0 25 Apr 2019
MultiGrain: a unified image embedding for classes and instances Maxim Berman Hervé Jégou Andrea Vedaldi Iasonas Kokkinos Matthijs Douze 15 110 0 14 Feb 2019
Statistical Characteristics of Deep Representations: An Empirical Investigation Daeyoung Choi Kyungeun Lee Changho Shin Stephen J. Roberts AI4TS 16 2 0 08 Nov 2018
An ETF view of Dropout regularization Dor Bank Raja Giryes 8 4 0 14 Oct 2018
The Optimal ANN Model for Predicting Bearing Capacity of Shallow Foundations Trained on Scarce Data Marta Baginska P. Srokosz AI4CE 18 33 0 22 Sep 2018
Removing the Feature Correlation Effect of Multiplicative Noise Zijun Zhang Yining Zhang Zongpeng Li 13 8 0 19 Sep 2018
Filter Distillation for Network Compression Xavier Suau Luca Zappella N. Apostoloff 18 38 0 20 Jul 2018
Restructuring Batch Normalization to Accelerate CNN Training Wonkyung Jung Daejin Jung and Byeongho Kim Sunjung Lee Wonjong Rhee Jung Ho Ahn 24 62 0 04 Jul 2018
Selfless Sequential Learning Rahaf Aljundi Marcus Rohrbach Tinne Tuytelaars CLL 28 114 0 14 Jun 2018
Decorrelated Batch Normalization Lei Huang Dawei Yang B. Lang Jia Deng 13 190 0 23 Apr 2018