Intriguing Properties of Contrastive Losses

5 November 2020

Papers citing "Intriguing Properties of Contrastive Losses"

50 / 112 papers shown

Title
Feature Dropout: Revisiting the Role of Augmentations in Contrastive Learning Alex Tamkin Margalit Glasgow Xiluo He Noah D. Goodman SSL 19 7 0 16 Dec 2022
Implicit variance regularization in non-contrastive SSL Manu Srinath Halvagal Axel Laborieux Friedemann Zenke 31 8 0 09 Dec 2022
Giga-SSL: Self-Supervised Learning for Gigapixel Images Tristan Lazard Marvin Lerousseau Etienne Decencière Thomas Walter 20 17 0 06 Dec 2022
Joint Embedding Predictive Architectures Focus on Slow Features Vlad Sobal V. JyothirS Siddhartha Jalagam Nicolas Carion Kyunghyun Cho Yann LeCun 6 8 0 20 Nov 2022
A simple, efficient and scalable contrastive masked autoencoder for learning visual representations Shlok Kumar Mishra Joshua Robinson Huiwen Chang David Jacobs Aaron Sarna Aaron Maschinot Dilip Krishnan DiffM 41 30 0 30 Oct 2022
MixMask: Revisiting Masking Strategy for Siamese ConvNets Kirill Vishniakov Eric P. Xing Zhiqiang Shen 16 0 0 20 Oct 2022
Rethinking Prototypical Contrastive Learning through Alignment, Uniformity and Correlation Shentong Mo Zhun Sun Chao Li 13 11 0 18 Oct 2022
Self-Supervised Learning Through Efference Copies Franz Scherr Qinghai Guo Timoleon Moraitis 19 10 0 17 Oct 2022
Correlation between Alignment-Uniformity and Performance of Dense Contrastive Representations Jong Hak Moon Wonjae Kim E. Choi 10 3 0 17 Oct 2022
Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers Tao Tang Changlin Li Guangrun Wang Kaicheng Yu Xiaojun Chang Xiaodan Liang ViT 18 1 0 16 Oct 2022
The Hidden Uniform Cluster Prior in Self-Supervised Learning Mahmoud Assran Randall Balestriero Quentin Duval Florian Bordes Ishan Misra Piotr Bojanowski Pascal Vincent Michael G. Rabbat Nicolas Ballas SSL 41 46 0 13 Oct 2022
Self-supervised debiasing using low rank regularization Geon Yeong Park Chanyong Jung Sangmin Lee Jong Chul Ye Sang Wan Lee CML SSL 36 3 0 11 Oct 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations Grégoire Mialon Randall Balestriero Yann LeCun 24 9 0 29 Sep 2022
Graph Contrastive Learning with Cross-view Reconstruction Qianlong Wen Z. Ouyang Chunhui Zhang Y. Qian Yanfang Ye Chuxu Zhang SSL 15 6 0 16 Sep 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 68 40 0 13 Sep 2022
Robust and Efficient Imbalanced Positive-Unlabeled Learning with Self-supervision Emilio Dorigatti J. Schweisthal Bernd Bischl Mina Rezaei OOD 15 2 0 06 Sep 2022
Design of the topology for contrastive visual-textual alignment Zhun Sun 25 1 0 05 Sep 2022
Improving Fine-tuning of Self-supervised Models with Contrastive Initialization Haolin Pan Yong Guo Qinyi Deng Hao-Fan Yang Yiqun Chen Jian Chen SSL 18 19 0 30 Jul 2022
Self-supervised learning with rotation-invariant kernels Léon Zheng Gilles Puy E. Riccietti Patrick Pérez Rémi Gribonval SSL 9 2 0 28 Jul 2022
Contrastive Self-Supervised Learning Leads to Higher Adversarial Susceptibility Rohit Gupta Naveed Akhtar Ajmal Saeed Mian M. Shah AAML SSL 21 5 0 22 Jul 2022
Self-Supervision Can Be a Good Few-Shot Learner Yuning Lu Liangjiang Wen Jianzhuang Liu Yajing Liu Xinmei Tian SSL 14 37 0 19 Jul 2022
Red PANDA: Disambiguating Anomaly Detection by Removing Nuisance Factors Niv Cohen Jonathan Kahana Yedid Hoshen 16 3 0 07 Jul 2022
Is Self-Supervised Learning More Robust Than Supervised Learning? Yuanyi Zhong Haoran Tang Jun-Kun Chen Jian-wei Peng Yu-xiong Wang SSL OOD 25 24 0 10 Jun 2022
POODLE: Improving Few-shot Learning via Penalizing Out-of-Distribution Samples Duong H. Le Khoi Duc Minh Nguyen Khoi Nguyen Quoc-Huy Tran Rang Nguyen Binh-Son Hua OODD 30 39 0 08 Jun 2022
Integrating Prior Knowledge in Contrastive Learning with Kernel Benoit Dufumier C. Barbano Robin Louiset Edouard Duchesnay Pietro Gori SSL 19 8 0 03 Jun 2022
On the duality between contrastive and non-contrastive self-supervised learning Q. Garrido Yubei Chen Adrien Bardes Laurent Najman Yann LeCun SSL 20 88 0 03 Jun 2022
Contrasting quadratic assignments for set-based representation learning A. Moskalev Ivan Sosnovik Volker Fischer A. Smeulders SSL 32 9 0 31 May 2022
Triangular Contrastive Learning on Molecular Graphs MinGyu Choi Wonseok Shin Yijingxiu Lu Sun Kim 12 2 0 26 May 2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning Zixin Wen Yuanzhi Li SSL 19 34 0 12 May 2022
The NT-Xent loss upper bound Wilhelm Ågren SSL 14 5 0 06 May 2022
Do More Negative Samples Necessarily Hurt in Contrastive Learning? Pranjal Awasthi Nishanth Dikkala Pritish Kamath 23 40 0 03 May 2022
Reducing Predictive Feature Suppression in Resource-Constrained Contrastive Image-Caption Retrieval Maurits J. R. Bleeker Andrew Yates Maarten de Rijke 28 4 0 28 Apr 2022
CAiD: Context-Aware Instance Discrimination for Self-supervised Learning in Medical Imaging M. Taher F. Haghighi Michael B. Gotway Jianming Liang OOD SSL 11 31 0 15 Apr 2022
Alignment-Uniformity aware Representation Learning for Zero-shot Video Classification Shi Pu Kaili Zhao Mao Zheng VLM 14 20 0 29 Mar 2022
A Contrastive Objective for Learning Disentangled Representations Jonathan Kahana Yedid Hoshen SSL 17 13 0 21 Mar 2022
CYBORGS: Contrastively Bootstrapping Object Representations by Grounding in Segmentation Renhao Wang Hang Zhao Yang Gao SSL 14 1 0 17 Mar 2022
Robots Autonomously Detecting People: A Multimodal Deep Contrastive Learning Method Robust to Intraclass Variations Angus Fung B. Benhabib G. Nejat 19 12 0 01 Mar 2022
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 19 109 0 28 Feb 2022
Towards better understanding and better generalization of few-shot classification in histology images with contrastive learning Jiawei Yang Hanbo Chen Jiangpeng Yan Xiaoyu Chen Jianhua Yao VLM 25 21 0 18 Feb 2022
Do Lessons from Metric Learning Generalize to Image-Caption Retrieval? Maurits J. R. Bleeker Maarten de Rijke SSL DML 21 9 0 14 Feb 2022
Crafting Better Contrastive Views for Siamese Representation Learning Xiang Peng Kai Wang Zheng Hua Zhu Mang Wang Yang You SSL 23 102 0 07 Feb 2022
SNCSE: Contrastive Learning for Unsupervised Sentence Embedding with Soft Negative Samples Hao Wang Yangguang Li Zhen Huang Yong Dou Lingpeng Kong Jing Shao SSL 11 54 0 16 Jan 2022
Similarity Contrastive Estimation for Self-Supervised Soft Contrastive Learning J. Denize Jaonary Rabarisoa Astrid Orcesi Romain Hérault S. Canu SSL 19 30 0 29 Nov 2021
Hyper-Representations: Self-Supervised Representation Learning on Neural Network Weights for Model Characteristic Prediction Konstantin Schurholt Dimche Kostadinov Damian Borth SSL 19 14 0 28 Oct 2021
Unsupervised Finetuning Suichan Li Dongdong Chen Yinpeng Chen Lu Yuan Lei Zhang Qi Chu B. Liu Nenghai Yu 17 8 0 18 Oct 2021
Inverse Problems Leveraging Pre-trained Contrastive Representations Sriram Ravula Georgios Smyrnis Matt Jordan A. Dimakis SSL 27 9 0 14 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 37 19 0 06 Oct 2021
Deep Bregman Divergence for Contrastive Learning of Visual Representations Mina Rezaei Farzin Soleymani B. Bischl Shekoofeh Azizi SSL 44 16 0 15 Sep 2021
Improve Unsupervised Pretraining for Few-label Transfer Suichan Li Dongdong Chen Yinpeng Chen Lu Yuan Lei Zhang Qi Chu B. Liu Nenghai Yu SSL 8 20 0 26 Jul 2021
Can contrastive learning avoid shortcut solutions? Joshua Robinson Li Sun Ke Yu Kayhan Batmanghelich Stefanie Jegelka S. Sra SSL 16 141 0 21 Jun 2021