Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere

20 May 2020

Papers citing "Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere"

46 / 296 papers shown

Title
SelfCF: A Simple Framework for Self-supervised Collaborative Filtering Xin Zhou Aixin Sun Yong-jin Liu Jie M. Zhang C. Miao SSL 25 76 0 07 Jul 2021
SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption Dara Bahri Heinrich Jiang Yi Tay Donald Metzler SSL 17 163 0 29 Jun 2021
Decomposed Mutual Information Estimation for Contrastive Representation Learning Alessandro Sordoni Nouha Dziri Hannes Schulz Geoffrey J. Gordon Philip Bachman Rémi Tachet des Combes SSL 22 29 0 25 Jun 2021
Co-advise: Cross Inductive Bias Distillation Sucheng Ren Zhengqi Gao Tianyu Hua Zihui Xue Yonglong Tian Shengfeng He Hang Zhao 42 53 0 23 Jun 2021
Can contrastive learning avoid shortcut solutions? Joshua Robinson Li Sun Ke Yu Kayhan Batmanghelich Stefanie Jegelka S. Sra SSL 19 141 0 21 Jun 2021
Multi-level Feature Learning for Contrastive Multi-view Clustering Jie Xu Huayi Tang Yazhou Ren Liang Peng Xiao-lan Zhu Lifang He 24 160 0 21 Jun 2021
Investigating the Role of Negatives in Contrastive Representation Learning Jordan T. Ash Surbhi Goel A. Krishnamurthy Dipendra Kumar Misra SSL 21 49 0 18 Jun 2021
Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation Haoxiang Wang Han Zhao Bo-wen Li 29 88 0 16 Jun 2021
Learning to See by Looking at Noise Manel Baradad Jonas Wulff Tongzhou Wang Phillip Isola Antonio Torralba 18 89 0 10 Jun 2021
Neighborhood Contrastive Learning Applied to Online Patient Monitoring Hugo Yèche Gideon Dresdner Francesco Locatello Matthias Huser Gunnar Rätsch 16 46 0 09 Jun 2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning Zixin Wen Yuanzhi Li SSL MLT 21 131 0 31 May 2021
Backdoor Attacks on Self-Supervised Learning Aniruddha Saha Ajinkya Tejankar Soroush Abbasi Koohpayegani Hamed Pirsiavash SSL AAML 27 100 0 21 May 2021
Divide and Contrast: Self-supervised Learning from Uncurated Data Yonglong Tian Olivier J. Hénaff Aaron van den Oord SSL 51 96 0 17 May 2021
TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learning Lu Wang Xiaofu Chang Shuang Li Yunfei Chu Hui Li Wei Zhang Xiaofeng He Le Song Jingren Zhou Hongxia Yang 18 51 0 17 May 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya-Qin Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 36 12 0 08 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 117 187 0 02 May 2021
Disentangled Contrastive Learning for Learning Robust Textual Representations Xiang Chen Xin Xie Zhen Bi Hongbin Ye Shumin Deng Ningyu Zhang Huajun Chen 33 5 0 11 Apr 2021
Self-Supervised Learning for Gastritis Detection with Gastric X-ray Images Guang Li Ren Togo Takahiro Ogawa Miki Haseyama 20 11 0 07 Apr 2021
Contrastive Syn-to-Real Generalization Wuyang Chen Zhiding Yu Shalini De Mello Sifei Liu J. Álvarez Zhangyang Wang Anima Anandkumar 15 46 0 06 Apr 2021
Elsa: Energy-based learning for semi-supervised anomaly detection Sungwon Han Hyeonho Song Seungeon Lee Sungwon Park M. Cha 27 12 0 29 Mar 2021
Behavior From the Void: Unsupervised Active Pre-Training Hao Liu Pieter Abbeel VLM SSL 34 195 0 08 Mar 2021
CoDeGAN: Contrastive Disentanglement for Generative Adversarial Network Lili Pan Peijun Tang Zhiyong Chen Zenglin Xu GAN DRL 11 6 0 05 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 21 2,288 0 04 Mar 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 85 90 0 25 Feb 2021
Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View Xuanchi Ren Tao Yang Yuwang Wang W. Zeng CoGe OCL DRL 31 36 0 21 Feb 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 207 0 17 Feb 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 16 43 0 13 Feb 2021
Neural Collapse with Cross-Entropy Loss Jianfeng Lu Stefan Steinerberger MLT 11 65 0 15 Dec 2020
Understanding the Behaviour of Contrastive Loss Feng Wang Huaping Liu SSL 17 664 0 15 Dec 2020
Concept Generalization in Visual Representation Learning Mert Bulent Sariyildiz Yannis Kalantidis Diane Larlus Alahari Karteek SSL 21 50 0 10 Dec 2020
CASTing Your Model: Learning to Localize Improves Self-Supervised Representations Ramprasaath R. Selvaraju Karan Desai Justin Johnson Nikhil Naik SSL 22 79 0 08 Dec 2020
Seed the Views: Hierarchical Semantic Alignment for Contrastive Representation Learning Haohang Xu Xiaopeng Zhang Hao Li Lingxi Xie H. Xiong Qi Tian SSL 6 12 0 04 Dec 2020
Heterogeneous Contrastive Learning: Encoding Spatial Information for Compact Visual Representations Xinyue Huo Lingxi Xie Longhui Wei Xiaopeng Zhang Hao Li Zijie Yang Wen-gang Zhou Houqiang Li Qi Tian SSL 6 13 0 19 Nov 2020
Towards Domain-Agnostic Contrastive Learning Vikas Verma Minh-Thang Luong Kenji Kawaguchi Hieu H. Pham Quoc V. Le SSL 15 115 0 09 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 28 173 0 05 Nov 2020
Pretext-Contrastive Learning: Toward Good Practices in Self-supervised Video Representation Leaning L. Tao Xueting Wang T. Yamasaki VLM SSL 18 14 0 29 Oct 2020
Federated Unsupervised Representation Learning Fengda Zhang Kun Kuang Zhaoyang You T. Shen Jun Xiao Yin Zhang Chao-Xiang Wu Yueting Zhuang Xiaolin Li FedML 20 133 0 18 Oct 2020
Contrastive Learning with Hard Negative Samples Joshua Robinson Ching-Yao Chuang S. Sra Stefanie Jegelka SSL 49 759 0 09 Oct 2020
Improving Few-Shot Learning through Multi-task Representation Learning Theory Quentin Bouniot I. Redko Romaric Audigier Angélique Loesch Amaury Habrard 45 10 0 05 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 27 628 0 02 Oct 2020
Understanding Self-supervised Learning with Dual Deep Networks Yuandong Tian Lantao Yu Xinlei Chen Surya Ganguli SSL 13 78 0 01 Oct 2020
Novelty Search in Representational Space for Sample Efficient Exploration Ruo Yu Tao Vincent François-Lavet Joelle Pineau 14 43 0 28 Sep 2020
Delving into Inter-Image Invariance for Unsupervised Visual Representations Jiahao Xie Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy SSL VLM 13 58 0 26 Aug 2020
Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases Senthil Purushwalkam Abhinav Gupta SSL 19 213 0 28 Jul 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 31 1,586 0 15 Jun 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,369 0 09 Mar 2020