Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere

20 May 2020

Papers citing "Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere"

50 / 298 papers shown

Title
Learning Common Rationale to Improve Self-Supervised Representation for Fine-Grained Visual Recognition Problems Yangyang Shu A. Hengel Lingqiao Liu SSL 28 14 0 03 Mar 2023
Amortised Invariance Learning for Contrastive Self-Supervision Ruchika Chavhan H. Gouk Jan Stuehmer Calum Heggan Mehrdad Yaghoobi Timothy M. Hospedales SSL 35 11 0 24 Feb 2023
Steerable Equivariant Representation Learning Sangnie Bhardwaj Willie McClinton Tongzhou Wang Guillaume Lajoie Chen Sun Phillip Isola Dilip Krishnan OOD LLMSV 26 5 0 22 Feb 2023
Contrastive Representation Learning for Acoustic Parameter Estimation Philipp Götz Cagdas Tuna Andreas Walther Emanuel Habets SSL 17 7 0 22 Feb 2023
Unsupervised Learning on a DIET: Datum IndEx as Target Free of Self-Supervision, Reconstruction, Projector Head Randall Balestriero 38 3 0 20 Feb 2023
Detecting Contextomized Quotes in News Headlines by Contrastive Learning Seonyeong Song Hyeonho Song Kunwoo Park Jiyoung Han M. Cha 16 1 0 09 Feb 2023
Multi-view Feature Extraction based on Dual Contrastive Head Hongjie Zhang 18 1 0 08 Feb 2023
Aggregation of Disentanglement: Reconsidering Domain Variations in Domain Generalization Daoan Zhang Mingkai Chen Chenming Li Lingyun Huang Jianguo Zhang OOD 21 9 0 05 Feb 2023
Contrastive Learning with Consistent Representations Zihu Wang Yu Wang Hanbin Hu Peng Li CLL 24 5 0 03 Feb 2023
Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation Ziwei Fan Zhiwei Liu Hao Peng Philip S Yu 27 15 0 28 Jan 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning Jiajun Ma Tianyang Hu Wenjia Wang 17 8 0 28 Jan 2023
Bayesian Self-Supervised Contrastive Learning B. Liu Bang-wei Wang Tianrui Li SSL BDL 16 4 0 27 Jan 2023
Simplifying Open-Set Video Domain Adaptation with Contrastive Learning Giacomo Zara Victor G. Turrisi da Costa Subhankar Roy Paolo Rota Elisa Ricci 33 1 0 09 Jan 2023
Learning the Relation between Similarity Loss and Clustering Loss in Self-Supervised Learning Jidong Ge YuXiang Liu Jie Gui Lanting Fang Ming Lin James T. Kwok LiGuo Huang B. Luo SSL 14 5 0 08 Jan 2023
Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching Byoungjip Kim Sun Choi Dasol Hwang Moontae Lee Honglak Lee 25 10 0 07 Jan 2023
Learning Decorrelated Representations Efficiently Using Fast Fourier Transform Yutaro Shigeto Masashi Shimbo Yuya Yoshikawa A. Takeuchi 13 0 0 04 Jan 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 17 9 0 27 Dec 2022
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse Xiao Li Sheng Liu Jin-li Zhou Xin Lu C. Fernandez‐Granda Zhihui Zhu Q. Qu AAML 23 18 0 23 Dec 2022
Similarity Contrastive Estimation for Image and Video Soft Contrastive Self-Supervised Learning J. Denize Jaonary Rabarisoa Astrid Orcesi Romain Hérault SSL 14 6 0 21 Dec 2022
NBC-Softmax : Darkweb Author fingerprinting and migration tracking Gayan K. Kulatilleke Shekhar S. Chandra Marius Portmann 34 0 0 15 Dec 2022
Spectral Feature Augmentation for Graph Contrastive Learning and Beyond Yifei Zhang Hao Zhu Zixing Song Piotr Koniusz Irwin King 37 87 0 02 Dec 2022
CL4CTR: A Contrastive Learning Framework for CTR Prediction Fang Wang Yingxu Wang Dongsheng Li Hansu Gu T. Lu Peng-Zhen Zhang Ning Gu SSL 18 42 0 01 Dec 2022
Task Discovery: Finding the Tasks that Neural Networks Generalize on Andrei Atanov Andrei Filatov Teresa Yeo Ajay Sohmshetty Amir Zamir OOD 40 10 0 01 Dec 2022
A Novel Semisupervised Contrastive Regression Framework for Forest Inventory Mapping with Multisensor Satellite Data Shaojia Ge Hong Gu W. Su Anne Lonnqvist O. Antropov 30 4 0 01 Dec 2022
Improved Representation of Asymmetrical Distances with Interval Quasimetric Embeddings Tongzhou Wang Phillip Isola 19 6 0 28 Nov 2022
Delving into Out-of-Distribution Detection with Vision-Language Representations Yifei Ming Ziyan Cai Jiuxiang Gu Yiyou Sun W. Li Yixuan Li VLM OODD 37 157 0 24 Nov 2022
Cross-Modal Contrastive Learning for Robust Reasoning in VQA Qinjie Zheng Chaoyue Wang Daqing Liu Dadong Wang Dacheng Tao LRM 23 0 0 21 Nov 2022
Self-Supervised Visual Representation Learning via Residual Momentum T. Pham Axi Niu Zhang Kang Sultan Rizky Hikmawan Madjid Jiajing Hong Daehyeok Kim Joshua Tian Jin Tee Chang-Dong Yoo SSL 41 6 0 17 Nov 2022
Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works Chao Tao Ji Qi Mingning Guo Qing Zhu Haifeng Li SSL 24 56 0 15 Nov 2022
The Role of Local Alignment and Uniformity in Image-Text Contrastive Learning on Medical Images Philip Muller Georgios Kaissis Daniel Rueckert MedIm 16 7 0 14 Nov 2022
Self-supervised learning of audio representations using angular contrastive loss Shanshan Wang S. Tripathy A. Mesaros SSL 18 4 0 10 Nov 2022
Contrastive Value Learning: Implicit Models for Simple Offline RL Bogdan Mazoure Benjamin Eysenbach Ofir Nachum Jonathan Tompson SSL OffRL 33 7 0 03 Nov 2022
Adversarial Auto-Augment with Label Preservation: A Representation Learning Principle Guided Approach Kaiwen Yang Yanchao Sun Jiahao Su Fengxiang He Xinmei Tian Furong Huang Tianyi Zhou Dacheng Tao 27 13 0 02 Nov 2022
SDCL: Self-Distillation Contrastive Learning for Chinese Spell Checking Xiaotian Zhang Hang Yan Sun Yu Xipeng Qiu 24 4 0 31 Oct 2022
A simple, efficient and scalable contrastive masked autoencoder for learning visual representations Shlok Kumar Mishra Joshua Robinson Huiwen Chang David Jacobs Aaron Sarna Aaron Maschinot Dilip Krishnan DiffM 43 30 0 30 Oct 2022
Discriminative Speaker Representation via Contrastive Learning with Class-Aware Attention in Angular Space Zhe Li Man-Wai Mak Helen M. Meng 26 9 0 29 Oct 2022
COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning Yue Yu Chenyan Xiong Si Sun Chao Zhang Arnold Overwijk VLM OOD 45 22 0 27 Oct 2022
Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings Jian Zhu Zuoyu Tian Yadong Liu Cong Zhang Chia-wen Lo SSL 30 2 0 23 Oct 2022
Self-Supervised Learning via Maximum Entropy Coding Xin Liu Zhongdao Wang Yali Li Shengjin Wang SSL 18 39 0 20 Oct 2022
Transferable Unlearnable Examples J. Ren Han Xu Yuxuan Wan Xingjun Ma Lichao Sun Jiliang Tang 28 36 0 18 Oct 2022
Unsupervised visualization of image datasets using contrastive learning Jan Boehm Philipp Berens D. Kobak SSL 21 15 0 18 Oct 2022
Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers Tao Tang Changlin Li Guangrun Wang Kaicheng Yu Xiaojun Chang Xiaodan Liang ViT 20 1 0 16 Oct 2022
A Large-Scale Annotated Multivariate Time Series Aviation Maintenance Dataset from the NGAFID Hong Yang Travis J. Desell AI4TS 19 1 0 13 Oct 2022
Generalized Inter-class Loss for Gait Recognition Weichen Yu Hongyuan Yu Yan Huang Liang Wang CVBM 20 12 0 13 Oct 2022
Continual Learning by Modeling Intra-Class Variation L. Yu Tianyang Hu Lanqing Hong Zhen Liu Adrian Weller Weiyang Liu CLL 48 12 0 11 Oct 2022
SDA: Simple Discrete Augmentation for Contrastive Sentence Representation Learning Dongsheng Zhu Zhenyu Mao Jinghui Lu Rui Zhao Fei Tan 26 1 0 08 Oct 2022
Zero-shot stance detection based on cross-domain feature enhancement by contrastive learning Xuechen Zhao Jiaying Zou Zhong Zhang Feng Xie Bin Zhou Lei Tian 29 3 0 07 Oct 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 48 20 0 02 Oct 2022
Rethinking the Learning Paradigm for Facial Expression Recognition Weijie Wang N. Sebe Bruno Lepri 29 2 0 30 Sep 2022
Few-shot Text Classification with Dual Contrastive Consistency Liwen Sun Jiawei Han 19 0 0 29 Sep 2022