Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere

20 May 2020

Papers citing "Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere"

50 / 298 papers shown

Title
RankCLIP: Ranking-Consistent Language-Image Pretraining Yiming Zhang Zhuokai Zhao Zhaorun Chen Zhili Feng Zenghui Ding Yining Sun SSL VLM 45 7 0 15 Apr 2024
Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Models Dennis Wu Jerry Yao-Chieh Hu Teng-Yun Hsiao Han Liu 40 28 0 04 Apr 2024
On the Surprising Efficacy of Distillation as an Alternative to Pre-Training Small Models Sean Farhat Deming Chen 34 0 0 04 Apr 2024
Automated Contrastive Learning Strategy Search for Time Series Baoyu Jing Yansen Wang Guoxin Sui Jing Hong Jingrui He Yuqing Yang Dongsheng Li Kan Ren AI4TS 32 6 0 19 Mar 2024
Poly-View Contrastive Learning Amitis Shidani Devon Hjelm Jason Ramapuram Russ Webb Eeshan Gunesh Dhekane Dan Busbridge VLM SSL 34 4 0 08 Mar 2024
Supervised Contrastive Representation Learning: Landscape Analysis with Unconstrained Features Tina Behnia Christos Thrampoulidis SSL 31 0 0 29 Feb 2024
FedUV: Uniformity and Variance for Heterogeneous Federated Learning Ha Min Son M. Kim Tai-Myung Chung Chao Huang Xin Liu FedML 41 3 0 27 Feb 2024
Separating common from salient patterns with Contrastive Representation Learning Robin Louiset Edouard Duchesnay Antoine Grigis Pietro Gori SSL DRL 38 1 0 19 Feb 2024
Beyond DAGs: A Latent Partial Causal Model for Multimodal Learning Yuhang Liu Zhen Zhang Dong Gong Biwei Huang Mingming Gong A. Hengel Kun Zhang Javen Qinfeng Shi J. Shi 41 7 0 09 Feb 2024
UNSEE: Unsupervised Non-contrastive Sentence Embeddings Ömer Veysel Çagatan SSL 24 0 0 27 Jan 2024
Contrastive Learning with Negative Sampling Correction Lu Wang Chao Du Pu Zhao Chuan Luo Zhangchi Zhu ... Wei Zhang Qingwei Lin Saravan Rajmohan Dongmei Zhang Qi Zhang SSL 88 1 0 13 Jan 2024
Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing Jaeill Kim Duhun Hwang Eunjung Lee Jangwon Suh Jimyeong Kim Wonjong Rhee 28 0 0 11 Jan 2024
Modality-Aware Representation Learning for Zero-shot Sketch-based Image Retrieval Eun-Young Lyou Doyeon Lee Jooeun Kim Joonseok Lee 34 4 0 10 Jan 2024
Preserving Silent Features for Domain Generalization Chujie Zhao Tianren Zhang Feng Chen 23 0 0 06 Jan 2024
Unveiling Vulnerabilities of Contrastive Recommender Systems to Poisoning Attacks Zongwei Wang Junliang Yu Min Gao Hongzhi Yin Bin Cui S. Sadiq AAML 26 7 0 30 Nov 2023
A Robust Semantics-based Watermark for Large Language Model against Paraphrasing Jie Ren Han Xu Yiding Liu Yingqian Cui Shuaiqiang Wang Dawei Yin Jiliang Tang OffRL 23 43 0 15 Nov 2023
BeLLM: Backward Dependency Enhanced Large Language Model for Sentence Embeddings Xianming Li Jing Li 42 10 0 09 Nov 2023
Towards a Unified Framework of Contrastive Learning for Disentangled Representations Stefan Matthes Zhiwei Han Hao Shen 31 4 0 08 Nov 2023
Uncertainty-guided Boundary Learning for Imbalanced Social Event Detection Jiaqian Ren Hao Peng Lei Jiang Zhiwei Liu Jia Wu Zhengtao Yu Phillp S. Yu 23 13 0 30 Oct 2023
Does Invariant Graph Learning via Environment Augmentation Learn Invariance? Yongqiang Chen Yatao Bian Kaiwen Zhou Binghui Xie Bo Han James Cheng OOD 28 33 0 29 Oct 2023
FUSC: Fetal Ultrasound Semantic Clustering of Second Trimester Scans Using Deep Self-supervised Learning Hussain Alasmawi Leanne Bricker Mohammad Yaqub 19 2 0 19 Oct 2023
Improving Contrastive Learning of Sentence Embeddings with Focal-InfoNCE Peng-Fei Hou Xingyu Li 20 6 0 10 Oct 2023
DrugCLIP: Contrastive Protein-Molecule Representation Learning for Virtual Screening Bowen Gao Bo Qiang Haichuan Tan Minsi Ren Yinjun Jia Minsi Lu Jingjing Liu Wei-Ying Ma Yanyan Lan 29 9 0 10 Oct 2023
Adaptive Multi-head Contrastive Learning Lei Wang Piotr Koniusz Tom Gedeon Liang Zheng 30 4 0 09 Oct 2023
Transferable Availability Poisoning Attacks Yiyong Liu Michael Backes Xiao Zhang AAML 19 3 0 08 Oct 2023
DimCL: Dimensional Contrastive Learning For Improving Self-Supervised Learning Thanh Nguyen T. Pham Chaoning Zhang T. Luu Thang Vu Chang-Dong Yoo 25 9 0 21 Sep 2023
LatentDR: Improving Model Generalization Through Sample-Aware Latent Degradation and Restoration Ran Liu Sahil Khose Jingyun Xiao Lakshmi Sathidevi Keerthan Ramnath Z. Kira Eva L. Dyer 34 3 0 28 Aug 2023
Toward a Better Understanding of Loss Functions for Collaborative Filtering Seongmin Park Mincheol Yoon Jae-woong Lee Hogun Park Jongwuk Lee 24 13 0 11 Aug 2023
No Length Left Behind: Enhancing Knowledge Tracing for Modeling Sequences of Excessive or Insufficient Lengths Moyu Zhang Xinning Zhu Chun-Xiao Zhang Feng Pan Wenchen Qian Hui Zhao 17 3 0 07 Aug 2023
Hierarchical Skeleton Meta-Prototype Contrastive Learning with Hard Skeleton Mining for Unsupervised Person Re-Identification Haocong Rao Cyril Leung Chun Miao 3DH 23 8 0 24 Jul 2023
Divide&Classify: Fine-Grained Classification for City-Wide Visual Place Recognition Gabriele Trivigno Gabriele Berton J. Aragon Barbara Caputo Carlo Masone 31 2 0 17 Jul 2023
All in One: Exploring Unified Vision-Language Tracking with Multi-Modal Alignment Chunhui Zhang Xin Sun Li Liu Yiqian Yang Qiong Liu Xiaoping Zhou Yanfeng Wang 38 15 0 07 Jul 2023
Knowledge Graph Self-Supervised Rationalization for Recommendation Yuhao Yang Chao Huang Lianghao Xia Chunzhen Huang 27 88 0 06 Jul 2023
Graph Contrastive Topic Model Zheheng Luo Lei Liu Qianqian Xie Sophia Ananiadou 16 2 0 05 Jul 2023
Online Unsupervised Video Object Segmentation via Contrastive Motion Clustering Lin Xi Weihai Chen Xingming Wu Zhong Liu Zhengguo Li VOS 26 9 0 21 Jun 2023
Unraveling Projection Heads in Contrastive Learning: Insights from Expansion and Shrinkage Yu Gui Cong Ma Yiqiao Zhong 22 6 0 06 Jun 2023
uCTRL: Unbiased Contrastive Representation Learning via Alignment and Uniformity for Collaborative Filtering Jae-woong Lee Seongmin Park Mincheol Yoon Jongwuk Lee 23 7 0 22 May 2023
Instance Smoothed Contrastive Learning for Unsupervised Sentence Embedding Hongliang He Junlei Zhang Zhenzhong Lan Yue Zhang 33 5 0 12 May 2023
Similarity of Neural Network Models: A Survey of Functional and Representational Measures Max Klabunde Tobias Schumacher M. Strohmaier Florian Lemmerich 50 64 0 10 May 2023
Denoising Cosine Similarity: A Theory-Driven Approach for Efficient Representation Learning Takumi Nakagawa Y. Sanada Hiroki Waida Yuhui Zhang Yuichiro Wada K. Takanashi Tomonori Yamada Takafumi Kanamori DiffM 19 5 0 19 Apr 2023
A surprisingly simple technique to control the pretraining bias for better transfer: Expand or Narrow your representation Florian Bordes Samuel Lavoie Randall Balestriero Nicolas Ballas Pascal Vincent SSL 32 5 0 11 Apr 2023
Semi-Supervised Relational Contrastive Learning Attiano Purpura-Pontoniere D. Terzopoulos Adam S. Wang A. Imran SSL 12 1 0 11 Apr 2023
Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition Shuhuai Ren Aston Zhang Yi Zhu Shuai Zhang Shuai Zheng Mu Li Alexander J. Smola Xu Sun VPVLM VLM 21 28 0 10 Apr 2023
Optimal Goal-Reaching Reinforcement Learning via Quasimetric Learning Tongzhou Wang Antonio Torralba Phillip Isola Amy Zhang OffRL 24 31 0 03 Apr 2023
Accelerating exploration and representation learning with offline pre-training Bogdan Mazoure Jake Bruce Doina Precup Rob Fergus Ankit Anand OffRL 27 5 0 31 Mar 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 32 29 0 27 Mar 2023
Preventing Dimensional Collapse of Incomplete Multi-View Clustering via Direct Contrastive Learning Kaiwu Zhang Shiqiang Du Bao-Yu Liu Shengxia Gao 17 0 0 22 Mar 2023
PRISE: Demystifying Deep Lucas-Kanade with Strongly Star-Convex Constraints for Multimodel Image Alignment Yiqing Zhang Xinming Huang Ziming Zhang 34 4 0 21 Mar 2023
Generalizing and Decoupling Neural Collapse via Hyperspherical Uniformity Gap Weiyang Liu L. Yu Adrian Weller Bernhard Schölkopf 32 17 0 11 Mar 2023
Improving Self-Supervised Learning for Audio Representations by Feature Diversity and Decorrelation Bac Nguyen Stefan Uhlich Fabien Cardinaux SSL 42 3 0 07 Mar 2023