Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2110.02473
Cited By
v1
v2
v3
v4 (latest)
The Power of Contrast for Feature Learning: A Theoretical Analysis
6 October 2021
Wenlong Ji
Zhun Deng
Ryumei Nakada
James Zou
Linjun Zhang
SSL
Re-assign community
ArXiv (abs)
PDF
HTML
Github
Papers citing
"The Power of Contrast for Feature Learning: A Theoretical Analysis"
43 / 43 papers shown
PCA++: How Uniformity Induces Robustness to Background Noise in Contrastive Learning
Mingqi Wu
Qiang Sun
Yi Yang
147
1
0
15 Nov 2025
CovMatch: Cross-Covariance Guided Multimodal Dataset Distillation with Trainable Text Encoder
Yongmin Lee
Hye Won Chung
208
1
0
21 Oct 2025
Theoretical Refinement of CLIP by Utilizing Linear Structure of Optimal Similarity
Naoki Yoshida
Satoshi Hayakawa
Yuhta Takida
Toshimitsu Uesaka
Hiromi Wakaki
Yuki Mitsufuji
147
0
0
17 Oct 2025
On the Alignment Between Supervised and Self-Supervised Contrastive Learning
Achleshwar Luthra
Priyadarsi Mishra
Tomer Galanti
SSL
214
1
0
09 Oct 2025
A theoretical framework for self-supervised contrastive learning for continuous dependent data
Alexander Marusov
Alexander Yuhay
Alexey Zaytsev
531
1
0
11 Jun 2025
A Contrastive Learning Foundation Model Based on Perfectly Aligned Sample Pairs for Remote Sensing Images
Hengtong Shen
Haiyan Gu
Haitao Li
Yi Yang
Agen qiu
SSL
511
2
0
26 May 2025
DivIL: Unveiling and Addressing Over-Invariance for Out-of- Distribution Generalization
Jiaqi Wang
Yuhang Zhou
Zhixiong Zhang
Qiguang Chen
Yongqiang Chen
James Cheng
OODD
521
2
0
18 Feb 2025
CSA: Data-efficient Mapping of Unimodal Features to Multimodal Features
International Conference on Learning Representations (ICLR), 2024
Po-han Li
Sandeep Chinchali
Ufuk Topcu
608
6
0
10 Oct 2024
Bootstrap Latents of Nodes and Neighbors for Graph Self-Supervised Learning
Yunhui Liu
Huaisong Zhang
Tieke He
Tao Zheng
Jianhua Zhao
SSL
342
7
0
09 Aug 2024
Bridging Mini-Batch and Asymptotic Analysis in Contrastive Learning: From InfoNCE to Kernel-Based Losses
Panagiotis Koromilas
Giorgos Bouritsas
Theodoros Giannakopoulos
M. Nicolaou
Yannis Panagakis
324
7
0
28 May 2024
Contrastive Learning on Multimodal Analysis of Electronic Health Records
Tianxi Cai
Feiqing Huang
Ryumei Nakada
Linjun Zhang
Doudou Zhou
276
4
0
22 Mar 2024
Data-Efficient Contrastive Language-Image Pretraining: Prioritizing Data Quality over Quantity
International Conference on Artificial Intelligence and Statistics (AISTATS), 2024
Siddharth Joshi
Arnav Jain
Ali Payani
Baharan Mirzasoleiman
VLM
CLIP
317
18
0
18 Mar 2024
Investigating the Benefits of Projection Head for Representation Learning
International Conference on Learning Representations (ICLR), 2024
Yihao Xue
Eric Gan
Jiayi Ni
Siddharth Joshi
Baharan Mirzasoleiman
326
22
0
18 Mar 2024
When can we Approximate Wide Contrastive Models with Neural Tangent Kernels and Principal Component Analysis?
AAAI Conference on Artificial Intelligence (AAAI), 2024
Gautham Govind Anil
Pascal Esser
Debarghya Ghoshdastidar
400
1
0
13 Mar 2024
Provable Multi-Party Reinforcement Learning with Diverse Human Feedback
Huiying Zhong
Zhun Deng
Weijie J. Su
Zhiwei Steven Wu
Linjun Zhang
269
27
0
08 Mar 2024
Variance Alignment Score: A Simple But Tough-to-Beat Data Selection Method for Multimodal Contrastive Learning
Yiping Wang
Yifang Chen
Wendan Yan
Kevin Jamieson
S. Du
289
7
0
03 Feb 2024
Towards Calibrated Robust Fine-Tuning of Vision-Language Models
Neural Information Processing Systems (NeurIPS), 2023
Changdae Oh
Hyesu Lim
Mijoo Kim
Dongyoon Han
Junhyeok Park
Euiseog Jeong
Alexander G. Hauptmann
Zhi-Qi Cheng
Kyungwoo Song
VLM
793
40
0
03 Nov 2023
Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift
International Conference on Learning Representations (ICLR), 2023
Yihao Xue
Siddharth Joshi
Dang Nguyen
Baharan Mirzasoleiman
VLM
293
6
0
08 Oct 2023
Complexity Matters: Rethinking the Latent Space for Generative Modeling
Neural Information Processing Systems (NeurIPS), 2023
Tianyang Hu
Fei Chen
Hong Wang
Jiawei Li
Wei Cao
Jiacheng Sun
Hao Sun
DiffM
368
20
0
17 Jul 2023
Safeguarding Data in Multimodal AI: A Differentially Private Approach to CLIP Training
Alyssa Huang
Peihan Liu
Ryumei Nakada
Linjun Zhang
Wanrong Zhang
VLM
461
8
0
13 Jun 2023
Unraveling Projection Heads in Contrastive Learning: Insights from Expansion and Shrinkage
Yu Gui
Cong Ma
Yiqiao Zhong
312
9
0
06 Jun 2023
How Does Information Bottleneck Help Deep Learning?
International Conference on Machine Learning (ICML), 2023
Kenji Kawaguchi
Zhun Deng
Xu Ji
Jiaoyang Huang
250
115
0
30 May 2023
HyperTime: Hyperparameter Optimization for Combating Temporal Distribution Shifts
ACM Multimedia (ACM MM), 2023
Shaokun Zhang
Yiran Wu
Zhonghua Zheng
Qingyun Wu
Chi Wang
OOD
296
8
0
28 May 2023
Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression
International Conference on Machine Learning (ICML), 2023
Yihao Xue
S. Joshi
Eric Gan
Pin-Yu Chen
Baharan Mirzasoleiman
SSL
428
36
0
25 May 2023
Discover and Cure: Concept-aware Mitigation of Spurious Correlation
International Conference on Machine Learning (ICML), 2023
Shirley Wu
Mert Yuksekgonul
Linjun Zhang
James Zou
414
97
0
01 May 2023
A Cookbook of Self-Supervised Learning
Randall Balestriero
Mark Ibrahim
Vlad Sobal
Ari S. Morcos
Shashank Shekhar
...
Pierre Fernandez
Amir Bar
Hamed Pirsiavash
Yann LeCun
Micah Goldblum
SyDa
FedML
SSL
579
383
0
24 Apr 2023
Last-Layer Fairness Fine-tuning is Simple and Effective for Neural Networks
Yuzhen Mao
Zhun Deng
Huaxiu Yao
Ting Ye
Kenji Kawaguchi
James Zou
315
28
0
08 Apr 2023
HappyMap: A Generalized Multi-calibration Method
Information Technology Convergence and Services (ITCS), 2023
Zhun Deng
Cynthia Dwork
Linjun Zhang
583
23
0
08 Mar 2023
InfoNCE Loss Provably Learns Cluster-Preserving Representations
Annual Conference Computational Learning Theory (COLT), 2023
Advait Parulekar
Liam Collins
Karthikeyan Shanmugam
Aryan Mokhtari
Sanjay Shakkottai
SSL
306
58
0
15 Feb 2023
Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Ryumei Nakada
Halil Ibrahim Gulluk
Zhun Deng
Wenlong Ji
James Zou
Linjun Zhang
SSL
VLM
462
55
0
13 Feb 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning
International Joint Conference on Artificial Intelligence (IJCAI), 2023
Jiajun Ma
Tianyang Hu
Wei Cao
256
8
0
28 Jan 2023
Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time
Neural Information Processing Systems (NeurIPS), 2022
Huaxiu Yao
Caroline Choi
Bochuan Cao
Yoonho Lee
Pang Wei Koh
Chelsea Finn
OOD
408
115
0
25 Nov 2022
Homomorphic Self-Supervised Learning
Thomas Anderson Keller
Xavier Suau
Luca Zappella
SSL
324
3
0
15 Nov 2022
Freeze then Train: Towards Provable Representation Learning under Spurious Correlations and Feature Noise
International Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Haotian Ye
James Zou
Linjun Zhang
OOD
542
27
0
20 Oct 2022
FIFA: Making Fairness More Generalizable in Classifiers Trained on Imbalanced Data
International Conference on Learning Representations (ICLR), 2022
Zhun Deng
Jiayao Zhang
Linjun Zhang
Ting Ye
Yates Coley
Weijie J. Su
James Zou
312
17
0
06 Jun 2022
Guided Deep Metric Learning
Jorge Gonzalez-Zapata
Iván Reyes-Amezcua
Daniel Flores-Araiza
M. Mendez-Ruiz
Gilberto Ochoa-Ruiz
Andres Mendez-Vazquez
FedML
236
7
0
04 Jun 2022
Understanding the Role of Nonlinearity in Training Dynamics of Contrastive Learning
International Conference on Learning Representations (ICLR), 2022
Yuandong Tian
MLT
312
19
0
02 Jun 2022
Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embedding
International Conference on Learning Representations (ICLR), 2022
Tianyang Hu
Zhili Liu
Fengwei Zhou
Wei Cao
Weiran Huang
SSL
384
34
0
30 May 2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning
Neural Information Processing Systems (NeurIPS), 2022
Zixin Wen
Yuanzhi Li
SSL
486
42
0
12 May 2022
Understanding Deep Contrastive Learning via Coordinate-wise Optimization
Neural Information Processing Systems (NeurIPS), 2022
Yuandong Tian
593
45
0
29 Jan 2022
Scaffolding Sets
M. Burhanpurkar
Zhun Deng
Cynthia Dwork
Linjun Zhang
265
9
0
04 Nov 2021
An Unconstrained Layer-Peeled Perspective on Neural Collapse
Wenlong Ji
Yiping Lu
Yiliang Zhang
Zhun Deng
Weijie J. Su
584
99
0
06 Oct 2021
When and How Mixup Improves Calibration
International Conference on Machine Learning (ICML), 2021
Linjun Zhang
Zhun Deng
Kenji Kawaguchi
James Zou
UQCV
445
79
0
11 Feb 2021
1
Page 1 of 1
