Can contrastive learning avoid shortcut solutions?

21 June 2021

Kayhan Batmanghelich

Papers citing "Can contrastive learning avoid shortcut solutions?"

29 / 29 papers shown

Title
Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization Shunxin Wang Raymond N. J. Veldhuis N. Strisciuglio VLM 71 0 0 05 Mar 2025
Your contrastive learning problem is secretly a distribution alignment problem Zihao Chen Chi-Heng Lin Ran Liu Jingyun Xiao Eva L. Dyer 65 1 0 27 Feb 2025
Unleashing the Potential of Pre-Trained Diffusion Models for Generalizable Person Re-Identification Jiachen Li Xiaojin Gong DiffM 79 0 0 10 Feb 2025
COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-training Sanghwan Kim Rui Xiao Mariana-Iuliana Georgescu Stephan Alaniz Zeynep Akata VLM 70 1 0 02 Dec 2024
Banyan: Improved Representation Learning with Explicit Structure Mattia Opper N. Siddharth 31 1 0 25 Jul 2024
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 33 5 0 28 Jun 2024
Can We Break Free from Strong Data Augmentations in Self-Supervised Learning? Shruthi Gowda Elahe Arani Bahram Zonooz 28 1 0 15 Apr 2024
Unsupervised Multi-modal Feature Alignment for Time Series Representation Learning Cheng Liang Donghua Yang Zhiyu Liang Hongzhi Wang Zheng Liang Xiyang Zhang Jianfeng Huang AI4TS 126 1 0 09 Dec 2023
Removing Biases from Molecular Representations via Information Maximization Chenyu Wang Sharut Gupta Caroline Uhler Tommi Jaakkola 15 4 0 01 Dec 2023
Augmenting Chest X-ray Datasets with Non-Expert Annotations Cathrine Damgaard Trine Eriksen Dovile Juodelyte V. Cheplygina Amelia Jiménez-Sánchez 37 3 0 05 Sep 2023
AdPE: Adversarial Positional Embeddings for Pretraining Vision Transformers via MAE+ Xiao Wang Ying Wang Ziwei Xuan Guo-Jun Qi ViT 33 3 0 14 Mar 2023
DrasCLR: A Self-supervised Framework of Learning Disease-related and Anatomy-specific Representation for 3D Medical Images K. Yu Li Sun Junxiang Chen Maxwell Reynolds Tigmanshu Chaudhary Kayhan Batmanghelich 17 1 0 21 Feb 2023
MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesis Tianhong Li Huiwen Chang Shlok Kumar Mishra Han Zhang Dina Katabi Dilip Krishnan 27 152 0 16 Nov 2022
A simple, efficient and scalable contrastive masked autoencoder for learning visual representations Shlok Kumar Mishra Joshua Robinson Huiwen Chang David Jacobs Aaron Sarna Aaron Maschinot Dilip Krishnan DiffM 41 30 0 30 Oct 2022
Adversarial Pretraining of Self-Supervised Deep Networks: Past, Present and Future Guo-Jun Qi M. Shah SSL 23 8 0 23 Oct 2022
Transformers Learn Shortcuts to Automata Bingbin Liu Jordan T. Ash Surbhi Goel A. Krishnamurthy Cyril Zhang OffRL LRM 26 155 0 19 Oct 2022
SDA: Simple Discrete Augmentation for Contrastive Sentence Representation Learning Dongsheng Zhu Zhenyu Mao Jinghui Lu Rui Zhao Fei Tan 26 1 0 08 Oct 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 48 20 0 02 Oct 2022
Graph Contrastive Learning with Cross-view Reconstruction Qianlong Wen Z. Ouyang Chunhui Zhang Y. Qian Yanfang Ye Chuxu Zhang SSL 15 6 0 16 Sep 2022
Shortcut Learning of Large Language Models in Natural Language Understanding Mengnan Du Fengxiang He Na Zou Dacheng Tao Xia Hu KELM OffRL 26 83 0 25 Aug 2022
Improving Fine-tuning of Self-supervised Models with Contrastive Initialization Haolin Pan Yong Guo Qinyi Deng Hao-Fan Yang Yiqun Chen Jian Chen SSL 18 19 0 30 Jul 2022
How Robust is Unsupervised Representation Learning to Distribution Shift? Yuge Shi Imant Daunhawer Julia E. Vogt Philip H. S. Torr Amartya Sanyal OOD 30 25 0 17 Jun 2022
Rectify ViT Shortcut Learning by Visual Saliency Chong Ma Lin Zhao Yuzhong Chen David Liu Xi Jiang Tuo Zhang Xintao Hu Dinggang Shen Dajiang Zhu Tianming Liu ViT 25 20 0 17 Jun 2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning Zixin Wen Yuanzhi Li SSL 19 34 0 12 May 2022
Interpretable Prediction of Lung Squamous Cell Carcinoma Recurrence With Self-supervised Learning Weicheng Zhu C. Fernandez‐Granda N. Razavian SSL 16 4 0 23 Mar 2022
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 19 109 0 28 Feb 2022
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Eric Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 13 68 0 12 Jan 2022
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 236 207 0 17 Feb 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 243 3,367 0 09 Mar 2020