On the Surrogate Gap between Contrastive and Supervised Losses

On the Surrogate Gap between Contrastive and Supervised Losses

6 October 2021

Yoshihiro Nagano

Papers citing "On the Surrogate Gap between Contrastive and Supervised Losses"

16 / 16 papers shown

Title
Generalization Analysis for Contrastive Representation Learning under Non-IID Settings Nong Minh Hieu Antoine Ledent 42 0 0 08 May 2025
Understanding Difficult-to-learn Examples in Contrastive Learning: A Theoretical Framework for Spectral Contrastive Learning Yi-Ge Zhang Jingyi Cui Qiran Li Yisen Wang SSL 39 0 0 03 Jan 2025
PhiNets: Brain-inspired Non-contrastive Learning Based on Temporal Prediction Hypothesis Satoki Ishikawa Makoto Yamada Han Bao Yuki Takezawa 50 0 0 23 May 2024
When can we Approximate Wide Contrastive Models with Neural Tangent Kernels and Principal Component Analysis? Gautham Govind Anil P. Esser D. Ghoshdastidar 24 1 0 13 Mar 2024
Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics Han Bao SSL MLT 16 1 0 28 Sep 2023
Representation Learning Dynamics of Self-Supervised Models P. Esser Satyaki Mukherjee D. Ghoshdastidar SSL 19 2 0 05 Sep 2023
Towards a Rigorous Analysis of Mutual Information in Contrastive Learning Kyungeun Lee Jaeill Kim Suhyun Kang Wonjong Rhee SSL 15 2 0 30 Aug 2023
CAME: Contrastive Automated Model Evaluation Ru Peng Qiuyang Duan Haobo Wang Jiachen Ma Yanbo Jiang Yongjun Tu Xiu Jiang J. Zhao ELM 13 4 0 22 Aug 2023
Rethinking Weak Supervision in Helping Contrastive Learning Jingyi Cui Weiran Huang Yifei Wang Yisen Wang NoLa SSL 11 13 0 07 Jun 2023
Towards Understanding the Mechanism of Contrastive Learning via Similarity Structure: A Theoretical Analysis Hiroki Waida Yuichiro Wada Léo Andéol Takumi Nakagawa Yuhui Zhang Takafumi Kanamori SSL 19 5 0 01 Apr 2023
Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism Zhijian Zhuo Yifei Wang Jinwen Ma Yisen Wang 41 24 0 04 Mar 2023
ArCL: Enhancing Contrastive Learning with Augmentation-Robust Representations Xuyang Zhao Tianqi Du Yisen Wang Jun Yao Weiran Huang 23 13 0 02 Mar 2023
Generalization Analysis for Contrastive Representation Learning Yunwen Lei Tianbao Yang Yiming Ying Ding-Xuan Zhou 6 8 0 24 Feb 2023
InfoNCE Loss Provably Learns Cluster-Preserving Representations Advait Parulekar Liam Collins Karthikeyan Shanmugam Aryan Mokhtari Sanjay Shakkottai SSL 27 20 0 15 Feb 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 15 9 0 27 Dec 2022
Classification from Pairwise Similarity and Unlabeled Data Han Bao Gang Niu Masashi Sugiyama 165 85 0 12 Feb 2018