What Should Not Be Contrastive in Contrastive Learning

13 August 2020

Papers citing "What Should Not Be Contrastive in Contrastive Learning"

50 / 64 papers shown

Title
Towards a Unified Representation Evaluation Framework Beyond Downstream Tasks Christos Plachouras Julien Guinot George Fazekas Elio Quinton Emmanouil Benetos Johan Pauwels 119 1 0 09 May 2025
seq-JEPA: Autoregressive Predictive Learning of Invariant-Equivariant World Models Hafez Ghaemi Eilif Muller Shahab Bakhtiari 49 0 0 06 May 2025
Intelligently Augmented Contrastive Tensor Factorization: Empowering Multi-dimensional Time Series Classification in Low-Data Environments Anushiya Arunan Yan Qin Xiaoli Li Yuen Chau AI4TS 23 0 0 03 May 2025
Beyond [cls]: Exploring the true potential of Masked Image Modeling representations Marcin Przewiȩźlikowski Randall Balestriero Wojciech Jasiński Marek 'Smieja Bartosz Zieliñski 69 0 0 04 Dec 2024
CLOVER: Context-aware Long-term Object Viewpoint- and Environment- Invariant Representation Learning Dongmyeong Lee Amanda Adkins Joydeep Biswas 40 0 0 12 Jul 2024
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 33 5 0 28 Jun 2024
A Review on Discriminative Self-supervised Learning Methods in Computer Vision Nikolaos Giakoumoglou Tania Stathaki Athanasios Gkelias SSL 64 1 0 08 May 2024
Heterogeneous Contrastive Learning for Foundation Models and Beyond Lecheng Zheng Baoyu Jing Zihao Li Hanghang Tong Jingrui He VLM 30 19 0 30 Mar 2024
LeOCLR: Leveraging Original Images for Contrastive Learning of Visual Representations Mohammad Alkhalefi Georgios Leontidis Mingjun Zhong 63 2 0 11 Mar 2024
Better Representations via Adversarial Training in Pre-Training: A Theoretical Perspective Yue Xing Xiaofeng Lin Qifan Song Yi Tian Xu Belinda Zeng Guang Cheng SSL 17 0 0 26 Jan 2024
Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing Jaeill Kim Duhun Hwang Eunjung Lee Jangwon Suh Jimyeong Kim Wonjong Rhee 28 0 0 11 Jan 2024
Information Theory-Guided Heuristic Progressive Multi-View Coding Jiangmeng Li Hang Gao Wenwen Qiang Changwen Zheng 22 2 0 21 Aug 2023
Stochastic positional embeddings improve masked image modeling Amir Bar Florian Bordes Assaf Shocher Mahmoud Assran Pascal Vincent Nicolas Ballas Trevor Darrell Amir Globerson Yann LeCun 16 3 0 31 Jul 2023
Does Visual Pretraining Help End-to-End Reasoning? Chen Sun Calvin Luo Xingyi Zhou Anurag Arnab Cordelia Schmid OCL LRM ViT 35 3 0 17 Jul 2023
Semantic Positive Pairs for Enhancing Visual Representation Learning of Instance Discrimination Methods Mohammad Alkhalefi Georgios Leontidis Min Zhong SSL 87 2 0 28 Jun 2023
Siamese Masked Autoencoders Agrim Gupta Jiajun Wu Jia Deng Li Fei-Fei 28 48 0 23 May 2023
Semi-Supervised Relational Contrastive Learning Attiano Purpura-Pontoniere D. Terzopoulos Adam S. Wang A. Imran SSL 12 1 0 11 Apr 2023
Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Label-Efficient Representations Ziyu Jiang Yinpeng Chen Mengchen Liu Dongdong Chen Xiyang Dai Lu Yuan Zicheng Liu Zhangyang Wang SSL VLM CLIP 35 16 0 27 Feb 2023
Amortised Invariance Learning for Contrastive Self-Supervision Ruchika Chavhan H. Gouk Jan Stuehmer Calum Heggan Mehrdad Yaghoobi Timothy M. Hospedales SSL 35 11 0 24 Feb 2023
Learning Visual Representations via Language-Guided Sampling Mohamed El Banani Karan Desai Justin Johnson SSL VLM 11 28 0 23 Feb 2023
Steerable Equivariant Representation Learning Sangnie Bhardwaj Willie McClinton Tongzhou Wang Guillaume Lajoie Chen Sun Phillip Isola Dilip Krishnan OOD LLMSV 28 5 0 22 Feb 2023
Self-supervised learning of Split Invariant Equivariant representations Q. Garrido Laurent Najman Yann LeCun SSL 24 32 0 14 Feb 2023
A Review of Predictive and Contrastive Self-supervised Learning for Medical Images Wei-Chien Wang E. Ahn Da-wei Feng Jinman Kim MedIm 24 27 0 10 Feb 2023
Contrastive Learning with Consistent Representations Zihu Wang Yu Wang Hanbin Hu Peng Li CLL 26 5 0 03 Feb 2023
The Influences of Color and Shape Features in Visual Contrastive Learning Xiao-qiong Zhuang SSL 19 0 0 29 Jan 2023
Task Discovery: Finding the Tasks that Neural Networks Generalize on Andrei Atanov Andrei Filatov Teresa Yeo Ajay Sohmshetty Amir Zamir OOD 40 10 0 01 Dec 2022
Hierarchical Consistent Contrastive Learning for Skeleton-Based Action Recognition with Growing Augmentations Jiahang Zhang Lilang Lin Jiaying Liu 13 46 0 24 Nov 2022
Homomorphic Self-Supervised Learning Thomas Anderson Keller Xavier Suau Luca Zappella SSL 19 2 0 15 Nov 2022
Self-Supervised Learning Through Efference Copies Franz Scherr Qinghai Guo Timoleon Moraitis 19 10 0 17 Oct 2022
Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers Tao Tang Changlin Li Guangrun Wang Kaicheng Yu Xiaojun Chang Xiaodan Liang ViT 23 1 0 16 Oct 2022
The Geometry of Self-supervised Learning Models and its Impact on Transfer Learning Romain Cosentino Sarath Shekkizhar Mahdi Soltanolkotabi A. Avestimehr Antonio Ortega SSL 51 7 0 18 Sep 2022
Improving Fine-tuning of Self-supervised Models with Contrastive Initialization Haolin Pan Yong Guo Qinyi Deng Hao-Fan Yang Yiqun Chen Jian Chen SSL 18 19 0 30 Jul 2022
Optimizing transformations for contrastive learning in a differentiable framework Camille Ruppli Pietro Gori R. Ardon Isabelle Bloch MedIm 20 2 0 27 Jul 2022
Contrastive Self-Supervised Learning Leads to Higher Adversarial Susceptibility Rohit Gupta Naveed Akhtar Ajmal Saeed Mian M. Shah AAML SSL 21 5 0 22 Jul 2022
FakeCLR: Exploring Contrastive Learning for Solving Latent Discontinuity in Data-Efficient GANs Ziqiang Li Chaoyue Wang Heliang Zheng Jing Zhang Bin Li 28 23 0 18 Jul 2022
Predicting is not Understanding: Recognizing and Addressing Underspecification in Machine Learning Damien Teney Maxime Peyrard Ehsan Abbasnejad 35 29 0 06 Jul 2022
Dissecting Self-Supervised Learning Methods for Surgical Computer Vision Sanat Ramesh V. Srivastav Deepak Alapatt Tong Yu Aditya Murali ... Saurav Sharma A. Fleurentin Georgios Exarchakis Alexandros Karargyris N. Padoy 18 42 0 01 Jul 2022
Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning M. Gwilliam Abhinav Shrivastava SSL 76 19 1 16 Jun 2022
Multi-scale and Cross-scale Contrastive Learning for Semantic Segmentation Theodoros Pissas Claudio S. Ravasio L. Cruz Christos Bergeles 15 15 0 25 Mar 2022
MetAug: Contrastive Learning via Meta Feature Augmentation Jiangmeng Li Wenwen Qiang Changwen Zheng Bing-Huang Su Hui Xiong 17 23 0 10 Mar 2022
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features N. Kalibhat Kanika Narang Hamed Firooz Maziar Sanjabi S. Feizi SSL 31 7 0 03 Mar 2022
Fuse Local and Global Semantics in Representation Learning Yuchi Zhao Yuhao Zhou FedML 9 1 0 28 Feb 2022
Max-Margin Contrastive Learning Anshul B. Shah S. Sra Ramalingam Chellappa A. Cherian SSL 21 44 0 21 Dec 2021
Masked Feature Prediction for Self-Supervised Visual Pre-Training Chen Wei Haoqi Fan Saining Xie Chaoxia Wu Alan Yuille Christoph Feichtenhofer ViT 77 655 0 16 Dec 2021
Towards General and Efficient Active Learning Yichen Xie M. Tomizuka Wei Zhan VLM 32 10 0 15 Dec 2021
Time-Equivariant Contrastive Video Representation Learning Simon Jenni Hailin Jin SSL AI4TS 140 60 0 07 Dec 2021
The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image Yuki M. Asano Aaqib Saeed 30 7 0 01 Dec 2021
Self-Supervised Learning Disentangled Group Representation as Feature Tan Wang Zhongqi Yue Jianqiang Huang Qianru Sun Hanwang Zhang OOD 31 67 0 28 Oct 2021
Graph Communal Contrastive Learning Bolian Li Baoyu Jing Hanghang Tong 31 57 0 28 Oct 2021
Robust Contrastive Learning Using Negative Samples with Diminished Semantics Songwei Ge Shlok Kumar Mishra Haohan Wang Chun-Liang Li David Jacobs SSL 16 71 0 27 Oct 2021