Understanding the Behaviour of Contrastive Loss

15 December 2020

Papers citing "Understanding the Behaviour of Contrastive Loss"

50 / 308 papers shown

Title
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 21 71 0 08 Jun 2022
Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved Negatives Wei Wang Liangzhu Ge Jingqiao Zhang Cheng Yang 20 20 0 06 Jun 2022
Beyond Just Vision: A Review on Self-Supervised Representation Learning on Multimodal and Temporal Data Shohreh Deldari Hao Xue Aaqib Saeed Jiayuan He Daniel V. Smith Flora D. Salim AI4TS 25 37 0 06 Jun 2022
Toward a Geometrical Understanding of Self-supervised Contrastive Learning Romain Cosentino Anirvan M. Sengupta Salman Avestimehr Mahdi Soltanolkotabi Antonio Ortega Ted Willke Mariano Tepper SSL 37 17 0 13 May 2022
Hyperspectral Image Classification With Contrastive Graph Convolutional Network Wentao Yu Sheng Wan Guangyu Li Jian Yang Chen Gong 35 25 0 11 May 2022
GRM: Gradient Rectification Module for Visual Place Retrieval Boshu Lei Wenjie Ding Limeng Qiao Xi Qiu 13 0 0 23 Apr 2022
Universum-inspired Supervised Contrastive Learning Aiyang Han Chuanxing Geng Songcan Chen SSL 23 3 0 22 Apr 2022
Rumor Detection with Self-supervised Learning on Texts and Social Graph Yuan Gao Xiang Wang Xiangnan He Huamin Feng Yongdong Zhang SSL 16 45 0 19 Apr 2022
CoCoSoDa: Effective Contrastive Learning for Code Search Ensheng Shi Yanlin Wang Wenchao Gu Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun 28 33 0 07 Apr 2022
Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo Chaoning Zhang Kang Zhang T. Pham Axi Niu Zhinan Qiao Chang-Dong Yoo In So Kweon 22 54 0 30 Mar 2022
How Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning Chaoning Zhang Kang Zhang Chenshuang Zhang T. Pham Chang-Dong Yoo In So Kweon SSL 29 71 0 30 Mar 2022
ContrastMask: Contrastive Learning to Segment Every Thing Xuehui Wang Kai Zhao Ruixin Zhang Shouhong Ding Yan Wang Wei Shen ISeg 31 34 0 18 Mar 2022
Contrastive Learning for Cross-Domain Open World Recognition Francesco Cappio Borlino S. Bucci Tatiana Tommasi SSL 24 3 0 17 Mar 2022
InsCon:Instance Consistency Feature Representation via Self-Supervised Learning Jun-Teng Yang Ke Zhang Zhaolin Cui Jinming Su Junfeng Luo Xiaolin K. Wei ISeg SSL 13 9 0 15 Mar 2022
Contrastive Learning of Sociopragmatic Meaning in Social Media Chiyu Zhang Muhammad Abdul-Mageed Ganesh Jawahar 28 1 0 15 Mar 2022
Rethinking Minimal Sufficient Representation in Contrastive Learning Haoqing Wang Xun Guo Zhiwei Deng Yan Lu SSL 13 73 0 14 Mar 2022
Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning Yuxin Jiang Linhan Zhang Wei Wang SSL 16 46 0 14 Mar 2022
The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy Tianlong Chen Zhenyu (Allen) Zhang Yu Cheng Ahmed Hassan Awadallah Zhangyang Wang ViT 35 37 0 12 Mar 2022
Embedding Earth: Self-supervised contrastive pre-training for dense land cover classification Michail Tarasiou S. Zafeiriou SSL 30 9 0 11 Mar 2022
How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection? Yifei Ming Yiyou Sun Ousmane Amadou Dia Yixuan Li OODD 26 95 0 08 Mar 2022
Geodesic Multi-Modal Mixup for Robust Fine-Tuning Changdae Oh Junhyuk So Hoyoon Byun Yongtaek Lim Minchul Shin Jong-June Jeon Kyungwoo Song 30 26 0 08 Mar 2022
SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models Liang Wang Wei-Ye Zhao Zhuoyu Wei Jingming Liu 28 178 0 04 Mar 2022
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning Weixin Liang Yuhui Zhang Yongchan Kwon Serena Yeung James Y. Zou VLM 40 385 0 03 Mar 2022
Understanding microbiome dynamics via interpretable graph representation learning K. Melnyk Kuba Weimann Tim Conrad 19 5 0 02 Mar 2022
Audio Self-supervised Learning: A Survey Shuo Liu Adria Mallol-Ragolta Emilia Parada-Cabeleiro Kun Qian Xingshuo Jing Alexander Kathan Bin Hu Bjoern W. Schuller SSL 35 106 0 02 Mar 2022
Generalizing similarity in noisy setups: the DIBS phenomenon Nayara Fonseca V. Guidetti 13 0 0 30 Jan 2022
Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives David T. Hoffmann Nadine Behrmann Juergen Gall Thomas Brox M. Noroozi 27 43 0 27 Jan 2022
Enhancing Hyperbolic Graph Embeddings via Contrastive Learning Jiahong Liu Menglin Yang Min Zhou Shanshan Feng Philippe Fournier-Viger SSL 25 22 0 21 Jan 2022
Interactive Contrastive Learning for Self-supervised Entity Alignment Kaisheng Zeng Zhenhao Dong Lei Hou Yixin Cao Minghao Hu Jifan Yu Xin Lv Juanzi Li Ling Feng 21 25 0 17 Jan 2022
Knowledge Tracing: A Survey Ghodai M. Abdelrahman Qing Wang B. Nunes AI4Ed 10 192 0 08 Jan 2022
MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound Rowan Zellers Jiasen Lu Ximing Lu Youngjae Yu Yanpeng Zhao Mohammadreza Salehi Aditya Kusupati Jack Hessel Ali Farhadi Yejin Choi 26 207 0 07 Jan 2022
Swift and Sure: Hardness-aware Contrastive Learning for Low-dimensional Knowledge Graph Embeddings Kai Wang Yu Liu Quan.Z Sheng 15 18 0 03 Jan 2022
Contrastive Object Detection Using Knowledge Graph Embeddings Christopher Lang Alexander Braun Abhinav Valada 13 8 0 21 Dec 2021
Rethinking Nearest Neighbors for Visual Classification Menglin Jia Bor-Chun Chen Zuxuan Wu Claire Cardie Serge J. Belongie Ser-Nam Lim SSL 38 10 0 15 Dec 2021
Self-Supervised Modality-Aware Multiple Granularity Pre-Training for RGB-Infrared Person Re-Identification Lin Wan Qianyan Jing Zongyuan Sun Chuan Zhang Zhihang Li Yehansen Chen SSL 17 5 0 12 Dec 2021
Learning Representations with Contrastive Self-Supervised Learning for Histopathology Applications Karin Stacke Jonas Unger Claes Lundström Gabriel Eilertsen OOD SSL 21 25 0 10 Dec 2021
Malfustection: Obfuscated Malware Detection and Malware Classification with Data Shortage by Combining Semi-Supervised and Contrastive Learning Mohammad Mahdi Maghouli Mohamadreza Fereydooni M. Abdoos M. Vahidi-Asl AAML 19 3 0 18 Nov 2021
Pose Recognition in the Wild: Animal pose estimation using Agglomerative Clustering and Contrastive Learning Samayan Bhattacharya Sk Shahnawaz 19 1 0 16 Nov 2021
Large-Scale Hyperspectral Image Clustering Using Contrastive Learning Yaoming Cai Zijia Zhang Y. Liu Pedram Ghamisi Kunping Li Xiaobo Liu Z. Cai 16 16 0 15 Nov 2021
Probabilistic Contrastive Learning for Domain Adaptation Junjie Li Yixin Zhang Zilei Wang Saihui Hou Keyu Tu Man Zhang 30 14 0 11 Nov 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 105 0 01 Nov 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp G. Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 201 102 0 21 Oct 2021
Temperature as Uncertainty in Contrastive Learning Oliver Zhang Mike Wu Jasmine Bayrooti Noah D. Goodman UQCV 12 30 0 08 Oct 2021
Camera-Tracklet-Aware Contrastive Learning for Unsupervised Vehicle Re-Identification Jongmin Yu Junsik Kim Minkyung Kim Hyeontaek Oh 23 8 0 14 Sep 2021
Contrastive Quantization with Code Memory for Unsupervised Image Retrieval Jinpeng Wang Ziyun Zeng Bin Chen Tao Dai Shutao Xia MQ 36 45 0 11 Sep 2021
An Empirical Study of Graph Contrastive Learning Yanqiao Zhu Yichen Xu Qiang Liu Shu Wu 11 167 0 02 Sep 2021
Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuning Chiyu Zhang Muhammad Abdul-Mageed ObjD AI4CE 8 6 0 01 Aug 2021
On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals Haizhou Shi Youcai Zhang Siliang Tang Wenjie Zhu Yaqian Li Yandong Guo Yueting Zhuang SyDa 21 14 0 30 Jul 2021
Distance-based Hyperspherical Classification for Multi-source Open-Set Domain Adaptation S. Bucci Francesco Cappio Borlino Barbara Caputo Tatiana Tommasi VLM 24 14 0 05 Jul 2021
Multi-Source domain adaptation via supervised contrastive learning and confident consistency regularization Marin Scalbert Maria Vakalopoulou Florent Couzinié-Devy 11 19 0 30 Jun 2021