Intriguing Properties of Contrastive Losses

5 November 2020

Papers citing "Intriguing Properties of Contrastive Losses"

50 / 112 papers shown

Title
Divide and Conquer Self-Supervised Learning for High-Content Imaging Lucas Farndale Paul Henderson Edward W Roberts Ke Yuan SSL 58 0 0 10 Mar 2025
A Transfer Learning Framework for Anomaly Detection in Multivariate IoT Traffic Data Mahshid Rezakhani Tolunay Seyfi Fatemeh Afghah MU 55 3 0 28 Jan 2025
COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-training Sanghwan Kim Rui Xiao Mariana-Iuliana Georgescu Stephan Alaniz Zeynep Akata VLM 70 1 0 02 Dec 2024
Enhancing Hyperspectral Image Prediction with Contrastive Learning in Low-Label Regime S. Haidar José Oramas SSL 26 0 0 10 Oct 2024
Exploiting Supervised Poison Vulnerability to Strengthen Self-Supervised Defense Jeremy A. Styborski Mingzhi Lyu Y. Huang Adams Kong 32 0 0 13 Sep 2024
The Clever Hans Effect in Unsupervised Learning Jacob R. Kauffmann Jonas Dippel Lukas Ruff Wojciech Samek Klaus-Robert Müller G. Montavon SSL CML HAI 24 1 0 15 Aug 2024
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 33 5 0 28 Jun 2024
Views Can Be Deceiving: Improved SSL Through Feature Space Augmentation Kimia Hamidieh Haoran Zhang Swami Sankaranarayanan Marzyeh Ghassemi 41 0 0 28 May 2024
Understanding Hyperbolic Metric Learning through Hard Negative Sampling Yun Yue Fangzhou Lin Guanyi Mou Ziming Zhang SSL 30 1 0 23 Apr 2024
Can We Break Free from Strong Data Augmentations in Self-Supervised Learning? Shruthi Gowda Elahe Arani Bahram Zonooz 28 1 0 15 Apr 2024
ComFe: An Interpretable Head for Vision Transformers Evelyn J. Mannix H. Bondell Howard Bondell VLM ViT 26 1 0 07 Mar 2024
Demonstrating and Reducing Shortcuts in Vision-Language Representation Learning Maurits J. R. Bleeker Mariya Hendriksen Andrew Yates Maarten de Rijke VLM 38 3 0 27 Feb 2024
The Common Stability Mechanism behind most Self-Supervised Learning Approaches Abhishek Jha Matthew B. Blaschko Yuki M. Asano Tinne Tuytelaars SSL 27 1 0 22 Feb 2024
Analysis of Using Sigmoid Loss for Contrastive Learning Chungpa Lee Joonhwan Chang Jy-yong Sohn 35 2 0 20 Feb 2024
Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learning Jihai Zhang Xiang Lan Xiaoye Qu Yu Cheng Mengling Feng Bryan Hooi SSL 19 4 0 19 Feb 2024
Detecting and recognizing characters in Greek papyri with YOLOv8, DeiT and SimCLR Robert Turnbull Evelyn Mannix 19 1 0 23 Jan 2024
EEG-based Cognitive Load Estimation of Acoustic Parameters for Data Sonification Gulshan Sharma Surbhi Madan Maneesh Bilalpur Abhinav Dhall Subramanian Ramanathan 25 2 0 16 Jan 2024
Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing Jaeill Kim Duhun Hwang Eunjung Lee Jangwon Suh Jimyeong Kim Wonjong Rhee 28 0 0 11 Jan 2024
Multimodal Data Curation via Object Detection and Filter Ensembles Tzu-Heng Huang Changho Shin Sui Jiet Tay Dyah Adila Frederic Sala 34 5 0 05 Jan 2024
RDGCL: Reaction-Diffusion Graph Contrastive Learning for Recommendation Jeongwhan Choi Hyowon Wi C. Lee Sung-Bae Cho Dongha Lee Noseong Park DiffM 36 2 0 27 Dec 2023
Medical Vision Language Pretraining: A survey Prashant Shrestha Sanskar Amgain Bidur Khanal Cristian A. Linte Binod Bhattarai VLM 27 14 0 11 Dec 2023
Optimal Sample Complexity of Contrastive Learning Noga Alon Dmitrii Avdiukhin Dor Elboim Orr Fischer G. Yaroslavtsev SSL 11 5 0 01 Dec 2023
Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations Cian Eastwood Julius von Kügelgen Linus Ericsson Diane Bouchacourt Pascal Vincent Bernhard Schölkopf Mark Ibrahim 34 10 0 15 Nov 2023
Towards a Unified Framework of Contrastive Learning for Disentangled Representations Stefan Matthes Zhiwei Han Hao Shen 22 4 0 08 Nov 2023
scBeacon: single-cell biomarker extraction via identifying paired cell clusters across biological conditions with contrastive siamese networks Chenyu Liu Kweon Yong Jin Jun Ding 11 1 0 05 Nov 2023
Domain-specific optimization and diverse evaluation of self-supervised models for histopathology Jeremy Lai Faruk Ahmed Supriya Vijay Tiam Jaroensri Jessica Loo ... Jonathan Krause Yun-hui Liu Po-Hsuan Cameron Chen Ellery Wulczyn David F. Steiner 33 7 0 20 Oct 2023
Keypoint-Augmented Self-Supervised Learning for Medical Image Segmentation with Limited Annotation Zhangsihao Yang Mengwei Ren Kaize Ding Guido Gerig Yalin Wang SSL 18 5 0 02 Oct 2023
Specializing Small Language Models towards Complex Style Transfer via Latent Attribute Pre-Training Ruiqi Xu Y. Huang Xin Chen Lin Zhang 16 3 0 19 Sep 2023
Towards a Rigorous Analysis of Mutual Information in Contrastive Learning Kyungeun Lee Jaeill Kim Suhyun Kang Wonjong Rhee SSL 28 2 0 30 Aug 2023
Masked Momentum Contrastive Learning for Zero-shot Semantic Understanding Jiantao Wu Shentong Mo Muhammad Awais Sara Atito Zhenhua Feng J. Kittler VLM 25 4 0 22 Aug 2023
Dynamically Scaled Temperature in Self-Supervised Contrastive Learning Siladittya Manna Soumitri Chattopadhyay Rakesh Dey Saumik Bhattacharya Umapada Pal 30 0 0 02 Aug 2023
End-to-End Supervised Multilabel Contrastive Learning A. Sajedi Samir Khaki Konstantinos N. Plataniotis Mahdi S. Hosseini SSL 21 8 0 08 Jul 2023
Augmentation-aware Self-supervised Learning with Conditioned Projector Marcin Przewike'zlikowski Mateusz Pyla Bartosz Zieliñski Bartlomiej Twardowski Jacek Tabor Marek Śmieja SSL 30 2 0 31 May 2023
Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression Yihao Xue S. Joshi Eric Gan Pin-Yu Chen Baharan Mirzasoleiman SSL 28 23 0 25 May 2023
Cold PAWS: Unsupervised class discovery and addressing the cold-start problem for semi-supervised learning Evelyn J. Mannix H. Bondell SSL 17 0 0 17 May 2023
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution Jaeill Kim Suhyun Kang Duhun Hwang Jungwook Shin Wonjong Rhee DRL 13 19 0 04 Apr 2023
Towards Understanding the Mechanism of Contrastive Learning via Similarity Structure: A Theoretical Analysis Hiroki Waida Yuichiro Wada Léo Andéol Takumi Nakagawa Yuhui Zhang Takafumi Kanamori SSL 21 5 0 01 Apr 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 24 29 0 27 Mar 2023
Temperature Schedules for Self-Supervised Contrastive Methods on Long-Tail Data Anna Kukleva Moritz Bohle Bernt Schiele Hilde Kuehne Christian Rupprecht 29 39 0 23 Mar 2023
PRISE: Demystifying Deep Lucas-Kanade with Strongly Star-Convex Constraints for Multimodel Image Alignment Yiqing Zhang Xinming Huang Ziming Zhang 32 4 0 21 Mar 2023
An Evaluation of Non-Contrastive Self-Supervised Learning for Federated Medical Image Analysis Soumitri Chattopadhyay Soham Ganguly Sreejit Chaudhury Sayan Nag S. Chattopadhyay 11 0 0 09 Mar 2023
Exploring Self-Supervised Representation Learning For Low-Resource Medical Image Analysis Soumitri Chattopadhyay Soham Ganguly Sreejit Chaudhury Sayan Nag S. Chattopadhyay 28 1 0 03 Mar 2023
InfoNCE Loss Provably Learns Cluster-Preserving Representations Advait Parulekar Liam Collins Karthikeyan Shanmugam Aryan Mokhtari Sanjay Shakkottai SSL 32 20 0 15 Feb 2023
Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective Chenyu You Weicheng Dai Yifei Min Fenglin Liu David A. Clifton S. Kevin Zhou Lawrence H. Staib James S Duncan 12 69 0 03 Feb 2023
Hyperbolic Contrastive Learning Yun Yue Fangzhou Lin Kazunori D Yamada Ziming Zhang SSL 27 18 0 02 Feb 2023
Simplicity Bias in 1-Hidden Layer Neural Networks Depen Morwani Jatin Batra Prateek Jain Praneeth Netrapalli 21 17 0 01 Feb 2023
Unifying Synergies between Self-supervised Learning and Dynamic Computation Tarun Krishna Ayush Rai Alexandru Drimbarean Eric Arazo Paul Albert A. Smeaton Kevin McGuinness Noel E. O'Connor 24 0 0 22 Jan 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 29 122 0 13 Jan 2023
Understanding and Improving the Role of Projection Head in Self-Supervised Learning Kartik Gupta Thalaiyasingam Ajanthan A. Hengel Stephen Gould SSL 13 37 0 22 Dec 2022
Similarity Contrastive Estimation for Image and Video Soft Contrastive Self-Supervised Learning J. Denize Jaonary Rabarisoa Astrid Orcesi Romain Hérault SSL 14 5 0 21 Dec 2022