How Well Do Self-Supervised Models Transfer?

26 November 2020

Linus Ericsson

H. Gouk

Timothy M. Hospedales

SSL

ArXiv PDF HTML

Papers citing "How Well Do Self-Supervised Models Transfer?"

50 / 182 papers shown

Title
Improving Unsupervised Task-driven Models of Ventral Visual Stream via Relative Position Predictivity Dazhong Rong Hao Dong Xing Gao Jiyu Wei Di Hong Yaoyao Hao Qinming He Y. Wang 21 0 0 13 May 2025
SEVERE++: Evaluating Benchmark Sensitivity in Generalization of Video Representation Learning Fida Mohammad Thoker Letian Jiang Chen Zhao Piyush Bagad Hazel Doughty Bernard Ghanem Cees G. M. Snoek ViT SSL 46 0 0 08 Apr 2025
Implicit Contrastive Representation Learning with Guided Stop-gradient Byeongchan Lee Sehyun Lee SSL 87 2 0 12 Mar 2025
CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation Hariprasath Govindarajan Maciej K. Wozniak Marvin Klingner Camille Maurice B. R. Kiran S. Yogamani 53 0 0 12 Mar 2025
Self-supervised Benchmark Lottery on ImageNet: Do Marginal Improvements Translate to Improvements on Similar Datasets? Utku Ozbulak Esla Timothy Anzaku Solha Kang W. D. Neve J. Vankerschaver 50 0 0 28 Jan 2025
How Well Do Self-Supervised Methods Perform in Cross-Domain Few-Shot Learning? Yiyi Zhang Ying Zheng Xiaogang Xu Jun Wang SSL 43 4 0 28 Jan 2025
Probing the Mid-level Vision Capabilities of Self-Supervised Learning Xuweiyi Chen Markus Marks Zezhou Cheng 79 0 0 25 Nov 2024
On Partial Prototype Collapse in the DINO Family of Self-Supervised Methods Hariprasath Govindarajan Per Sidén Jacob Roll Fredrik Lindsten 24 2 0 17 Oct 2024
VIBES -- Vision Backbone Efficient Selection Joris Guerin Shray Bansal Amirreza Shaban Paulo Mann Harshvardhan Gazula VLM 28 0 0 11 Oct 2024
Non-transferable Pruning Ruyi Ding Lili Su A. A. Ding Yunsi Fei AAML 24 2 0 10 Oct 2024
Simple Unsupervised Knowledge Distillation With Space Similarity Aditya Singh Haohan Wang 29 1 0 20 Sep 2024
Self-Masking Networks for Unsupervised Adaptation Alfonso Taboada Warmerdam Mathilde Caron Yuki M. Asano 39 1 0 11 Sep 2024
A Survey of the Self Supervised Learning Mechanisms for Vision Transformers Asifullah Khan A. Sohail M. Fiaz Mehdi Hassan Tariq Habib Afridi ... Muhammad Zaigham Zaheer Kamran Ali Tangina Sultana Ziaurrehman Tanoli Naeem Akhter 43 3 0 30 Aug 2024
On Learning Discriminative Features from Synthesized Data for Self-Supervised Fine-Grained Visual Recognition Zihu Wang Lingqiao Liu Scott Ricardo Figueroa Weston Samuel Tian Peng Li 29 2 0 19 Jul 2024
Jigsaw Game: Federated Clustering Jinxuan Xu Hong-You Chen Wei-Lun Chao Yuqian Zhang FedML 36 0 0 17 Jul 2024
A Closer Look at Benchmarking Self-Supervised Pre-training with Image Classification Markus Marks Manuel Knott Neehar Kondapaneni Elijah Cole T. Defraeye Fernando Pérez-Cruz Pietro Perona SSL 40 2 0 16 Jul 2024
Understanding the Role of Invariance in Transfer Learning Till Speicher Vedant Nanda Krishna P. Gummadi SSL OOD 40 1 0 05 Jul 2024
Look Ahead or Look Around? A Theoretical Comparison Between Autoregressive and Masked Pretraining Qi Zhang Tianqi Du Haotian Huang Yifei Wang Yisen Wang 34 3 0 01 Jul 2024
AND: Audio Network Dissection for Interpreting Deep Acoustic Models Tung-Yu Wu Yu-Xiang Lin Tsui-Wei Weng 50 1 0 24 Jun 2024
Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations? Mark Ibrahim David Klindt Randall Balestriero SSL 56 2 1 15 Jun 2024
Generalization Beyond Data Imbalance: A Controlled Study on CLIP for Transferable Insights Xin Wen Bingchen Zhao Yilun Chen Jiangmiao Pang Xiaojuan Qi 30 3 0 31 May 2024
Back to the Basics on Predicting Transfer Performance Levy G. Chaves Eduardo Valle Alceu Bissoto Sandra Avila MedIm 42 0 0 30 May 2024
DINO as a von Mises-Fisher mixture model Hariprasath Govindarajan Per Sidén Jacob Roll Fredrik Lindsten 34 11 0 17 May 2024
Boosting Unsupervised Semantic Segmentation with Principal Mask Proposals Oliver Hahn Nikita Araslanov Simone Schaub-Meyer Stefan Roth 3DPC 38 3 0 25 Apr 2024
An Experimental Comparison Of Multi-view Self-supervised Methods For Music Tagging Gabriel Meseguer-Brocal Dorian Desblancs Romain Hennequin SSL 36 3 0 14 Apr 2024
Situation Awareness for Driver-Centric Driving Style Adaptation Johann Haselberger Bonifaz Stuhr Bernhard Schick Steffen Müller 29 1 0 28 Mar 2024
PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition Chenhongyi Yang Zehui Chen Miguel Espinosa Linus Ericsson Zhenyu Wang Jiaming Liu Elliot J. Crowley Mamba 26 86 0 26 Mar 2024
On Pretraining Data Diversity for Self-Supervised Learning Hasan Hammoud Tuhin Das Fabio Pizzati Philip H. S. Torr Adel Bibi Bernard Ghanem 98 2 0 20 Mar 2024
uaMix-MAE: Efficient Tuning of Pretrained Audio Transformers with Unsupervised Audio Mixtures Afrina Tabassum Dung N. Tran Trung D. Q. Dang Ismini Lourentzou K. Koishida 42 0 0 14 Mar 2024
LoDisc: Learning Global-Local Discriminative Features for Self-Supervised Fine-Grained Visual Recognition Jialu Shi Zhiqiang Wei Jie Nie Lei Huang SSL 35 0 0 06 Mar 2024
A Large-scale Evaluation of Pretraining Paradigms for the Detection of Defects in Electroluminescence Solar Cell Images David Torpey Lawrence Pratt Richard Klein 16 0 0 27 Feb 2024
DeepSet SimCLR: Self-supervised deep sets for improved pathology representation learning David Torpey Richard Klein SSL 29 1 0 23 Feb 2024
Rethinking U-net Skip Connections for Biomedical Image Segmentation Frauke Wilm Jonas Ammeling Mathias Öttl Rutger Fick Marc Aubreville Katharina Breininger OOD SSeg 15 4 0 13 Feb 2024
Task-customized Masked AutoEncoder via Mixture of Cluster-conditional Experts Zhili Liu Kai Chen Jianhua Han Lanqing Hong Hang Xu Zhenguo Li James T. Kwok MoE 109 24 0 08 Feb 2024
Review of multimodal machine learning approaches in healthcare "Felix H. Krones Umar Marikkar Guy Parsons Adam Szmul Adam Mahdi 32 27 0 04 Feb 2024
BECLR: Batch Enhanced Contrastive Few-Shot Learning Stylianos Poulakakis-Daktylidis Hadi Jamali Rad 23 5 0 04 Feb 2024
On the Transferability of Large-Scale Self-Supervision to Few-Shot Audio Classification Calum Heggan S. Budgett Timothy M. Hospedales Mehrdad Yaghoobi SSL 19 1 0 02 Feb 2024
Generic Knowledge Boosted Pre-training For Remote Sensing Images Ziyue Huang Mingming Zhang Yuan Gong Qingjie Liu Yunhong Wang VLM 28 14 0 09 Jan 2024
GTA: Guided Transfer of Spatial Attention from Object-Centric Representations SeokHyun Seo Jinwoo Hong Jungwoo Chae Kyungyul Kim Sangheum Hwang 32 0 0 05 Jan 2024
Revisiting Supervision for Continual Representation Learning Daniel Marczak Sebastian Cygert Tomasz Trzciñski Bartlomiej Twardowski SSL CLL 32 0 0 22 Nov 2023
Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations Cian Eastwood Julius von Kügelgen Linus Ericsson Diane Bouchacourt Pascal Vincent Bernhard Schölkopf Mark Ibrahim 34 10 0 15 Nov 2023
Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks Micah Goldblum Hossein Souri Renkun Ni Manli Shu Viraj Prabhu ... Adrien Bardes Judy Hoffman Ramalingam Chellappa Andrew Gordon Wilson Tom Goldstein VLM 73 62 0 30 Oct 2023
Understanding Calibration of Deep Neural Networks for Medical Image Classification A. Sambyal Usma Niyaz N. C. Krishnan Deepti R. Bathula 9 7 0 22 Sep 2023
A Systematic Review of Few-Shot Learning in Medical Imaging Eva Pachetti Sara Colantonio 24 17 0 20 Sep 2023
Building a Winning Team: Selecting Source Model Ensembles using a Submodular Transferability Estimation Approach KB Vimal Saketh Bachu Tanmay Garg Niveditha Lakshmi Narasimhan Raghavan Konuru Vineeth N. Balasubramanian 19 2 0 05 Sep 2023
An Empirical Analysis for Zero-Shot Multi-Label Classification on COVID-19 CT Scans and Uncurated Reports Ethan Dack Lorenzo Brigato Matthew McMurray Matthias Fontanellaz Thomas Frauenfelder ... Thomas Geiser M. Funke-Chambour Andreas Christe L. Ebner S. Mougiakakou 15 2 0 04 Sep 2023
CA2: Class-Agnostic Adaptive Feature Adaptation for One-class Classification Zilong Zhang Zhibin Zhao Deyu Meng Xingwu Zhang Xuefeng Chen VLM 19 1 0 04 Sep 2023
Exploring Model Transferability through the Lens of Potential Energy Xiaotong Li Zixuan Hu Yixiao Ge Ying Shan Ling-Yu Duan 19 7 0 29 Aug 2023
DR-Tune: Improving Fine-tuning of Pretrained Visual Models by Distribution Regularization with Semantic Calibration Nana Zhou Jiaxin Chen Di Huang 19 4 0 23 Aug 2023
Systematic comparison of semi-supervised and self-supervised learning for medical image classification Zhe Huang Ruijie Jiang Shuchin Aeron M. C. Hughes SSL OOD 26 6 0 18 Jul 2023