Transfer Learning or Self-supervised Learning? A Tale of Two Pretraining Paradigms

19 June 2020

Shanghang Zhang

Papers citing "Transfer Learning or Self-supervised Learning? A Tale of Two Pretraining Paradigms"

22 / 22 papers shown

Title
SEVERE++: Evaluating Benchmark Sensitivity in Generalization of Video Representation Learning Fida Mohammad Thoker Letian Jiang Chen Zhao Piyush Bagad Hazel Doughty Bernard Ghanem Cees G. M. Snoek ViT SSL 118 0 0 08 Apr 2025
How Well Do Supervised 3D Models Transfer to Medical Imaging Tasks? Wenxuan Li Alan Yuille Zongwei Zhou MedIm 148 10 0 20 Jan 2025
A Survey of the Self Supervised Learning Mechanisms for Vision Transformers Asifullah Khan A. Sohail Mustansar Fiaz Mehdi Hassan Tariq Habib Afridi ... Muhammad Zaigham Zaheer Kamran Ali Tangina Sultana Ziaurrehman Tanoli Naeem Akhter 274 5 0 30 Aug 2024
Detection of Animal Movement from Weather Radar using Self-Supervised Learning Mubin Ul Haque J. Dabrowski Rebecca M. Rogers Hazel Parry SSL 79 0 0 08 Aug 2024
JOSENet: A Joint Stream Embedding Network for Violence Detection in Surveillance Videos Pietro Nardelli Danilo Comminiello 74 1 0 05 May 2024
Self-Supervised Learning Featuring Small-Scale Image Dataset for Treatable Retinal Diseases Classification Luffina C. Huang Darren J. Chiu Manish Mehta 73 1 0 15 Apr 2024
AdapterFL: Adaptive Heterogeneous Federated Learning for Resource-constrained Mobile Computing Systems Ruixuan Liu Ming Hu Zeke Xia Jun Xia Peng Zhang Yihao Huang Yang Liu Mingsong Chen FedML 95 7 0 23 Nov 2023
Shifting to Machine Supervision: Annotation-Efficient Semi and Self-Supervised Learning for Automatic Medical Image Segmentation and Classification P. Singh Raviteja Chukkapalli Shravan Chaudhari Luoyao Chen Mei Chen Jinqian Pan Craig Smuda Jacopo Cirrone 38 8 0 17 Nov 2023
Towards Foundational Models for Molecular Learning on Large-Scale Multi-Task Datasets Dominique Beaini Shenyang Huang Joao Alex Cunha Zhiyi Li Gabriela Moisescu-Pareja ... Thérence Bois Andrew Fitzgibbon Bla.zej Banaszewski Chad Martin Dominic Masters AI4CE 120 25 0 06 Oct 2023
IAdet: Simplest human-in-the-loop object detection Franco Marchesoni-Acland Gabriele Facciolo VLM 104 1 0 04 Jul 2023
The Trade-off between Universality and Label Efficiency of Representations from Contrastive Learning Zhenmei Shi Jiefeng Chen Kunyang Li Jayaram Raghuram Xi Wu Yingyu Liang S. Jha SSL 79 20 0 28 Feb 2023
Feature Dropout: Revisiting the Role of Augmentations in Contrastive Learning Alex Tamkin Margalit Glasgow Xiluo He Noah D. Goodman SSL 118 7 0 16 Dec 2022
Deep Model Reassembly Xingyi Yang Zhou Daquan Songhua Liu Jingwen Ye Xinchao Wang MoMe 98 129 0 24 Oct 2022
Comparison of semi-supervised learning methods for High Content Screening quality control Umar Masud Ethan O. Cohen Ihab Bendidi Guillaume Bollot Auguste Genovesio 62 4 0 09 Aug 2022
How Severe is Benchmark-Sensitivity in Video Self-Supervised Learning? Fida Mohammad Thoker Hazel Doughty Piyush Bagad Cees G. M. Snoek SSL 82 19 0 27 Mar 2022
Augment with Care: Contrastive Learning for Combinatorial Problems Haonan Duan Pashootan Vaezipoor Max B. Paulus Yangjun Ruan Chris J. Maddison SSL 62 21 0 17 Feb 2022
Tradeoffs Between Contrastive and Supervised Learning: An Empirical Study A. Karthik Mike Wu Noah D. Goodman Alex Tamkin SSL 72 5 0 10 Dec 2021
Unsupervised Knowledge-Transfer for Learned Image Reconstruction Riccardo Barbano Ž. Kereta A. Hauptmann Simon Arridge Bangti Jin 66 11 0 06 Jul 2021
When Does Contrastive Visual Representation Learning Work? Elijah Cole Xuan S. Yang Kimberly Wilber Oisin Mac Aodha Serge Belongie SSL 90 125 0 12 May 2021
Self-Supervised Pretraining Improves Self-Supervised Pretraining Colorado Reed Xiangyu Yue Aniruddha Nrusimha Sayna Ebrahimi Vivek Vijaykumar ... Shanghang Zhang Devin Guillory Sean L. Metzger Kurt Keutzer Trevor Darrell 121 108 0 23 Mar 2021
Self-supervised Regularization for Text Classification Meng Zhou Zechen Li P. Xie 60 16 0 09 Mar 2021
Contrastive Self-supervised Learning for Graph Classification Jiaqi Zeng P. Xie SSL 115 156 0 13 Sep 2020