How Useful is Self-Supervised Pretraining for Visual Tasks?

31 March 2020

Papers citing "How Useful is Self-Supervised Pretraining for Visual Tasks?"

27 / 27 papers shown

Title
Why does my medical AI look at pictures of birds? Exploring the efficacy of transfer learning across domain boundaries F. Jonske M. Kim Enrico Nasca J. Evers Johannes Haubold ... F. Nensa Michael Kamp C. Seibold Jan Egger Jens Kleesiek 79 1 0 17 Feb 2025
Self-supervised Learning via Cluster Distance Prediction for Operating Room Context Awareness Idris Hamoud Alexandros Karargyris Aidean Sharghi Omid Mohareri N. Padoy SSL 21 1 0 07 Jul 2024
On the Difficulty of Defending Contrastive Learning against Backdoor Attacks Changjiang Li Ren Pang Bochuan Cao Zhaohan Xi Jinghui Chen Shouling Ji Ting Wang AAML 32 6 0 14 Dec 2023
Individualized Deepfake Detection Exploiting Traces Due to Double Neural-Network Operations Mushfiqur Rahman Runze Liu Chau-Wai Wong Huaiyu Dai 36 0 0 13 Dec 2023
Representation Synthesis by Probabilistic Many-Valued Logic Operation in Self-Supervised Learning Hiroki Nakamura Masashi Okada T. Taniguchi SSL NAI 23 0 0 08 Sep 2023
Overwriting Pretrained Bias with Finetuning Data Angelina Wang Olga Russakovsky 21 29 0 10 Mar 2023
A Review of Predictive and Contrastive Self-supervised Learning for Medical Images Wei-Chien Wang E. Ahn Da-wei Feng Jinman Kim MedIm 19 27 0 10 Feb 2023
Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud Yachao Zhang Zhonghao Li Yuan Xie Yanyun Qu Cuihua Li Tao Mei 3DPC 19 94 0 09 Dec 2022
Rethinking Two Consensuses of the Transferability in Deep Learning Yixiong Chen Jingxia Li C. Ding Li Liu 19 2 0 01 Dec 2022
Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works Chao Tao Ji Qi Mingning Guo Qing Zhu Haifeng Li SSL 19 56 0 15 Nov 2022
Data-Limited Tissue Segmentation using Inpainting-Based Self-Supervised Learning J. Dominic Nandita Bhaskhar Arjun D Desai Andrew M Schmidt E. Rubin ... G. Gold B. Hargreaves L. Lenchik R. Boutin Akshay S. Chaudhari 10 0 0 14 Oct 2022
Composite Learning for Robust and Effective Dense Predictions Menelaos Kanakis Thomas E. Huang David Brüggemann F. I. F. Richard Yu Luc Van Gool SSL 34 3 0 13 Oct 2022
Improving Fine-tuning of Self-supervised Models with Contrastive Initialization Haolin Pan Yong Guo Qinyi Deng Hao-Fan Yang Yiqun Chen Jian Chen SSL 18 19 0 30 Jul 2022
A Closer Look at Self-Supervised Lightweight Vision Transformers Shaoru Wang Jin Gao Zeming Li Jian-jun Sun Weiming Hu ViT 62 41 0 28 May 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 14 4 0 18 Apr 2022
Comparison Analysis of Traditional Machine Learning and Deep Learning Techniques for Data and Image Classification Efstathios Karypidis Stylianos G. Mouslech Kassiani Skoulariki Alexandros Gazis 18 14 0 11 Apr 2022
Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data Kyungjune Baek Hyunjung Shim 16 12 0 11 Apr 2022
Scaled ReLU Matters for Training Vision Transformers Pichao Wang Xue Wang Haowen Luo Jingkai Zhou Zhipeng Zhou Fan Wang Hao Li R. L. Jin 13 41 0 08 Sep 2021
A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective? Hiroaki Mikami Kenji Fukumizu Shogo Murai Shuji Suzuki Yuta Kikuchi Taiji Suzuki S. Maeda Kohei Hayashi 38 12 0 25 Aug 2021
How Transferable Are Self-supervised Features in Medical Image Classification Tasks? T. Truong Sadegh Mohammadi Matthias Lenga 32 45 0 23 Aug 2021
Geographical Knowledge-driven Representation Learning for Remote Sensing Images Wenyuan Li Keyan Chen Hao Chen Zhenwei Shi SSL 38 64 0 12 Jul 2021
Contrasting Contrastive Self-Supervised Representation Learning Pipelines Klemen Kotar Gabriel Ilharco Ludwig Schmidt Kiana Ehsani Roozbeh Mottaghi SSL 23 45 0 25 Mar 2021
Self-Supervised Pretraining Improves Self-Supervised Pretraining Colorado Reed Xiangyu Yue Aniruddha Nrusimha Sayna Ebrahimi Vivek Vijaykumar ... Shanghang Zhang Devin Guillory Sean L. Metzger Kurt Keutzer Trevor Darrell 23 104 0 23 Mar 2021
Self-supervised deep convolutional neural network for chest X-ray classification Matej Gazda J. Gazda J. Plávka P. Drotár SSL 17 54 0 04 Mar 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 11 43 0 13 Feb 2021
Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotations Navid Alemi Koohbanani Balagopal Unnikrishnan S. Khurram Pavitra Krishnaswamy Nasir M. Rajpoot SSL 14 164 0 12 Aug 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 24 1,586 0 15 Jun 2020