How Well Do Self-Supervised Models Transfer?

26 November 2020

Linus Ericsson

H. Gouk

Timothy M. Hospedales

SSL

ArXiv PDF HTML

Papers citing "How Well Do Self-Supervised Models Transfer?"

32 / 182 papers shown

Title
Long-tail Recognition via Compositional Knowledge Transfer Sarah Parisot P. Esperança Steven G. McDonagh T. Madarász Yongxin Yang Zhenguo Li 15 25 0 13 Dec 2021
Tradeoffs Between Contrastive and Supervised Learning: An Empirical Study A. Karthik Mike Wu Noah D. Goodman Alex Tamkin SSL 24 5 0 10 Dec 2021
Revisiting the Transferability of Supervised Pretraining: an MLP Perspective Yizhou Wang Shixiang Tang Feng Zhu Lei Bai Rui Zhao Donglian Qi Wanli Ouyang 21 51 0 01 Dec 2021
Similarity Contrastive Estimation for Self-Supervised Soft Contrastive Learning J. Denize Jaonary Rabarisoa Astrid Orcesi Romain Hérault S. Canu SSL 19 30 0 29 Nov 2021
Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes Sam Bond-Taylor P. Hessey Hiroshi Sasaki T. Breckon Chris G. Willcocks DiffM 25 71 0 24 Nov 2021
One to Transfer All: A Universal Transfer Framework for Vision Foundation Model with Few Data Yujie Wang Junqin Huang Mengya Gao Yichao Wu Zhen-fei Yin Ding Liang Junjie Yan 14 0 0 24 Nov 2021
Why Do Self-Supervised Models Transfer? Investigating the Impact of Invariance on Downstream Tasks Linus Ericsson H. Gouk Timothy M. Hospedales SSL 8 15 0 22 Nov 2021
Do we still need ImageNet pre-training in remote sensing scene classification? Vladimir Risojević Vladan Stojnić 22 11 0 05 Nov 2021
Self-Supervised Learning Disentangled Group Representation as Feature Tan Wang Zhongqi Yue Jianqiang Huang Qianru Sun Hanwang Zhang OOD 27 67 0 28 Oct 2021
Self-Supervised Representation Learning: Introduction, Advances and Challenges Linus Ericsson H. Gouk Chen Change Loy Timothy M. Hospedales SSL OOD AI4TS 27 270 0 18 Oct 2021
Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning Dahyun Kim Jonghyun Choi SSL MQ 20 5 0 17 Oct 2021
PASS: An ImageNet replacement for self-supervised pretraining without humans Yuki M. Asano Christian Rupprecht Andrew Zisserman Andrea Vedaldi VLM SSL 13 57 0 27 Sep 2021
Focus on the Positives: Self-Supervised Learning for Biodiversity Monitoring Omiros Pantazis Gabriel J. Brostow Kate E. Jones Oisin Mac Aodha SSL 23 30 0 14 Aug 2021
A Systematic Benchmarking Analysis of Transfer Learning for Medical Image Analysis M. Taher F. Haghighi Ruibin Feng Michael B. Gotway Jianming Liang 23 67 0 12 Aug 2021
Do Different Tracking Tasks Require Different Appearance Models? Zhongdao Wang Hengshuang Zhao Yali Li Shengjin Wang Philip H. S. Torr Luca Bertinetto 29 81 0 05 Jul 2021
Residual Contrastive Learning for Image Reconstruction: Learning Transferable Representations from Noisy Images Nanqing Dong Matteo Maggioni Yongxin Yang Eduardo Pérez-Pellitero A. Leonardis Steven G. McDonagh SSL 17 6 0 18 Jun 2021
Hybrid Generative-Contrastive Representation Learning Saehoon Kim Sungwoong Kim Juho Lee SSL 12 11 0 11 Jun 2021
Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations Wouter Van Gansbeke Simon Vandenhende Stamatios Georgoulis Luc Van Gool SSL 17 65 0 10 Jun 2021
Personalizing Pre-trained Models Mina Khan P. Srivatsa Advait Rane Shriram Chenniappa A. Hazariwala Pattie Maes VLM 37 5 0 02 Jun 2021
When Does Contrastive Visual Representation Learning Work? Elijah Cole Xuan S. Yang Kimberly Wilber Oisin Mac Aodha Serge J. Belongie SSL 21 123 0 12 May 2021
How Well Does Self-Supervised Pre-Training Perform with Streaming Data? Dapeng Hu Shipeng Yan Qizhengqiu Lu Lanqing Hong Hailin Hu Yifan Zhang Zhenguo Li Xinchao Wang Jiashi Feng 45 28 0 25 Apr 2021
Neural Mean Discrepancy for Efficient Out-of-Distribution Detection Xin Dong Junfeng Guo Ang Li W. Ting Cong Liu H. T. Kung OODD 11 57 0 23 Apr 2021
Benchmarking Representation Learning for Natural World Image Collections Grant Van Horn Elijah Cole Sara Beery Kimberly Wilber Serge J. Belongie Oisin Mac Aodha SSL VLM 18 164 0 30 Mar 2021
Self-Supervised Training Enhances Online Continual Learning Jhair Gallardo Tyler L. Hayes Christopher Kanan CLL 25 68 0 25 Mar 2021
Contrasting Contrastive Self-Supervised Representation Learning Pipelines Klemen Kotar Gabriel Ilharco Ludwig Schmidt Kiana Ehsani Roozbeh Mottaghi SSL 23 45 0 25 Mar 2021
Factors of Influence for Transfer Learning across Diverse Appearance Domains and Task Types Thomas Mensink J. Uijlings Alina Kuznetsova Michael Gygli V. Ferrari VLM 15 80 0 24 Mar 2021
Unleashing the Power of Contrastive Self-Supervised Visual Models via Contrast-Regularized Fine-Tuning Yifan Zhang Bryan Hooi Dapeng Hu Jian Liang Jiashi Feng 71 64 0 12 Feb 2021
Improving Neural Network Robustness through Neighborhood Preserving Layers Bingyuan Liu Christopher Malon Lingzhou Xue E. Kruus AAML 13 5 0 28 Jan 2021
Concept Generalization in Visual Representation Learning Mert Bulent Sariyildiz Yannis Kalantidis Diane Larlus Alahari Karteek SSL 21 50 0 10 Dec 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 243 3,367 0 09 Mar 2020
Impact of ImageNet Model Selection on Domain Adaptation Youshan Zhang Brian D. Davison FAtt OOD VLM 39 34 0 06 Feb 2020
Semantic Understanding of Scenes through the ADE20K Dataset Bolei Zhou Hang Zhao Xavier Puig Tete Xiao Sanja Fidler Adela Barriuso Antonio Torralba SSeg 253 1,824 0 18 Aug 2016