How Well Do Self-Supervised Models Transfer?

26 November 2020

Linus Ericsson

H. Gouk

Timothy M. Hospedales

SSL

ArXiv PDF HTML

Papers citing "How Well Do Self-Supervised Models Transfer?"

50 / 182 papers shown

Title
Dive into Self-Supervised Learning for Medical Image Analysis: Data, Models and Tasks Chuyan Zhang Yun Gu 27 0 0 25 Sep 2022
A Simple and Powerful Global Optimization for Unsupervised Video Object Segmentation Georgy Ponimatkin Nermin Samet Yanghua Xiao Yuming Du Renaud Marlet Vincent Lepetit VOS 72 20 0 19 Sep 2022
The Geometry of Self-supervised Learning Models and its Impact on Transfer Learning Romain Cosentino Sarath Shekkizhar Mahdi Soltanolkotabi A. Avestimehr Antonio Ortega SSL 46 7 0 18 Sep 2022
Self-Supervised Learning with an Information Maximization Criterion Serdar Ozsoy Shadi S. Hamdan Sercan Ö. Arik Deniz Yuret A. Erdogan SSL 11 33 0 16 Sep 2022
Enhance the Visual Representation via Discrete Adversarial Training Xiaofeng Mao YueFeng Chen Ranjie Duan Yao Zhu Gege Qi Shaokai Ye Xiaodan Li Rong Zhang Hui Xue 39 31 0 16 Sep 2022
Measuring the Interpretability of Unsupervised Representations via Quantized Reverse Probing Iro Laina Yuki M. Asano Andrea Vedaldi SSL 19 8 0 07 Sep 2022
Federated Transfer Learning with Multimodal Data Yulian Sun FedML 11 4 0 05 Sep 2022
Analyzing Data-Centric Properties for Graph Contrastive Learning Puja Trivedi Ekdeep Singh Lubana Mark Heimann Danai Koutra Jayaraman J. Thiagarajan 26 11 0 04 Aug 2022
Revisiting the Critical Factors of Augmentation-Invariant Representation Learning Junqiang Huang Xiangwen Kong Xiangyu Zhang 19 6 0 30 Jul 2022
On the robustness of self-supervised representations for multi-view object classification David Torpey Richard Klein SSL 11 1 0 27 Jul 2022
Exploring the Design of Adaptation Protocols for Improved Generalization and Machine Learning Safety Puja Trivedi Danai Koutra Jayaraman J. Thiagarajan AAML 20 0 0 26 Jul 2022
Inter-model Interpretability: Self-supervised Models as a Case Study Ahmad Mustapha Wael Khreich Wassim Masri SSL 6 0 0 24 Jul 2022
HyperNet: Self-Supervised Hyperspectral Spatial-Spectral Feature Understanding Network for Hyperspectral Change Detection Meiqi Hu Chen Wu L. Zhang SSL 26 57 0 20 Jul 2022
Self-Supervision Can Be a Good Few-Shot Learner Yuning Lu Liangjiang Wen Jianzhuang Liu Yajing Liu Xinmei Tian SSL 14 37 0 19 Jul 2022
Semantic Novelty Detection via Relational Reasoning Francesco Cappio Borlino S. Bucci Tatiana Tommasi 17 4 0 18 Jul 2022
Is a Caption Worth a Thousand Images? A Controlled Study for Representation Learning Shibani Santurkar Yann Dubois Rohan Taori Percy Liang Tatsunori Hashimoto CLIP VLM 19 41 0 15 Jul 2022
Consecutive Pretraining: A Knowledge Transfer Learning Strategy with Relevant Unlabeled Data for Remote Sensing Domain Tong Zhang Peng Gao Hao-Chen Dong Zhuang Yin Guanqun Wang Wei Zhang He Chen 20 33 0 08 Jul 2022
Not All Models Are Equal: Predicting Model Transferability in a Self-challenging Fisher Space Wenqi Shao Xun Zhao Yixiao Ge Zhaoyang Zhang Lei Yang Xiaogang Wang Ying Shan Ping Luo 11 26 0 07 Jul 2022
On the Importance and Applicability of Pre-Training for Federated Learning Hong-You Chen Cheng-Hao Tu Zi-hua Li Hang Shen Wei-Lun Chao FedML 11 77 0 23 Jun 2022
Visualizing and Understanding Contrastive Learning Fawaz Sammani Boris Joukovsky Nikos Deligiannis SSL FAtt 12 9 0 20 Jun 2022
Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning M. Gwilliam Abhinav Shrivastava SSL 74 19 1 16 Jun 2022
Lessons learned from the NeurIPS 2021 MetaDL challenge: Backbone fine-tuning without episodic meta-learning dominates for few-shot learning image classification Adrian El Baz Ihsan Ullah Edesio Alcobaça André C. P. L. F. de Carvalho Hong Chen ... Ekrem Öztürk J. V. Rijn Haozhe Sun Xin Wang Wenwu Zhu 30 12 0 15 Jun 2022
Is Self-Supervised Learning More Robust Than Supervised Learning? Yuanyi Zhong Haoran Tang Jun-Kun Chen Jian-wei Peng Yu-xiong Wang SSL OOD 25 24 0 10 Jun 2022
Segmentation Enhanced Lameness Detection in Dairy Cows from RGB and Depth Video Eric Arazo Robin Aly Kevin McGuinness 29 6 0 09 Jun 2022
Decoupled Self-supervised Learning for Non-Homophilous Graphs Teng Xiao Zhengyu Chen Zhimeng Guo Zeyang Zhuang Suhang Wang BDL SSL 23 18 0 07 Jun 2022
Extending Momentum Contrast with Cross Similarity Consistency Regularization M. Seyfi Amin Banitalebi-Dehkordi Yong Zhang SSL 28 11 0 07 Jun 2022
Pruning for Feature-Preserving Circuits in CNNs Christopher Hamblin Talia Konkle G. Alvarez 10 2 0 03 Jun 2022
Using Representation Expressiveness and Learnability to Evaluate Self-Supervised Learning Methods Yuchen Lu Zhen Liu A. Baratin Romain Laroche Aaron C. Courville Alessandro Sordoni SSL 15 0 0 02 Jun 2022
Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance with Expanded Views Junbo Zhang Kaisheng Ma 17 43 0 01 Jun 2022
Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embedding Tianyang Hu Zhili Liu Fengwei Zhou Wenjia Wang Weiran Huang SSL 36 26 0 30 May 2022
Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods Randall Balestriero Yann LeCun SSL 11 129 0 23 May 2022
Robust and Efficient Medical Imaging with Self-Supervision Shekoofeh Azizi Laura J. Culp Jan Freyberg Basil Mustafa Sebastien Baur ... Geoffrey E. Hinton N. Houlsby Alan Karthikesalingam Mohammad Norouzi Vivek Natarajan OOD 63 58 0 19 May 2022
Toward a Geometrical Understanding of Self-supervised Contrastive Learning Romain Cosentino Anirvan M. Sengupta Salman Avestimehr Mahdi Soltanolkotabi Antonio Ortega Ted Willke Mariano Tepper SSL 35 17 0 13 May 2022
How to Fine-tune Models with Few Samples: Update, Data Augmentation, and Test-time Augmentation Yujin Kim Jaehoon Oh Sungnyun Kim Se-Young Yun 29 6 0 13 May 2022
Multiplexed Immunofluorescence Brain Image Analysis Using Self-Supervised Dual-Loss Adaptive Masked Autoencoder S. Ly Bai Lin Hung Q. Vo D. Maric B. Roysam H. V. Nguyen 26 0 0 10 May 2022
Domain Invariant Masked Autoencoders for Self-supervised Learning from Multi-domains Haiyang Yang Meilin Chen Yizhou Wang Shixiang Tang Feng Zhu Lei Bai Rui Zhao Wanli Ouyang 19 16 0 10 May 2022
Diverse Imagenet Models Transfer Better Niv Nayman A. Golbert Asaf Noy Tan Ping Lihi Zelnik-Manor 27 0 0 19 Apr 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 14 4 0 18 Apr 2022
Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Difference S. Hu Da Li Jan Stuhmer Minyoung Kim Timothy M. Hospedales 19 188 0 15 Apr 2022
Learning Downstream Task by Selectively Capturing Complementary Knowledge from Multiple Self-supervisedly Learning Pretexts Jiayu Yao Qingyuan Wu Quan Feng Songcan Chen SSL 17 1 0 11 Apr 2022
Frequency Selective Augmentation for Video Representation Learning Jinhyung Kim Taeoh Kim Minho Shim Dongyoon Han Dongyoon Wee Junmo Kim AI4TS 41 3 0 08 Apr 2022
How Severe is Benchmark-Sensitivity in Video Self-Supervised Learning? Fida Mohammad Thoker Hazel Doughty Piyush Bagad Cees G. M. Snoek SSL 25 19 0 27 Mar 2022
One Network Doesn't Rule Them All: Moving Beyond Handcrafted Architectures in Self-Supervised Learning Sharath Girish Debadeepta Dey Neel Joshi Vibhav Vineet S. Shah C. C. T. Mendes Abhinav Shrivastava Yale Song SSL 32 2 0 15 Mar 2022
Simple Control Baselines for Evaluating Transfer Learning Andrei Atanov Shijian Xu Onur Beker Andrei Filatov Amir Zamir SSL 29 1 0 07 Feb 2022
A Review of Landcover Classification with Very-High Resolution Remotely Sensed Optical Images-Analysis Unit,Model Scalability and Transferability R. Qin Tao Liu 24 61 0 07 Feb 2022
Understanding Cross-Domain Few-Shot Learning Based on Domain Similarity and Few-Shot Difficulty Jaehoon Oh Sungnyun Kim Namgyu Ho Jin-Hwa Kim Hwanjun Song Se-Young Yun 22 34 0 01 Feb 2022
Max-Margin Contrastive Learning Anshul B. Shah S. Sra Ramalingam Chellappa A. Cherian SSL 18 44 0 21 Dec 2021
High Fidelity Visualization of What Your Self-Supervised Representation Knows About Florian Bordes Randall Balestriero Pascal Vincent DiffM 20 61 0 16 Dec 2021
Rethinking Nearest Neighbors for Visual Classification Menglin Jia Bor-Chun Chen Zuxuan Wu Claire Cardie Serge J. Belongie Ser-Nam Lim SSL 30 10 0 15 Dec 2021
Graph Representation Learning via Contrasting Cluster Assignments Chun-Yang Zhang Hong-Yu Yao F. I. C. L. Philip Chen Yue-Na Lin SSL 21 2 0 15 Dec 2021