What makes instance discrimination good for transfer learning?

11 June 2020

Papers citing "What makes instance discrimination good for transfer learning?"

40 / 40 papers shown

Title
DA-Net: A Disentangled and Adaptive Network for Multi-Source Cross-Lingual Transfer Learning Ling Ge Chunming Hu Guanghui Ma Jihong Liu Hong Zhang 29 0 0 07 Mar 2024
FedImpro: Measuring and Improving Client Update in Federated Learning Zhenheng Tang Yonggang Zhang S. Shi Xinmei Tian Tongliang Liu Bo Han Xiaowen Chu FedML 13 13 0 10 Feb 2024
Transferability of Representations Learned using Supervised Contrastive Learning Trained on a Multi-Domain Dataset Alvin De Jun Tan Clement Tan C. Yeo 23 0 0 27 Sep 2023
AutoLTS: Automating Cycling Stress Assessment via Contrastive Learning and Spatial Post-processing Bo Lin Shoshanna Saxe Timothy C. Y. Chan HAI 26 0 0 15 Aug 2023
A Closer Look at Few-shot Classification Again Xu Luo Hao Wu Ji Zhang Lianli Gao Jing Xu Jingkuan Song 24 48 0 28 Jan 2023
GH-Feat: Learning Versatile Generative Hierarchical Features from GANs Yinghao Xu Yujun Shen Jiapeng Zhu Ceyuan Yang Bolei Zhou 23 2 0 12 Jan 2023
FedFM: Anchor-based Feature Matching for Data Heterogeneity in Federated Learning Rui Ye Zhenyang Ni Chenxin Xu Jianyu Wang Siheng Chen Yonina C. Eldar FedML 19 31 0 14 Oct 2022
CFL-Net: Image Forgery Localization Using Contrastive Learning Fahim Faisal Niloy K. Bhaumik Simon S. Woo 23 31 0 04 Oct 2022
Automatically Discovering Novel Visual Categories with Self-supervised Prototype Learning Lu Zhang Lu Qi Xu Yang Hong Qiao Ming Yang Zhiyong Liu SSL 16 3 0 01 Aug 2022
Self-Supervised Pretraining for Differentially Private Learning Arash Asadian Evan Weidner Lei Jiang PICV 17 3 0 14 Jun 2022
Extreme Masking for Learning Instance and Distributed Visual Representations Zhirong Wu Zihang Lai Xiao Sun Stephen Lin 30 22 0 09 Jun 2022
A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities Yisheng Song Ting-Yuan Wang S. Mondal J. P. Sahoo SLR 36 342 0 13 May 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 14 4 0 18 Apr 2022
CAiD: Context-Aware Instance Discrimination for Self-supervised Learning in Medical Imaging M. Taher F. Haghighi Michael B. Gotway Jianming Liang OOD SSL 11 31 0 15 Apr 2022
Frequency Selective Augmentation for Video Representation Learning Jinhyung Kim Taeoh Kim Minho Shim Dongyoon Han Dongyoon Wee Junmo Kim AI4TS 41 3 0 08 Apr 2022
Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives David T. Hoffmann Nadine Behrmann Juergen Gall Thomas Brox M. Noroozi 25 43 0 27 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 17 100 0 15 Jan 2022
High Fidelity Visualization of What Your Self-Supervised Representation Knows About Florian Bordes Randall Balestriero Pascal Vincent DiffM 20 61 0 16 Dec 2021
Masked Feature Prediction for Self-Supervised Visual Pre-Training Chen Wei Haoqi Fan Saining Xie Chaoxia Wu Alan Yuille Christoph Feichtenhofer ViT 54 654 0 16 Dec 2021
Tradeoffs Between Contrastive and Supervised Learning: An Empirical Study A. Karthik Mike Wu Noah D. Goodman Alex Tamkin SSL 24 5 0 10 Dec 2021
Revisiting the Transferability of Supervised Pretraining: an MLP Perspective Yizhou Wang Shixiang Tang Feng Zhu Lei Bai Rui Zhao Donglian Qi Wanli Ouyang 19 51 0 01 Dec 2021
Rethinking Supervised Pre-training for Better Downstream Transferring Yutong Feng Jianwen Jiang Mingqian Tang R. L. Jin Yue Gao SSL 43 39 0 12 Oct 2021
Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Data Jiaxing Huang Dayan Guan Aoran Xiao Shijian Lu 140 212 0 07 Oct 2021
Reducing Label Effort: Self-Supervised meets Active Learning Javad Zolfaghari Bengar Joost van de Weijer Bartlomiej Twardowski Bogdan Raducanu VLM 14 60 0 25 Aug 2021
Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization Rui Qian Yuxi Li Huabin Liu John See Shuangrui Ding Xian Liu Dian Li Weiyao Lin 21 42 0 04 Aug 2021
Rectifying the Shortcut Learning of Background for Few-Shot Learning Xu Luo Longhui Wei Liangjiang Wen Jinrong Yang Lingxi Xie Zenglin Xu Qi Tian 34 86 0 16 Jul 2021
Can contrastive learning avoid shortcut solutions? Joshua Robinson Li Sun Ke Yu Kayhan Batmanghelich Stefanie Jegelka S. Sra SSL 11 141 0 21 Jun 2021
MST: Masked Self-Supervised Transformer for Visual Representation Zhaowen Li Zhiyang Chen Fan Yang Wei Li Yousong Zhu ... Rui Deng Liwei Wu Rui Zhao Ming Tang Jinqiao Wang ViT 30 161 0 10 Jun 2021
Large-scale Unsupervised Semantic Segmentation Shangqi Gao Zhong-Yu Li Ming-Hsuan Yang Mingg-Ming Cheng Junwei Han Philip H. S. Torr UQCV 25 84 0 06 Jun 2021
Divide and Contrast: Self-supervised Learning from Uncurated Data Yonglong Tian Olivier J. Hénaff Aaron van den Oord SSL 51 96 0 17 May 2021
Contrasting Contrastive Self-Supervised Representation Learning Pipelines Klemen Kotar Gabriel Ilharco Ludwig Schmidt Kiana Ehsani Roozbeh Mottaghi SSL 17 45 0 25 Mar 2021
A Broad Study on the Transferability of Visual Representations with Contrastive Learning Ashraful Islam Chun-Fu Chen Rameswar Panda Leonid Karlinsky Richard J. Radke Rogerio Feris SSL 10 113 0 24 Mar 2021
Concept Generalization in Visual Representation Learning Mert Bulent Sariyildiz Yannis Kalantidis Diane Larlus Alahari Karteek SSL 18 50 0 10 Dec 2020
How Well Do Self-Supervised Models Transfer? Linus Ericsson H. Gouk Timothy M. Hospedales SSL 16 274 0 26 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 14 173 0 05 Nov 2020
MixCo: Mix-up Contrastive Learning for Visual Representation Sungnyun Kim Gihun Lee Sangmin Bae Seyoung Yun SSL 104 80 0 13 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 27 627 0 02 Oct 2020
Delving into Inter-Image Invariance for Unsupervised Visual Representations Jiahao Xie Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy SSL VLM 13 58 0 26 Aug 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,367 0 09 Mar 2020
Transferability and Hardness of Supervised Classification Tasks Anh Tran Cuong V Nguyen Tal Hassner 134 164 0 21 Aug 2019