A surprisingly simple technique to control the pretraining bias for
better transfer: Expand or Narrow your representation

A surprisingly simple technique to control the pretraining bias for better transfer: Expand or Narrow your representation

11 April 2023

Randall Balestriero

Pascal Vincent

Papers citing "A surprisingly simple technique to control the pretraining bias for better transfer: Expand or Narrow your representation"

6 / 6 papers shown

Title
Self-Supervised Learning for Text Recognition: A Critical Survey Carlos Peñarrubia J. J. Valero-Mas Jorge Calvo-Zaragoza 69 1 0 29 Jul 2024
The Brain's Bitter Lesson: Scaling Speech Decoding With Self-Supervised Learning D. Jayalath Gilad Landau Brendan Shillingford M. Woolrich Oiwi Parker Jones SSL 39 4 0 06 Jun 2024
Evaluating The Robustness of Self-Supervised Representations to Background/Foreground Removal Xavier F. Cadet Ranya Aloufi A. Miranville S. Ahmadi-Abhari Hamed Haddadi 16 0 0 02 Jun 2023
A Cookbook of Self-Supervised Learning Randall Balestriero Mark Ibrahim Vlad Sobal Ari S. Morcos Shashank Shekhar ... Pierre Fernandez Amir Bar Hamed Pirsiavash Yann LeCun Micah Goldblum SyDa FedML SSL 31 270 0 24 Apr 2023
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 61 40 0 13 Sep 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,337 0 11 Nov 2021