Limited Data, Unlimited Potential: A Study on ViTs Augmented by Masked
Autoencoders

Limited Data, Unlimited Potential: A Study on ViTs Augmented by Masked Autoencoders

31 October 2023

Dominick Reilly

Soumyajit Karmakar

Michael S. Ryoo

Papers citing "Limited Data, Unlimited Potential: A Study on ViTs Augmented by Masked Autoencoders"

18 / 18 papers shown

Title
Heart Failure Prediction using Modal Decomposition and Masked Autoencoders for Scarce Echocardiography Databases Andrés Bell-Navas M. Villalba-Orero Enrique Lara Pezzi J. Garicano-Mena S. L. Clainche 46 0 0 10 Apr 2025
Beyond H&E: Unlocking Pathological Insights with Polarization via Self-supervised Learning Yao Du Jiaxin Zhuang Xiaoyu Zheng Jing Cong Limei Guo Chao He Lin Luo Xiaomeng Li MedIm 35 1 0 05 Mar 2025
3D Nephrographic Image Synthesis in CT Urography with the Diffusion Model and Swin Transformer Hongkun Yu Syed Jamal Safdar Gardezi E. J. Abel D. D. Shapiro Meghan G. Lubner ... Matthew Smith G. Toia Lu Mao Pallavi Tiwari Andrew L. Wentland MedIm 54 0 0 26 Feb 2025
Exploring Active Data Selection Strategies for Continuous Training in Deepfake Detection Yoshihiko Furuhashi Junichi Yamagishi Xin Eric Wang H. Nguyen Isao Echizen 40 0 0 11 Feb 2025
Self-supervised Auxiliary Learning for Texture and Model-based Hybrid Robust and Fair Featuring in Face Analysis Shukesh Reddy Nishit Poddar Srijan Das Abhijit Das CVBM 20 0 0 29 Sep 2024
How Lightweight Can A Vision Transformer Be Jen Hong Tan ViT MoE 55 0 0 25 Jul 2024
SSAD: Self-supervised Auxiliary Detection Framework for Panoramic X-ray based Dental Disease Diagnosis Zijian Cai Xinquan Yang Xuguang Li Xiaoling Luo Xuechen Li Linlin Shen He Meng Yongqiang Deng MedIm 26 0 0 20 Jun 2024
Exploring Self-Supervised Vision Transformers for Deepfake Detection: A Comparative Analysis H. Nguyen Junichi Yamagishi Isao Echizen 34 6 0 01 May 2024
Crossway Diffusion: Improving Diffusion-based Visuomotor Policy via Self-supervised Learning Xiang Li Varun Belagali Jinghuan Shang Michael S. Ryoo 24 28 0 04 Jul 2023
What Do Self-Supervised Vision Transformers Learn? Namuk Park Wonjae Kim Byeongho Heo Taekyung Kim Sangdoo Yun SSL 65 76 1 01 May 2023
Real-World Robot Learning with Masked Visual Pre-training Ilija Radosavovic Tete Xiao Stephen James Pieter Abbeel Jitendra Malik Trevor Darrell SSL 146 238 0 06 Oct 2022
Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality Xiang Li Wenhai Wang Lingfeng Yang Jian Yang 95 73 0 20 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,337 0 11 Nov 2021
MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classification Jiancheng Yang Rui Shi D. Wei Zequan Liu Lin Zhao B. Ke Hanspeter Pfister Bingbing Ni VLM 161 634 0 27 Oct 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 283 5,723 0 29 Apr 2021
Transformer in Transformer Kai Han An Xiao Enhua Wu Jianyuan Guo Chunjing Xu Yunhe Wang ViT 282 1,490 0 27 Feb 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 263 3,538 0 24 Feb 2021
Is Space-Time Attention All You Need for Video Understanding? Gedas Bertasius Heng Wang Lorenzo Torresani ViT 278 1,939 0 09 Feb 2021