Visual Atoms: Pre-training Vision Transformers with Sinusoidal Waves

2 March 2023

Papers citing "Visual Atoms: Pre-training Vision Transformers with Sinusoidal Waves"

4 / 4 papers shown

Title
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 255 7,337 0 11 Nov 2021
Improving Fractal Pre-training Connor Anderson Ryan Farrell 77 21 0 06 Oct 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 283 4,299 0 29 Apr 2021
Pre-training without Natural Images Hirokatsu Kataoka Kazushige Okayasu Asato Matsumoto Eisuke Yamagata Ryosuke Yamada Nakamasa Inoue Akio Nakamura Y. Satoh 73 103 0 21 Jan 2021