v1v2v3 (latest)

iBOT: Image BERT Pre-Training with Online Tokenizer

15 November 2021

Cihang Xie

Papers citing "iBOT: Image BERT Pre-Training with Online Tokenizer"

50 / 605 papers shown

Title
MogaNet: Multi-order Gated Aggregation NetworkInternational Conference on Learning Representations (ICLR), 2022 Siyuan Li Zedong Wang Zicheng Liu Cheng Tan Haitao Lin Di Wu Zhiyuan Chen Jiangbin Zheng Stan Z. Li 245 115 0 07 Nov 2022
On Fine-Tuned Deep Features for Unsupervised Domain AdaptationIEEE International Joint Conference on Neural Network (IJCNN), 2022 Qian Wang T. Breckon 141 4 0 25 Oct 2022
The Robustness Limits of SoTA Vision Models to Natural Variation Mark Ibrahim Q. Garrido Ari S. Morcos Diane Bouchacourt VLM 171 17 0 24 Oct 2022
Delving into Masked Autoencoders for Multi-Label Thorax Disease ClassificationIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2022 Junfei Xiao Yutong Bai Alan Yuille Zongwei Zhou MedIm ViT 186 90 0 23 Oct 2022
Adversarial Pretraining of Self-Supervised Deep Networks: Past, Present and Future Guo-Jun Qi M. Shah SSL 126 8 0 23 Oct 2022
Neural Eigenfunctions Are Structured Representation Learners Zhijie Deng Jiaxin Shi Hao Zhang Peng Cui Cewu Lu Jun Zhu 183 16 0 23 Oct 2022
Self-Supervised Learning via Maximum Entropy CodingNeural Information Processing Systems (NeurIPS), 2022 Xin Liu Zhongdao Wang Yali Li Shengjin Wang SSL 265 54 0 20 Oct 2022
Towards Sustainable Self-supervised Learning Shanghua Gao Pan Zhou Mingg-Ming Cheng Shuicheng Yan CLL 312 11 0 20 Oct 2022
CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View CompletionNeural Information Processing Systems (NeurIPS), 2022 Philippe Weinzaepfel Vincent Leroy Thomas Lucas Romain Brégier Yohann Cabon Vaibhav Arora L. Antsfeld Boris Chidlovskii G. Csurka Jérôme Revaud SSL 330 120 0 19 Oct 2022
Non-Contrastive Learning Meets Language-Image Pre-TrainingComputer Vision and Pattern Recognition (CVPR), 2022 Jinghao Zhou Li Dong Zhe Gan Lijuan Wang Furu Wei VLM CLIP 182 33 0 17 Oct 2022
Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers Tao Tang Changlin Li Guangrun Wang Kaicheng Yu Xiaojun Chang Xiaodan Liang ViT 181 1 0 16 Oct 2022
The Hidden Uniform Cluster Prior in Self-Supervised LearningInternational Conference on Learning Representations (ICLR), 2022 Mahmoud Assran Randall Balestriero Quentin Duval Florian Bordes Ishan Misra Piotr Bojanowski Pascal Vincent Michael G. Rabbat Nicolas Ballas SSL 183 62 0 13 Oct 2022
How to Train Vision Transformer on Small-scale Datasets?British Machine Vision Conference (BMVC), 2022 Hanan Gani Muzammal Naseer Mohammad Yaqub ViT 167 62 0 13 Oct 2022
Exploring Long-Sequence Masked Autoencoders Ronghang Hu Shoubhik Debnath Saining Xie Xinlei Chen 171 22 0 13 Oct 2022
OPERA: Omni-Supervised Representation Learning with Hierarchical SupervisionsIEEE International Conference on Computer Vision (ICCV), 2022 Cheng-Hao Wang Wenzhao Zheng Zhengbiao Zhu Jie Zhou Jiwen Lu SSL AI4TS 196 5 0 11 Oct 2022
Self-supervised Model Based on Masked Autoencoders Advance CT Scans ClassificationInternational Journal of Image Graphics and Signal Processing (IJIGSP), 2022 Jiashu Xu S. Stirenko 127 3 0 11 Oct 2022
RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rankInternational Conference on Machine Learning (ICML), 2022 Q. Garrido Randall Balestriero Laurent Najman Yann LeCun SSL 262 110 0 05 Oct 2022
Exploring The Role of Mean Teachers in Self-supervised Masked Auto-Encoders Youngwan Lee Jeffrey Willette Jonghee Kim Juho Lee Sung Ju Hwang 162 20 0 05 Oct 2022
VICRegL: Self-Supervised Learning of Local Visual FeaturesNeural Information Processing Systems (NeurIPS), 2022 Adrien Bardes Jean Ponce Yann LeCun SSL 206 150 0 04 Oct 2022
CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-trainingIEEE International Conference on Computer Vision (ICCV), 2022 Tianyu Huang Bowen Dong Yunhan Yang Xiaoshui Huang Rynson W. H. Lau Wanli Ouyang W. Zuo VLM 3DPC CLIP 504 196 0 03 Oct 2022
Attention Distillation: self-supervised vision transformer students need more guidanceBritish Machine Vision Conference (BMVC), 2022 Kai Wang Fei Yang Joost van de Weijer ViT 146 21 0 03 Oct 2022
Rethinking the Learning Paradigm for Facial Expression Recognition Weijie Wang Andrii Zadaianchuk Bruno Lepri Bruno Lepri 219 4 0 30 Sep 2022
Zero-shot visual reasoning through probabilistic analogical mappingNature Communications (Nat Commun), 2022 Taylor Webb Shuhao Fu Trevor Bihl K. Holyoak Hongjing Lu LRM 135 20 0 29 Sep 2022
Audio Barlow Twins: Self-Supervised Audio Representation LearningIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2022 Jonah Anton H. Coppock Pancham Shukla Bjorn W. Schuller BDL SSL 240 13 0 28 Sep 2022
Enhance the Visual Representation via Discrete Adversarial TrainingNeural Information Processing Systems (NeurIPS), 2022 Xiaofeng Mao YueFeng Chen Ranjie Duan Yao Zhu Gege Qi Shaokai Ye Xiaodan Li Rong Zhang Hui Xue 212 43 0 16 Sep 2022
Exploring Target Representations for Masked AutoencodersInternational Conference on Learning Representations (ICLR), 2022 Xingbin Liu Jinghao Zhou Tao Kong Xianming Lin Rongrong Ji 479 58 0 08 Sep 2022
MimCo: Masked Image Modeling Pre-training with Contrastive TeacherACM Multimedia (ACM MM), 2022 Qiang-feng Zhou Chaohui Yu Haowen Luo Zhibin Wang Hao Li VLM 264 28 0 07 Sep 2022
An Empirical Study of End-to-End Video-Language Transformers with Masked Visual ModelingComputer Vision and Pattern Recognition (CVPR), 2022 Tsu-Jui Fu Linjie Li Zhe Gan Kevin Qinghong Lin William Yang Wang Lijuan Wang Zicheng Liu VLM 566 82 0 04 Sep 2022
Masked Autoencoders Enable Efficient Knowledge DistillersComputer Vision and Pattern Recognition (CVPR), 2022 Yutong Bai Zeyu Wang Junfei Xiao Chen Wei Huiyu Wang Alan Yuille Yuyin Zhou Cihang Xie CLL 243 56 0 25 Aug 2022
MILAN: Masked Image Pretraining on Language Assisted Representation Zejiang Hou Fei Sun Yen-kuang Chen Yuan Xie S. Kung ViT 231 83 0 11 Aug 2022
Understanding Masked Image Modeling via Learning Occlusion Invariant FeatureComputer Vision and Pattern Recognition (CVPR), 2022 Xiangwen Kong Xiangyu Zhang SSL 169 64 0 08 Aug 2022
GPPF: A General Perception Pre-training Framework via Sparsely Activated Multi-Task Learning Benyuan Sun Jinqiao Dai Zihao Liang Cong Liu Yi Yang Bo Bai MoE 157 4 0 03 Aug 2022
Learning Prior Feature and Attention Enhanced Image InpaintingEuropean Conference on Computer Vision (ECCV), 2022 Chenjie Cao Qiaole Dong Yanwei Fu DiffM 142 34 0 03 Aug 2022
SdAE: Self-distillated Masked AutoencoderEuropean Conference on Computer Vision (ECCV), 2022 Yabo Chen Yuchen Liu Dongsheng Jiang Xiaopeng Zhang Wenrui Dai H. Xiong Qi Tian ViT 180 85 0 31 Jul 2022
A Survey on Masked Autoencoder for Self-supervised Learning in Vision and Beyond Chaoning Zhang Chenshuang Zhang Junha Song John Seon Keun Yi Kang Zhang In So Kweon SSL 173 93 0 30 Jul 2022
Transfer Learning for Segmentation Problems: Choose the Right Encoder and Skip the Decoder Jonas Dippel Matthias Lenga Thomas Goerttler Klaus Obermayer Johannes Höhne SSL 143 3 0 29 Jul 2022
Contrastive Masked Autoencoders are Stronger Vision LearnersIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022 Zhicheng Huang Xiaojie Jin Cheng Lu Qibin Hou Mingg-Ming Cheng Dongmei Fu Xiaohui Shen Jiashi Feng 436 202 0 27 Jul 2022
Bootstrapped Masked Autoencoders for Vision BERT PretrainingEuropean Conference on Computer Vision (ECCV), 2022 Xiaoyi Dong Jianmin Bao Ting Zhang Dongdong Chen Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu 202 87 0 14 Jul 2022
Unsupervised Semantic Segmentation with Self-supervised Object-centric RepresentationsInternational Conference on Learning Representations (ICLR), 2022 Antonios Tragoudaras Matthaeus Kleindessner Yi Zhu Francesco Locatello Thomas Brox 235 57 0 11 Jul 2022
A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense PredictionIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022 Wei Shen Zelin Peng Xuehui Wang Huayu Wang Jiazhong Cen Dongsheng Jiang Lingxi Xie Yunbo Wang Qi Tian VLM 331 113 0 04 Jul 2022
No Reason for No Supervision: Improved Generalization in Supervised ModelsInternational Conference on Learning Representations (ICLR), 2022 Mert Bulent Sariyildiz Yannis Kalantidis Alahari Karteek Diane Larlus SSL OOD LRM 171 35 0 30 Jun 2022
Teach me how to Interpolate a Myriad of Embeddings Shashanka Venkataramanan Ewa Kijak Laurent Amsaleg Yannis Avrithis 212 2 0 29 Jun 2022
Masked World Models for Visual ControlConference on Robot Learning (CoRL), 2022 Younggyo Seo Danijar Hafner Hao Liu Fangchen Liu Stephen James Kimin Lee Pieter Abbeel OffRL 367 178 0 28 Jun 2022
Guillotine Regularization: Why removing layers is needed to improve generalization in Self-Supervised Learning Florian Bordes Randall Balestriero Q. Garrido Adrien Bardes Pascal Vincent 261 30 0 27 Jun 2022
Self-supervised Learning in Remote Sensing: A ReviewIEEE Geoscience and Remote Sensing Magazine (GRSM), 2022 Yi Wang C. Albrecht Nassim Ait Ali Braham Lichao Mou Xiao Xiang Zhu 390 288 0 27 Jun 2022
SemMAE: Semantic-Guided Masking for Learning Masked AutoencodersNeural Information Processing Systems (NeurIPS), 2022 Gang Li Heliang Zheng Daqing Liu Chaoyue Wang Fuchun Sun Changwen Zheng 404 151 0 21 Jun 2022
OmniMAE: Single Model Masked Pretraining on Images and VideosComputer Vision and Pattern Recognition (CVPR), 2022 Rohit Girdhar Alaaeldin El-Nouby Mannat Singh Kalyan Vasudev Alwala Armand Joulin Ishan Misra ViT 251 117 0 16 Jun 2022
iBoot: Image-bootstrapped Self-Supervised Video Representation Learning F. Saleh Fuwen Tan Adrian Bulat Georgios Tzimiropoulos Brais Martínez SSL 235 1 0 16 Jun 2022
Masked Frequency Modeling for Self-Supervised Visual Pre-TrainingInternational Conference on Learning Representations (ICLR), 2022 Jiahao Xie Wei Li Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy 203 97 0 15 Jun 2022
Masked Siamese ConvNets L. Jing Jiachen Zhu Yann LeCun SSL 179 37 0 15 Jun 2022