ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2112.09133
  4. Cited By
Masked Feature Prediction for Self-Supervised Visual Pre-Training
v1v2 (latest)

Masked Feature Prediction for Self-Supervised Visual Pre-Training

16 December 2021
Chen Wei
Haoqi Fan
Saining Xie
Chaoxia Wu
Alan Yuille
Christoph Feichtenhofer
    ViT
ArXiv (abs)PDFHTML

Papers citing "Masked Feature Prediction for Self-Supervised Visual Pre-Training"

50 / 498 papers shown
Rethinking the Learning Paradigm for Facial Expression Recognition
Rethinking the Learning Paradigm for Facial Expression Recognition
Weijie Wang
Andrii Zadaianchuk
Bruno Lepri
Bruno Lepri
239
4
0
30 Sep 2022
Improving Molecular Pretraining with Complementary Featurizations
Improving Molecular Pretraining with Complementary Featurizations
Yanqiao Zhu
Dingshuo Chen
Yuanqi Du
Yingze Wang
Qiang Liu
Shu Wu
AI4CE
165
7
0
29 Sep 2022
Spiking Neural Networks for event-based action recognition: A new task
  to understand their advantage
Spiking Neural Networks for event-based action recognition: A new task to understand their advantageNeurocomputing (Neurocomputing), 2022
Alex Vicente-Sola
D. L. Manna
Paul Kirkland
G. D. Caterina
Trevor Bihl
210
25
0
29 Sep 2022
Information-Theoretic Hashing for Zero-Shot Cross-Modal Retrieval
Information-Theoretic Hashing for Zero-Shot Cross-Modal Retrieval
Yufeng Shi
Shujian Yu
Duanquan Xu
Xinge You
126
1
0
26 Sep 2022
Self-Supervised Masked Convolutional Transformer Block for Anomaly
  Detection
Self-Supervised Masked Convolutional Transformer Block for Anomaly DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Neelu Madan
Nicolae-Cătălin Ristea
Radu Tudor Ionescu
Kamal Nasrollahi
Fahad Shahbaz Khan
T. Moeslund
M. Shah
ViTMedIm
548
100
0
25 Sep 2022
Exploring Modulated Detection Transformer as a Tool for Action
  Recognition in Videos
Exploring Modulated Detection Transformer as a Tool for Action Recognition in Videos
Tomás Crisol
J. Ermantraut
Adrián Rostagno
Santiago L. Aggio
Javier Iparraguirre
132
0
0
21 Sep 2022
Attentive Symmetric Autoencoder for Brain MRI Segmentation
Attentive Symmetric Autoencoder for Brain MRI SegmentationInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2022
Junjia Huang
Haofeng Li
Guanbin Li
Xiang Wan
MedIm
132
24
0
19 Sep 2022
S$^3$R: Self-supervised Spectral Regression for Hyperspectral
  Histopathology Image Classification
S3^33R: Self-supervised Spectral Regression for Hyperspectral Histopathology Image ClassificationInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2022
Xingran Xie
Yan Wang
Qingli Li
161
6
0
19 Sep 2022
Vision Transformers for Action Recognition: A Survey
Vision Transformers for Action Recognition: A Survey
Anwaar Ulhaq
Naveed Akhtar
Ganna Pogrebna
Lin Wang
ViT
225
66
0
13 Sep 2022
Exploring Target Representations for Masked Autoencoders
Exploring Target Representations for Masked AutoencodersInternational Conference on Learning Representations (ICLR), 2022
Xingbin Liu
Jinghao Zhou
Tao Kong
Xianming Lin
Rongrong Ji
666
58
0
08 Sep 2022
MimCo: Masked Image Modeling Pre-training with Contrastive Teacher
MimCo: Masked Image Modeling Pre-training with Contrastive TeacherACM Multimedia (ACM MM), 2022
Qiang-feng Zhou
Chaohui Yu
Haowen Luo
Zhibin Wang
Hao Li
VLM
301
28
0
07 Sep 2022
An Empirical Study of End-to-End Video-Language Transformers with Masked
  Visual Modeling
An Empirical Study of End-to-End Video-Language Transformers with Masked Visual ModelingComputer Vision and Pattern Recognition (CVPR), 2022
Tsu-Jui Fu
Linjie Li
Zhe Gan
Kevin Qinghong Lin
William Yang Wang
Lijuan Wang
Zicheng Liu
VLM
624
82
0
04 Sep 2022
MORI-RAN: Multi-view Robust Representation Learning via Hybrid
  Contrastive Fusion
MORI-RAN: Multi-view Robust Representation Learning via Hybrid Contrastive Fusion
Guanzhou Ke
Yong-Nan Zhu
Yang Yu
117
9
0
26 Aug 2022
MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image
  Pretraining
MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image PretrainingComputer Vision and Pattern Recognition (CVPR), 2022
Xiaoyi Dong
Jianmin Bao
Yinglin Zheng
Ting Zhang
Dongdong Chen
...
Weiming Zhang
Lu Yuan
Dong Chen
Fang Wen
Nenghai Yu
CLIPVLM
281
221
0
25 Aug 2022
Masked Autoencoders Enable Efficient Knowledge Distillers
Masked Autoencoders Enable Efficient Knowledge DistillersComputer Vision and Pattern Recognition (CVPR), 2022
Yutong Bai
Zeyu Wang
Junfei Xiao
Chen Wei
Huiyu Wang
Alan Yuille
Yuyin Zhou
Cihang Xie
CLL
284
57
0
25 Aug 2022
VLMAE: Vision-Language Masked Autoencoder
VLMAE: Vision-Language Masked Autoencoder
Su He
Taian Guo
Tao Dai
Ruizhi Qiao
Chen Wu
Xiujun Shu
Bohan Ren
VLM
195
11
0
19 Aug 2022
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers
Zhiliang Peng
Li Dong
Hangbo Bao
QiXiang Ye
Furu Wei
405
389
0
12 Aug 2022
MILAN: Masked Image Pretraining on Language Assisted Representation
MILAN: Masked Image Pretraining on Language Assisted Representation
Zejiang Hou
Fei Sun
Yen-kuang Chen
Yuan Xie
S. Kung
ViT
301
83
0
11 Aug 2022
Frozen CLIP Models are Efficient Video Learners
Frozen CLIP Models are Efficient Video LearnersEuropean Conference on Computer Vision (ECCV), 2022
Ziyi Lin
Shijie Geng
Renrui Zhang
Shiyang Feng
Gerard de Melo
Xiaogang Wang
Jifeng Dai
Yu Qiao
Jiaming Song
CLIPVLM
256
253
0
06 Aug 2022
Learning Prior Feature and Attention Enhanced Image Inpainting
Learning Prior Feature and Attention Enhanced Image InpaintingEuropean Conference on Computer Vision (ECCV), 2022
Chenjie Cao
Qiaole Dong
Yanwei Fu
DiffM
163
35
0
03 Aug 2022
SdAE: Self-distillated Masked Autoencoder
SdAE: Self-distillated Masked AutoencoderEuropean Conference on Computer Vision (ECCV), 2022
Yabo Chen
Yuchen Liu
Dongsheng Jiang
Xiaopeng Zhang
Wenrui Dai
H. Xiong
Qi Tian
ViT
210
86
0
31 Jul 2022
A Survey on Masked Autoencoder for Self-supervised Learning in Vision
  and Beyond
A Survey on Masked Autoencoder for Self-supervised Learning in Vision and Beyond
Chaoning Zhang
Chenshuang Zhang
Junha Song
John Seon Keun Yi
Kang Zhang
In So Kweon
SSL
225
94
0
30 Jul 2022
Contrastive Masked Autoencoders are Stronger Vision Learners
Contrastive Masked Autoencoders are Stronger Vision LearnersIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Zhicheng Huang
Xiaojie Jin
Cheng Lu
Qibin Hou
Mingg-Ming Cheng
Dongmei Fu
Xiaohui Shen
Jiashi Feng
503
206
0
27 Jul 2022
P2ANet: A Dataset and Benchmark for Dense Action Detection from Table
  Tennis Match Broadcasting Videos
P2ANet: A Dataset and Benchmark for Dense Action Detection from Table Tennis Match Broadcasting Videos
Jiang Bian
Xuhong Li
Tao Wang
Qingzhong Wang
Jun Huang
Chen Liu
Jun Zhao
Feixiang Lu
Dejing Dou
Haoyi Xiong
190
17
0
26 Jul 2022
MAR: Masked Autoencoders for Efficient Action Recognition
MAR: Masked Autoencoders for Efficient Action RecognitionIEEE transactions on multimedia (IEEE TMM), 2022
Zhiwu Qing
Shiwei Zhang
Ziyuan Huang
Xiang Wang
Yuehuang Wang
Yiliang Lv
Changxin Gao
Nong Sang
236
58
0
24 Jul 2022
MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations
  of Behavior
MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of BehaviorInternational Conference on Machine Learning (ICML), 2022
Jennifer J. Sun
Markus Marks
Andrew Ulmer
Dipam Chakraborty
Brian Geuther
...
Joseph Parker
Pietro Perona
Yisong Yue
K. Branson
Ann Kennedy
225
14
0
21 Jul 2022
Self-Supervised-RCNN for Medical Image Segmentation with Limited Data
  Annotation
Self-Supervised-RCNN for Medical Image Segmentation with Limited Data Annotation
B. Felfeliyan
A. Hareendranathan
G. Kuntze
David Cornell
Nils D. Forkert
Jacob L. Jaremko
J. Ronsky
186
24
0
17 Jul 2022
Bootstrapped Masked Autoencoders for Vision BERT Pretraining
Bootstrapped Masked Autoencoders for Vision BERT PretrainingEuropean Conference on Computer Vision (ECCV), 2022
Xiaoyi Dong
Jianmin Bao
Ting Zhang
Dongdong Chen
Weiming Zhang
Lu Yuan
Dong Chen
Fang Wen
Nenghai Yu
207
88
0
14 Jul 2022
Masked Autoencoders that Listen
Masked Autoencoders that ListenNeural Information Processing Systems (NeurIPS), 2022
Po-Yao (Bernie) Huang
Hu Xu
Juncheng Billy Li
Alexei Baevski
Michael Auli
Wojciech Galuba
Florian Metze
Christoph Feichtenhofer
534
385
0
13 Jul 2022
Big Learning
Big Learning
Yulai Cong
Miaoyun Zhao
AI4CE
387
0
0
08 Jul 2022
Consecutive Pretraining: A Knowledge Transfer Learning Strategy with
  Relevant Unlabeled Data for Remote Sensing Domain
Consecutive Pretraining: A Knowledge Transfer Learning Strategy with Relevant Unlabeled Data for Remote Sensing DomainRemote Sensing (RS), 2022
Tong Zhang
Shiyang Feng
Hao-Chen Dong
Zhuang Yin
Guanqun Wang
Wei Zhang
He Chen
171
44
0
08 Jul 2022
Masked Surfel Prediction for Self-Supervised Point Cloud Learning
Masked Surfel Prediction for Self-Supervised Point Cloud Learning
Yabin Zhang
Jiehong Lin
Chenhang He
Yuxiao Chen
Kui Jia
Lei Zhang
3DPC
197
24
0
07 Jul 2022
Dissecting Self-Supervised Learning Methods for Surgical Computer Vision
Dissecting Self-Supervised Learning Methods for Surgical Computer Vision
Sanat Ramesh
V. Srivastav
Deepak Alapatt
Tong Yu
Aditya Murali
...
Saurav Sharma
A. Fleurentin
Georgios Exarchakis
Alexandros Karargyris
N. Padoy
514
66
0
01 Jul 2022
Reading and Writing: Discriminative and Generative Modeling for
  Self-Supervised Text Recognition
Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text RecognitionACM Multimedia (ACM MM), 2022
Mingkun Yang
Minghui Liao
Pu Lu
Jing Wang
Shenggao Zhu
Hualin Luo
Qingzhen Tian
X. Bai
SSL
349
67
0
01 Jul 2022
Masked World Models for Visual Control
Masked World Models for Visual ControlConference on Robot Learning (CoRL), 2022
Younggyo Seo
Danijar Hafner
Hao Liu
Fangchen Liu
Stephen James
Kimin Lee
Pieter Abbeel
OffRL
402
181
0
28 Jun 2022
ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learning
ST-Adapter: Parameter-Efficient Image-to-Video Transfer LearningNeural Information Processing Systems (NeurIPS), 2022
Junting Pan
Ziyi Lin
Xiatian Zhu
Jing Shao
Jiaming Song
382
264
0
27 Jun 2022
Bi-Calibration Networks for Weakly-Supervised Video Representation
  Learning
Bi-Calibration Networks for Weakly-Supervised Video Representation LearningInternational Journal of Computer Vision (IJCV), 2022
Fuchen Long
Ting Yao
Zhaofan Qiu
Xinmei Tian
Jiebo Luo
Tao Mei
252
9
0
21 Jun 2022
SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders
SemMAE: Semantic-Guided Masking for Learning Masked AutoencodersNeural Information Processing Systems (NeurIPS), 2022
Gang Li
Heliang Zheng
Daqing Liu
Chaoyue Wang
Fuchun Sun
Changwen Zheng
464
152
0
21 Jun 2022
EATFormer: Improving Vision Transformer Inspired by Evolutionary
  Algorithm
EATFormer: Improving Vision Transformer Inspired by Evolutionary AlgorithmInternational Journal of Computer Vision (IJCV), 2022
Jiangning Zhang
Xiangtai Li
Yabiao Wang
Chengjie Wang
Jianlong Wu
Yong Liu
Dacheng Tao
ViT
304
46
0
19 Jun 2022
Self-Supervised Learning for Videos: A Survey
Self-Supervised Learning for Videos: A SurveyACM Computing Surveys (ACM CSUR), 2022
Madeline Chantry Schiappa
Yogesh S Rawat
M. Shah
SSL
474
166
0
18 Jun 2022
OmniMAE: Single Model Masked Pretraining on Images and Videos
OmniMAE: Single Model Masked Pretraining on Images and VideosComputer Vision and Pattern Recognition (CVPR), 2022
Rohit Girdhar
Alaaeldin El-Nouby
Mannat Singh
Kalyan Vasudev Alwala
Armand Joulin
Ishan Misra
ViT
265
118
0
16 Jun 2022
iBoot: Image-bootstrapped Self-Supervised Video Representation Learning
iBoot: Image-bootstrapped Self-Supervised Video Representation Learning
F. Saleh
Fuwen Tan
Adrian Bulat
Georgios Tzimiropoulos
Brais Martínez
SSL
275
1
0
16 Jun 2022
Adapting Self-Supervised Vision Transformers by Probing
  Attention-Conditioned Masking Consistency
Adapting Self-Supervised Vision Transformers by Probing Attention-Conditioned Masking ConsistencyNeural Information Processing Systems (NeurIPS), 2022
Viraj Prabhu
Sriram Yenamandra
Aaditya K. Singh
Judy Hoffman
140
15
0
16 Jun 2022
Masked Frequency Modeling for Self-Supervised Visual Pre-Training
Masked Frequency Modeling for Self-Supervised Visual Pre-TrainingInternational Conference on Learning Representations (ICLR), 2022
Jiahao Xie
Wei Li
Xiaohang Zhan
Ziwei Liu
Yew-Soon Ong
Chen Change Loy
232
99
0
15 Jun 2022
LAVENDER: Unifying Video-Language Understanding as Masked Language
  Modeling
LAVENDER: Unifying Video-Language Understanding as Masked Language ModelingComputer Vision and Pattern Recognition (CVPR), 2022
Linjie Li
Zhe Gan
Kevin Qinghong Lin
Chung-Ching Lin
Zicheng Liu
Ce Liu
Lijuan Wang
MLLMVLM
191
94
0
14 Jun 2022
SERE: Exploring Feature Self-relation for Self-supervised Transformer
SERE: Exploring Feature Self-relation for Self-supervised TransformerIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Zhong-Yu Li
Shanghua Gao
Ming-Ming Cheng
ViTMDE
253
19
0
10 Jun 2022
Extreme Masking for Learning Instance and Distributed Visual
  Representations
Extreme Masking for Learning Instance and Distributed Visual Representations
Zhirong Wu
Zihang Lai
Xiao Sun
Stephen Lin
291
24
0
09 Jun 2022
Spatial Entropy as an Inductive Bias for Vision Transformers
Spatial Entropy as an Inductive Bias for Vision TransformersMachine-mediated learning (ML), 2022
E. Peruzzo
E. Sangineto
Yahui Liu
Marco De Nadai
Wei Bi
Bruno Lepri
Andrii Zadaianchuk
ViTMDE
277
6
0
09 Jun 2022
Towards Understanding Why Mask-Reconstruction Pretraining Helps in
  Downstream Tasks
Towards Understanding Why Mask-Reconstruction Pretraining Helps in Downstream TasksInternational Conference on Learning Representations (ICLR), 2022
Jia Pan
Pan Zhou
Shuicheng Yan
SSL
345
20
0
08 Jun 2022
Siamese Image Modeling for Self-Supervised Vision Representation
  Learning
Siamese Image Modeling for Self-Supervised Vision Representation LearningComputer Vision and Pattern Recognition (CVPR), 2022
Chenxin Tao
Xizhou Zhu
Weijie Su
Gao Huang
Bin Li
Jie Zhou
Yu Qiao
Xiaogang Wang
Jifeng Dai
SSL
286
107
0
02 Jun 2022
Previous
123...1089
Next