Contrastive Masked Autoencoders are Stronger Vision Learners

27 July 2022

Papers citing "Contrastive Masked Autoencoders are Stronger Vision Learners"

50 / 100 papers shown

Title
Self-Supervised Learning based on Transformed Image Reconstruction for Equivariance-Coherent Feature Representation Qin Wang Benjamin Bruns Hanno Scharr Kai Krajsek 48 0 0 24 Mar 2025
Structured-Noise Masked Modeling for Video, Audio and Beyond Aritra Bhowmik Fida Mohammad Thoker Carlos Hinojosa Bernard Ghanem Cees G. M. Snoek VGen 59 0 0 20 Mar 2025
Conjuring Positive Pairs for Efficient Unification of Representation Learning and Image Synthesis Imanol G. Estepa Jesús M. Rodríguez-de-Vera Ignacio Sarasúa Bhalaji Nagarajan P. Radeva 47 0 0 19 Mar 2025
MIM-Refiner: A Contrastive Learning Boost from Intermediate Pre-Trained Representations Benedikt Alkin Lukas Miklautz Sepp Hochreiter Johannes Brandstetter VLM 57 8 0 24 Feb 2025
Intensity-Spatial Dual Masked Autoencoder for Multi-Scale Feature Learning in Chest CT Segmentation Yuexing Ding Jun Wang H. Lyu 78 0 0 17 Feb 2025
PR-MIM: Delving Deeper into Partial Reconstruction in Masked Image Modeling Zhong-Yu Li Yunheng Li Deng-Ping Fan Ming-Ming Cheng 64 0 0 24 Nov 2024
From Prototypes to General Distributions: An Efficient Curriculum for Masked Image Modeling Jinhong Lin Cheng-En Wu Huanran Li Jifan Zhang Yu Hen Hu Pedro Morgado 26 0 0 16 Nov 2024
BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities Shaozhe Hao Xuantong Liu Xianbiao Qi Shihao Zhao Bojia Zi Rong Xiao Kai Han Kwan-Yee K. Wong 41 3 0 18 Oct 2024
Self-Supervised Learning for Real-World Object Detection: a Survey Alina Ciocarlan Sidonie Lefebvre S. L. Hégarat-Mascle Arnaud Woiselle ObjD 19 0 0 09 Oct 2024
Denoising with a Joint-Embedding Predictive Architecture Dengsheng Chen Jie Hu Xiaoming Wei Enhua Wu DiffM 47 2 0 02 Oct 2024
RingMo-Aerial: An Aerial Remote Sensing Foundation Model With A Affine Transformation Contrastive Learning Wenhui Diao Haichen Yu Kaiyue Kang Tong Ling Di Liu ... Hanbo Bi Libo Ren Xuexue Li Yongqiang Mao Xian Sun 29 1 0 20 Sep 2024
Dual Advancement of Representation Learning and Clustering for Sparse and Noisy Images Wenlin Li Yucheng Xu Xiaoqing Zheng Suoya Han Jun Wang Xiaobo Sun 23 0 0 03 Sep 2024
Masked Image Modeling: A Survey Vlad Hondru Florinel-Alin Croitoru Shervin Minaee Radu Tudor Ionescu N. Sebe 59 6 0 13 Aug 2024
Contrastive masked auto-encoders based self-supervised hashing for 2D image and 3D point cloud cross-modal retrieval Rukai Wei Heng Cui Yu Liu Yufeng Hou Yanzhao Xie Ke Zhou 3DPC 19 0 0 11 Aug 2024
POA: Pre-training Once for Models of All Sizes Yingying Zhang Xin Guo Jiangwei Lao Lei Yu Lixiang Ru Jian Wang Guo Ye Huimei He Jingdong Chen Ming Yang 53 1 0 02 Aug 2024
A Multi-view Mask Contrastive Learning Graph Convolutional Neural Network for Age Estimation Yiping Zhang Yuntao Shou Tao Meng Wei Ai Keqin Li CVBM 43 10 0 23 Jul 2024
Self-supervised transformer-based pre-training method with General Plant Infection dataset Zhengle Wang Ruifeng Wang Minjuan Wang Tianyun Lai Man Zhang 24 8 0 20 Jul 2024
Progressive Proxy Anchor Propagation for Unsupervised Semantic Segmentation Hyun Seok Seong WonJun Moon Subeen Lee Jae-Pil Heo 33 0 0 17 Jul 2024
Tissue-Contrastive Semi-Masked Autoencoders for Segmentation Pretraining on Chest CT Jie Zheng Ru Wen Haiqin Hu Lina Wei Kui Su Wei Chen Chen Liu Jun Wang 16 1 0 12 Jul 2024
Paving the way toward foundation models for irregular and unaligned Satellite Image Time Series Iris Dumeur Silvia Valero Jordi Inglada 27 3 0 11 Jul 2024
Video In-context Learning: Autoregressive Transformers are Zero-Shot Video Imitators Wentao Zhang Junliang Guo Tianyu He Li Zhao Linli Xu Jiang Bian 32 3 0 10 Jul 2024
AnatoMask: Enhancing Medical Image Segmentation with Reconstruction-guided Self-masking Yuheng Li Tianyu Luan Yizhou Wu Shaoyan Pan Yenho Chen Xiaofeng Yang 28 4 0 09 Jul 2024
Bringing Masked Autoencoders Explicit Contrastive Properties for Point Cloud Self-Supervised Learning Bin Ren Guofeng Mei D. Paudel Weijie Wang Yawei Li Mengyuan Liu Rita Cucchiara Luc Van Gool N. Sebe 3DPC 38 7 0 08 Jul 2024
SemanticMIM: Marring Masked Image Modeling with Semantics Compression for General Visual Representation Yike Yuan Huanzhang Dou Fengjun Guo Xi Li 21 2 0 15 Jun 2024
MASA: Motion-aware Masked Autoencoder with Semantic Alignment for Sign Language Recognition Weichao Zhao Hezhen Hu Wen-gang Zhou Yunyao Mao Min Wang Houqiang Li SLR 31 8 0 31 May 2024
Harmony: A Joint Self-Supervised and Weakly-Supervised Framework for Learning General Purpose Visual Representations Mohammed Baharoon Jonathan Klein D. L. Michels SSL VLM 34 0 0 23 May 2024
Salience-Based Adaptive Masking: Revisiting Token Dynamics for Enhanced Pre-training Hyesong Choi Hyejin Park Kwang Moo Yi Sungmin Cha Dongbo Min 29 9 0 12 Apr 2024
NeuroNet: A Novel Hybrid Self-Supervised Learning Framework for Sleep Stage Classification Using Single-Channel EEG Cheol-Hui Lee Hakseung Kim Hyun-jee Han Min-Kyung Jung Byung C. Yoon Dong-Joo Kim 27 5 0 10 Apr 2024
SP $^2$ OT: Semantic-Regularized Progressive Partial Optimal Transport for Imbalanced Clustering Chuyu Zhang Hui Ren Xuming He OT 32 0 0 04 Apr 2024
Disentangling Hippocampal Shape Variations: A Study of Neurological Disorders Using Graph Variational Autoencoder with Contrastive Learning Jakaria Rabbi Johannes Kiechle Christian Beaulieu Nilanjan Ray Dana Cobzas 19 0 0 31 Mar 2024
GenView: Enhancing View Quality with Pretrained Generative Model for Self-Supervised Learning Xiaojie Li Yibo Yang Xiangtai Li Jianlong Wu Yue Yu Bernard Ghanem Min Zhang SSL 32 6 0 18 Mar 2024
SELECTOR: Heterogeneous graph network with convolutional masked autoencoder for multimodal robust prediction of cancer survival Liangrui Pan Yijun Peng Yan Li Xiang Wang Wenjuan Liu Liwen Xu Qingchun Liang Shaoliang Peng 25 1 0 14 Mar 2024
Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencoder Jiaqi Wang Zhenxi Song Zhengyu Ma Xipeng Qiu Min Zhang Zhiguo Zhang 29 5 0 27 Feb 2024
Computer Vision for Primate Behavior Analysis in the Wild Richard Vogg Timo Lüddecke Jonathan Henrich Sharmita Dey Matthias Nuske ... Alexander Gail Stefan Treue H. Scherberger F. Worgotter Alexander S. Ecker 28 3 0 29 Jan 2024
Revisiting Active Learning in the Era of Vision Foundation Models S. Gupte Josiah Aklilu Jeffrey Nirschl Serena Yeung-Levy VLM 14 3 0 25 Jan 2024
Learning Representations for Clustering via Partial Information Discrimination and Cross-Level Interaction Hai-Xin Zhang Dong Huang Hua-Bao Ling Guang-Yu Zhang Wei-jun Sun Zi-hao Wen 13 0 0 24 Jan 2024
Exploring scalable medical image encoders beyond text supervision Fernando Pérez-García Harshita Sharma Sam Bond-Taylor Kenza Bouzid Valentina Salvatelli ... Maria T. A. Wetscherek Noel Codella Stephanie L. Hyland Javier Alvarez-Valle Ozan Oktay LM&MA MedIm 45 25 0 19 Jan 2024
Masked Modeling for Self-supervised Representation Learning on Vision and Beyond Siyuan Li Luyuan Zhang Zedong Wang Di Wu Lirong Wu ... Jun-Xiong Xia Cheng Tan Yang Liu Baigui Sun Stan Z. Li SSL 29 13 0 31 Dec 2023
Morphing Tokens Draw Strong Masked Image Models Taekyung Kim Byeongho Heo Dongyoon Han 38 3 0 30 Dec 2023
Learning to Embed Time Series Patches Independently Seunghan Lee Taeyoung Park Kibok Lee SSL AI4TS 13 26 0 27 Dec 2023
Soft Contrastive Learning for Time Series Seunghan Lee Taeyoung Park Kibok Lee AI4TS 22 2 0 27 Dec 2023
Adapting Vision Transformer for Efficient Change Detection Yang Zhao Yuxiang Zhang Yanni Dong Bo Du VLM 16 2 0 08 Dec 2023
Do text-free diffusion models learn discriminative visual representations? Soumik Mukhopadhyay M. Gwilliam Yosuke Yamaguchi Vatsal Agarwal Namitha Padmanabhan Archana Swaminathan Tianyi Zhou Abhinav Shrivastava DiffM 22 11 1 29 Nov 2023
PersonMAE: Person Re-Identification Pre-Training with Masked AutoEncoders Hezhen Hu Xiaoyi Dong Jianmin Bao Dongdong Chen Lu Yuan Dong Chen Houqiang Li 13 3 0 08 Nov 2023
BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping S. Sastry Subash Khanal A. Dhakal Di Huang Nathan Jacobs 38 9 0 29 Oct 2023
Generative and Contrastive Paradigms Are Complementary for Graph Self-Supervised Learning Yuxiang Wang Xiao Yan Chuang Hu Fangcheng Fu Wentao Zhang Hao Wang Shuo Shang Jiawei Jiang SSL 37 6 0 24 Oct 2023
Learning with Unmasked Tokens Drives Stronger Vision Learners Taekyung Kim Sanghyuk Chun Byeongho Heo Dongyoon Han SSL 28 1 0 20 Oct 2023
Adaptive Multi-head Contrastive Learning Lei Wang Piotr Koniusz Tom Gedeon Liang Zheng 26 4 0 09 Oct 2023
Understanding Masked Autoencoders From a Local Contrastive Perspective Xiaoyu Yue Lei Bai Meng Wei Jiangmiao Pang Xihui Liu Luping Zhou Wanli Ouyang SSL 54 4 0 03 Oct 2023
Neural Image Compression Using Masked Sparse Visual Representation Wei Jiang Wei Wang Yuewei Chen 11 7 0 20 Sep 2023