Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling

9 January 2023

Papers citing "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

20 / 70 papers shown

Title
Self-Supervised Pre-Training with Contrastive and Masked Autoencoder Methods for Dealing with Small Datasets in Deep Learning for Medical Imaging Daniel Wolf Tristan Payer C. Lisson C. Lisson Meinrad Beer Michael Götz Timo Ropinski 25 14 0 12 Aug 2023
Exploring Transformers for Open-world Instance Segmentation Jiannan Wu Yi-Xin Jiang B. Yan Huchuan Lu Zehuan Yuan Ping Luo ViT 15 5 0 08 Aug 2023
DreamTeacher: Pretraining Image Backbones with Deep Generative Models Daiqing Li Huan Ling Amlan Kar David Acuna Seung Wook Kim Karsten Kreis Antonio Torralba Sanja Fidler VLM DiffM 13 26 0 14 Jul 2023
Augmentation-aware Self-supervised Learning with Conditioned Projector Marcin Przewike'zlikowski Mateusz Pyla Bartosz Zieliñski Bartlomiej Twardowski Jacek Tabor Marek Śmieja SSL 16 2 0 31 May 2023
Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Training Utku Ozbulak Hyun Jung Lee Beril Boga Esla Timothy Anzaku Ho-min Park Arnout Van Messem W. D. Neve J. Vankerschaver DiffM 16 36 0 23 May 2023
CM-MaskSD: Cross-Modality Masked Self-Distillation for Referring Image Segmentation Wenxuan Wang Jing Liu Xingjian He Yisi Zhang Cheng Chen Jiachen Shen Yan Zhang Jiangyun Li 14 11 0 19 May 2023
An Inverse Scaling Law for CLIP Training Xianhang Li Zeyu Wang Cihang Xie VLM CLIP 35 54 0 11 May 2023
Transformer-Based Visual Segmentation: A Survey Xiangtai Li Henghui Ding Haobo Yuan Wenwei Zhang Jiangmiao Pang Guangliang Cheng Kai-xiang Chen Ziwei Liu Chen Change Loy ViT MedIm 37 132 0 19 Apr 2023
CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding Dilxat Muhtar Xue-liang Zhang P. Xiao Zhenshi Li Feng-Xue Gu SSL 19 48 0 19 Apr 2023
Multi-Level Contrastive Learning for Dense Prediction Task Qiushan Guo Yizhou Yu Yi-Xin Jiang Jiannan Wu Zehuan Yuan Ping Luo SSL 12 2 0 04 Apr 2023
SSVMR: Saliency-based Self-training for Video-Music Retrieval Xuxin Cheng Zhihong Zhu Hongxiang Li Yaowei Li Yuexian Zou 16 29 0 18 Feb 2023
Self-Supervised Visual Representation Learning via Residual Momentum T. Pham Axi Niu Zhang Kang Sultan Rizky Hikmawan Madjid Jiajing Hong Daehyeok Kim Joshua Tian Jin Tee Chang-Dong Yoo SSL 23 6 0 17 Nov 2022
A Dynamic Graph Interactive Framework with Label-Semantic Injection for Spoken Language Understanding Zhihong Zhu Weiyuan Xu Xuxin Cheng Tengtao Song Yuexian Zou 19 22 0 08 Nov 2022
Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN Siyuan Li Di Wu Fang Wu Lei Shang Stan.Z.Li 25 47 0 27 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,412 0 11 Nov 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 207 484 0 01 Oct 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 292 5,761 0 29 Apr 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,764 0 24 Feb 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,359 0 09 Mar 2020
Spatial Transformer Networks Max Jaderberg Karen Simonyan Andrew Zisserman Koray Kavukcuoglu 124 7,319 0 05 Jun 2015