Efficient Self-supervised Vision Transformers for Representation Learning

17 June 2021

Jianwei Yang

Lu Yuan

Papers citing "Efficient Self-supervised Vision Transformers for Representation Learning"

48 / 148 papers shown

Title
Patch-level Representation Learning for Self-supervised Vision Transformers Sukmin Yun Hankook Lee Jaehyung Kim Jinwoo Shin ViT 10 63 0 16 Jun 2022
Rethinking Generalization in Few-Shot Classification Markus Hiller Rongkai Ma Mehrtash Harandi Tom Drummond OCL VLM 15 55 0 15 Jun 2022
SERE: Exploring Feature Self-relation for Self-supervised Transformer Zhong-Yu Li Shanghua Gao Ming-Ming Cheng ViT MDE 19 14 0 10 Jun 2022
Extreme Masking for Learning Instance and Distributed Visual Representations Zhirong Wu Zihang Lai Xiao Sun Stephen Lin 27 22 0 09 Jun 2022
Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning Richard J. Chen Chengkuan Chen Yicong Li Tiffany Y. Chen A. Trister Rahul G. Krishnan Faisal Mahmood ViT MedIm 34 398 0 06 Jun 2022
On the duality between contrastive and non-contrastive self-supervised learning Q. Garrido Yubei Chen Adrien Bardes Laurent Najman Yann LeCun SSL 10 88 0 03 Jun 2022
Siamese Image Modeling for Self-Supervised Vision Representation Learning Chenxin Tao Xizhou Zhu Weijie Su Gao Huang Bin Li Jie Zhou Yu Qiao Xiaogang Wang Jifeng Dai SSL 26 94 0 02 Jun 2022
Hard Negative Sampling Strategies for Contrastive Representation Learning Afrina Tabassum Muntasir Wahed Hoda Eldardiry Ismini Lourentzou SSL 17 24 0 02 Jun 2022
Self-Supervised Visual Representation Learning with Semantic Grouping Xin Wen Bingchen Zhao Anlin Zheng X. Zhang Xiaojuan Qi SSL 101 71 0 30 May 2022
HiViT: Hierarchical Vision Transformer Meets Masked Image Modeling Xiaosong Zhang Yunjie Tian Wei Huang QiXiang Ye Qi Dai Lingxi Xie Qi Tian 50 26 0 30 May 2022
Temporal Latent Bottleneck: Synthesis of Fast and Slow Processing Mechanisms in Sequence Learning Aniket Didolkar Kshitij Gupta Anirudh Goyal Nitesh B. Gundavarapu Alex Lamb Nan Rosemary Ke Yoshua Bengio AI4CE 110 17 0 30 May 2022
Contrastive Learning Rivals Masked Image Modeling in Fine-tuning via Feature Distillation Yixuan Wei Han Hu Zhenda Xie Zheng-Wei Zhang Yue Cao Jianmin Bao Dong Chen B. Guo CLIP 80 123 0 27 May 2022
MixMAE: Mixed and Masked Autoencoder for Efficient Pretraining of Hierarchical Vision Transformers Jihao Liu Xin Huang Jinliang Zheng Yu Liu Hongsheng Li 22 53 0 26 May 2022
Wav2Seq: Pre-training Speech-to-Text Encoder-Decoder Models Using Pseudo Languages Felix Wu Kwangyoun Kim Shinji Watanabe Kyu Jeong Han Ryan T. McDonald Kilian Q. Weinberger Yoav Artzi SyDa 31 37 0 02 May 2022
Depth Estimation with Simplified Transformer John Yang Le An Anurag Dixit Jinkyu Koo Su Inn Park MDE 17 21 0 28 Apr 2022
RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning Xiaojian Ma Weili Nie Zhiding Yu Huaizu Jiang Chaowei Xiao Yuke Zhu Song-Chun Zhu Anima Anandkumar ViT LRM 22 19 0 24 Apr 2022
Representation Learning by Detecting Incorrect Location Embeddings Sepehr Sameni Simon Jenni Paolo Favaro ViT 18 4 0 10 Apr 2022
Unified Contrastive Learning in Image-Text-Label Space Jianwei Yang Chunyuan Li Pengchuan Zhang Bin Xiao Ce Liu Lu Yuan Jianfeng Gao VLM SSL 34 218 0 07 Apr 2022
Revisiting a kNN-based Image Classification System with High-capacity Storage K. Nakata Youyang Ng Daisuke Miyashita A. Maki Yu Lin J. Deguchi 17 24 0 03 Apr 2022
How Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning Chaoning Zhang Kang Zhang Chenshuang Zhang T. Pham Chang-Dong Yoo In So Kweon SSL 19 71 0 30 Mar 2022
Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations? Y. Fu Shunyao Zhang Shan-Hung Wu Cheng Wan Yingyan Lin AAML 18 63 0 16 Mar 2022
Towards Self-Supervised Learning of Global and Object-Centric Representations Federico Baldassarre Hossein Azizpour SSL 3DPC OCL 30 13 0 11 Mar 2022
Provable Stochastic Optimization for Global Contrastive Learning: Small Batch Does Not Harm Performance Zhuoning Yuan Yuexin Wu Zi-qi Qiu Xianzhi Du Lijun Zhang Denny Zhou Tianbao Yang 25 26 0 24 Feb 2022
FreeSOLO: Learning to Segment Objects without Annotations Xinlong Wang Zhiding Yu Shalini De Mello Jan Kautz Anima Anandkumar Chunhua Shen J. Álvarez ISeg SSeg 14 111 0 24 Feb 2022
S3T: Self-Supervised Pre-training with Swin Transformer for Music Classification Han Zhao Chen Zhang Belei Zhu Zejun Ma Ke-jun Zhang ViT 6 23 0 21 Feb 2022
ScoreNet: Learning Non-Uniform Attention and Augmentation for Transformer-Based Histopathological Image Classification Thomas Stegmüller Behzad Bozorgtabar A. Spahr Jean-Philippe Thiran ViT MedIm 19 42 0 15 Feb 2022
Results and findings of the 2021 Image Similarity Challenge Zoe Papakipos Giorgos Tolias Tomás Jenícek Ed Pizzi Shuhei Yokoo ... Sanjay V. Addicam S. M. Papadakis Cristian Canton Ferrer Ondřej Chum Matthijs Douze 13 12 0 08 Feb 2022
Pushing the limits of self-supervised ResNets: Can we outperform supervised learning without labels on ImageNet? Nenad Tomašev Ioana Bica Brian McWilliams Lars Buesing Razvan Pascanu Charles Blundell Jovana Mitrović SSL 60 80 0 13 Jan 2022
Few-Shot Image Classification Along Sparse Graphs Joseph F. Comer P. Jacobson Heiko Hoffmann 8 1 0 07 Dec 2021
3rd Place: A Global and Local Dual Retrieval Solution to Facebook AI Image Similarity Challenge Xinlong Sun Yangyang Qin Xuyuan Xu Guoping Gong Yang Fang Yexin Wang 25 5 0 04 Dec 2021
TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentation Zhao-Heng Yin Pichao Wang Fan Wang Xianzhe Xu Hanling Zhang Hao Li Rong Jin 22 39 0 02 Dec 2021
Semantic-Aware Generation for Self-Supervised Visual Representation Learning Yunjie Tian Lingxi Xie Xiaopeng Zhang Jiemin Fang Haohang Xu Wei Huang Jianbin Jiao Qi Tian QiXiang Ye SSL GAN 15 16 0 25 Nov 2021
Active Learning at the ImageNet Scale Z. Emam Hong-Min Chu Ping Yeh-Chiang W. Czaja R. Leapman Micah Goldblum Tom Goldstein 13 32 0 25 Nov 2021
iBOT: Image BERT Pre-Training with Online Tokenizer Jinghao Zhou Chen Wei Huiyu Wang Wei Shen Cihang Xie Alan Yuille Tao Kong 14 704 0 15 Nov 2021
A Survey of Self-Supervised and Few-Shot Object Detection Gabriel Huang I. Laradji David Vazquez Simon Lacoste-Julien Pau Rodríguez López ObjD 14 77 0 27 Oct 2021
Self supervised learning improves dMMR/MSI detection from histology slides across multiple cancers C. Saillard Olivier Dehaene Tanguy Marchand O. Moindrot A. Kamoun B. Schmauch S. Jégou 30 38 0 13 Sep 2021
Focal Self-attention for Local-Global Interactions in Vision Transformers Jianwei Yang Chunyuan Li Pengchuan Zhang Xiyang Dai Bin Xiao Lu Yuan Jianfeng Gao ViT 17 422 0 01 Jul 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya-Qin Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 18 12 0 08 May 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 239 2,554 0 04 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 283 5,723 0 29 Apr 2021
Characterizing and Improving the Robustness of Self-Supervised Learning through Background Augmentations Chaitanya K. Ryali D. Schwab Ari S. Morcos SSL 22 9 0 23 Mar 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 263 3,538 0 24 Feb 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,735 0 24 Feb 2021
Instance Localization for Self-supervised Detection Pretraining Ceyuan Yang Zhirong Wu Bolei Zhou Stephen Lin ViT SSL 95 144 0 16 Feb 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir F. Khan M. Shah ViT 225 2,404 0 04 Jan 2021
A Survey on Visual Transformer Kai Han Yunhe Wang Hanting Chen Xinghao Chen Jianyuan Guo ... Chunjing Xu Yixing Xu Zhaohui Yang Yiman Zhang Dacheng Tao ViT 16 2,096 0 23 Dec 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,359 0 09 Mar 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA Luowei Zhou Hamid Palangi Lei Zhang Houdong Hu Jason J. Corso Jianfeng Gao MLLM VLM 250 922 0 24 Sep 2019