Improved Robustness of Vision Transformer via PreLayerNorm in Patch Embedding

16 November 2021

Papers citing "Improved Robustness of Vision Transformer via PreLayerNorm in Patch Embedding"

6 / 6 papers shown

Title
The Disappearance of Timestep Embedding in Modern Time-Dependent Neural Networks Bum Jun Kim Yoshinobu Kawahara Sang Woo Kim AI4TS 29 1 0 23 May 2024
Configuring Data Augmentations to Reduce Variance Shift in Positional Embedding of Vision Transformers Bum Jun Kim Sang Woo Kim ViT 43 1 0 23 May 2024
Dual PatchNorm Manoj Kumar Mostafa Dehghani N. Houlsby UQCV ViT 29 11 0 02 Feb 2023
Intriguing Properties of Vision Transformers Muzammal Naseer Kanchana Ranasinghe Salman Khan Munawar Hayat F. Khan Ming-Hsuan Yang ViT 265 621 0 21 May 2021
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 297 10,220 0 16 Nov 2016
Semantic Understanding of Scenes through the ADE20K Dataset Bolei Zhou Hang Zhao Xavier Puig Tete Xiao Sanja Fidler Adela Barriuso Antonio Torralba SSeg 253 1,828 0 18 Aug 2016