Learning to Adapt to Position Bias in Vision Transformer Classifiers

19 May 2025

Papers citing "Learning to Adapt to Position Bias in Vision Transformer Classifiers"

11 / 11 papers shown

Title
Global Pooling, More than Meets the Eye: Position Information is Encoded Channel-Wise in CNNs Md. Amirul Islam M. Kowal Sen Jia Konstantinos G. Derpanis Neil D. B. Bruce 31 27 0 17 Aug 2021
A Survey on Bias in Visual Datasets Simone Fabbrizzi Symeon Papadopoulos Eirini Ntoutsi Y. Kompatsiaris 146 122 0 16 Jul 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 135 2,307 0 20 Apr 2021
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases Stéphane dÁscoli Hugo Touvron Matthew L. Leavitt Ari S. Morcos Giulio Biroli Levent Sagun ViT 90 818 0 19 Mar 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 314 40,217 0 22 Oct 2020
On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Location O. Kayhan Jan van Gemert 278 234 0 16 Mar 2020
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features Sangdoo Yun Dongyoon Han Seong Joon Oh Sanghyuk Chun Junsuk Choe Y. Yoo OOD 572 4,735 0 13 May 2019
Making Convolutional Networks Shift-Invariant Again Richard Y. Zhang OOD 74 794 0 25 Apr 2019
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 427 129,831 0 12 Jun 2017
Learning Important Features Through Propagating Activation Differences Avanti Shrikumar Peyton Greenside A. Kundaje FAtt 119 3,848 0 10 Apr 2017
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 219 8,030 0 13 Aug 2016