Self-attention in Vision Transformers Performs Perceptual Grouping, Not Attention

2 March 2023

Papers citing "Self-attention in Vision Transformers Performs Perceptual Grouping, Not Attention"

13 / 13 papers shown

Title
A recurrent vision transformer shows signatures of primate visual attention Jonathan Morgan Badr Albanna James P. Herman 34 0 0 16 Feb 2025
Flexible ViG: Learning the Self-Saliency for Flexible Object Recognition Lin Zuo Kunshan Yang Xianlong Tian Kunbin He Yongqi Ding Mengmeng Jing 21 1 0 06 Jun 2024
Dissecting Query-Key Interaction in Vision Transformers Xu Pan Aaron Philip Ziqian Xie Odelia Schwartz 32 1 0 04 Apr 2024
Visual Reasoning in Object-Centric Deep Neural Networks: A Comparative Cognition Approach Guillermo Puebla Jeffrey S. Bowers OCL 38 0 0 20 Feb 2024
RetSeg: Retention-based Colorectal Polyps Segmentation Network Khaled Elkarazle V. Raman Caslon Chua P. Then MedIm ViT 27 1 0 09 Oct 2023
Affinity-based Attention in Self-supervised Transformers Predicts Dynamics of Object Grouping in Humans Hossein Adeli Seoyoung Ahn N. Kriegeskorte G. Zelinsky ViT 19 5 0 01 Jun 2023
Modelling Human Visual Motion Processing with Trainable Motion Energy Sensing and a Self-attention Network Zitang Sun Yen-Ju Chen Yung-Hao Yang Shinýa Nishida 3DH 23 0 0 16 May 2023
AttentionViz: A Global View of Transformer Attention Catherine Yeh Yida Chen Aoyu Wu Cynthia Chen Fernanda Viégas Martin Wattenberg ViT 33 51 0 04 May 2023
Understanding the computational demands underlying visual reasoning Mohit Vaishnav Rémi Cadène A. Alamia Drew Linsley Rufin VanRullen Thomas Serre GNN CoGe 32 16 0 08 Aug 2021
CMT: Convolutional Neural Networks Meet Vision Transformers Jianyuan Guo Kai Han Han Wu Yehui Tang Chunjing Xu Yunhe Wang Chang Xu ViT 337 500 0 13 Jul 2021
Intriguing Properties of Vision Transformers Muzammal Naseer Kanchana Ranasinghe Salman Khan Munawar Hayat F. Khan Ming-Hsuan Yang ViT 251 619 0 21 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 303 5,761 0 29 Apr 2021
Bottleneck Transformers for Visual Recognition A. Srinivas Tsung-Yi Lin Niki Parmar Jonathon Shlens Pieter Abbeel Ashish Vaswani SLR 270 979 0 27 Jan 2021