Exploring Self-attention for Image Recognition

Exploring Self-attention for Image Recognition

28 April 2020

Hengshuang Zhao

ArXiv (abs)PDF HTML

Papers citing "Exploring Self-attention for Image Recognition"

19 / 319 papers shown

Title
Deep Learning and the Global Workspace Theory R. V. Rullen Ryota Kanai 151 73 0 04 Dec 2020
Pre-Trained Image Processing Transformer Hanting Chen Yunhe Wang Tianyu Guo Chang Xu Yiping Deng Zhenhua Liu Siwei Ma Chunjing Xu Chao Xu Wen Gao VLM ViT 487 1,762 0 01 Dec 2020
Deeper or Wider Networks of Point Clouds with Self-attention? Haoxi Ran Li Lu 3DPC 72 1 0 29 Nov 2020
Reflective-Net: Learning from Explanations Johannes Schneider Michalis Vlachos FAtt OffRL LRM 187 18 0 27 Nov 2020
Deep Magnification-Flexible Upsampling over 3D Point Clouds Y. Qian Xianqiang Lyu Sam Kwong Ying He 3DPC 186 47 0 25 Nov 2020
Delving Deep into Label Smoothing Chang-Bin Zhang Peng-Tao Jiang Qibin Hou Yunchao Wei Qi Han Zhen Li Ming-Ming Cheng 145 233 0 25 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 957 45,641 0 22 Oct 2020
Global Self-Attention Networks for Image Recognition Zhuoran Shen Irwan Bello Raviteja Vemulapalli Xuhui Jia Ching-Hui Chen ViT 96 30 0 06 Oct 2020
Group Equivariant Stand-Alone Self-Attention For Vision David W. Romero Jean-Baptiste Cordonnier MDE 205 61 0 02 Oct 2020
Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition Yang Liu Keze Wang Guanbin Li Liang Lin 170 100 0 01 Sep 2020
Joint Self-Attention and Scale-Aggregation for Self-Calibrated Deraining Network Cong Wang Yutong Wu Zhixun Su Junyang Chen 64 75 0 06 Aug 2020
Exploiting Non-Local Priors via Self-Convolution For Highly-Efficient Image Restoration Lanqing Guo Zhiyuan Zha S. Ravishankar Bihan Wen SupR 109 21 0 24 Jun 2020
Tent: Fully Test-time Adaptation by Entropy Minimization Dequan Wang Evan Shelhamer Shaoteng Liu Bruno A. Olshausen Trevor Darrell OOD 168 54 0 18 Jun 2020
Visual Transformers: Token-based Image Representation and Processing for Computer Vision Bichen Wu Chenfeng Xu Xiaoliang Dai Alvin Wan Peizhao Zhang Zhicheng Yan Masayoshi Tomizuka Joseph E. Gonzalez Kurt Keutzer Peter Vajda ViT 213 602 0 05 Jun 2020
Auto-decoding Graphs Sohil Shah V. Koltun GNN 78 4 0 04 Jun 2020
GPCA: A Probabilistic Framework for Gaussian Process Embedded Channel Attention Jiyang Xie Dongliang Chang Zhanyu Ma Guoqiang Zhang Jun Guo 72 25 0 10 Mar 2020
A Second look at Exponential and Cosine Step Sizes: Simplicity, Adaptivity, and Performance Xiaoyun Li Zhenxun Zhuang Francesco Orabona 143 22 0 12 Feb 2020
An Attentive Survey of Attention Models S. Chaudhari Varun Mithal Gungor Polatkan R. Ramanath 254 685 0 05 Apr 2019
ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks M.G.H. Cox A. Mishra 53 1 0 08 Nov 2018