Exploring Self-attention for Image Recognition

28 April 2020

Papers citing "Exploring Self-attention for Image Recognition"

50 / 319 papers shown

Title
VNT-Net: Rotational Invariant Vector Neuron Transformers Hedi Zisling Andrei Sharf 3DPC 99 1 0 19 May 2022
Transformers in 3D Point Clouds: A Survey Dening Lu Qian Xie Mingqiang Wei Kyle Gao Linlin Xu Jonathan Li 3DPC ViT 176 55 0 16 May 2022
TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation Wenqiang Zhang Zilong Huang Guozhong Luo Tao Chen Xinggang Wang Wenyu Liu Gang Yu Chunhua Shen ViT 143 219 0 12 Apr 2022
HiTPR: Hierarchical Transformer for Place Recognition in Point Cloud Zhixing Hou Yan Yan Chengzhong Xu Hui Kong ViT 89 26 0 12 Apr 2022
MixFormer: Mixing Features across Windows and Dimensions Qiang Chen Qiman Wu Jian Wang Qinghao Hu T. Hu Errui Ding Jian Cheng Jingdong Wang MDE ViT 114 112 0 06 Apr 2022
FoV-Net: Field-of-View Extrapolation Using Self-Attention and Uncertainty Liqian Ma Stamatios Georgoulis Xu Jia Luc Van Gool 87 6 0 04 Apr 2022
ReSTR: Convolution-free Referring Image Segmentation Using Transformers N. Kim Dongwon Kim Cuiling Lan Wenjun Zeng Suha Kwak 227 153 0 31 Mar 2022
NL-FCOS: Improving FCOS through Non-Local Modules for Object Detection Lukas Pavez Jose M. Saavedra Rondo ObjD 78 0 0 29 Mar 2022
Domain Invariant Siamese Attention Mask for Small Object Change Detection via Everyday Indoor Robot Navigation Koji Takeda Kanji Tanaka Yoshimasa Nakamura 3DPC 90 3 0 29 Mar 2022
Stratified Transformer for 3D Point Cloud Segmentation Xin Lai Jianhui Liu Li Jiang Liwei Wang Hengshuang Zhao Shu Liu Xiaojuan Qi Jiaya Jia 3DPC ViT 163 296 0 28 Mar 2022
A General Survey on Attention Mechanisms in Deep Learning Gianni Brauwers Flavius Frasincar 118 374 0 27 Mar 2022
Exploring Self-Attention for Visual Intersection Classification Haruki Nakata Kanji Tanaka Koji Takeda 44 0 0 26 Mar 2022
Global Tracking Transformers Xingyi Zhou Tianwei Yin V. Koltun Philipp Krahenbuhl VOT 145 143 0 24 Mar 2022
Lane detection with Position Embedding Jun Xie Jiacheng Han Dezhen Qi F. Chen Kaer Huang Jia Shuai 76 5 0 23 Mar 2022
ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer Rui Yang Hailong Ma Jie Wu Yansong Tang Xuefeng Xiao Min Zheng Xiu Li ViT 198 59 0 21 Mar 2022
CodedVTR: Codebook-based Sparse Voxel Transformer with Geometric Guidance Tianchen Zhao Niansong Zhang Xuefei Ning He Wang Li Yi Yu Wang 3DPC ViT 78 10 0 18 Mar 2022
DuMLP-Pin: A Dual-MLP-dot-product Permutation-invariant Network for Set Feature Extraction Jiajun Fei Ziyu Zhu Wenlei Liu Zhidong Deng Mingyang Li Huanjun Deng Shuo Zhang 3DPC 115 6 0 08 Mar 2022
Aggregated Pyramid Vision Transformer: Split-transform-merge Strategy for Image Recognition without Convolutions Ruikang Ju Ting-Yu Lin Jen-Shiun Chiang Jia-Hao Jian Yu-Shian Lin Liu-Rui-Yi Huang ViT 44 2 0 02 Mar 2022
3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification Dening Lu Qian Xie Linlin Xu Jonathan Li 3DV 98 80 0 02 Mar 2022
Learn From the Past: Experience Ensemble Knowledge Distillation Chaofei Wang Shaowei Zhang Qing Xiao Gao Huang 117 6 0 25 Feb 2022
Guided Visual Attention Model Based on Interactions Between Top-down and Bottom-up Information for Robot Pose Prediction Hyogo Hiruma Hiroki Mori Hiroshi Ito Tetsuya Ogata 71 0 0 21 Feb 2022
Equivariant Graph Attention Networks for Molecular Property Prediction Tuan Le Frank Noé Djork-Arné Clevert 135 23 0 20 Feb 2022
When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism Guangting Wang Yucheng Zhao Chuanxin Tang Chong Luo Wenjun Zeng 116 77 0 26 Jan 2022
Attention-based Proposals Refinement for 3D Object Detection Minh-Quan Dao Elwan Héry Vincent Frémont 3DPC 53 2 0 18 Jan 2022
GAT-CADNet: Graph Attention Network for Panoptic Symbol Spotting in CAD Drawings Zhaohua Zheng Jianfang Li Lingjie Zhu Honghua Li F. Petzold Ping Tan 59 15 0 03 Jan 2022
Few-shot Backdoor Defense Using Shapley Estimation Jiyang Guan Zhuozhuo Tu Ran He Dacheng Tao AAML 145 57 0 30 Dec 2021
Learned Queries for Efficient Local Attention Moab Arar Ariel Shamir Amit H. Bermano ViT 165 33 0 21 Dec 2021
Lite Vision Transformer with Enhanced Self-Attention Chenglin Yang Yilin Wang Jianming Zhang He Zhang Zijun Wei Zhe Lin Alan Yuille ViT 112 123 0 20 Dec 2021
A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentation Wuyang Chen Xianzhi Du Fan Yang Lucas Beyer Xiaohua Zhai ... Huizhong Chen Jing Li Xiaodan Song Zhangyang Wang Denny Zhou ViT 137 24 0 17 Dec 2021
EEG-Transformer: Self-attention from Transformer Architecture for Decoding EEG of Imagined Speech Y. E. Lee Seo-Hyun Lee 56 50 0 15 Dec 2021
Embracing Single Stride 3D Object Detector with Sparse Transformer Lue Fan Ziqi Pang Tianyuan Zhang Yu-Xiong Wang Hang Zhao Feng Wang Naiyan Wang Zhaoxiang Zhang ViT 125 279 0 13 Dec 2021
Couplformer:Rethinking Vision Transformer with Coupling Attention Map Hai Lan Xihao Wang Xian Wei ViT 106 3 0 10 Dec 2021
Fast Point Transformer Chunghyun Park Yoonwoo Jeong Minsu Cho Jaesik Park 3DPC ViT 119 194 0 09 Dec 2021
PTTR: Relational 3D Point Cloud Object Tracking with Transformer Changqing Zhou Zhipeng Luo Yueru Luo Tianrui Liu Liang Pan Zhongang Cai Haiyu Zhao Shijian Lu ViT 3DPC 204 109 0 06 Dec 2021
CTIN: Robust Contextual Transformer Network for Inertial Navigation Bingbing Rao Ehsan Kazemi Yifan Ding D. Shila F. M. Tucker Liqiang Wang 3DPC 120 47 0 03 Dec 2021
TBN-ViT: Temporal Bilateral Network with Vision Transformer for Video Scene Parsing Bo Yan Leilei Cao Hongbin Wang ViT 54 2 0 02 Dec 2021
Robust Partial-to-Partial Point Cloud Registration in a Full Range Liang Pan Zhongang Cai Ziwei Liu 3DPC 82 25 0 30 Nov 2021
On the Integration of Self-Attention and Convolution Xuran Pan Chunjiang Ge Rui Lu Qing Xiao Guanfu Chen Zeyi Huang Gao Huang SSL 170 332 0 29 Nov 2021
SWAT: Spatial Structure Within and Among Tokens Kumara Kahatapitiya Michael S. Ryoo 106 7 0 26 Nov 2021
MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection Zhenhong Sun Ming Lin Xiuyu Sun Zhiyu Tan Hao Li Rong Jin 203 34 0 26 Nov 2021
PointMixer: MLP-Mixer for Point Cloud Understanding Jaesung Choe Chunghyun Park François Rameau Jaesik Park In So Kweon 3DPC 199 108 0 22 Nov 2021
DuDoTrans: Dual-Domain Transformer Provides More Attention for Sinogram Restoration in Sparse-View CT Reconstruction Ce Wang Kun Shang Haimiao Zhang Qian Li Yuan Hui S. Kevin Zhou ViT MedIm 78 29 0 21 Nov 2021
Attention Mechanisms in Computer Vision: A Survey Meng-Hao Guo Tianhan Xu Jiangjiang Liu Zheng-Ning Liu Peng-Tao Jiang Tai-Jiang Mu Song-Hai Zhang Ralph Robert Martin Ming-Ming Cheng Shimin Hu 186 1,854 0 15 Nov 2021
Searching for TrioNet: Combining Convolution with Local and Global Self-Attention Huaijin Pi Huiyu Wang Yingwei Li Zizhang Li Alan Yuille ViT 93 3 0 15 Nov 2021
Full-attention based Neural Architecture Search using Context Auto-regression Yuan Zhou Haiyang Wang Shuwei Huo Boyu Wang 83 3 0 13 Nov 2021
A Survey of Visual Transformers Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Peng Wang Jianping Fan Zhiqiang He 3DGS ViT 270 384 0 11 Nov 2021
Are Transformers More Robust Than CNNs? Yutong Bai Jieru Mei Alan Yuille Cihang Xie ViT AAML 351 282 0 10 Nov 2021
Direct Multi-view Multi-person 3D Pose Estimation Tao Wang Jianfeng Zhang Yujun Cai Shuicheng Yan Jiashi Feng 3DH 104 102 0 07 Nov 2021
Sampling Equivariant Self-attention Networks for Object Detection in Aerial Images Guo-Ye Yang Xiang-Li Li Ralph Robert Martin Shimin Hu 3DPC 79 16 0 05 Nov 2021
Relational Self-Attention: What's Missing in Attention for Video Understanding Manjin Kim Heeseung Kwon Chunyu Wang Suha Kwak Minsu Cho ViT 106 30 0 02 Nov 2021