Shunted Self-Attention via Multi-Scale Token Aggregation

30 November 2021

Papers citing "Shunted Self-Attention via Multi-Scale Token Aggregation"

36 / 86 papers shown

Title
Star-Net: Improving Single Image Desnowing Model With More Efficient Connection and Diverse Feature Interaction Jia-ju Mao Yuan Chang Xuesong Yin Binling Nie 28 1 0 17 Mar 2023
BiFormer: Vision Transformer with Bi-Level Routing Attention Lei Zhu Xinjiang Wang Zhanghan Ke Wayne Zhang Rynson W. H. Lau 123 438 0 15 Mar 2023
A Convolutional Vision Transformer for Semantic Segmentation of Side-Scan Sonar Data Hayat Rajani N. Gracias Rafael García ViT 19 12 0 24 Feb 2023
DilateFormer: Multi-Scale Dilated Transformer for Visual Recognition Jiayu Jiao Yuyao Tang Kun-Li Channing Lin Yipeng Gao Jinhua Ma Yaowei Wang Wei-Shi Zheng MedIm ViT 17 134 0 03 Feb 2023
SAT: Size-Aware Transformer for 3D Point Cloud Semantic Segmentation Junjie Zhou Yongping Xiong C. Chiu Fangyu Liu Xiangyang Gong 3DPC ViT 25 6 0 17 Jan 2023
Head-Free Lightweight Semantic Segmentation with Linear Transformer B. Dong Pichao Wang Fan Wang ViT 8 64 0 11 Jan 2023
Hierarchical Point Attention for Indoor 3D Object Detection Manli Shu Le Xue Ning Yu Roberto Martín-Martín Caiming Xiong Tom Goldstein Juan Carlos Niebles Ran Xu 3DPC 35 1 0 06 Jan 2023
TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models Sucheng Ren Fangyun Wei Zheng-Wei Zhang Han Hu 19 34 0 03 Jan 2023
SMMix: Self-Motivated Image Mixing for Vision Transformers Mengzhao Chen Mingbao Lin Zhihang Lin Yu-xin Zhang Fei Chao Rongrong Ji 31 10 0 26 Dec 2022
GPViT: A High Resolution Non-Hierarchical Vision Transformer with Group Propagation Chenhongyi Yang Jiarui Xu Shalini De Mello Elliot J. Crowley X. Wang ViT 27 21 0 13 Dec 2022
Vision Transformer with Super Token Sampling Huaibo Huang Xiaoqiang Zhou Jie Cao Ran He T. Tan ViT 13 54 0 21 Nov 2022
MSMG-Net: Multi-scale Multi-grained Supervised Metworks for Multi-task Image Manipulation Detection and Localization Fengsheng Wang Leyi Wei 14 2 0 06 Nov 2022
Dataset Distillation via Factorization Songhua Liu Kai Wang Xingyi Yang Jingwen Ye Xinchao Wang DD 124 137 0 30 Oct 2022
MetaFormer Baselines for Vision Weihao Yu Chenyang Si Pan Zhou Mi Luo Yichen Zhou Jiashi Feng Shuicheng Yan Xinchao Wang MoE 17 155 0 24 Oct 2022
Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning Dongze Lian Daquan Zhou Jiashi Feng Xinchao Wang 34 244 0 17 Oct 2022
Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets Zhiying Lu Hongtao Xie Chuanbin Liu Yongdong Zhang ViT 10 56 0 12 Oct 2022
Attention Diversification for Domain Generalization Rang Meng Xianfeng Li Weijie Chen Shicai Yang Jie Song Xinchao Wang Lei Zhang Mingli Song Di Xie Shiliang Pu 18 38 0 09 Oct 2022
LRT: An Efficient Low-Light Restoration Transformer for Dark Light Field Images Shansi Zhang Nan Meng E. Lam ViT 34 20 0 06 Sep 2022
ClusTR: Exploring Efficient Self-attention via Clustering for Vision Transformers Yutong Xie Jianpeng Zhang Yong-quan Xia A. Hengel Qi Wu 23 6 0 28 Aug 2022
In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation Bolin Lai Miao Liu Fiona Ryan James M. Rehg ViT 27 32 0 08 Aug 2022
Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection Gaoang Wang Yibing Zhan Xinchao Wang Min-Gyoo Song K. Nahrstedt 11 11 0 24 Jul 2022
Learning Graph Neural Networks for Image Style Transfer Yongcheng Jing Yining Mao Yiding Yang Yibing Zhan Mingli Song Xinchao Wang Dacheng Tao 26 53 0 24 Jul 2022
Learning with Recoverable Forgetting Jingwen Ye Yifang Fu Jie Song Xingyi Yang Songhua Liu Xin Jin Mingli Song Xinchao Wang CLL KELM 17 39 0 17 Jul 2022
DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generation Songhua Liu Jingwen Ye Sucheng Ren Xinchao Wang 19 44 0 13 Jul 2022
MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowing Sixiang Chen Tian-Chun Ye Yun-Peng Liu Taodong Liao Y. Ye Erkang Chen Peng Chen ViT 18 51 0 12 Jul 2022
Factorizing Knowledge in Neural Networks Xingyi Yang Jingwen Ye Xinchao Wang MoMe 28 121 0 04 Jul 2022
EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm Jiangning Zhang Xiangtai Li Yabiao Wang Chengjie Wang Yibo Yang Yong Liu Dacheng Tao ViT 28 32 0 19 Jun 2022
Learning Domain Adaptive Object Detection with Probabilistic Teacher Meilin Chen Weijie Chen Shicai Yang Jie Song Xinchao Wang ... Yunfeng Yan Donglian Qi Yueting Zhuang Di Xie Shiliang Pu 35 72 0 13 Jun 2022
Super Vision Transformer Mingbao Lin Mengzhao Chen Yu-xin Zhang Yunhang Shen Rongrong Ji Liujuan Cao ViT 25 20 0 23 May 2022
A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformers Yuzhong Chen Yu Du Zhe Xiao Lin Zhao Lu Zhang ... Dajiang Zhu Tuo Zhang Xintao Hu Tianming Liu Xi Jiang ViT 19 5 0 20 May 2022
Meta Clustering Learning for Large-scale Unsupervised Person Re-identification Xin Jin Tianyu He Xu Shen Tongliang Liu Xinchao Wang Jianqiang Huang Zhibo Chen Xiansheng Hua 17 11 0 19 Nov 2021
Unifying Global-Local Representations in Salient Object Detection with Transformer Sucheng Ren Qiang Wen Nanxuan Zhao Guoqiang Han Shengfeng He ViT 21 25 0 05 Aug 2021
CMT: Convolutional Neural Networks Meet Vision Transformers Jianyuan Guo Kai Han Han Wu Yehui Tang Chunjing Xu Yunhe Wang Chang Xu ViT 337 500 0 13 Jul 2021
Balancing Biases and Preserving Privacy on Balanced Faces in the Wild Joseph P. Robinson Can Qin Yann Henon Samson Timoner Y. Fu 6 24 0 16 Mar 2021
Transformer in Transformer Kai Han An Xiao Enhua Wu Jianyuan Guo Chunjing Xu Yunhe Wang ViT 282 1,490 0 27 Feb 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 263 3,538 0 24 Feb 2021