How Do Vision Transformers Work?

14 February 2022

Papers citing "How Do Vision Transformers Work?"

50 / 236 papers shown

Title
Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs Qiu-hui Chen Yi Hong MedIm 17 11 0 02 Feb 2023
Enhancing Face Recognition with Latent Space Data Augmentation and Facial Posture Reconstruction Soroush Hashemifar Abdolreza Marefat Javad Hassannataj Joloudari H. Hassanpour CVBM 13 11 0 27 Jan 2023
A Simple Adaptive Unfolding Network for Hyperspectral Image Reconstruction Junyu Wang Shijie Wang Wenyu Liu Zengqiang Zheng Xinggang Wang 13 2 0 24 Jan 2023
Koopman neural operator as a mesh-free solver of non-linear partial differential equations Wei Xiong Xiaomeng Huang Ziyang Zhang Ruixuan Deng Pei Sun Yang Tian AI4CE 17 30 0 24 Jan 2023
Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing Shruthi Bannur Stephanie L. Hyland Qianchu Liu Fernando Pérez-García Maximilian Ilse ... Maria T. A. Wetscherek M. Lungren A. Nori Javier Alvarez-Valle Ozan Oktay 27 109 0 11 Jan 2023
KoopmanLab: machine learning for solving complex physics equations Wei Xiong Muyuan Ma Xiaomeng Huang Ziyang Zhang Pei Sun Yang Tian AI4CE 17 13 0 03 Jan 2023
Representation Separation for Semantic Segmentation with Vision Transformers Yuanduo Hong Huihui Pan Weichao Sun Xinghu Yu Huijun Gao ViT 11 5 0 28 Dec 2022
Investigation of Network Architecture for Multimodal Head-and-Neck Tumor Segmentation Ye Li Junyu Chen Se-In Jang Kuang Gong Quanzheng Li ViT MedIm 11 1 0 21 Dec 2022
What do Vision Transformers Learn? A Visual Exploration Amin Ghiasi Hamid Kazemi Eitan Borgnia Steven Reich Manli Shu Micah Goldblum A. Wilson Tom Goldstein ViT 11 60 0 13 Dec 2022
Towards Practical Plug-and-Play Diffusion Models Hyojun Go Yunsung Lee Jin-Young Kim Seunghyun Lee Myeongho Jeong Hyun Seung Lee Seungtaek Choi DiffM 16 16 0 12 Dec 2022
Non-equispaced Fourier Neural Solvers for PDEs Haitao Lin Lirong Wu Yongjie Xu Yufei Huang Siyuan Li Guojiang Zhao Z. Stan 14 7 0 09 Dec 2022
Group Generalized Mean Pooling for Vision Transformer ByungSoo Ko Han-Gyu Kim Byeongho Heo Sangdoo Yun Sanghyuk Chun Geonmo Gu Wonjae Kim ViT 17 1 0 08 Dec 2022
Teaching Matters: Investigating the Role of Supervision in Vision Transformers Matthew Walmer Saksham Suri Kamal Gupta Abhinav Shrivastava 22 33 0 07 Dec 2022
Pivotal Role of Language Modeling in Recommender Systems: Enriching Task-specific and Task-agnostic Representation Learning Kyuyong Shin Hanock Kwak Wonjae Kim Jisu Jeong Seungjae Jung KyungHyun Kim Jung-Woo Ha Sang-Woo Lee 14 4 0 07 Dec 2022
Minority-Oriented Vicinity Expansion with Attentive Aggregation for Video Long-Tailed Recognition WonJun Moon Hyun Seok Seong Jae-Pil Heo VLM 9 5 0 24 Nov 2022
Beyond the Field-of-View: Enhancing Scene Visibility and Perception with Clip-Recurrent Transformer Haowen Shi Qi Jiang Kailun Yang Xiaoyue Yin Ze Wang Kaiwei Wang ViT 35 5 0 21 Nov 2022
Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders Minsoo Kim Sihwa Lee S. Hong Duhyeuk Chang Jungwook Choi MQ 14 11 0 20 Nov 2022
Vision Transformers in Medical Imaging: A Review Emerald U. Henry Onyeka Emebob C. Omonhinmin ViT MedIm 11 33 0 18 Nov 2022
MogaNet: Multi-order Gated Aggregation Network Siyuan Li Zedong Wang Zicheng Liu Cheng Tan Haitao Lin Di Wu Zhiyuan Chen Jiangbin Zheng Stan Z. Li 18 54 0 07 Nov 2022
ViT-LSLA: Vision Transformer with Light Self-Limited-Attention Zhenzhe Hechen Wei Huang Yixin Zhao ViT 22 6 0 31 Oct 2022
Contextual Learning in Fourier Complex Field for VHR Remote Sensing Images Yan Zhang Xiyuan Gao Qingyan Duan Jiaxu Leng Xiao Pu Xinbo Gao ViT 16 1 0 28 Oct 2022
WaveBound: Dynamic Error Bounds for Stable Time Series Forecasting Youngin Cho Daejin Kim Dongmin Kim Mohammad Azam Khan Jaegul Choo AI4TS 18 3 0 25 Oct 2022
Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Data Huy Hoang Nguyen Matthew B. Blaschko S. Saarakkala A. Tiulpin MedIm AI4CE 40 15 0 25 Oct 2022
G2NetPL: Generic Game-Theoretic Network for Partial-Label Image Classification R. Abdelfattah Xin Zhang M. Fouda Xiaofeng Wang Song Wang VLM 17 6 0 20 Oct 2022
Similarity of Neural Architectures using Adversarial Attack Transferability Jaehui Hwang Dongyoon Han Byeongho Heo Song Park Sanghyuk Chun Jong-Seok Lee AAML 17 1 0 20 Oct 2022
Scratching Visual Transformer's Back with Uniform Attention Nam Hyeon-Woo Kim Yu-Ji Byeongho Heo Doonyoon Han Seong Joon Oh Tae-Hyun Oh 346 22 0 16 Oct 2022
Vision Transformer Visualization: What Neurons Tell and How Neurons Behave? Van-Anh Nguyen Khanh Pham Dinh L. Vuong Thanh-Toan Do Quan Hung Tran Dinh Q. Phung Trung Le ViT 4 2 0 14 Oct 2022
How to Train Vision Transformer on Small-scale Datasets? Hanan Gani Muzammal Naseer Mohammad Yaqub ViT 12 49 0 13 Oct 2022
Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets Zhiying Lu Hongtao Xie Chuanbin Liu Yongdong Zhang ViT 10 56 0 12 Oct 2022
Curved Representation Space of Vision Transformers Juyeop Kim Junha Park Songkuk Kim Jongseok Lee ViT 17 6 0 11 Oct 2022
Natural Color Fool: Towards Boosting Black-box Unrestricted Attacks Shengming Yuan Qilong Zhang Lianli Gao Yaya Cheng Jingkuan Song AAML 9 42 0 05 Oct 2022
Towards Flexible Inductive Bias via Progressive Reparameterization Scheduling Yunsung Lee Gyuseong Lee Kwang-seok Ryoo Hyojun Go Jihye Park Seung Wook Kim 16 5 0 04 Oct 2022
A Comparison of Transformer, Convolutional, and Recurrent Neural Networks on Phoneme Recognition Kyuhong Shim Wonyong Sung 17 2 0 01 Oct 2022
On the Surprising Effectiveness of Transformers in Low-Labeled Video Recognition Farrukh Rahman Ömer Mubarek Z. Kira ViT 10 2 0 15 Sep 2022
On the interplay of adversarial robustness and architecture components: patches, convolution and attention Francesco Croce Matthias Hein 29 6 0 14 Sep 2022
Transformer-CNN Cohort: Semi-supervised Semantic Segmentation by the Best of Both Students Xueye Zheng Yuan Luo Hao Wang Chong Fu Lin Wang ViT 36 17 0 06 Sep 2022
Transformers in Remote Sensing: A Survey Abdulaziz Amer Aleissaee Amandeep Kumar Rao Muhammad Anwer Salman Khan Hisham Cholakkal Guisong Xia F. Khan ViT 29 174 0 02 Sep 2022
Exploring Adversarial Robustness of Vision Transformers in the Spectral Perspective Gihyun Kim Juyeop Kim Jong-Seok Lee AAML ViT 6 4 0 20 Aug 2022
The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs C. Rockwell Justin Johnson David Fouhey ViT 11 42 0 18 Aug 2022
Hierarchical Attention Network for Few-Shot Object Detection via Meta-Contrastive Learning Dong Huk Park Jongmin Lee ObjD 12 11 0 15 Aug 2022
Attention Hijacking in Trojan Transformers Weimin Lyu Songzhu Zheng Teng Ma Haibin Ling Chao Chen 19 6 0 09 Aug 2022
End-to-end View Synthesis via NeRF Attention Zelin Zhao Jiaya Jia 13 8 0 29 Jul 2022
Magic ELF: Image Deraining Meets Association Learning and Transformer Kui Jiang Zhongyuan Wang Chen Chen Zheng Wang Laizhong Cui Chia-Wen Lin ViT 14 62 0 21 Jul 2022
An Efficient Spatio-Temporal Pyramid Transformer for Action Detection Yuetian Weng Zizheng Pan Mingfei Han Xiaojun Chang Bohan Zhuang ViT 11 25 0 21 Jul 2022
SplitMixer: Fat Trimmed From MLP-like Models Ali Borji Sikun Lin 21 3 0 21 Jul 2022
Next-ViT: Next Generation Vision Transformer for Efficient Deployment in Realistic Industrial Scenarios Jiashi Li Xin Xia W. Li Huixia Li Xing Wang Xuefeng Xiao Rui Wang Min Zheng Xin Pan ViT 6 145 0 12 Jul 2022
Attention mechanisms for physiological signal deep learning: which attention should we take? Seong-A Park Hyung‐Chul Lee Chul-Woo Jung Hyun-Lim Yang 36 5 0 04 Jul 2022
Automatic Sleep Scoring from Large-scale Multi-channel Pediatric EEG Harlin Lee Aaqib Saeed 14 3 0 30 Jun 2022
Continual Learning with Transformers for Image Classification B. Ermiş Giovanni Zappella Martin Wistuba Aditya Rawal Cédric Archambeau CLL 41 21 0 28 Jun 2022
Rarity Score : A New Metric to Evaluate the Uncommonness of Synthesized Images Jiyeon Han Hwanil Choi Yunjey Choi Jae Hyun Kim Jung-Woo Ha Jaesik Choi EGVM 10 31 0 17 Jun 2022