Quantifying Attention Flow in Transformers

2 May 2020

Papers citing "Quantifying Attention Flow in Transformers"

50 / 403 papers shown

Title
Game Theoretic Mixed Experts for Combinational Adversarial Machine Learning Ethan Rathbun Kaleel Mahmood Sohaib Ahmad Caiwen Ding Marten van Dijk AAML 19 4 0 26 Nov 2022
Transformer Based Multi-Grained Features for Unsupervised Person Re-Identification Jiacheng Li Menglin Wang Xiaojin Gong ViT 32 16 0 22 Nov 2022
FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering Akhil Kedia Mohd Abbas Zaidi Haejun Lee 19 10 0 18 Nov 2022
Explanation on Pretraining Bias of Finetuned Vision Transformer Bumjin Park Jaesik Choi ViT 36 1 0 18 Nov 2022
Easy to Decide, Hard to Agree: Reducing Disagreements Between Saliency Methods Josip Jukić Martin Tutek Jan Snajder FAtt 21 0 0 15 Nov 2022
Language models are good pathologists: using attention-based sequence reduction and text-pretrained transformers for efficient WSI classification Juan Pisula Katarzyna Bozek VLM MedIm 36 3 0 14 Nov 2022
MultiCrossViT: Multimodal Vision Transformer for Schizophrenia Prediction using Structural MRI and Functional Network Connectivity Data Yuda Bi A. Abrol Z. Fu Vince D. Calhoun MedIm 13 3 0 12 Nov 2022
3D-CSL: self-supervised 3D context similarity learning for Near-Duplicate Video Retrieval Rui Deng Qianyu Wu Yuke Li ViT 22 4 0 10 Nov 2022
Understanding Cross-modal Interactions in V&L Models that Generate Scene Descriptions Michele Cafagna Kees van Deemter Albert Gatt CoGe 16 3 0 09 Nov 2022
Harmonizing the object recognition strategies of deep neural networks with humans Thomas Fel Ivan Felipe Drew Linsley Thomas Serre 36 71 0 08 Nov 2022
ViT-CX: Causal Explanation of Vision Transformers Weiyan Xie Xiao-hui Li Caleb Chen Cao Nevin L.Zhang ViT 29 17 0 06 Nov 2022
FedTP: Federated Learning by Transformer Personalization Hongxia Li Zhongyi Cai Jingya Wang Jiangnan Tang Weiping Ding Chin-Teng Lin Ye-ling Shi FedML 38 59 0 03 Nov 2022
Fully-attentive and interpretable: vision and video vision transformers for pain detection Giacomo Fiorentini Itir Onal Ertugrul A. A. Salah MedIm ViT 18 2 0 27 Oct 2022
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification Junfei Xiao Yutong Bai Alan Yuille Zongwei Zhou MedIm ViT 37 59 0 23 Oct 2022
Anticipative Feature Fusion Transformer for Multi-Modal Action Anticipation Zeyun Zhong David Schneider Michael Voit Rainer Stiefelhagen Jürgen Beyerer 71 44 0 23 Oct 2022
Information-Transport-based Policy for Simultaneous Translation Shaolei Zhang Yang Feng 51 47 0 22 Oct 2022
TokenMixup: Efficient Attention-guided Token-level Data Augmentation for Transformers Hyeong Kyu Choi Joonmyung Choi Hyunwoo J. Kim ViT 31 35 0 14 Oct 2022
STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognition Dasom Ahn Sangwon Kim H. Hong ByoungChul Ko ViT 28 97 0 14 Oct 2022
Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors Federico Baldassarre Quentin Debard Gonzalo Fiz Pontiveros Tri Kurniawan Wijaya 44 4 0 07 Oct 2022
COPILOT: Human-Environment Collision Prediction and Localization from Egocentric Videos Boxiao Pan Bokui Shen Davis Rempe Despoina Paschalidou Kaichun Mo Yanchao Yang Leonidas J. Guibas 17 2 0 04 Oct 2022
Mastering Spatial Graph Prediction of Road Networks Sotiris Anagnostidis Aurelien Lucchi Thomas Hofmann GNN 27 1 0 03 Oct 2022
Towards Faithful Model Explanation in NLP: A Survey Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 114 107 0 22 Sep 2022
Hydra Attention: Efficient Attention with Many Heads Daniel Bolya Cheng-Yang Fu Xiaoliang Dai Peizhao Zhang Judy Hoffman 99 77 0 15 Sep 2022
Exploring Visual Interpretability for Contrastive Language-Image Pre-training Yi Li Hualiang Wang Yiqun Duan Han Xu Xiaomeng Li CLIP VLM 98 25 0 15 Sep 2022
Attacking the Spike: On the Transferability and Security of Spiking Neural Networks to Adversarial Examples Nuo Xu Kaleel Mahmood Haowen Fang Ethan Rathbun Caiwen Ding Wujie Wen AAML 29 12 0 07 Sep 2022
TransPolymer: a Transformer-based language model for polymer property predictions Changwen Xu Yuyang Wang A. Farimani 27 86 0 03 Sep 2022
Explainability of Deep Learning models for Urban Space perception Ruben Sangers Jan van Gemert S. Cranenburgh ViT FAtt 11 1 0 29 Aug 2022
ProtoPFormer: Concentrating on Prototypical Parts in Vision Transformers for Interpretable Image Recognition Mengqi Xue Qihan Huang Haofei Zhang Lechao Cheng Mingli Song Ming-hui Wu Mingli Song ViT 27 53 0 22 Aug 2022
Exploring Adversarial Robustness of Vision Transformers in the Spectral Perspective Gihyun Kim Juyeop Kim Jong-Seok Lee AAML ViT 24 4 0 20 Aug 2022
Multiple Instance Neuroimage Transformer Ayush Singla Qingyu Zhao Daniel K. Do Yuyin Zhou K. Pohl Ehsan Adeli ViT MedIm 24 11 0 19 Aug 2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks Tilman Raukur A. Ho Stephen Casper Dylan Hadfield-Menell AAML AI4CE 23 124 0 27 Jul 2022
Adaptive occlusion sensitivity analysis for visually explaining video recognition networks Tomoki Uchiyama Naoya Sogi S. Iizuka Koichiro Niinuma Kazuhiro Fukui 24 2 0 26 Jul 2022
Locality Guidance for Improving Vision Transformers on Tiny Datasets Kehan Li Runyi Yu Zhennan Wang Li-ming Yuan Guoli Song Jie Chen ViT 32 43 0 20 Jul 2022
Vision Transformers: From Semantic Segmentation to Dense Prediction Li Zhang Jiachen Lu Sixiao Zheng Xinxuan Zhao Xiatian Zhu Yanwei Fu Tao Xiang Jianfeng Feng Philip H. S. Torr ViT 27 7 0 19 Jul 2022
iColoriT: Towards Propagating Local Hint to the Right Region in Interactive Colorization by Leveraging Vision Transformer Jooyeol Yun Sanghyeon Lee Minho Park Jaegul Choo ViT 17 2 0 14 Jul 2022
eX-ViT: A Novel eXplainable Vision Transformer for Weakly Supervised Semantic Segmentation Lu Yu Wei Xiang Juan Fang Yi-Ping Phoebe Chen Lianhua Chi ViT 27 24 0 12 Jul 2022
Trusted Multi-Scale Classification Framework for Whole Slide Image Ming Feng Kele Xu Na Wu Weiquan Huang Yan Bai Changjian Wang Huaimin Wang 39 5 0 12 Jul 2022
BAST: Binaural Audio Spectrogram Transformer for Binaural Sound Localization Sheng Kuang Kiki van der Heijden S. Mehrkanoon 11 3 0 08 Jul 2022
Don't Pay Attention to the Noise: Learning Self-supervised Representations of Light Curves with a Denoising Time Series Transformer M. Morvan N. Nikolaou K. H. Yip Ingo P. Waldmann AI4TS 107 9 0 06 Jul 2022
TractoFormer: A Novel Fiber-level Whole Brain Tractography Analysis Framework Using Spectral Embedding and Vision Transformers Fan Zhang Tengfei Xue Weidong (Tom) Cai Yogesh Rathi C. Westin L. O’Donnell MedIm 34 8 0 05 Jul 2022
Neural Transformers for Intraductal Papillary Mucosal Neoplasms (IPMN) Classification in MRI images Federica Proietto Salanitri Giovanni Bellitto S. Palazzo Ismail Irmakci Michael B. Wallace ... S. Hoogenboom Marco Aldinucci Ulas Bagci D. Giordano C. Spampinato ViT MedIm 11 7 0 21 Jun 2022
What is Where by Looking: Weakly-Supervised Open-World Phrase-Grounding without Text Inputs Tal Shaharabany Yoad Tewel Lior Wolf ObjD 38 15 0 19 Jun 2022
Backdoor Attacks on Vision Transformers Akshayvarun Subramanya Aniruddha Saha Soroush Abbasi Koohpayegani Ajinkya Tejankar Hamed Pirsiavash ViT AAML 21 16 0 16 Jun 2022
It's Time for Artistic Correspondence in Music and Video Dídac Surís Carl Vondrick Bryan C. Russell Justin Salamon 19 37 0 14 Jun 2022
Learning to Estimate Shapley Values with Vision Transformers Ian Covert Chanwoo Kim Su-In Lee FAtt 25 34 0 10 Jun 2022
Optimizing Relevance Maps of Vision Transformers Improves Robustness Hila Chefer Idan Schwartz Lior Wolf ViT 35 37 0 02 Jun 2022
Attention Flows for General Transformers Niklas Metzger Christopher Hahn Julian Siber Frederik Schmitt Bernd Finkbeiner 34 0 0 30 May 2022
3D-C2FT: Coarse-to-fine Transformer for Multi-view 3D Reconstruction Leslie Ching Ow Tiong Dick Sigmund Andrew Beng Jin Teoh 3DV ViT 31 12 0 29 May 2022
Object-wise Masked Autoencoders for Fast Pre-training Jiantao Wu Shentong Mo ViT OCL 25 15 0 28 May 2022
ASSET: Autoregressive Semantic Scene Editing with Transformers at High Resolutions Difan Liu Sandesh Shetty Tobias Hinz Matthew Fisher Richard Y. Zhang Taesung Park E. Kalogerakis ViT 27 30 0 24 May 2022