Quantifying Attention Flow in Transformers

2 May 2020

Papers citing "Quantifying Attention Flow in Transformers"

50 / 403 papers shown

Title
Have the VLMs Lost Confidence? A Study of Sycophancy in VLMs Shuo Li Tao Ji Xiaoran Fan Linsheng Lu L. Yang ... Yansen Wang Xiaohui Zhao Tao Gui Qi Zhang Xuanjing Huang 44 0 0 15 Oct 2024
Domain-Conditioned Transformer for Fully Test-time Adaptation Yushun Tang Shuoshuo Chen Jiyuan Jia Yi Zhang Zhihai He 25 2 0 14 Oct 2024
Pretraining Graph Transformers with Atom-in-a-Molecule Quantum Properties for Improved ADMET Modeling Alessio Fallani Ramil I. Nugmanov Jose A. Arjona-Medina Jörg Kurt Wegner Alexandre Tkatchenko Kostiantyn Chernichenko MedIm AI4CE 34 0 0 10 Oct 2024
Audio Explanation Synthesis with Generative Foundation Models Alican Akman Qiyang Sun Björn W. Schuller 25 1 0 10 Oct 2024
Toward Robust Real-World Audio Deepfake Detection: Closing the Explainability Gap Georgia Channing Juil Sock Ronald Clark Philip Torr Christian Schroeder de Witt 35 2 0 09 Oct 2024
Unveiling Transformer Perception by Exploring Input Manifolds A. Benfenati Alfio Ferrara A. Marta Davide Riva Elisabetta Rocchetti 18 0 0 08 Oct 2024
Training-Free Open-Ended Object Detection and Segmentation via Attention as Prompts Zhiwei Lin Yongtao Wang Zhi Tang ObjD VLM 30 2 0 08 Oct 2024
Core Tokensets for Data-efficient Sequential Training of Transformers Subarnaduti Paul Manuel Brack P. Schramowski Kristian Kersting Martin Mundt 35 0 0 08 Oct 2024
Mechanistic? Naomi Saphra Sarah Wiegreffe AI4CE 29 9 0 07 Oct 2024
Explanation sensitivity to the randomness of large language models: the case of journalistic text classification Jérémie Bogaert Marie-Catherine de Marneffe Antonin Descampe Louis Escouflaire Cedrick Fairon François-Xavier Standaert 24 1 0 07 Oct 2024
How Language Models Prioritize Contextual Grammatical Cues? Hamidreza Amirzadeh A. Alishahi Hosein Mohebbi 26 0 0 04 Oct 2024
Unveiling the Role of Pretraining in Direct Speech Translation Belen Alastruey Gerard I. Gállego Marta R. Costa-jussá 33 0 0 26 Sep 2024
UNICORN: A Deep Learning Model for Integrating Multi-Stain Data in Histopathology Valentin Koch Sabine Bauer Valerio Luppberger Michael Joner Heribert Schunkert Julia A. Schnabel Moritz von Scheidt Carsten Marr MedIm ViT 34 0 0 26 Sep 2024
ViTGuard: Attention-aware Detection against Adversarial Examples for Vision Transformer Shihua Sun Kenechukwu Nwodo Shridatt Sugrim Angelos Stavrou Haining Wang AAML 26 1 0 20 Sep 2024
OATS: Outlier-Aware Pruning Through Sparse and Low Rank Decomposition Stephen Zhang Vardan Papyan VLM 51 1 0 20 Sep 2024
Pay Attention to What Matters Pedro Luiz Silva Antonio De Domenico Ali Maatouk Fadhel Ayed ALM 29 0 0 19 Sep 2024
Down-Sampling Inter-Layer Adapter for Parameter and Computation Efficient Ultra-Fine-Grained Image Recognition Edwin Arkel Rios Femiloye Oyerinde Min-Chun Hu Bo-Cheng Lai 32 0 0 17 Sep 2024
Trustworthiness in Retrieval-Augmented Generation Systems: A Survey Yujia Zhou Yan Liu Xiaoxi Li Jiajie Jin Hongjin Qian Zheng Liu Chaozhuo Li Zhicheng Dou Tsung-Yi Ho Philip S. Yu 3DV RALM 60 28 0 16 Sep 2024
Transformer with Controlled Attention for Synchronous Motion Captioning Karim Radouane Sylvie Ranwez Julien Lagarde Andon Tchechmedjiev 21 0 0 13 Sep 2024
iConFormer: Dynamic Parameter-Efficient Tuning with Input-Conditioned Adaptation Hayeon Jo Hyesong Choi Minhee Cho Dongbo Min 41 1 0 04 Sep 2024
ContextCite: Attributing Model Generation to Context Benjamin Cohen-Wang Harshay Shah Kristian Georgiev Aleksander Madry LRM 33 18 0 01 Sep 2024
Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction Melkamu Mersha Khang Lam Joseph Wood Ali AlShami Jugal Kalita XAI AI4TS 69 28 0 30 Aug 2024
Probing the Robustness of Vision-Language Pretrained Models: A Multimodal Adversarial Attack Approach Jiwei Guan Tianyu Ding Longbing Cao Lei Pan Chen Wang Xi Zheng AAML 33 1 0 24 Aug 2024
Counterfactuals As a Means for Evaluating Faithfulness of Attribution Methods in Autoregressive Language Models Sepehr Kamahi Yadollah Yaghoobzadeh 53 0 0 21 Aug 2024
A Unified Framework for Interpretable Transformers Using PDEs and Information Theory Yukun Zhang AI4CE 11 0 0 18 Aug 2024
PAFormer: Part Aware Transformer for Person Re-identification Hyeono Jung Jangwon Lee Jiwon Yoo Dami Ko Gyeonghwan Kim ViT 42 1 0 12 Aug 2024
Human-inspired Explanations for Vision Transformers and Convolutional Neural Networks Mahadev Prasad Panda Matteo Tiezzi Martina Vilas Gemma Roig Bjoern M. Eskofier Dario Zanca ViT AAML 39 1 0 04 Aug 2024
Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs Shiping Liu Kecheng Zheng Wei Chen MLLM 49 34 0 31 Jul 2024
MaskInversion: Localized Embeddings via Optimization of Explainability Maps Walid Bousselham Sofian Chaybouti Christian Rupprecht Vittorio Ferrari Hilde Kuehne 80 0 0 29 Jul 2024
Empowering Clinicians with Medical Decision Transformers: A Framework for Sepsis Treatment A. Rahman Pranav Agarwal R. Noumeir P. Jouvet Vincent Michalski Samira Ebrahimi Kahou OffRL 32 0 0 28 Jul 2024
Explanation Regularisation through the Lens of Attributions Pedro Ferreira Wilker Aziz Ivan Titov 46 1 0 23 Jul 2024
FairViT: Fair Vision Transformer via Adaptive Masking Bowei Tian Ruijie Du Yanning Shen 35 1 0 20 Jul 2024
Evaluating the Reliability of Self-Explanations in Large Language Models Korbinian Randl John Pavlopoulos Aron Henriksson Tony Lindgren LRM 46 0 0 19 Jul 2024
Mechanistically Interpreting a Transformer-based 2-SAT Solver: An Axiomatic Approach Nils Palumbo Ravi Mangal Zifan Wang Saranya Vijayakumar Corina S. Pasareanu Somesh Jha 41 1 0 18 Jul 2024
Benchmarking the Attribution Quality of Vision Models Robin Hesse Simone Schaub-Meyer Stefan Roth FAtt 34 3 0 16 Jul 2024
Noise-Free Explanation for Driving Action Prediction Hongbo Zhu Theodor Wulff R. S. Maharjan Jinpei Han Angelo Cangelosi AAML FAtt 38 0 0 08 Jul 2024
Interpreting Pretrained Speech Models for Automatic Speech Assessment of Voice Disorders Hok-Shing Lau Mark Huntly Nathon Morgan Adesua Iyenoma Biao Zeng Tim Bashford 28 0 0 29 Jun 2024
Evaluating Human Alignment and Model Faithfulness of LLM Rationale Mohsen Fayyaz Fan Yin Jiao Sun Nanyun Peng 65 3 0 28 Jun 2024
Predicting Depression and Anxiety Risk in Dutch Neighborhoods from Street-View Images Nin Khodorivsko Giacomo Spigler 24 0 0 27 Jun 2024
Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generation Jirui Qi Gabriele Sarti Raquel Fernández Arianna Bisazza RALM 45 6 0 19 Jun 2024
Is AI fun? HumorDB: a curated dataset and benchmark to investigate graphical humor Veedant Jain Felipe dos Santos Alves Feitosa Gabriel Kreiman VLM 45 2 0 19 Jun 2024
Inpainting the Gaps: A Novel Framework for Evaluating Explanation Methods in Vision Transformers Lokesh Badisa Sumohana S. Channappayya 45 0 0 17 Jun 2024
Duoduo CLIP: Efficient 3D Understanding with Multi-View Images Han-Hung Lee Yiming Zhang Angel X. Chang 3DPC 48 3 0 17 Jun 2024
An Unsupervised Approach to Achieve Supervised-Level Explainability in Healthcare Records Joakim Edin Maria Maistro Lars Maaløe Lasse Borgholt Jakob Drachmann Havtorn Tuukka Ruotsalo FAtt 40 2 0 13 Jun 2024
MambaLRP: Explaining Selective State Space Sequence Models F. Jafari G. Montavon Klaus-Robert Müller Oliver Eberle Mamba 62 9 0 11 Jun 2024
Compositional Video Generation as Flow Equalization Xingyi Yang Xinchao Wang DiffM VGen 61 7 0 10 Jun 2024
Adapting Pretrained ViTs with Convolution Injector for Visuo-Motor Control Dongyoon Hwang ByungKun Lee Hojoon Lee Hyunseung Kim Jaegul Choo 53 0 0 10 Jun 2024
Attribute-Aware Implicit Modality Alignment for Text Attribute Person Search Xin Wang Fangfang Liu Zheng Li Caili Guo 46 1 0 06 Jun 2024
Interpreting the Second-Order Effects of Neurons in CLIP Yossi Gandelsman Alexei A. Efros Jacob Steinhardt MILM 62 16 0 06 Jun 2024
Population Transformer: Learning Population-level Representations of Neural Activity Geeling Chau Christopher Wang Sabera Talukder Vighnesh Subramaniam Saraswati Soedarmadji Yisong Yue Boris Katz Andrei Barbu MedIm 73 0 0 05 Jun 2024