Uncertainty Estimation of Transformers' Predictions via Topological
Analysis of the Attention Matrices

Uncertainty Estimation of Transformers' Predictions via Topological Analysis of the Attention Matrices

22 August 2023

Elizaveta Kostenok

D. Cherniavskii

Alexey Zaytsev

Papers citing "Uncertainty Estimation of Transformers' Predictions via Topological Analysis of the Attention Matrices"

9 / 9 papers shown

Title
Hallucination Detection in LLMs via Topological Divergence on Attention Graphs Alexandra Bazarova Aleksandr Yugay Andrey Shulga A. Ermilova Andrei Volodichev ... Dmitry Simakov M. Savchenko Andrey Savchenko Serguei Barannikov Alexey Zaytsev HILM 21 0 0 14 Apr 2025
Expert-aware uncertainty estimation for quality control of neural-based blood typing E.E. Zaychenkova Dmitrii Iarchuk S.A. Korchagin Alexey Zaitsev Egor Ershov 39 0 0 15 Jul 2024
Mapping the Multiverse of Latent Representations Jeremy Wayland Corinna Coupette Bastian Alexander Rieck 48 7 0 02 Feb 2024
Correcting sampling biases via importance reweighting for spatial modeling Boris Prokhorov Diana Koldasbayeva Alexey Zaytsev 11 0 0 09 Sep 2023
Acceptability Judgements via Examining the Topology of Attention Maps D. Cherniavskii Eduard Tulchinskii Vladislav Mikhailov Irina Proskurina Laida Kushnareva Ekaterina Artemova S. Barannikov Irina Piontkovskaya D. Piontkovski Evgeny Burnaev 764 19 0 19 May 2022
Artificial Text Detection via Examining the Topology of Attention Maps Laida Kushnareva D. Cherniavskii Vladislav Mikhailov Ekaterina Artemova S. Barannikov A. Bernstein Irina Piontkovskaya D. Piontkovski Evgeny Burnaev 31 48 0 10 Sep 2021
Gradient-based Adversarial Attacks against Text Transformers Chuan Guo Alexandre Sablayrolles Hervé Jégou Douwe Kiela SILM 98 225 0 15 Apr 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 268 5,635 0 05 Dec 2016
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 247 9,042 0 06 Jun 2015