The Topological BERT: Transforming Attention into Topology for Natural Language Processing

30 June 2022

Papers citing "The Topological BERT: Transforming Attention into Topology for Natural Language Processing"

12 / 12 papers shown

Title
SEVEN: Pruning Transformer Model by Reserving Sentinels Jinying Xiao Ping Li Jie Nie Zhe Tang 23 3 0 19 Mar 2024
Position: Topological Deep Learning is the New Frontier for Relational Learning Theodore Papamarkou Tolga Birdal Michael M. Bronstein Gunnar Carlsson Justin Curry ... Petar Velickovic Bei Wang Yusu Wang Guo-Wei Wei Ghada Zamzmi AI4CE 42 25 0 14 Feb 2024
Detecting out-of-distribution text using topological features of transformer-based language models Andres Pollano Anupam Chaudhuri Anj Simmons 13 0 0 22 Nov 2023
TOPFORMER: Topology-Aware Authorship Attribution of Deepfake Texts with Diverse Writing Styles Adaku Uchendu Thai Le Dongwon Lee DeLMO 24 3 0 22 Sep 2023
A Novel Ehanced Move Recognition Algorithm Based on Pre-trained Models with Positional Embeddings H. Wen Jie Wang Xiaodong Qiao 13 0 0 14 Aug 2023
DeepCuts: Single-Shot Interpretability based Pruning for BERT Jasdeep Singh Grover Bhavesh Gawri R. Manku 17 1 0 27 Dec 2022
Topological Data Analysis for Speech Processing Eduard Tulchinskii Kristian Kuznetsov Laida Kushnareva D. Cherniavskii S. Barannikov Irina Piontkovskaya Sergey I. Nikolenko Evgeny Burnaev 28 5 0 30 Nov 2022
miCSE: Mutual Information Contrastive Learning for Low-shot Sentence Embeddings T. Klein Moin Nabi SSL 8 14 0 09 Nov 2022
Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspective Adaku Uchendu Thai Le Dongwon Lee DeLMO 16 40 0 19 Oct 2022
Acceptability Judgements via Examining the Topology of Attention Maps D. Cherniavskii Eduard Tulchinskii Vladislav Mikhailov Irina Proskurina Laida Kushnareva Ekaterina Artemova S. Barannikov Irina Piontkovskaya D. Piontkovski Evgeny Burnaev 761 19 0 19 May 2022
Artificial Text Detection via Examining the Topology of Attention Maps Laida Kushnareva D. Cherniavskii Vladislav Mikhailov Ekaterina Artemova S. Barannikov A. Bernstein Irina Piontkovskaya D. Piontkovski Evgeny Burnaev 31 48 0 10 Sep 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018