Homophone Disambiguation Reveals Patterns of Context Mixing in Speech Transformers

15 October 2023

Papers citing "Homophone Disambiguation Reveals Patterns of Context Mixing in Speech Transformers"

9 / 9 papers shown

Title
Mechanistic? Naomi Saphra Sarah Wiegreffe AI4CE 11 9 0 07 Oct 2024
How Language Models Prioritize Contextual Grammatical Cues? Hamidreza Amirzadeh A. Alishahi Hosein Mohebbi 16 0 0 04 Oct 2024
Human-like Linguistic Biases in Neural Speech Models: Phonetic Categorization and Phonotactic Constraints in Wav2Vec2.0 Marianne de Heer Kloots Willem H. Zuidema 22 1 0 03 Jul 2024
Self-Supervised Speech Representations are More Phonetic than Semantic Kwanghee Choi Ankita Pasad Tomohiko Nakamura Satoru Fukayama Karen Livescu Shinji Watanabe 21 14 0 12 Jun 2024
Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps Giuseppe Attanasio Beatrice Savoldi Dennis Fucci Dirk Hovy 18 2 0 28 Feb 2024
Computational modeling of semantic change Nina Tahmasebi Haim Dubossarsky 26 6 0 13 Apr 2023
Quantifying Context Mixing in Transformers Hosein Mohebbi Willem H. Zuidema Grzegorz Chrupała A. Alishahi 164 24 0 30 Jan 2023
Analysis of Self-Attention Head Diversity for Conformer-based Automatic Speech Recognition Kartik Audhkhasi Yinghui Huang Bhuvana Ramabhadran Pedro J. Moreno 11 3 0 13 Sep 2022
Incorporating Residual and Normalization Layers into Analysis of Masked Language Models Goro Kobayashi Tatsuki Kuribayashi Sho Yokoi Kentaro Inui 153 45 0 15 Sep 2021