Contextual Adapters for Personalized Speech Recognition in Neural Transducers

26 May 2022

Kanthashree Mysore Sathyendra

Athanasios Mouchtaris

Siegfried Kunzmann

ArXiv PDF HTML

Papers citing "Contextual Adapters for Personalized Speech Recognition in Neural Transducers"

47 / 47 papers shown

Title
Optimizing Contextual Speech Recognition Using Vector Quantization for Efficient Retrieval Nikolaos Flemotomos Roger Hsiao P. Swietojanski Takaaki Hori Dogan Can Xiaodan Zhuang 44 0 0 01 Nov 2024
Efficient Long-Form Speech Recognition for General Speech In-Context Learning Hao Yen Shaoshi Ling Guoli Ye 21 0 0 29 Sep 2024
An Efficient Self-Learning Framework For Interactive Spoken Dialog Systems Hitesh Tulsiani David M. Chan Shalini Ghosh Garima Lalwani Prabhat Pandey Ankish Bansal Sri Garimella Ariya Rastrow Björn Hoffmeister 31 0 0 16 Sep 2024
An Effective Context-Balanced Adaptation Approach for Long-Tailed Speech Recognition Yi-Cheng Wang Li-Ting Pai Bi-Cheng Yan Hsin-Wei Wang Chi-Han Lin Berlin Chen 25 1 0 10 Sep 2024
Improving Neural Biasing for Contextual Speech Recognition by Early Context Injection and Text Perturbation Ruizhe Huang M. Yarmohammadi Sanjeev Khudanpur Dan Povey 33 2 0 14 Jul 2024
Leveraging Parameter-Efficient Transfer Learning for Multi-Lingual Text-to-Speech Adaptation Yingting Li Ambuj Mehrish Bryan Chew Bo Cheng Soujanya Poria 38 0 0 25 Jun 2024
Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss Muhammad Shakeel Yui Sudo Yifan Peng Shinji Watanabe AI4CE 29 2 0 23 Jun 2024
Multi-Modal Retrieval For Large Language Model Based Speech Recognition J. Kolehmainen Aditya Gourav Prashanth Gurunath Shivakumar Yile Gu Ankur Gandhe Ariya Rastrow Grant P. Strimel I. Bulyko 38 4 0 13 Jun 2024
Keyword-Guided Adaptation of Automatic Speech Recognition Aviv Shamsian Aviv Navon Neta Glazer Gill Hetz Joseph Keshet 33 1 0 04 Jun 2024
Deferred NAM: Low-latency Top-K Context Injection via Deferred Context Encoding for Non-Streaming ASR Zelin Wu Gan Song Christopher Li Pat Rondon Zhong Meng ... D. Caseiro Golan Pundak Tsendsuren Munkhdalai Angad Chandorkar Rohit Prabhavalkar 18 3 0 15 Apr 2024
DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognition Yi-Cheng Wang Hsin-Wei Wang Bi-Cheng Yan Chi-Han Lin Berlin Chen 29 1 0 26 Mar 2024
Exploration of Adapter for Noise Robust Automatic Speech Recognition Hao Shi Tatsuya Kawahara 35 5 0 28 Feb 2024
Self-consistent context aware conformer transducer for speech recognition Konstantin Kolokolov Pavel Pekichev Karthik Raghunathan 22 0 0 09 Feb 2024
Locality enhanced dynamic biasing and sampling strategies for contextual ASR Md. Asif Jalal Pablo Peso Parada George Pavlidis Vasileios Moschopoulos Karthikeyan P. Saravanan ... Jisi Zhang Anastasios Drosou Gil Ho Lee Jungin Lee Seokyeong Jung 24 2 0 23 Jan 2024
Improving ASR Contextual Biasing with Guided Attention Jiyang Tang Kwangyoun Kim Suwon Shon Felix Wu Prashant Sridhar Shinji Watanabe 19 8 0 16 Jan 2024
Promptformer: Prompted Conformer Transducer for ASR Sergio Duarte Torres Arunasish Sen Aman Rana Lukas Drude Alejandro Gomez-Alanis Andreas Schwarz Leif Rädel Volker Leutnant 32 3 0 14 Jan 2024
Task Oriented Dialogue as a Catalyst for Self-Supervised Automatic Speech Recognition David M. Chan Shalini Ghosh Hitesh Tulsiani Ariya Rastrow Björn Hoffmeister 28 1 0 04 Jan 2024
Phoneme-aware Encoding for Prefix-tree-based Contextual ASR Hayato Futami E. Tsunoo Yosuke Kashiwagi Hiroaki Ogawa Siddhant Arora Shinji Watanabe 18 5 0 15 Dec 2023
Improving Large-scale Deep Biasing with Phoneme Features and Text-only Data in Streaming Transducer Jin Qiu Lu Huang Boyu Li Jun Zhang Lu Lu Zejun Ma 21 3 0 15 Nov 2023
Retrieve and Copy: Scaling ASR Personalization to Large Catalogs Sai Muralidhar Jayanthi Devang Kulshreshtha Saket Dingliwal S. Ronanki S. Bodapati 30 7 0 14 Nov 2023
Cascaded Multi-task Adaptive Learning Based on Neural Architecture Search Yingying Gao Shilei Zhang Zihao Cui Chao Deng Junlan Feng 15 0 0 23 Oct 2023
Spike-Triggered Contextual Biasing for End-to-End Mandarin Speech Recognition Kaixun Huang Aoting Zhang Binbin Zhang Tianyi Xu Xingchen Song Lei Xie 16 3 0 07 Oct 2023
Wiki-En-ASR-Adapt: Large-scale synthetic dataset for English ASR Customization Alexandra Antonova 33 0 0 29 Sep 2023
End-to-End Speech Recognition Contextualization with Large Language Models Egor Lakomkin Chunyang Wu Yassir Fathullah Ozlem Kalinli M. Seltzer Christian Fuegen 55 17 0 19 Sep 2023
A Multitask Training Approach to Enhance Whisper with Contextual Biasing and Open-Vocabulary Keyword Spotting Yuang Li Min Zhang Chang Su Yinglu Li Xiaosong Qiao Mengxin Ren Miaomiao Ma Daimeng Wei Shimin Tao Hao-Yu Yang 22 5 0 18 Sep 2023
Incorporating Class-based Language Model for Named Entity Recognition in Factorized Neural Transducer Peng Wang Yifan Yang Zheng Liang Tian Tan Shiliang Zhang Xie Chen 15 0 0 14 Sep 2023
SeACo-Paraformer: A Non-Autoregressive ASR System with Flexible and Effective Hotword Customization Ability Xian Shi Yexin Yang Zerui Li Yanni Chen Zhifu Gao Shiliang Zhang 19 11 0 07 Aug 2023
Zero-shot Domain-sensitive Speech Recognition with Prompt-conditioning Fine-tuning F. Liao Yung-Chieh Chan Yi-Chang Chen Chan-Jan Hsu Da-shan Shiu 32 6 0 18 Jul 2023
Leveraging Pretrained ASR Encoders for Effective and Efficient End-to-End Speech Intent Classification and Slot Filling Hengguan Huang Jagadeesh Balam Boris Ginsburg 16 4 0 13 Jul 2023
Personalization for BERT-based Discriminative Speech Recognition Rescoring J. Kolehmainen Yile Gu Aditya Gourav Prashanth Gurunath Shivakumar Ankur Gandhe Ariya Rastrow I. Bulyko 30 2 0 13 Jul 2023
Multilingual Contextual Adapters To Improve Custom Word Recognition In Low-resource Languages Devang Kulshreshtha Saket Dingliwal Brady C. Houston S. Bodapati 12 2 0 03 Jul 2023
Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentation Zheng Liang Zheshu Song Ziyang Ma Chenpeng Du K. Yu Xie Chen 30 5 0 14 Jun 2023
Streaming Speech-to-Confusion Network Speech Recognition Denis Filimonov Prabhat Pandey Ariya Rastrow Ankur Gandhe A. Stolcke HAI 16 0 0 02 Jun 2023
Retraining-free Customized ASR for Enharmonic Words Based on a Named-Entity-Aware Model and Phoneme Similarity Estimation Yui Sudo K. Hata K. Nakadai 23 2 0 29 May 2023
CopyNE: Better Contextual ASR by Copying Named Entities Shilin Zhou Zhenghua Li Yu Hong M. Zhang Zhefeng Wang Baoxing Huai 15 5 0 22 May 2023
Robust Acoustic and Semantic Contextual Biasing in Neural Transducers for Speech Recognition Xuandi Fu Kanthashree Mysore Sathyendra Ankur Gandhe Jing Liu Grant P. Strimel Ross McGowan Athanasios Mouchtaris 25 14 0 09 May 2023
CB-Conformer: Contextual biasing Conformer for biased word recognition Yaoxun Xu Baiji Liu Qiaochu Huang and Xingcheng Song Zhiyong Wu Shiyin Kang H. Meng 60 14 0 19 Apr 2023
Approximate Nearest Neighbour Phrase Mining for Contextual Speech Recognition Maurits J. R. Bleeker P. Swietojanski Stefan Braun Xiaodan Zhuang 39 8 0 18 Apr 2023
Dual-Attention Neural Transducers for Efficient Wake Word Spotting in Speech Recognition Saumya Yashmohini Sahai Jing Liu Thejaswi Muniyappa Kanthashree Mysore Sathyendra Anastasios Alexandridis ... Ross McGowan Ariya Rastrow Feng-Ju Chang Athanasios Mouchtaris Siegfried Kunzmann 33 5 0 03 Apr 2023
Dialog act guided contextual adapter for personalized speech recognition Feng-Ju Chang Thejaswi Muniyappa Kanthashree Mysore Sathyendra Kailin Wei Grant P. Strimel Ross McGowan 11 4 0 31 Mar 2023
PROCTER: PROnunciation-aware ConTextual adaptER for personalized speech recognition in neural transducers R. Pandey Roger Ren Qi Luo Jing Liu Ariya Rastrow Ankur Gandhe Denis Filimonov Grant P. Strimel A. Stolcke I. Bulyko 25 13 0 30 Mar 2023
Adaptive Endpointing with Deep Contextual Multi-armed Bandits Do June Min A. Stolcke A. Raju Colin Vaz Di He Venkatesh Ravichandran V. Trinh OffRL 27 0 0 23 Mar 2023
On-the-fly Text Retrieval for End-to-End ASR Adaptation Bolaji Yusuf Aditya Gourav Ankur Gandhe I. Bulyko KELM RALM 32 4 0 20 Mar 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić E. Ponti MoMe OOD 26 73 0 22 Feb 2023
Using External Off-Policy Speech-To-Text Mappings in Contextual End-To-End Automated Speech Recognition David M. Chan Shalini Ghosh Ariya Rastrow Björn Hoffmeister OffRL 18 6 0 06 Jan 2023
Towards Personalization of CTC Speech Recognition Models with Contextual Adapters and Adaptive Boosting Saket Dingliwal Monica Sunkara S. Bodapati S. Ronanki Jeffrey J. Farris Katrin Kirchhoff 25 0 0 18 Oct 2022
Damage Control During Domain Adaptation for Transducer Based Automatic Speech Recognition Somshubra Majumdar Shantanu Acharya Vitaly Lavrukhin Boris Ginsburg 19 3 0 06 Oct 2022