Reducing Language confusion for Code-switching Speech Recognition with
Token-level Language Diarization

Reducing Language confusion for Code-switching Speech Recognition with Token-level Language Diarization

26 October 2022

Leibny Paola García

Andy W. H. Khong

Sanjeev Khudanpur

Papers citing "Reducing Language confusion for Code-switching Speech Recognition with Token-level Language Diarization"

16 / 16 papers shown

Title
Adapting Whisper for Code-Switching through Encoding Refining and Language-Aware Decoding Jiahui Zhao Hao Shi Chenrui Cui Tianrui Wang Hexin Liu Zhaoheng Ni Lingxuan Ye Longbiao Wang 72 0 0 21 Dec 2024
Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injection Tzu-Ting Yang Hsin-Wei Wang Yi-Cheng Wang Berlin Chen 78 0 0 26 Nov 2024
Romanization Encoding For Multilingual ASR Wen Ding Fei Jia Hainan Xu Yu Xi Junjie Lai Boris Ginsburg 29 0 0 05 Jul 2024
SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR Shuaishuai Ye Shunfei Chen Xinhui Hu Xinkang Xu MoE 27 3 0 26 Jun 2024
The Second DISPLACE Challenge : DIarization of SPeaker and LAnguage in Conversational Environments Shareef Babu Kalluri Prachi Singh Pratik Roy Chowdhuri Apoorva Kulkarni Shikha Baghel ... Swapnil Sontakke D. K T S. R. M. Prasanna Deepu Vijayasenan Sriram Ganapathy 29 3 0 13 Jun 2024
Mamba in Speech: Towards an Alternative to Self-Attention Xiangyu Zhang Qiquan Zhang Hexin Liu Tianyi Xiao Xinyuan Qian Beena Ahmed E. Ambikairajah Haizhou Li Julien Epps Mamba 54 36 0 21 May 2024
An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglement Tzu-Ting Yang Hsin-Wei Wang Yi-Cheng Wang Chi-Han Lin Berlin Chen 32 6 0 27 Feb 2024
It's Never Too Late: Fusing Acoustic Information into Large Language Models for Automatic Speech Recognition Chen Chen Ruizhe Li Yuchen Hu Sabato Marco Siniscalchi Pin-Yu Chen Ensiong Chng Chao-Han Huck Yang 28 19 0 08 Feb 2024
Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak Supervision Chih-Kai Yang Kuan-Po Huang Ke-Han Lu Chun-Yi Kuan Chi-Yuan Hsiao Hung-yi Lee 48 7 0 30 Dec 2023
Leveraging Language ID to Calculate Intermediate CTC Loss for Enhanced Code-Switching Speech Recognition Tzu-Ting Yang Hsin-Wei Wang Berlin Chen 32 0 0 15 Dec 2023
Summary of the DISPLACE Challenge 2023 - DIarization of SPeaker and LAnguage in Conversational Environments Shikha Baghel Shreyas Ramoji Somil Jain Pratik Roy Chowdhuri Prachi Singh Deepu Vijayasenan Sriram Ganapathy 19 6 0 21 Nov 2023
Generative error correction for code-switching speech recognition using large language models Chen Chen Yuchen Hu Chao-Han Huck Yang Hexin Liu Sabato Marco Siniscalchi Chng Eng Siong 29 8 0 17 Oct 2023
Zero Resource Code-switched Speech Benchmark Using Speech Utterance Pairs For Multiple Spoken Languages Kuan-Po Huang Chih-Kai Yang Yu-Kuan Fu Ewan Dunbar Hung-yi Lee 29 5 0 04 Oct 2023
Enhancing Code-switching Speech Recognition with Interactive Language Biases Hexin Liu Leibny Paola García Jingze Lu Wenchao Wang Sanjeev Khudanpur 16 11 0 29 Sep 2023
LAE-ST-MoE: Boosted Language-Aware Encoder Using Speech Translation Auxiliary Task for E2E Code-switching ASR Guodong Ma Wenxuan Wang Yuke Li Yuting Yang Binbin Du Haoran Fu 23 5 0 28 Sep 2023
DISPLACE Challenge: DIarization of SPeaker and LAnguage in Conversational Environments Shikha Baghel Shreyas Ramoji Sidharth Sidharth Ranjana H Prachi Singh ... Pratik Roy Chowdhuri Kaustubh Kulkarni Swapnil Padhi Deepu Vijayasenan Sriram Ganapathy 27 8 0 01 Mar 2023