Improving CTC-based speech recognition via knowledge transferring from
pre-trained language models

Improving CTC-based speech recognition via knowledge transferring from pre-trained language models

22 February 2022

Pengyuan Zhang

ArXiv (abs)PDF HTML

Papers citing "Improving CTC-based speech recognition via knowledge transferring from pre-trained language models"

7 / 7 papers shown

Title
Cross-modal Alignment with Optimal Transport for CTC-based ASR Xugang Lu Peng Shen Yu Tsao Hisashi Kawai 89 6 0 24 Sep 2023
Research on an improved Conformer end-to-end Speech Recognition Model with R-Drop Structure Weidong Ji Shijie Zan Guohui Zhou Xu Wang SyDa 49 1 0 14 Jun 2023
Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation Minglun Han Feilong Chen Jing Shi Shuang Xu Bo Xu VLM 83 13 0 30 Jan 2023
Speech-text based multi-modal training with bidirectional attention for improved speech recognition Yuhang Yang Haihua Xu Hao-Ming Huang Eng Siong Chng Sheng Li 93 7 0 01 Nov 2022
A context-aware knowledge transferring strategy for CTC-based ASR Keda Lu Kuan-Yu Chen 56 16 0 12 Oct 2022
Improving Streaming End-to-End ASR on Transformer-based Causal Models with Encoder States Revision Strategies Zehan Li Haoran Miao Keqi Deng Gaofeng Cheng Sanli Tian Ta Li Yonghong Yan KELM 66 4 0 06 Jul 2022
WaBERT: A Low-resource End-to-end Model for Spoken Language Understanding and Speech-to-BERT Alignment Lin Yao Jianfei Song Rui Xu Yingfang Yang Zijian Chen Yafeng Deng VLM 104 2 0 22 Apr 2022