Knowledge Distillation for Small-footprint Highway Networks

2 August 2016

Papers citing "Knowledge Distillation for Small-footprint Highway Networks"

11 / 11 papers shown

Title
Inter-KD: Intermediate Knowledge Distillation for CTC-Based Automatic Speech Recognition J. Yoon Beom Jun Woo Sunghwan Ahn Hyeon Seung Lee N. Kim VLM 20 9 0 28 Nov 2022
Low-resource Low-footprint Wake-word Detection using Knowledge Distillation Arindam Ghosh Mark C. Fuhs Deblin Bagchi Bahman Farahani Monika Woszczyna VLM 26 3 0 06 Jul 2022
Oracle Teacher: Leveraging Target Information for Better Knowledge Distillation of CTC Models J. Yoon H. Kim Hyeon Seung Lee Sunghwan Ahn N. Kim 36 1 0 05 Nov 2021
Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification Li Zhang Qing Wang Kong Aik Lee Lei Xie Haizhou Li 25 13 0 17 Jun 2021
Knowledge Distillation as Semiparametric Inference Tri Dao G. Kamath Vasilis Syrgkanis Lester W. Mackey 40 31 0 20 Apr 2021
Streaming Transformer ASR with Blockwise Synchronous Beam Search E. Tsunoo Yosuke Kashiwagi Shinji Watanabe 22 11 0 25 Jun 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 19 2,843 0 09 Jun 2020
Patient Knowledge Distillation for BERT Model Compression S. Sun Yu Cheng Zhe Gan Jingjing Liu 51 828 0 25 Aug 2019
Sub-band Convolutional Neural Networks for Small-footprint Spoken Term Classification Chieh-Chi Kao Ming Sun Yixin Gao S. Vitaladevuni Chao Wang 21 13 0 02 Jul 2019
Conditional Teacher-Student Learning Zhong Meng Jinyu Li Yong Zhao Jiawei Liu 22 90 0 28 Apr 2019
Small-footprint Highway Deep Neural Networks for Speech Recognition Liang Lu Steve Renals 30 15 0 18 Oct 2016