uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimes

uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimes

1 July 2024

Bhiksha Raj

Muhammad Abdul-Mageed

Papers citing "uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimes"

4 / 4 papers shown

Title
Scaling Speech Technology to 1,000+ Languages Vineel Pratap Andros Tjandra Bowen Shi Paden Tomasello Arun Babu ... Yossi Adi Xiaohui Zhang Wei-Ning Hsu Alexis Conneau Michael Auli VLM 73 297 0 22 May 2023
FLEURS: Few-shot Learning Evaluation of Universal Representations of Speech Alexis Conneau Min Ma Simran Khanuja Yu Zhang Vera Axelrod Siddharth Dalmia Jason Riesa Clara E. Rivera Ankur Bapna VLM 78 281 0 25 May 2022
ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic Muhammad Abdul-Mageed AbdelRahim Elmadany El Moatez Billah Nagoudi VLM 60 444 0 27 Dec 2020
Improving Streaming Automatic Speech Recognition With Non-Streaming Model Distillation On Unsupervised Data Thibault Doutre Wei Han Min Ma Zhiyun Lu Chung-Cheng Chiu Ruoming Pang A. Narayanan Ananya Misra Yu Zhang Liangliang Cao 52 22 0 22 Oct 2020