From Speech-to-Speech Translation to Automatic Dubbing

From Speech-to-Speech Translation to Automatic Dubbing

19 January 2020

Marcello Federico

Roberto Barra-Chicote

A. Krishnaswamy

Papers citing "From Speech-to-Speech Translation to Automatic Dubbing"

18 / 18 papers shown

Title
MAVFlow: Preserving Paralinguistic Elements with Conditional Flow Matching for Zero-Shot AV2AV Multilingual Translation Sungwoo Cho J. Choi Sungnyun Kim Se-Young Yun 63 0 0 14 Mar 2025
IsoChronoMeter: A simple and effective isochronic translation evaluation metric Nikolai Rozanov Vikentiy Pankov Dmitrii Mukhutdinov Dima Vypirailenko 30 1 0 14 Oct 2024
GenerTTS: Pronunciation Disentanglement for Timbre and Style Generalization in Cross-Lingual Text-to-Speech Yahuan Cong Haoyu Zhang Hao-Ping Lin Shichao Liu Chunfeng Wang Yi Ren Xiang Yin Zejun Ma 25 1 0 27 Jun 2023
Efficient Spoken Language Recognition via Multilabel Classification Oriol Nieto Zeyu Jin Franck Dernoncourt Justin Salamon 11 1 0 02 Jun 2023
Improving Isochronous Machine Translation with Target Factors and Auxiliary Counters Proyag Pal Brian Thompson Yogesh Virkar Prashant Mathur Alexandra Chronopoulou Marcello Federico 30 4 0 22 May 2023
Joint Multi-scale Cross-lingual Speaking Style Transfer with Bidirectional Attention Mechanism for Automatic Dubbing Jingbei Li Sipan Li Ping Chen Lu Zhang Yi Meng Zhiyong Wu H. Meng Qiao Tian Yuping Wang Yuxuan Wang 35 3 0 09 May 2023
Evaluating the Efficacy of Length-Controllable Machine Translation Hao Cheng Meng Zhang Weixuan Wang Liangyou Li Qun Liu Zhihua Zhang 32 0 0 03 May 2023
Looking Similar, Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learning Nikhil Singh Chih-Wei Wu Iroro Orife Mahdi M. Kalayeh 23 2 0 12 Apr 2023
Jointly Optimizing Translations and Speech Timing to Improve Isochrony in Automatic Dubbing Alexandra Chronopoulou Brian Thompson Prashant Mathur Yogesh Virkar Surafel Melaku Lakew Marcello Federico 26 7 0 25 Feb 2023
Dubbing in Practice: A Large Scale Study of Human Localization With Insights for Automatic Dubbing William Brannon Yogesh Virkar Brian Thompson 42 21 0 23 Dec 2022
VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing Yihan Wu Junliang Guo Xuejiao Tan Chen Zhang Bohan Li Ruihua Song Lei He Sheng Zhao Arul Menezes Jiang Bian 26 15 0 30 Nov 2022
Technology Pipeline for Large Scale Cross-Lingual Dubbing of Lecture Videos into Multiple Indian Languages Anusha Prakash Arun Kumar Ashish Seth Bhagyashree Mukherjee Ishika Gupta ... D. Sharma H. Murthy P. Bhattacharya S. Umesh R. Sangal 38 4 0 01 Nov 2022
Prosodic Alignment for off-screen automatic dubbing Yogesh Virkar Marcello Federico Robert Enyedi Roberto Barra-Chicote 22 9 0 06 Apr 2022
Isometric MT: Neural Machine Translation for Automatic Dubbing Surafel Melaku Lakew Yogesh Virkar Prashant Mathur Marcello Federico 11 22 0 16 Dec 2021
Isochrony-Aware Neural Machine Translation for Automatic Dubbing Derek Tam Surafel Melaku Lakew Yogesh Virkar Prashant Mathur Marcello Federico 14 8 0 16 Dec 2021
Machine Translation Verbosity Control for Automatic Dubbing Surafel Melaku Lakew Marcello Federico Yue Wang Cuong Hoang Yogesh Virkar Roberto Barra-Chicote Robert Enyedi 19 21 0 08 Oct 2021
AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languages Machel Reid Junjie Hu Graham Neubig Y. Matsuo 68 31 0 10 Sep 2021
Speech Translation and the End-to-End Promise: Taking Stock of Where We Are Matthias Sperber Matthias Paulik 30 106 0 14 Apr 2020