Does Simultaneous Speech Translation need Simultaneous Models?

Does Simultaneous Speech Translation need Simultaneous Models?

8 April 2022

Papers citing "Does Simultaneous Speech Translation need Simultaneous Models?"

19 / 19 papers shown

Title
PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation Libo Zhao Jing Li Ziqian Zeng 19 1 0 05 Oct 2024
NAIST Simultaneous Speech Translation System for IWSLT 2024 Yuka Ko Ryo Fukuda Yuta Nishikawa Yasumasa Kano Tomoya Yanagita ... Haotian Tan Makoto Sakai S. Sakti Katsuhito Sudoh Satoshi Nakamura 25 1 0 30 Jun 2024
SimulSeamless: FBK at IWSLT 2024 Simultaneous Speech Translation Sara Papi Marco Gaido Matteo Negri L. Bentivogli 48 2 0 20 Jun 2024
Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection Haoyu Wang Guoqiang Hu Guodong Lin Wei-Qiang Zhang Jian Li 22 1 0 14 Jun 2024
StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection Sara Papi Marco Gaido Matteo Negri L. Bentivogli 46 3 0 10 Jun 2024
Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translation Keqi Deng Philip C. Woodland 23 4 0 06 Jun 2024
Simultaneous Masking, Not Prompting Optimization: A Paradigm Shift in Fine-tuning LLMs for Simultaneous Translation Matthew Raffel Victor Agostinelli Lizhong Chen 36 5 0 16 May 2024
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? Marco Gaido Sara Papi Matteo Negri L. Bentivogli 41 11 0 19 Feb 2024
Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023 Sara Papi Marco Gaido Matteo Negri 33 7 0 27 Sep 2023
Simultaneous Machine Translation with Large Language Models Minghan Wang Jinming Zhao Thuy-Trang Vu Fatemeh Shiri Ehsan Shareghi Gholamreza Haffari 27 2 0 13 Sep 2023
Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models Liam Dugan Anshul Wadhawan Kyle Spence Chris Callison-Burch Morgan McGuire Victor Zordan OffRL 17 2 0 01 Jun 2023
AlignAtt: Using Attention-based Audio-Translation Alignments as a Guide for Simultaneous Speech Translation Sara Papi Marco Turchi Matteo Negri 11 19 0 19 May 2023
Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference Biao Fu Minpeng Liao Kai Fan Zhongqiang Huang Boxing Chen Yidong Chen Xiaodon Shi 41 8 0 14 Mar 2023
Attention as a Guide for Simultaneous Speech Translation Sara Papi Matteo Negri Marco Turchi 19 30 0 15 Dec 2022
Joint Speech Translation and Named Entity Recognition Marco Gaido Sara Papi Matteo Negri Marco Turchi 25 3 0 21 Oct 2022
Over-Generation Cannot Be Rewarded: Length-Adaptive Average Lagging for Simultaneous Speech Translation Sara Papi Marco Gaido Matteo Negri Marco Turchi 26 46 0 12 Jun 2022
Efficient yet Competitive Speech Translation: FBK@IWSLT2022 Marco Gaido Sara Papi Dennis Fucci G. Fiameni Matteo Negri Marco Turchi 18 19 0 05 May 2022
Speechformer: Reducing Information Loss in Direct Speech Translation Sara Papi Marco Gaido Matteo Negri Marco Turchi 49 23 0 09 Sep 2021
Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoring H. Inaguma Yosuke Higuchi Kevin Duh Tatsuya Kawahara Shinji Watanabe 38 11 0 09 Sep 2021