Streaming Simultaneous Speech Translation with Augmented Memory Transformer

30 October 2020

Papers citing "Streaming Simultaneous Speech Translation with Augmented Memory Transformer"

23 / 23 papers shown

Title
Joint Training And Decoding for Multilingual End-to-End Simultaneous Speech Translation Wuwei Huang Renren Jin Wen Zhang Jian Luan Bin Wang Deyi Xiong 69 1 0 14 Mar 2025
High-Fidelity Simultaneous Speech-To-Speech Translation Tom Labiausse Laurent Mazaré Edouard Grave P. Pérez Alexandre Défossez Neil Zeghidour 257 0 0 05 Feb 2025
CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation Rui Zhao Jinyu Li Ruchao Fan Matt Post 41 1 0 07 Oct 2024
FASST: Fast LLM-based Simultaneous Speech Translation Siqi Ouyang Xi Xu Chinmay Dandekar Lei Li 33 3 0 18 Aug 2024
StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection Sara Papi Marco Gaido Matteo Negri L. Bentivogli 81 4 0 10 Jun 2024
Modeling Real-Time Interactive Conversations as Timed Diarized Transcripts Garrett Tanzer Gustaf Ahdritz Luke Melas-Kyriazi 26 1 0 21 May 2024
Long-form Simultaneous Speech Translation: Thesis Proposal Peter Polák 3DV 47 3 0 17 Oct 2023
BASS: Block-wise Adaptation for Speech Summarization Roshan S. Sharma Kenneth Zheng Siddhant Arora Shinji Watanabe Rita Singh Bhiksha Raj 37 7 0 17 Jul 2023
Implicit Memory Transformer for Computationally Efficient Simultaneous Speech Translation Matthew Raffel Lizhong Chen 9 5 0 03 Jul 2023
Shiftable Context: Addressing Training-Inference Context Mismatch in Simultaneous Speech Translation Matthew Raffel Drew Penney Lizhong Chen 24 3 0 03 Jul 2023
End-to-End Simultaneous Speech Translation with Differentiable Segmentation Shaolei Zhang Yang Feng 35 17 0 25 May 2023
Attention as a Guide for Simultaneous Speech Translation Sara Papi Matteo Negri Marco Turchi 28 30 0 15 Dec 2022
A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability Jian Xue Peidong Wang Jinyu Li Eric Sun 32 10 0 04 Nov 2022
Blockwise Streaming Transformer for Spoken Language Understanding and Simultaneous Speech Translation Keqi Deng Shinji Watanabe Jiatong Shi Siddhant Arora 33 15 0 19 Apr 2022
Large-Scale Streaming End-to-End Speech Translation with Neural Transducers Jian Xue Peidong Wang Jinyu Li Matt Post Yashesh Gaur AI4TS 32 26 0 11 Apr 2022
Does Simultaneous Speech Translation need Simultaneous Models? Sara Papi Marco Gaido Matteo Negri Marco Turchi 46 26 0 08 Apr 2022
Exploring Continuous Integrate-and-Fire for Adaptive Simultaneous Speech Translation Chih-Chiang Chang Hung-yi Lee 32 13 0 22 Mar 2022
Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attention Xutai Ma Hongyu Gong Danni Liu Ann Lee Yun Tang Peng-Jen Chen Wei-Ning Hsu P. Koehn J. Pino 62 8 0 15 Oct 2021
StreaMulT: Streaming Multimodal Transformer for Heterogeneous and Arbitrary Long Sequential Data Victor Pellegrain Myriam Tami M. Batteux C´eline Hudelot AI4TS 28 2 0 15 Oct 2021
Learning When to Translate for Streaming Speech Qianqian Dong Yaoming Zhu Mingxuan Wang Lei Li 52 30 0 15 Sep 2021
Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR Junkun Chen Mingbo Ma Renjie Zheng Liang Huang 31 31 0 11 Jun 2021
RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer Xingshan Zeng Liangyou Li Qun Liu 25 45 0 09 Jun 2021
Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems Yanjie Gou Yinjie Lei Lingqiao Liu Yong Dai Chunxu Shen 16 17 0 12 Oct 2020