A Call for Clarity in Reporting BLEU Scores

23 April 2018

Papers citing "A Call for Clarity in Reporting BLEU Scores"

50 / 634 papers shown

Title
Tagged End-to-End Simultaneous Speech Translation Training using Simultaneous Interpretation Data Yuka Ko Ryo Fukuda Yuta Nishikawa Yasumasa Kano Katsuhito Sudoh Satoshi Nakamura 29 6 0 14 Jun 2023
KIT's Multilingual Speech Translation System for IWSLT 2023 Danni Liu Thai-Binh Nguyen Sai Koneru Enes Yavuz Ugan Ngoc-Quan Pham Tuan-Nam Nguyen Tu Anh Dinh Carlos Mullov A. Waibel Jan Niehues 28 7 0 08 Jun 2023
Improving Language Model Integration for Neural Machine Translation Christian Herold Yingbo Gao Mohammad Zeineldeen Hermann Ney 29 2 0 08 Jun 2023
MobileNMT: Enabling Translation in 15MB and 30ms Ye Lin Xiaohui Wang Zhexi Zhang Mingxuan Wang Tong Xiao Jingbo Zhu MQ 38 1 0 07 Jun 2023
World Models for Math Story Problems Andreas Opedal Niklas Stoehr Abulhair Saparov Mrinmaya Sachan ReLM 36 12 0 07 Jun 2023
Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models Liam Dugan Anshul Wadhawan Kyle Spence Chris Callison-Burch Morgan McGuire Victor Zordan OffRL 35 2 0 01 Jun 2023
A Call for Standardization and Validation of Text Style Transfer Evaluation Phil Ostheimer Mayank Nagda Marius Kloft Sophie Fellenz 47 14 0 01 Jun 2023
Strategies for improving low resource speech to text translation relying on pre-trained ASR models Santosh Kesiraju Marek Sarvaš T. Pavlíček Cécile Macaire Alejandro Ciuba 15 4 0 31 May 2023
Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentation Benjamin Minixhofer Jonas Pfeiffer Ivan Vulić 29 17 0 30 May 2023
HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Language Shantipriya Parida Idris Abdulmumin Shamsuddeen Hassan Muhammad Aneesh Bose Guneet Singh Kohli I. Ahmad Ketan Kotwal S. Sarkar Ondrej Bojar Habeebah Adamu Kakudi 26 5 0 28 May 2023
CTC-based Non-autoregressive Speech Translation Chen Xu Xiaoqian Liu Xiaowen Liu Qingxuan Sun Yuhao Zhang ... Tom Ko Mingxuan Wang Tong Xiao Anxiang Ma Jingbo Zhu 25 11 0 27 May 2023
CODET: A Benchmark for Contrastive Dialectal Evaluation of Machine Translation Md Mahfuz Ibn Alam Sina Ahmadi Antonios Anastasopoulos 30 6 0 26 May 2023
Robustness of Multi-Source MT to Transcription Errors Dominik Machávcek Peter Polák Ondrej Bojar Raj Dabre 34 4 0 26 May 2023
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation Zhiwei Cao Baosong Yang Huan Lin Suhang Wu Xiangpeng Wei Dayiheng Liu Jun Xie Min Zhang Jinsong Su 31 2 0 26 May 2023
Script Normalization for Unconventional Writing of Under-Resourced Languages in Bilingual Communities Sina Ahmadi Antonios Anastasopoulos 34 1 0 25 May 2023
Revisiting Non-Autoregressive Translation at Scale Zhihao Wang Longyue Wang Jinsong Su Junfeng Yao Zhaopeng Tu 36 3 0 25 May 2023
End-to-End Simultaneous Speech Translation with Differentiable Segmentation Shaolei Zhang Yang Feng 28 17 0 25 May 2023
Towards Higher Pareto Frontier in Multilingual Machine Translation Yi-Chong Huang Xiaocheng Feng Xinwei Geng Baohang Li Bing Qin 41 9 0 25 May 2023
Leveraging GPT-4 for Automatic Translation Post-Editing Vikas Raunak Amr Sharaf Yiren Wang H. Awadallah Arul Menezes 18 62 0 24 May 2023
Utility-Probability Duality of Neural Networks Bojun Huang Fei Yuan UQCV 35 1 0 24 May 2023
ComSL: A Composite Speech-Language Model for End-to-End Speech-to-Text Translation Chenyang Le Yao Qian Long Zhou Shujie Liu Yanmin Qian Michael Zeng Xuedong Huang 24 13 0 24 May 2023
Exploring Representational Disparities Between Multilingual and Bilingual Translation Models Neha Verma Kenton W. Murray Kevin Duh 21 0 0 23 May 2023
Beyond Shared Vocabulary: Increasing Representational Word Similarities across Languages for Multilingual Machine Translation Di Wu Christof Monz 42 9 0 23 May 2023
When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale Christos Baziotis Biao Zhang Alexandra Birch Barry Haddow 32 2 0 23 May 2023
CTQScorer: Combining Multiple Features for In-context Example Selection for Machine Translation Aswanth Kumar Ratish Puduppully Raj Dabre Anoop Kunchukuttan 49 12 0 23 May 2023
Improving speech translation by fusing speech and text Wenbiao Yin Zhicheng Liu Chengqi Zhao Tao Wang Jian-Fei Tong Rong Ye 15 4 0 23 May 2023
Challenges in Context-Aware Neural Machine Translation Linghao Jin Jacqueline He Jonathan May Xuezhe Ma 38 7 0 23 May 2023
TeCS: A Dataset and Benchmark for Tense Consistency of Machine Translation Yiming Ai Zhiwei He Kai Yu Rui Wang 8 1 0 23 May 2023
Non-parametric, Nearest-neighbor-assisted Fine-tuning for Neural Machine Translation Jiayi Wang Ke Min Wang Yuqi Zhang Yu Zhao Pontus Stenetorp 21 0 0 23 May 2023
Improving Isochronous Machine Translation with Target Factors and Auxiliary Counters Proyag Pal Brian Thompson Yogesh Virkar Prashant Mathur Alexandra Chronopoulou Marcello Federico 32 4 0 22 May 2023
Extrapolating Multilingual Understanding Models as Multilingual Generators Bohong Wu Fei Yuan Hai Zhao Lei Li Jingjing Xu AI4CE 25 2 0 22 May 2023
Improving Metrics for Speech Translation Claudio Paonessa Dominik Frefel Manfred Vogel 31 1 0 22 May 2023
Multilingual Simplification of Medical Texts Sebastian Antony Joseph Kathryn Kazanas Keziah Reina Vishnesh J. Ramanathan Wei-ping Xu Byron C. Wallace Junyi Jessy Li 38 13 0 21 May 2023
A request for clarity over the End of Sequence token in the Self-Critical Sequence Training J. Hu Roberto Cavicchioli Alessandro Capotondi 32 6 0 20 May 2023
Pointwise Mutual Information Based Metric and Decoding Strategy for Faithful Generation in Document Grounded Dialogs Yatin Nandwani Vineet Kumar Dinesh Raghu Sachindra Joshi Luis Lastras 35 6 0 20 May 2023
Learning to Compose Representations of Different Encoder Layers towards Improving Compositional Generalization Lei Lin Shuangtao Li Yafang Zheng Biao Fu Shantao Liu Yidong Chen Xiaodon Shi CoGe 27 3 0 20 May 2023
DUB: Discrete Unit Back-translation for Speech Translation Dong Zhang Rong Ye Tom Ko Mingxuan Wang Yaqian Zhou 29 23 0 19 May 2023
Accelerating Transformer Inference for Translation via Parallel Decoding Andrea Santilli Silvio Severino Emilian Postolache Valentino Maiorca Michele Mancusi R. Marin Emanuele Rodolà 41 80 0 17 May 2023
Towards More Robust NLP System Evaluation: Handling Missing Scores in Benchmarks Anas Himmi Ekhine Irurozki Nathan Noiry Stéphan Clémençon Pierre Colombo 34 5 0 17 May 2023
Towards Speech Dialogue Translation Mediating Speakers of Different Languages Shuichiro Shimizu Chenhui Chu Sheng Li Sadao Kurohashi Kyoto University 8 1 0 16 May 2023
Iterative Adversarial Attack on Image-guided Story Ending Generation Youze Wang Wenbo Hu Richang Hong 36 3 0 16 May 2023
PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in India Ashok Urlana Pinzhen Chen Zheng Zhao Shay B. Cohen Manish Shrivastava Barry Haddow 37 9 0 15 May 2023
Back Translation for Speech-to-text Translation Without Transcripts Qingkai Fang Yang Feng 38 13 0 15 May 2023
TESS: Text-to-Text Self-Conditioned Simplex Diffusion Rabeeh Karimi Mahabadi Hamish Ivison Jaesung Tae James Henderson Iz Beltagy Matthew E. Peters Arman Cohan 37 21 0 15 May 2023
Prompt Learning to Mitigate Catastrophic Forgetting in Cross-lingual Transfer for Open-domain Dialogue Generation Lei Liu J. Huang CLL 29 2 0 12 May 2023
How Good are Commercial Large Language Models on African Languages? Jessica Ojo Kelechi Ogueji 31 5 0 11 May 2023
NorBench -- A Benchmark for Norwegian Language Models David Samuel Andrey Kutuzov Samia Touileb Erik Velldal Lilja Ovrelid Egil Rønningstad Elina Sigdel Anna Palatkina 26 23 0 06 May 2023
Train Global, Tailor Local: Minimalist Multilingual Translation into Endangered Languages Zhong Zhou Jan Niehues Alexander Waibel 30 0 0 05 May 2023
Investigating Lexical Sharing in Multilingual Machine Translation for Indian Languages Sonal Sannigrahi Rachel Bawden 37 0 0 04 May 2023
Evaluating the Efficacy of Length-Controllable Machine Translation Hao Cheng Meng Zhang Weixuan Wang Liangyou Li Qun Liu Zhihua Zhang 37 0 0 03 May 2023