COMET: A Neural Framework for MT Evaluation

18 September 2020

Papers citing "COMET: A Neural Framework for MT Evaluation"

50 / 264 papers shown

Title
Towards Fine-Grained Information: Identifying the Type and Location of Translation Errors Keqin Bao Yu Wan Dayiheng Liu Baosong Yang Wenqiang Lei Xiangnan He Derek F.Wong Jun Xie 29 4 0 17 Feb 2023
A Reparameterized Discrete Diffusion Model for Text Generation Lin Zheng Jianbo Yuan Lei Yu Lingpeng Kong DiffM 36 57 0 11 Feb 2023
AutoNMT: A Framework to Streamline the Research of Seq2Seq Models Salvador Carrión F. Casacuberta 22 2 0 09 Feb 2023
Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection Weijia Xu Sweta Agrawal Eleftheria Briakou Marianna J. Martindale Marine Carpuat HILM 16 46 0 18 Jan 2023
Dubbing in Practice: A Large Scale Study of Human Localization With Insights for Automatic Dubbing William Brannon Yogesh Virkar Brian Thompson 42 21 0 23 Dec 2022
Extrinsic Evaluation of Machine Translation Metrics Nikita Moghe Tom Sherborne Mark Steedman Alexandra Birch ELM 18 18 0 20 Dec 2022
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis Qingyu Lu Liang Ding Liping Xie Kanjian Zhang Derek F. Wong Dacheng Tao ELM ALM 34 14 0 20 Dec 2022
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation Tianxing He Jingyu Zhang Tianle Wang Sachin Kumar Kyunghyun Cho James R. Glass Yulia Tsvetkov 37 44 0 20 Dec 2022
Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models Bernd Bohnet Vinh Q. Tran Pat Verga Roee Aharoni D. Andor ... Michael Collins Dipanjan Das Donald Metzler Slav Petrov Kellie Webster 41 59 0 15 Dec 2022
Subword-Delimited Downsampling for Better Character-Level Translation Lukas Edman Antonio Toral Gertjan van Noord 12 6 0 02 Dec 2022
BJTU-WeChat's Systems for the WMT22 Chat Translation Task Yunlong Liang Fandong Meng Jinan Xu Yufeng Chen Jie Zhou 16 2 0 28 Nov 2022
Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality? Pei Zhang Baosong Yang Hao-Ran Wei Dayiheng Liu Kai Fan Luo Si Jun Xie 19 3 0 25 Nov 2022
Best- $k$ Search Algorithm for Neural Text Generation Jiacheng Xu Caiming Xiong Silvio Savarese Yingbo Zhou 32 5 0 22 Nov 2022
Operationalizing Specifications, In Addition to Test Sets for Evaluating Constrained Generative Models Vikas Raunak Matt Post Arul Menezes EGVM 27 0 0 19 Nov 2022
Dialect-robust Evaluation of Generated Text Jiao Sun Thibault Sellam Elizabeth Clark Tu Vu Timothy Dozat Dan Garrette Aditya Siddhant Jacob Eisenstein Sebastian Gehrmann 15 19 0 02 Nov 2022
DEMETR: Diagnosing Evaluation Metrics for Translation Marzena Karpinska N. Raj Katherine Thai Yixiao Song Ankita Gupta Mohit Iyyer 21 37 0 25 Oct 2022
Don't Discard Fixed-Window Audio Segmentation in Speech-to-Text Translation Chantal Amrhein Barry Haddow 28 8 0 24 Oct 2022
Bilingual Synchronization: Restoring Translational Relationships with Editing Operations Jitao Xu Josep Crego François Yvon 30 4 0 24 Oct 2022
Finding Memo: Extractive Memorization in Constrained Sequence Generation Tasks Vikas Raunak Arul Menezes 30 13 0 24 Oct 2022
A Textless Metric for Speech-to-Speech Comparison Laurent Besacier S. Ribeiro Olivier Galibert Ioan Calapodescu 33 5 0 21 Oct 2022
Alibaba-Translate China's Submission for WMT 2022 Metrics Shared Task Yu Wan Keqin Bao Dayiheng Liu Baosong Yang Derek F. Wong Lidia S. Chao Wenqiang Lei Jun Xie 22 9 0 18 Oct 2022
BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation Tianxiang Sun Junliang He Xipeng Qiu Xuanjing Huang 24 44 0 14 Oct 2022
DICTDIS: Dictionary Constrained Disambiguation for Improved NMT Ayush Maheshwari Piyush Sharma P. Jyothi Ganesh Ramakrishnan 31 2 0 13 Oct 2022
Toxicity in Multilingual Machine Translation at Scale Marta R. Costa-jussá Eric Michael Smith C. Ropers Daniel Licht Jean Maillard Javier Ferrando Carlos Escolano 22 24 0 06 Oct 2022
Just ClozE! A Novel Framework for Evaluating the Factual Consistency Faster in Abstractive Summarization Yiyang Li Lei Li Marina Litvak N. Vanetik Dingxing Hu Yuze Li Yanquan Zhou HILM 32 0 0 06 Oct 2022
GAPX: Generalized Autoregressive Paraphrase-Identification X Yi Zhou Renyu Li Hayden Housen Ser-Nam Lim BDL 27 0 0 05 Oct 2022
Out-of-Distribution Detection and Selective Generation for Conditional Language Models Jie Jessie Ren Jiaming Luo Yao-Min Zhao Kundan Krishna Mohammad Saleh Balaji Lakshminarayanan Peter J. Liu OODD 67 94 0 30 Sep 2022
An Automatic Evaluation of the WMT22 General Machine Translation Task Benjamin Marie AIMat 9 2 0 28 Sep 2022
Approaching English-Polish Machine Translation Quality Assessment with Neural-based Methods Artur Nowakowski 16 0 0 22 Sep 2022
Rethinking Round-Trip Translation for Machine Translation Evaluation Terry Yue Zhuo Qiongkai Xu Xuanli He Trevor Cohn LRM 22 2 0 15 Sep 2022
Layer or Representation Space: What makes BERT-based Evaluation Metrics Robust? Doan Nam Long Vu N. Moosavi Steffen Eger 14 9 0 06 Sep 2022
SelF-Eval: Self-supervised Fine-grained Dialogue Evaluation Longxuan Ma Ziyu Zhuang Weinan Zhang Mingda Li Ting Liu 21 4 0 17 Aug 2022
Building Multilingual Machine Translation Systems That Serve Arbitrary X-Y Translations Akiko Eriguchi Shufang Xie Tao Qin Hany Awadalla LRM 53 7 0 30 Jun 2022
Exploring Diversity in Back Translation for Low-Resource Machine Translation Laurie Burchell Alexandra Birch Kenneth Heafield 27 15 0 01 Jun 2022
Chunk-based Nearest Neighbor Machine Translation Pedro Henrique Martins Zita Marinho André F.T. Martins RALM 78 28 0 24 May 2022
Lack of Fluency is Hurting Your Translation Model J. Yoo Jaewoo Kang 18 0 0 24 May 2022
Understanding and Mitigating the Uncertainty in Zero-Shot Translation Wenxuan Wang Wenxiang Jiao Shuo Wang Zhaopeng Tu Michael R. Lyu UQLM 27 9 0 20 May 2022
Twist Decoding: Diverse Generators Guide Each Other Jungo Kasai Keisuke Sakaguchi Ronan Le Bras Hao Peng Ximing Lu Dragomir R. Radev Yejin Choi Noah A. Smith SyDa 19 4 0 19 May 2022
PreQuEL: Quality Estimation of Machine Translation Outputs in Advance Shachar Don-Yehiya Leshem Choshen Omri Abend 25 10 0 18 May 2022
Who Are We Talking About? Handling Person Names in Speech Translation Marco Gaido Matteo Negri Marco Turchi 20 7 0 13 May 2022
SubER: A Metric for Automatic Evaluation of Subtitle Quality P. Wilken P. Georgakopoulou E. Matusov 20 13 0 11 May 2022
Building Machine Translation Systems for the Next Thousand Languages Ankur Bapna Isaac Caswell Julia Kreutzer Orhan Firat D. Esch ... Apurva Shah Yanping Huang Z. Chen Yonghui Wu Macduff Hughes 54 98 0 09 May 2022
Non-Autoregressive Machine Translation: It's Not as Fast as it Seems Jindvrich Helcl Barry Haddow Alexandra Birch 19 19 0 04 May 2022
Quality-Aware Decoding for Neural Machine Translation Patrick Fernandes António Farinhas Ricardo Rei José G. C. de Souza Perez Ogayo Graham Neubig André F. T. Martins 33 57 0 02 May 2022
Semantically Informed Slang Interpretation Zhewei Sun R. Zemel Yang Xu 20 7 0 02 May 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 16 9 0 29 Apr 2022
Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code Daniel Deutsch Dan Roth AI4CE 37 2 0 29 Apr 2022
UniTE: Unified Translation Evaluation Yu Wan Dayiheng Liu Baosong Yang Haibo Zhang Boxing Chen Derek F. Wong Lidia S. Chao 33 41 0 28 Apr 2022
Efficient Machine Translation Domain Adaptation Pedro Henrique Martins Zita Marinho André F.T. Martins 58 14 0 26 Apr 2022
A Call for Clarity in Beam Search: How It Works and When It Stops Jungo Kasai Keisuke Sakaguchi Ronan Le Bras Dragomir R. Radev Yejin Choi Noah A. Smith 26 6 0 11 Apr 2022