COMET: A Neural Framework for MT Evaluation

18 September 2020

Papers citing "COMET: A Neural Framework for MT Evaluation"

50 / 264 papers shown

Title
Registering Source Tokens to Target Language Spaces in Multilingual Neural Machine Translation Zhi Qu Yiran Wang Jiannan Mao Chenchen Ding Hideki Tanaka Masao Utiyama Taro Watanabe LRM 40 0 0 06 Jan 2025
A review of faithfulness metrics for hallucination assessment in Large Language Models Ben Malin Tatiana Kalganova Nikoloas Boulgouris HILM 59 2 0 03 Jan 2025
Large Language Models Are Read/Write Policy-Makers for Simultaneous Generation Shoutao Guo Shaolei Zhang Zhengrui Ma Yang Feng 31 0 0 03 Jan 2025
A 2-step Framework for Automated Literary Translation Evaluation: Its Promises and Pitfalls Sheikh Shafayat Dongkeun Yoon Woori Jang Jiwoo Choi Alice H. Oh Seohyon Jung 94 1 0 03 Jan 2025
Domain adapted machine translation: What does catastrophic forgetting forget and why? Danielle Saunders Steve DeNeefe AI4CE 26 0 0 23 Dec 2024
Investigating Length Issues in Document-level Machine Translation Ziqian Peng Rachel Bawden François Yvon 69 1 0 23 Dec 2024
Self-Evolution Knowledge Distillation for LLM-based Machine Translation Yuncheng Song Liang Ding Changtong Zan Shujian Huang 70 0 0 19 Dec 2024
Towards Automatic Evaluation for Image Transcreation Simran Khanuja Vivek Iyer Claire He Graham Neubig ViT 82 1 0 18 Dec 2024
Findings of the WMT 2024 Shared Task on Discourse-Level Literary Translation Longyue Wang Siyou Liu Chenyang Lyu Wenxiang Jiao Xing Wang ... Minghao Wu Liting Zhou Philipp Koehn Andy Way Yulin Yuan VLM 137 6 0 16 Dec 2024
CATER: Leveraging LLM to Pioneer a Multidimensional, Reference-Independent Paradigm in Translation Quality Evaluation Kurando Iida Kenjiro Mimura 75 0 0 15 Dec 2024
From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set M. Finkelstein Dan Deutsch Parker Riley Juraj Juraska Geza Kovacs Markus Freitag 74 0 0 23 Nov 2024
Quasi-random Multi-Sample Inference for Large Language Models Aditya Parashar Aditya Vikram Singh Avinash Amballa Jinlin Lai Benjamin Rozonoyer LRM 61 0 0 09 Nov 2024
BhasaAnuvaad: A Speech Translation Dataset for 13 Indian Languages Sparsh Jain Ashwin Sankar Devilal Choudhary Dhairya Suman Nikhil Narasimhan Mohammed Safi Ur Rahman Khan Anoop Kunchukuttan Mitesh M. Khapra Raj Dabre 42 2 0 07 Nov 2024
Predictor-Corrector Enhanced Transformers with Exponential Moving Average Coefficient Learning B. Li Tong Zheng R. Wang Jiahao Liu Qingyan Guo ... Xu Tan Tong Xiao Jingbo Zhu J. Wang Xunliang Cai 50 1 0 05 Nov 2024
Code-Switching Curriculum Learning for Multilingual Transfer in LLMs Haneul Yoo Cheonbok Park Sangdoo Yun Alice H. Oh Hwaran Lee 24 3 0 04 Nov 2024
MetaMetrics-MT: Tuning Meta-Metrics for Machine Translation via Human Preference Calibration David Anugraha Garry Kuwanto Lucky Susanto Derry Wijaya Genta Indra Winata OSLM 35 2 0 01 Nov 2024
Linguistics Theory Meets LLM: Code-Switched Text Generation via Equivalence Constrained Large Language Models Garry Kuwanto Chaitanya Agarwal Genta Indra Winata Derry Wijaya 54 1 0 30 Oct 2024
SpeechQE: Estimating the Quality of Direct Speech Translation HyoJung Han Kevin Duh Marine Carpuat 34 0 0 28 Oct 2024
Learning from others' mistakes: Finetuning machine translation models with span-level error annotations Lily H. Zhang Hamid Dadkhahi M. Finkelstein Firas Trabelsi Jiaming Luo Markus Freitag 29 1 0 21 Oct 2024
Theoretical Aspects of Bias and Diversity in Minimum Bayes Risk Decoding Hidetaka Kamigaito Hiroyuki Deguchi Yusuke Sakai Katsuhiko Hayashi Taro Watanabe 41 1 0 19 Oct 2024
Towards Cross-Cultural Machine Translation with Retrieval-Augmented Generation from Multilingual Knowledge Graphs Simone Conia Daniel Lee Min Li U. F. Minhas Saloni Potdar Yunyao Li 32 9 0 17 Oct 2024
Cross-Lingual Auto Evaluation for Assessing Multilingual LLMs Sumanth Doddapaneni Mohammed Safi Ur Rahman Khan Dilip Venkatesh Raj Dabre Anoop Kunchukuttan Mitesh M. Khapra ELM 35 1 0 17 Oct 2024
Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling W. Xu Rujun Han Z. Wang L. Le Dhruv Madeka Lei Li W. Wang Rishabh Agarwal Chen-Yu Lee Tomas Pfister 80 8 0 15 Oct 2024
Adapters for Altering LLM Vocabularies: What Languages Benefit the Most? HyoJung Han Akiko Eriguchi Haoran Xu Hieu T. Hoang Marine Carpuat Huda Khayrallah VLM 32 2 0 12 Oct 2024
Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation Sweta Agrawal José G. C. de Souza Ricardo Rei António Farinhas Gonçalo Faria Patrick Fernandes Nuno M. Guerreiro Andre Martins 24 5 0 10 Oct 2024
Are Large Language Models State-of-the-art Quality Estimators for Machine Translation of User-generated Content? Shenbin Qian Constantin Orasan Diptesh Kanojia Félix do Carmo ELM 25 0 0 08 Oct 2024
On Instruction-Finetuning Neural Machine Translation Models Vikas Raunak Roman Grundkiewicz Marcin Junczys-Dowmunt 26 1 0 07 Oct 2024
Translation Canvas: An Explainable Interface to Pinpoint and Analyze Translation Systems Chinmay Dandekar W. Xu Xi Xu Siqi Ouyang Lei Li ELM 23 0 0 07 Oct 2024
Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics Stefano Perrella Lorenzo Proietti Pere-Lluís Huguet Cabot Edoardo Barba Roberto Navigli 21 3 0 07 Oct 2024
CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation Rui Zhao Jinyu Li Ruchao Fan Matt Post 38 1 0 07 Oct 2024
Can the Variation of Model Weights be used as a Criterion for Self-Paced Multilingual NMT? Àlex R. Atrio Alexis Allemann Ljiljana Dolamic Andrei Popescu-Belis 24 1 0 05 Oct 2024
MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task Juraj Juraska Daniel Deutsch Mara Finkelstein Markus Freitag 39 14 0 04 Oct 2024
Should Cross-Lingual AMR Parsing go Meta? An Empirical Assessment of Meta-Learning and Joint Learning AMR Parsing J. Kang Maximin Coavoux Cédric Lopez D. Schwab 34 3 0 04 Oct 2024
What do Large Language Models Need for Machine Translation Evaluation? Shenbin Qian Archchana Sindhujan Minnie Kabra Diptesh Kanojia Constantin Orasan Tharindu Ranasinghe Frédéric Blain ELM LRM ALM LM&MA 26 0 0 04 Oct 2024
A Multi-task Learning Framework for Evaluating Machine Translation of Emotion-loaded User-generated Content Shenbin Qian Constantin Orasan Diptesh Kanojia Félix do Carmo 28 0 0 04 Oct 2024
LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations Hadas Orgad Michael Toker Zorik Gekhman Roi Reichart Idan Szpektor Hadas Kotek Yonatan Belinkov HILM AIFin 49 25 0 03 Oct 2024
Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning Tianxiang Hu Pei Zhang Baosong Yang Jun Xie Derek F. Wong Rui Wang ALM LRM 37 1 0 03 Oct 2024
Better Instruction-Following Through Minimum Bayes Risk Ian Wu Patrick Fernandes Amanda Bertsch Seungone Kim Sina Pakazad Graham Neubig 48 9 0 03 Oct 2024
InstaTrans: An Instruction-Aware Translation Framework for Non-English Instruction Datasets Yungi Kim Chanjun Park 26 0 0 02 Oct 2024
Creative and Context-Aware Translation of East Asian Idioms with GPT-4 Kenan Tang Peiyang Song Yao Qin Xifeng Yan 28 1 0 01 Oct 2024
Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation Jiyoon Myung Jihyeon Park Jungki Son Kyungro Lee Joohyung Han 23 0 0 01 Oct 2024
What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study Beatrice Savoldi Sara Papi Matteo Negri Ana Guerberof L. Bentivogli 35 6 0 01 Oct 2024
Multi-Target Cross-Lingual Summarization: a novel task and a language-neutral approach Diogo Pernes Gonçalo M. Correia Afonso Mendes 24 1 0 01 Oct 2024
Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis Hippolyte Gisserot-Boukhlef Ricardo Rei Emmanuel Malherbe C´eline Hudelot Pierre Colombo Nuno M. Guerreiro 32 2 0 30 Sep 2024
DENEB: A Hallucination-Robust Automatic Evaluation Metric for Image Captioning Kazuki Matsuda Yuiga Wada Komei Sugiura 26 1 0 28 Sep 2024
Evaluation of Large Language Models for Summarization Tasks in the Medical Domain: A Narrative Review Emma Croxford Yanjun Gao Nicholas Pellegrino Karen K. Wong Graham Wills Elliot First Frank J. Liao Cherodeep Goswami Brian Patterson Majid Afshar HILM ELM LM&MA 37 1 0 26 Sep 2024
On Translating Technical Terminology: A Translation Workflow for Machine-Translated Acronyms Richard Yue John E. Ortega Kenneth Ward Church 29 0 0 26 Sep 2024
On Extending Direct Preference Optimization to Accommodate Ties Jinghong Chen Guangyu Yang Weizhe Lin Jingbiao Mei Bill Byrne 32 3 0 25 Sep 2024
How to Connect Speech Foundation Models and Large Language Models? What Matters and What Does Not Francesco Verdini Pierfrancesco Melucci Stefano Perna Francesco Cariaggi Marco Gaido ... Marek Kasztelnik L. Bentivogli Sébastien Bratières P. Merialdo Simone Scardapane AuLLM 20 0 0 25 Sep 2024
HW-TSC's Submission to the CCMT 2024 Machine Translation Tasks Zhanglin Wu Yuanchang Luo Daimeng Wei Jiawei Zheng Bin Wei ... Jiaxin Guo Shaojun Li Weidong Zhang Ning Xie Hao Yang 32 1 0 23 Sep 2024