COMET: A Neural Framework for MT Evaluation

18 September 2020

Papers citing "COMET: A Neural Framework for MT Evaluation"

50 / 264 papers shown

Title
Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Task Zhanglin Wu Daimeng Wei Zongyao Li Hengchao Shang Jiaxin Guo Shaojun Li Zhiqiang Rao Yuanchang Luo Ning Xie Hao Yang 21 4 0 23 Sep 2024
Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approach Siqi Li Danni Liu Jan Niehues 26 0 0 13 Sep 2024
BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training Pavel Chizhov Catherine Arnett Elizaveta Korotkova Ivan P. Yamshchikov 40 2 0 06 Sep 2024
How Much Data is Enough Data? Fine-Tuning Large Language Models for In-House Translation: Performance Evaluation Across Multiple Dataset Sizes Inacio Vieira Will Allred Séamus Lankford Sheila Castilho Andy Way 21 5 0 05 Sep 2024
Self-Judge: Selective Instruction Following with Alignment Self-Evaluation Hai Ye Hwee Tou Ng ELM ALM 33 4 0 02 Sep 2024
Correcting FLORES Evaluation Dataset for Four African Languages Idris Abdulmumin Sthembiso Mkhwanazi Mahlatse S. Mbooi Shamsuddeen Hassan Muhammad I. Ahmad Neo Putini Miehleketo Mathebula Matimba Shingange T. Gwadabe Vukosi Marivate 31 5 0 01 Sep 2024
Towards Tailored Recovery of Lexical Diversity in Literary Machine Translation Esther Ploeger Huiyuan Lai Rik van Noord Antonio Toral 21 1 0 30 Aug 2024
What Makes a Good Story and How Can We Measure It? A Comprehensive Survey of Story Evaluation Dingyi Yang Qin Jin 38 5 0 26 Aug 2024
Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In! Stefano Perrella Lorenzo Proietti Alessandro Sciré Edoardo Barba Roberto Navigli 23 3 0 25 Aug 2024
Defining Boundaries: The Impact of Domain Specification on Cross-Language and Cross-Domain Transfer in Machine Translation Lia Shahnazaryan Meriem Beloucif 18 0 0 21 Aug 2024
What can Large Language Models Capture about Code Functional Equivalence? Nickil Maveli Antonio Vergari Shay B. Cohen 36 2 0 20 Aug 2024
From Brazilian Portuguese to European Portuguese Joao Sanches Rui Ribeiro Luísa Coheur 24 0 0 14 Aug 2024
Language-Informed Beam Search Decoding for Multilingual Machine Translation Yilin Yang Stefan Lee Prasad Tadepalli 25 1 0 11 Aug 2024
Simplifying Translations for Children: Iterative Simplification Considering Age of Acquisition with LLMs Masashi Oshika Makoto Morishita Tsutomu Hirao Ryohei Sasano Koichi Takeda 32 2 0 08 Aug 2024
mbrs: A Library for Minimum Bayes Risk Decoding Hiroyuki Deguchi Yusuke Sakai Hidetaka Kamigaito Taro Watanabe 42 3 0 08 Aug 2024
Evaluating the Translation Performance of Large Language Models Based on Euas-20 Yan Huang Wei Liu ELM 35 0 0 06 Aug 2024
The Quest for the Right Mediator: A History, Survey, and Theoretical Grounding of Causal Interpretability Aaron Mueller Jannik Brinkmann Millicent Li Samuel Marks Koyena Pal ... Arnab Sen Sharma Jiuding Sun Eric Todd David Bau Yonatan Belinkov CML 44 18 0 02 Aug 2024
In-Context Example Selection via Similarity Search Improves Low-Resource Machine Translation Joel Witzke Benoît Sagot Rachel Bawden 36 7 0 01 Aug 2024
Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agent Shanbo Cheng Zhichao Huang Tom Ko Hang Li Ningxin Peng Lu Xu Qini Zhang 48 3 0 31 Jul 2024
Visual Riddles: a Commonsense and World Knowledge Challenge for Large Vision and Language Models Nitzan Bitton-Guetta Aviv Slobodkin Aviya Maimon Eliya Habba Royi Rassin Yonatan Bitton Idan Szpektor Amir Globerson Yuval Elovici ReLM VLM LRM 38 5 0 28 Jul 2024
The power of Prompts: Evaluating and Mitigating Gender Bias in MT with LLMs Aleix Sant Carlos Escolano Audrey Mash Francesca de Luca Fornaciari Maite Melero 36 4 0 26 Jul 2024
Improving Minimum Bayes Risk Decoding with Multi-Prompt David Heineman Yao Dou Wei-ping Xu 34 6 0 22 Jul 2024
CoVoSwitch: Machine Translation of Synthetic Code-Switched Text Based on Intonation Units Yeeun Kang 37 0 0 19 Jul 2024
Towards Zero-Shot Multimodal Machine Translation Matthieu Futeral Cordelia Schmid Benoît Sagot Rachel Bawden 30 3 0 18 Jul 2024
Towards Chapter-to-Chapter Context-Aware Literary Translation via Large Language Models Linghao Jin Li An Xuezhe Ma 32 0 0 12 Jul 2024
KpopMT: Translation Dataset with Terminology for Kpop Fandom JiWoo Kim Yunsu Kim Jinyeong Bak 16 1 0 10 Jul 2024
LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languages Yinquan Lu Wenhao Zhu Lei Li Yu Qiao Fei Yuan 42 24 0 08 Jul 2024
Toucan: Many-to-Many Translation for 150 African Language Pairs AbdelRahim Elmadany Ife Adebara Muhammad Abdul-Mageed 31 1 0 05 Jul 2024
Controlling Whisper: Universal Acoustic Adversarial Attacks to Control Speech Foundation Models Vyas Raina Mark J. F. Gales AAML 35 1 0 05 Jul 2024
M5 -- A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks Florian Schneider Sunayana Sitaram VLM 37 7 0 04 Jul 2024
GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levels Jianhao Yan Pingchuan Yan Yulong Chen Judy Li Xianchao Zhu Yue Zhang LM&MA ELM 77 14 0 04 Jul 2024
Evaluating Automatic Metrics with Incremental Machine Translation Systems Guojun Wu Shay B. Cohen Rico Sennrich 26 0 0 03 Jul 2024
Sentence-level Aggregation of Lexical Metrics Correlates Stronger with Human Judgements than Corpus-level Aggregation Paulo Cavalin P. Domingues Claudio S. Pinhanez 35 0 0 03 Jul 2024
How to Learn in a Noisy World? Self-Correcting the Real-World Data Noise in Machine Translation Yan Meng Di Wu Christof Monz 28 1 0 02 Jul 2024
Cross-Lingual Transfer Learning for Speech Translation Rao Ma Yassir Fathullah Mengjie Qian Siyuan Tang Mark J. F. Gales Kate Knill 20 1 0 01 Jul 2024
xTower: A Multilingual LLM for Explaining and Correcting Translation Errors Marcos Vinícius Treviso Nuno M. Guerreiro Sweta Agrawal Ricardo Rei José P. Pombal Tânia Vaz Helena Wu Beatriz Silva Daan van Stigt André F. T. Martins LRM 34 7 0 27 Jun 2024
A Case Study on Contextual Machine Translation in a Professional Scenario of Subtitling S. Vincent Charlotte Prescott Chris Bayliss Chris Oakley Carolina Scarton 24 1 0 27 Jun 2024
Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models Lynn Chua Badih Ghazi Yangsibo Huang Pritish Kamath Ravi Kumar Pasin Manurangsi Amer Sinha Chulin Xie Chiyuan Zhang 60 1 0 23 Jun 2024
Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraph Roman Vashurin Ekaterina Fadeeva Artem Vazhentsev Akim Tsvigun Daniil Vasilev ... Timothy Baldwin Timothy Baldwin Maxim Panov Artem Shelmanov Artem Shelmanov HILM 66 8 0 21 Jun 2024
PFID: Privacy First Inference Delegation Framework for LLMs Haoyan Yang Zhitao Li Yong Zhang Jianzong Wang Ning Cheng Ming Li Jing Xiao 36 1 0 18 Jun 2024
AnyTrans: Translate AnyText in the Image with Large Scale Models Zhipeng Qian Pei Zhang Baosong Yang Kai Fan Yiwei Ma Derek F. Wong Xiaoshuai Sun Rongrong Ji VLM 40 1 0 17 Jun 2024
Word Order in English-Japanese Simultaneous Interpretation: Analyses and Evaluation using Chunk-wise Monotonic Translation Kosuke Doi Yuka Ko Mana Makinae Katsuhito Sudoh Satoshi Nakamura 28 2 0 13 Jun 2024
Guiding In-Context Learning of LLMs through Quality Estimation for Machine Translation Javad Pourmostafa Roshan Sharami D. Shterionov Pieter Spronck 26 0 0 12 Jun 2024
Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Models Shoutao Guo Shaolei Zhang Zhengrui Ma Min Zhang Yang Feng LLMAG 33 1 0 11 Jun 2024
Efficient k-Nearest-Neighbor Machine Translation with Dynamic Retrieval Yan Gao Zhiwei Cao Zhongjian Miao Baosong Yang Shiyu Liu Min Zhang Jinsong Su 37 0 0 10 Jun 2024
How Good is Zero-Shot MT Evaluation for Low Resource Indian Languages? Anushka Singh Ananya B. Sai Raj Dabre Ratish Puduppully Anoop Kunchukuttan Mitesh Khapra 28 1 0 06 Jun 2024
Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation Matthias Sperber Ondrej Bojar Barry Haddow Dávid Javorský Xutai Ma ... Jan Niehues Peter Polák Elizabeth Salesky Katsuhito Sudoh Marco Turchi 23 2 0 06 Jun 2024
Recovering document annotations for sentence-level bitext R. Wicks Matt Post Philipp Koehn 31 4 0 06 Jun 2024
IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models David Ifeoluwa Adelani Jessica Ojo Israel Abebe Azime Jian Yun Zhuang Jesujoba Oluwadara Alabi ... Salomey Osei Sokhar Samb Tadesse Kebede Guge Pontus Stenetorp Pontus Stenetorp ELM 57 7 0 05 Jun 2024
Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithms Firas Trabelsi David Vilar Mara Finkelstein Markus Freitag 29 6 0 05 Jun 2024