Learning Compact Metrics for MT

12 October 2021

Papers citing "Learning Compact Metrics for MT"

50 / 75 papers shown

Title
LITERA: An LLM Based Approach to Latin-to-English Translation Paul Rosu 14 0 0 14 Apr 2025
LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offline Biao Fu Minpeng Liao Kai Fan Chengxi Li L. Zhang Yidong Chen Xiaodong Shi OffRL 39 1 0 13 Apr 2025
Extend Adversarial Policy Against Neural Machine Translation via Unknown Token Wei Zou Shujian Huang Jiajun Chen AAML 68 0 0 21 Jan 2025
SciDQA: A Deep Reading Comprehension Dataset over Scientific Papers Shruti Singh Nandan Sarkar Arman Cohan 29 0 0 08 Nov 2024
Context-Informed Machine Translation of Manga using Multimodal Large Language Models Philip Lippmann Konrad Skublicki Joshua Tanner Shonosuke Ishiwatari Jie-jin Yang 16 0 0 04 Nov 2024
MetaMetrics-MT: Tuning Meta-Metrics for Machine Translation via Human Preference Calibration David Anugraha Garry Kuwanto Lucky Susanto Derry Wijaya Genta Indra Winata OSLM 30 2 0 01 Nov 2024
Diverse Sign Language Translation Xin Shen Lei Shen Shaozu Yuan Heming Du Haiyang Sun Xin Yu SLR 28 0 0 25 Oct 2024
Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics Stefano Perrella Lorenzo Proietti Pere-Lluís Huguet Cabot Edoardo Barba Roberto Navigli 9 2 0 07 Oct 2024
MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task Juraj Juraska Daniel Deutsch Mara Finkelstein Markus Freitag 26 0 0 04 Oct 2024
LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations Hadas Orgad Michael Toker Zorik Gekhman Roi Reichart Idan Szpektor Hadas Kotek Yonatan Belinkov HILM AIFin 40 24 0 03 Oct 2024
Reinforcement Learning without Human Feedback for Last Mile Fine-Tuning of Large Language Models Alec Solway ALM 29 0 0 29 Aug 2024
Improving Clinical Note Generation from Complex Doctor-Patient Conversation Yizhan Li Sifan Wu Christopher W. Smith Thomas Lo Bang Liu 18 3 0 26 Aug 2024
FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation Garrett Tanzer SLR VLM 19 0 0 24 Aug 2024
Plug, Play, and Fuse: Zero-Shot Joint Decoding via Word-Level Re-ranking Across Diverse Vocabularies Sai Koneru Matthias Huck M. Exel Jan Niehues 14 0 0 21 Aug 2024
Promises and Pitfalls of Generative Masked Language Modeling: Theoretical Framework and Practical Guidelines Yuchen Li Alexandre Kirchmeyer Aashay Mehta Yilong Qin Boris Dadachev Kishore Papineni Sanjiv Kumar Andrej Risteski 30 0 0 22 Jul 2024
Scaling Sign Language Translation Biao Zhang Garrett Tanzer Orhan Firat LRM VLM SLR 19 1 0 16 Jul 2024
Finetuning End-to-End Models for Estonian Conversational Spoken Language Translation Tiia Sildam Andra Velve Tanel Alumäe 20 0 0 04 Jul 2024
Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation Boxuan Lyu Hidetaka Kamigaito Kotaro Funakoshi Manabu Okumura 30 0 0 17 Jun 2024
Reconsidering Sentence-Level Sign Language Translation Garrett Tanzer Maximus Shengelia Ken Harrenstien David C. Uthus SLR 22 2 0 16 Jun 2024
Tell Me What's Next: Textual Foresight for Generic UI Representations Andrea Burns Kate Saenko Bryan A. Plummer LM&Ro AI4TS 20 4 0 12 Jun 2024
Evaluating Durability: Benchmark Insights into Multimodal Watermarking Jielin Qiu William Jongwon Han Xuandong Zhao Shangbang Long Christos Faloutsos Lei Li 43 1 0 06 Jun 2024
Faithful Chart Summarization with ChaTS-Pi Syrine Krichene Francesco Piccinno Fangyu Liu Julian Martin Eisenschlos 21 1 0 29 May 2024
G-DIG: Towards Gradient-based Diverse and High-quality Instruction Data Selection for Machine Translation Xingyuan Pan Luyang Huang Liyan Kang Zhicheng Liu Yu Lu Shanbo Cheng ALM 22 11 0 21 May 2024
What Have We Achieved on Non-autoregressive Translation? Yafu Li Huajian Zhang Jianhao Yan Yongjing Yin Yue Zhang 21 0 0 21 May 2024
Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair Yusuke Sakai Mana Makinae Hidetaka Kamigaito Taro Watanabe 25 2 0 18 Apr 2024
Token-Efficient Leverage Learning in Large Language Models Yuanhao Zeng Min Wang Yihang Wang Yingxia Shao 26 0 0 01 Apr 2024
REFeREE: A REference-FREE Model-Based Metric for Text Simplification Yichen Huang Ekaterina Kochmar 35 0 0 26 Mar 2024
SnapNTell: Enhancing Entity-Centric Visual Question Answering with Retrieval Augmented Multimodal LLM Jielin Qiu Andrea Madotto Zhaojiang Lin Paul A. Crook Y. Xu Xin Luna Dong Christos Faloutsos Lei Li Babak Damavandi Seungwhan Moon 20 8 0 07 Mar 2024
Enabling Weak LLMs to Judge Response Reliability via Meta Ranking Zijun Liu Boqun Kou Peng Li Ming Yan Ji Zhang Fei Huang Yang Janet Liu 18 2 0 19 Feb 2024
Open-ended VQA benchmarking of Vision-Language models by exploiting Classification datasets and their semantic hierarchy Simon Ging M. A. Bravo Thomas Brox VLM 33 11 0 11 Feb 2024
Hallucination Detection and Hallucination Mitigation: An Investigation Junliang Luo Tianyu Li Di Wu Michael R. M. Jenkin Steve Liu Gregory Dudek HILM LLMAG 26 20 0 16 Jan 2024
Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies Tom Kocmi Vilém Zouhar C. Federmann Matt Post 15 10 0 12 Jan 2024
POMP: Probability-driven Meta-graph Prompter for LLMs in Low-resource Unsupervised Neural Machine Translation Shilong Pan Zhiliang Tian Liang Ding Zhen Huang Zhihua Wen Dongsheng Li 19 2 0 11 Jan 2024
Hyperparameter-Free Approach for Faster Minimum Bayes Risk Decoding Yuu Jinnai Kaito Ariu 14 8 0 05 Jan 2024
JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language Processing Shester Gueuwou Sophie Siake Colin Leong Mathias Müller SLR 14 11 0 16 Nov 2023
Model-Based Minimum Bayes Risk Decoding for Text Generation Yuu Jinnai Tetsuro Morimura Ukyo Honda Kaito Ariu Kenshi Abe 8 6 0 09 Nov 2023
Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks Yichen Huang Timothy Baldwin 17 2 0 01 Nov 2023
GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4 Tom Kocmi C. Federmann 11 72 0 21 Oct 2023
Enhancing Neural Machine Translation with Semantic Units Langlin Huang Shuhao Gu Zhuocheng Zhang Yang Feng 20 4 0 17 Oct 2023
Exploring Automatic Evaluation Methods based on a Decoder-based LLM for Text Generation Tomohito Kasahara Daisuke Kawahara 25 2 0 17 Oct 2023
xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection Nuno M. Guerreiro Ricardo Rei Daan van Stigt Luísa Coheur Pierre Colombo André F.T. Martins 24 109 0 16 Oct 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization Ondrej Skopek Rahul Aralikatte Sian Gooding Victor Carbune ELM 31 17 0 12 Oct 2023
It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Risk Amanda Bertsch Alex Xie Graham Neubig Matthew R. Gormley 20 31 0 02 Oct 2023
Segmentation-Free Streaming Machine Translation Javier Iranzo-Sánchez Jorge Iranzo-Sánchez Adria Giménez Jorge Civera Saiz A. Juan VOS 14 1 0 26 Sep 2023
Reranking for Natural Language Generation from Logical Forms: A Study based on Large Language Models Levon Haroutunian Zhuang Li Lucian Galescu Philip R. Cohen Raj Tumuluri Gholamreza Haffari LRM 13 1 0 21 Sep 2023
Time Travel in LLMs: Tracing Data Contamination in Large Language Models Shahriar Golchin Mihai Surdeanu 14 90 0 16 Aug 2023
This is not correct! Negation-aware Evaluation of Language Generation Systems Miriam Anschütz Diego Miguel Lozano Georg Groh 19 6 0 26 Jul 2023
Benchmarking Large Language Model Capabilities for Conditional Generation Joshua Maynez Priyanka Agrawal Sebastian Gehrmann ELM LM&MA 20 28 0 29 Jun 2023
YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpus David C. Uthus Garrett Tanzer Manfred Georg SLR 32 39 0 27 Jun 2023
FunQA: Towards Surprising Video Comprehension Binzhu Xie Sicheng Zhang Zitang Zhou Bo-wen Li Yuanhan Zhang Jack Hessel Jingkang Yang Ziwei Liu 21 20 0 26 Jun 2023