173

How Important is `Perfect' English for Machine Translation Prompts?

Main:7 Pages
10 Figures
Bibliography:4 Pages
7 Tables
Appendix:6 Pages
Abstract

Large language models (LLMs) have achieved top results in recent machine translation evaluations, but they are also known to be sensitive to errors and perturbations in their prompts. We systematically evaluate how both humanly plausible and synthetic errors in user prompts affect LLMs' performance on two related tasks: Machine translation and machine translation evaluation. We provide both a quantitative analysis and qualitative insights into how the models respond to increasing noise in the user prompt.

View on arXiv
Comments on this paper