Error Analysis Prompting Enables Human-Like Translation Evaluation in
Large Language Models

Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models

24 March 2023

Liang Ding

Papers citing "Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models"

19 / 69 papers shown

Title
Towards Explainable Evaluation Metrics for Machine Translation Christoph Leiter Piyawat Lertvittayakumjorn M. Fomicheva Wei-Ye Zhao Yang Gao Steffen Eger ELM 12 11 0 22 Jun 2023
Iterative Translation Refinement with Large Language Models Pinzhen Chen Zhicheng Guo Barry Haddow Kenneth Heafield LRM 10 22 0 06 Jun 2023
Large Language Models are not Fair Evaluators Peiyi Wang Lei Li Liang Chen Zefan Cai Dawei Zhu Binghuai Lin Yunbo Cao Qi Liu Tianyu Liu Zhifang Sui ALM 14 505 0 29 May 2023
BookGPT: A General Framework for Book Recommendation Empowered by Large Language Model Aakas Zhiyuli YanFang Chen Xuan Zhang Xun Liang ALM LLMAG 20 17 0 25 May 2023
Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References Tianyi Tang Hongyuan Lu Yuchen Eleanor Jiang Haoyang Huang Dongdong Zhang Wayne Xin Zhao Tom Kocmi Furu Wei 13 0 0 24 May 2023
Leveraging GPT-4 for Automatic Translation Post-Editing Vikas Raunak Amr Sharaf Yiren Wang H. Awadallah Arul Menezes 11 62 0 24 May 2023
Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks Haoqi Zheng Qihuang Zhong Liang Ding Zhiliang Tian Xin-Yi Niu Dongsheng Li Dacheng Tao VLM 29 6 0 22 May 2023
A Survey on Zero Pronoun Translation Longyue Wang Siyou Liu Mingzhou Xu Linfeng Song Shuming Shi Zhaopeng Tu 23 6 0 17 May 2023
Exploring Human-Like Translation Strategy with Large Language Models Zhiwei He Tian Liang Wenxiang Jiao Zhuosheng Zhang Yujiu Yang Rui Wang Zhaopeng Tu Shuming Shi Xing Wang 13 35 0 06 May 2023
Prompt-Learning for Cross-Lingual Relation Extraction Chiaming Hsu Changtong Zan Liang Ding Longyue Wang Xiaoting Wang Weifeng Liu Fu Lin Wenbin Hu LRM 11 5 0 20 Apr 2023
G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment Yang Liu Dan Iter Yichong Xu Shuohang Wang Ruochen Xu Chenguang Zhu ELM ALM LM&MA 12 1,063 0 29 Mar 2023
Hallucinations in Large Multilingual Translation Models Nuno M. Guerreiro Duarte M. Alves Jonas Waldendorf Barry Haddow Alexandra Birch Pierre Colombo André F.T. Martins VLM HILM LRM 13 139 0 28 Mar 2023
Towards Making the Most of ChatGPT for Machine Translation Keqin Peng Liang Ding Qihuang Zhong Li Shen Xuebo Liu Min Zhang Y. Ouyang Dacheng Tao LRM 81 132 0 24 Mar 2023
Large Language Models Are State-of-the-Art Evaluators of Translation Quality Tom Kocmi C. Federmann ELM 29 329 0 28 Feb 2023
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis Qingyu Lu Liang Ding Liping Xie Kanjian Zhang Derek F. Wong Dacheng Tao ELM ALM 18 12 0 20 Dec 2022
Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis Wenda Xu Yi-Lin Tuan Yujie Lu Michael Stephen Saxon Lei Li William Yang Wang 31 22 0 10 Oct 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 315 8,261 0 28 Jan 2022
Understanding and Improving Lexical Choice in Non-Autoregressive Translation Liang Ding Longyue Wang Xuebo Liu Derek F. Wong Dacheng Tao Zhaopeng Tu 91 76 0 29 Dec 2020