Unsupervised Quality Estimation for Neural Machine Translation

21 May 2020

Francisco Guzmán

Papers citing "Unsupervised Quality Estimation for Neural Machine Translation"

38 / 38 papers shown

Title
LLM-Independent Adaptive RAG: Let the Question Speak for Itself Maria Marina Nikolay Ivanov Sergey Pletenev Mikhail Salnikov Daria Galimzianova Nikita Krayko Vasily Konovalov Alexander Panchenko Viktor Moskvoretskii RALM 42 0 0 07 May 2025
Calibrating Uncertainty Quantification of Multi-Modal LLMs using Grounding Trilok Padhi R. Kaur Adam D. Cobb Manoj Acharya Anirban Roy Colin Samplawski Brian Matejek Alexander M. Berenbeim Nathaniel D. Bastian Susmit Jha 28 0 0 30 Apr 2025
Calibrating Translation Decoding with Quality Estimation on LLMs Di Wu Yibin Lei Christof Monz 70 0 0 26 Apr 2025
Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review Toghrul Abbasli Kentaroh Toyoda Yuan Wang Leon Witt Muhammad Asif Ali Yukai Miao Dan Li Qingsong Wei UQCV 92 0 0 25 Apr 2025
Semantic Volume: Quantifying and Detecting both External and Internal Uncertainty in LLMs Xiaomin Li Zhou Yu Ziji Zhang Yingying Zhuang S. Narayanan Sadagopan Anurag Beniwal HILM 58 0 0 28 Feb 2025
Alleviating Distribution Shift in Synthetic Data for Machine Translation Quality Estimation Xiang Geng Zhejian Lai Jiajun Chen Hao Yang Shujian Huang 62 0 0 27 Feb 2025
Adaptive Retrieval Without Self-Knowledge? Bringing Uncertainty Back Home Viktor Moskvoretskii M. Lysyuk Mikhail Salnikov Nikolay Ivanov Sergey Pletenev Daria Galimzianova Nikita Krayko Vasily Konovalov Irina Nikishina Alexander Panchenko RALM 74 4 0 24 Feb 2025
Can Your Uncertainty Scores Detect Hallucinated Entity? Min-Hsuan Yeh Max Kamachee Seongheon Park Yixuan Li HILM 53 1 0 17 Feb 2025
Do LLMs estimate uncertainty well in instruction-following? Juyeon Heo Miao Xiong Christina Heinze-Deml Jaya Narain ELM 50 3 0 18 Oct 2024
MAQA: Evaluating Uncertainty Quantification in LLMs Regarding Data Uncertainty Yongjin Yang Haneul Yoo Hwaran Lee 65 1 0 13 Aug 2024
Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraph Roman Vashurin Ekaterina Fadeeva Artem Vazhentsev Akim Tsvigun Daniil Vasilev ... Timothy Baldwin Timothy Baldwin Maxim Panov Artem Shelmanov Artem Shelmanov HILM 66 8 0 21 Jun 2024
Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs D. Yaldiz Yavuz Faruk Bakman Baturalp Buyukates Chenyang Tao Anil Ramakrishna Dimitrios Dimitriadis Jieyu Zhao Salman Avestimehr 44 2 0 17 Jun 2024
CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMs Shuang Ao Stefan Rueger Advaith Siddharthan 33 1 0 05 Jun 2024
Can We Verify Step by Step for Incorrect Answer Detection? Xin Xu Shizhe Diao Can Yang Yang Wang LRM 122 13 0 16 Feb 2024
Introspective Planning: Aligning Robots' Uncertainty with Inherent Task Ambiguity Kaiqu Liang Zixu Zhang J. F. Fisac LLMAG 46 6 0 09 Feb 2024
Cousins Of The Vendi Score: A Family Of Similarity-Based Diversity Metrics For Science And Machine Learning Amey P. Pasarkar Adji Bousso Dieng 27 11 0 19 Oct 2023
Learning Evaluation Models from Large Language Models for Sequence Generation Chenglong Wang Hang Zhou Kai-Chun Chang Tongran Liu Chunliang Zhang Quan Du Tong Xiao Yue Zhang Jingbo Zhu ELM 34 3 0 08 Aug 2023
Generate, Transform, Answer: Question Specific Tool Synthesis for Tabular Data Carlos Gemmell Jeffrey Stephen Dalton LMTD 27 13 0 17 Mar 2023
Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection Weijia Xu Sweta Agrawal Eleftheria Briakou Marianna J. Martindale Marine Carpuat HILM 24 46 0 18 Jan 2023
Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality? Pei Zhang Baosong Yang Hao-Ran Wei Dayiheng Liu Kai Fan Luo Si Jun Xie 19 3 0 25 Nov 2022
Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Resource MT Models Harshita Diddee Sandipan Dandapat Monojit Choudhury T. Ganu Kalika Bali 27 5 0 27 Oct 2022
AugCSE: Contrastive Sentence Embedding with Diverse Augmentations Zilu Tang Muhammed Yusuf Kocyigit Derry Wijaya 35 8 0 20 Oct 2022
Mismatching-Aware Unsupervised Translation Quality Estimation For Low-Resource Languages Fatemeh Azadi Heshaam Faili M. Dousti 15 4 0 31 Jul 2022
Shifts 2.0: Extending The Dataset of Real Distributional Shifts A. Malinin A. Athanasopoulos M. Barakovic Meritxell Bach Cuadra Mark J. F. Gales ... Francesco La Rosa Eli Sivena V. Tsarsitalidis Efi Tsompopoulou E. Volf OOD 22 28 0 30 Jun 2022
Learning to Scaffold: Optimizing Model Explanations for Teaching Patrick Fernandes Marcos Vinícius Treviso Danish Pruthi André F. T. Martins Graham Neubig FAtt 19 22 0 22 Apr 2022
Learning Confidence for Transformer-based Neural Machine Translation Yu Lu Jiali Zeng Jiajun Zhang Shuangzhi Wu Mu Li 36 9 0 22 Mar 2022
Towards Explainable Evaluation Metrics for Natural Language Generation Christoph Leiter Piyawat Lertvittayakumjorn M. Fomicheva Wei-Ye Zhao Yang Gao Steffen Eger AAML ELM 22 20 0 21 Mar 2022
QEMind: Alibaba's Submission to the WMT21 Quality Estimation Shared Task Jiayi Wang Ke Min Wang Boxing Chen Yu Zhao Weihua Luo Yuqi Zhang 59 13 0 30 Dec 2021
Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation Ke Min Wang Yangbin Shi Jiayi Wang Yuqi Zhang Yu Zhao Xiaolin Zheng 44 6 0 15 Sep 2021
Translation Error Detection as Rationale Extraction M. Fomicheva Lucia Specia Nikolaos Aletras 13 23 0 27 Aug 2021
Icelandic Parallel Abstracts Corpus Haukur Barri Símonarson Vésteinn Snæbjarnarson 13 1 0 11 Aug 2021
ChrEnTranslate: Cherokee-English Machine Translation Demo with Quality Estimation and Corrective Feedback Shiyue Zhang B. Frey Mohit Bansal 18 7 0 30 Jul 2021
Knowledge Distillation for Quality Estimation Amit Gajbhiye M. Fomicheva Fernando Alva-Manchego Frédéric Blain A. Obamuyide Nikolaos Aletras Lucia Specia 19 11 0 01 Jul 2021
Translation Quality Assessment: A Brief Survey on Manual and Automatic Methods Lifeng Han Gareth J. F. Jones A. Smeaton 8 36 0 05 May 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,660 0 05 Dec 2016
Neural versus Phrase-Based Machine Translation Quality: a Case Study L. Bentivogli Arianna Bisazza Mauro Cettolo Marcello Federico 191 328 0 16 Aug 2016
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,923 0 17 Aug 2015
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 285 9,136 0 06 Jun 2015