Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors

8 October 2021

Papers citing "Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors"

19 / 19 papers shown

Title
Onco-Retriever: Generative Classifier for Retrieval of EHR Records in Oncology Shashi Kant Gupta Aditya Basu Bradley Taylor Anai N. Kothari Hrituraj Singh RALM 21 3 0 10 Apr 2024
The Eval4NLP 2023 Shared Task on Prompting Large Language Models as Explainable Metrics Christoph Leiter Juri Opitz Daniel Deutsch Yang Gao Rotem Dror Steffen Eger ALM LRM ELM 27 31 0 30 Oct 2023
Towards Explainable Evaluation Metrics for Machine Translation Christoph Leiter Piyawat Lertvittayakumjorn M. Fomicheva Wei-Ye Zhao Yang Gao Steffen Eger ELM 26 12 0 22 Jun 2023
Description-Based Text Similarity Shauli Ravfogel Valentina Pyatkin Amir D. N. Cohen Avshalom Manevich Yoav Goldberg 20 5 0 21 May 2023
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist Iftitahu Ni'mah Meng Fang Vlado Menkovski Mykola Pechenizkiy 25 12 0 15 May 2023
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation Tianxing He Jingyu Zhang Tianle Wang Sachin Kumar Kyunghyun Cho James R. Glass Yulia Tsvetkov 25 44 0 20 Dec 2022
DEMETR: Diagnosing Evaluation Metrics for Translation Marzena Karpinska N. Raj Katherine Thai Yixiao Song Ankita Gupta Mohit Iyyer 21 36 0 25 Oct 2022
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation Metrics Daniil Larionov Jens Grunwald Christoph Leiter Steffen Eger 8 5 0 20 Sep 2022
Towards explainable evaluation of language models on the semantic similarity of visual concepts Maria Lymperaiou George Manoliadis Orfeas Menis-Mastromichalakis Edmund Dervakos Giorgos Stamou AAML 13 5 0 08 Sep 2022
Layer or Representation Space: What makes BERT-based Evaluation Metrics Robust? Doan Nam Long Vu N. Moosavi Steffen Eger 14 9 0 06 Sep 2022
MENLI: Robust Evaluation Metrics from Natural Language Inference Yanran Chen Steffen Eger 27 15 0 15 Aug 2022
Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview Florian Karl Tobias Pielok Julia Moosbauer Florian Pfisterer Stefan Coors ... Jakob Richter Michel Lang Eduardo C. Garrido-Merchán Juergen Branke B. Bischl AI4CE 26 56 0 15 Jun 2022
SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Features Juri Opitz Anette Frank 17 32 0 14 Jun 2022
Towards Explainable Evaluation Metrics for Natural Language Generation Christoph Leiter Piyawat Lertvittayakumjorn M. Fomicheva Wei-Ye Zhao Yang Gao Steffen Eger AAML ELM 22 20 0 21 Mar 2022
FastKASSIM: A Fast Tree Kernel-Based Syntactic Similarity Metric Maximillian Chen Caitlyn Chen Xiao Yu Zhou Yu 11 7 0 15 Mar 2022
USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation Jonas Belouadi Steffen Eger 24 20 0 21 Feb 2022
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text Sebastian Gehrmann Elizabeth Clark Thibault Sellam ELM AI4CE 58 181 0 14 Feb 2022
DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence Wei-Ye Zhao Michael Strube Steffen Eger 19 37 0 26 Jan 2022
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 199 879 0 03 May 2018