Efficient LLM Comparative Assessment: a Product of Experts Framework for
Pairwise Comparisons

Efficient LLM Comparative Assessment: a Product of Experts Framework for Pairwise Comparisons

9 May 2024

Yassir Fathullah

Mark J. F. Gales

Papers citing "Efficient LLM Comparative Assessment: a Product of Experts Framework for Pairwise Comparisons"

10 / 10 papers shown

Title
SAS-Bench: A Fine-Grained Benchmark for Evaluating Short Answer Scoring with Large Language Models Peichao Lai K. Zhang Yi-Tun Lin L. Zhang Feiyang Ye ... Y. Xu Conghui He Y. Wang Wentao Zhang Bin Cui ELM LRM 27 0 0 12 May 2025
Aggregation of Dependent Expert Distributions in Multimodal Variational Autoencoders R. A. Mancisidor Robert Jenssen Shujian Yu Michael C. Kampffmeyer 15 0 0 02 May 2025
Optimizing Compound Retrieval Systems Harrie Oosterhuis R. Jagerman Zhen Qin Xuanhui Wang 36 0 0 16 Apr 2025
Efficient Portfolio Selection through Preference Aggregation with Quicksort and the Bradley--Terry Model Yurun Ge Lucas Böttcher T. Chou Maria R. DÓrsogna 22 0 0 06 Apr 2025
Improving LLM-as-a-Judge Inference with the Judgment Distribution Victor Wang Michael J.Q. Zhang Eunsol Choi 53 0 0 04 Mar 2025
Finetuning LLMs for Comparative Assessment Tasks Vatsal Raina Adian Liusie Mark J. F. Gales 26 1 0 24 Sep 2024
PairEval: Open-domain Dialogue Evaluation with Pairwise Comparison chaeHun Park Minseok Choi Dohyun Lee Jaegul Choo 35 4 0 01 Apr 2024
Humans or LLMs as the Judge? A Study on Judgement Biases Guiming Hardy Chen Shunian Chen Ziche Liu Feng Jiang Benyou Wang 74 89 0 16 Feb 2024
Zero-shot Audio Topic Reranking using Large Language Models Mengjie Qian Rao Ma Adian Liusie Erfan Loweimi Kate Knill Mark J. F. Gales 24 1 0 14 Sep 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022