Can We Use Large Language Models to Fill Relevance Judgment Holes?

9 May 2024

Papers citing "Can We Use Large Language Models to Fill Relevance Judgment Holes?"

9 / 9 papers shown

Title
LLM-Driven Usefulness Judgment for Web Search Evaluation Mouly Dewan Jiqun Liu Aditya Gautam Chirag Shah 45 0 0 19 Apr 2025
Augmented Relevance Datasets with Fine-Tuned Small LLMs Quentin Fitte-Rey Matyas Amrouche Romain Deveaud 34 0 0 14 Apr 2025
How do Large Language Models Understand Relevance? A Mechanistic Interpretability Perspective Qi Liu Jiaxin Mao Ji-Rong Wen LRM 29 0 0 10 Apr 2025
Query Understanding in LLM-based Conversational Information Seeking Yifei Yuan Zahra Abbasiantaeb Yang Deng Mohammad Aliannejadi 35 0 0 08 Apr 2025
LLM-Driven Usefulness Labeling for IR Evaluation Mouly Dewan Jiqun Liu Chirag Shah 56 0 0 13 Mar 2025
IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrieval Tingyu Song Guo Gan Mingsheng Shang Yilun Zhao VLM 58 0 0 06 Mar 2025
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge Dawei Li Bohan Jiang Liangjie Huang Alimohammad Beigi Chengshuai Zhao ... Canyu Chen Tianhao Wu Kai Shu Lu Cheng Huan Liu ELM AILaw 113 65 0 25 Nov 2024
Query Performance Prediction using Relevance Judgments Generated by Large Language Models Chuan Meng Negar Arabzadeh Arian Askari Mohammad Aliannejadi Maarten de Rijke LRM 27 11 0 01 Apr 2024
TREC iKAT 2023: The Interactive Knowledge Assistance Track Overview Mohammad Aliannejadi Zahra Abbasiantaeb Shubham Chatterjee Jeffery Dalton Leif Azzopardi 41 17 0 02 Jan 2024