INSTRUCTIR: A Benchmark for Instruction Following of Information
Retrieval Models

INSTRUCTIR: A Benchmark for Instruction Following of Information Retrieval Models

22 February 2024

Hyunji Lee

Papers citing "INSTRUCTIR: A Benchmark for Instruction Following of Information Retrieval Models"

16 / 16 papers shown

Title
MultiConIR: Towards multi-condition Information Retrieval Xuan Lu Sifan Liu Bochao Yin Y. K. Li Xinghao Chen Hui Su Yaohui Jin Wenjun Zeng Xiaoyu Shen 64 0 0 13 Mar 2025
Exploiting Instruction-Following Retrievers for Malicious Information Retrieval Parishad BehnamGhader Nicholas Meade Siva Reddy 58 0 0 11 Mar 2025
IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrieval Tingyu Song Guo Gan Mingsheng Shang Yilun Zhao VLM 51 0 0 06 Mar 2025
OrdRankBen: A Novel Ranking Benchmark for Ordinal Relevance in NLP Yan Wang Lingfei Qian Xueqing Peng J. Huang Dongji Feng 34 0 0 02 Mar 2025
Rank1: Test-Time Compute for Reranking in Information Retrieval Orion Weller Kathryn Ricci Eugene Yang Andrew Yates Dawn J Lawrie Benjamin Van Durme ReLM AI4TS LRM 126 4 0 25 Feb 2025
Learning to Explore and Select for Coverage-Conditioned Retrieval-Augmented Generation Takyoung Kim Kyungjae Lee Y. Jang Ji Yong Cho Gangwoo Kim Minseok Cho Moontae Lee 80 0 0 28 Jan 2025
RARe: Retrieval Augmented Retrieval with In-Context Examples Atula Tejaswi Yoonsang Lee Sujay Sanghavi Eunsol Choi RALM LRM 25 1 0 26 Oct 2024
Instruction Embedding: Latent Representations of Instructions Towards Task Identification Yiwei Li Jiayi Shi Shaoxiong Feng Peiwen Yuan Xinglin Wang Boyuan Pan Heda Wang Yao Hu Kan Li 18 1 0 29 Sep 2024
Disentangling Questions from Query Generation for Task-Adaptive Retrieval Yoonsang Lee Minsoo Kim Seung-won Hwang RALM 16 0 0 25 Sep 2024
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models Orion Weller Benjamin Van Durme Dawn J Lawrie Ashwin Paranjape Yuhao Zhang Jack Hessel LRM RALM 43 16 0 17 Sep 2024
CodeUpdateArena: Benchmarking Knowledge Editing on API Updates Zeyu Leo Liu Shrey Pandit Xi Ye Eunsol Choi Greg Durrett KELM ALM 57 4 0 08 Jul 2024
ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval Kelong Mao Chenlong Deng Haonan Chen Fengran Mo Zheng Liu Tetsuya Sakai Zhicheng Dou KELM 26 11 0 21 Apr 2024
AmbigDocs: Reasoning across Documents on Different Entities under the Same Name Yoonsang Lee Xi Ye Eunsol Choi 30 5 0 18 Apr 2024
FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions Orion Weller Benjamin Chang Sean MacAvaney Kyle Lo Arman Cohan Benjamin Van Durme Dawn J Lawrie Luca Soldaini 45 27 0 22 Mar 2024
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 229 961 0 17 Apr 2021