From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effective

10 May 2022

Papers citing "From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effective"

50 / 59 papers shown

Title
Leveraging Decoder Architectures for Learned Sparse Retrieval Jingfen Qiao Thong Nguyen Evangelos Kanoulas Andrew Yates 49 0 0 25 Apr 2025
CSPLADE: Learned Sparse Retrieval with Causal Language Models Zhichao Xu Aosong Feng Yijun Tian Haibo Ding Lin Leee Cheong RALM 40 0 0 15 Apr 2025
MURR: Model Updating with Regularized Replay for Searching a Document Stream Eugene Yang Nicola Tonellotto Dawn J Lawrie Sean MacAvaney James Mayfield Douglas W. Oard Scott Miller KELM 33 0 0 14 Apr 2025
OSCAR: Online Soft Compression And Reranking Maxime Louis Thibault Formal Hervé Déjean S. Clinchant 28 0 0 17 Mar 2025
Variations in Relevance Judgments and the Shelf Life of Test Collections Andrew Parry Maik Frobe Harrisen Scells Ferdinand Schlatt Guglielmo Faggioli Saber Zerhoudi Sean MacAvaney Eugene Yang 40 0 0 28 Feb 2025
Improving Scientific Document Retrieval with Concept Coverage-based Query Set Generation SeongKu Kang Bowen Jin Wonbin Kweon Yu Zhang Dongha Lee J. Han Hwanjo Yu 57 0 0 16 Feb 2025
A Comparative Study of Text Retrieval Models on DaReCzech Jakub Stetina Martin Fajcik Michal Stefanik Michal Hradis 74 0 0 19 Nov 2024
Best Practices for Distilling Large Language Models into BERT for Web Search Ranking Dezhi Ye Junwei Hu Jiabin Fan Bowen Tian Jie Liu Haijin Liang Jin Ma 36 1 0 07 Nov 2024
Taxonomy-guided Semantic Indexing for Academic Paper Search SeongKu Kang Yunyi Zhang Pengcheng Jiang Dongha Lee J. Han Hwanjo Yu 34 3 0 25 Oct 2024
Link, Synthesize, Retrieve: Universal Document Linking for Zero-Shot Information Retrieval Dae Yon Hwang Bilal Taha Harshit Pande Yaroslav Nechaev SyDa 26 0 0 24 Oct 2024
HyQE: Ranking Contexts with Hypothetical Query Embeddings Weichao Zhou Jiaxin Zhang Hilaf Hasson Anu Singh Wenchao Li RALM 19 1 0 20 Oct 2024
Reward-RAG: Enhancing RAG with Reward Driven Supervision Thang Nguyen Peter Chin Yu-Wing Tai RALM 34 4 0 03 Oct 2024
Results of the Big ANN: NeurIPS'23 competition H. Simhadri Martin Aumüller Amir Ingber Matthijs Douze G. Williams ... Yizhuo Chen W. J. Zheng Zihao Wan Jie Yin Ben Huang 24 5 0 25 Sep 2024
Leveraging Estimated Transferability Over Human Intuition for Model Selection in Text Ranking Jun Bai Zhuofan Chen Zhenzi Li Hanhua Hong Jianfei Zhang Chen Li Chenghua Lin Wenge Rong 24 0 0 24 Sep 2024
Mistral-SPLADE: LLMs for better Learned Sparse Retrieval Meet Doshi Vishwajeet Kumar Rudra Murthy Vignesh P Jaydeep Sen RALM 20 2 0 20 Aug 2024
Robust Neural Information Retrieval: An Adversarial and Out-of-distribution Perspective Yu-An Liu Ruqing Zhang Jiafeng Guo Maarten de Rijke Yixing Fan Xueqi Cheng 33 6 0 09 Jul 2024
BERGEN: A Benchmarking Library for Retrieval-Augmented Generation David Rau Hervé Déjean Nadezhda Chirkova Thibault Formal Shuai Wang Vassilina Nikoulina S. Clinchant 45 10 0 01 Jul 2024
APEER: Automatic Prompt Engineering Enhances Large Language Model Reranking Can Jin Hongwu Peng Shiyu Zhao Zhenting Wang Wujiang Xu Ligong Han Jiahui Zhao Kai Zhong Sanguthevar Rajasekaran Dimitris N. Metaxas KELM 40 32 0 20 Jun 2024
TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategy Yiqun Chen Qi Liu Yi Zhang Weiwei Sun Daiting Shi Jiaxin Mao Dawei Yin Jiaxin Mao Dawei Yin 33 6 0 17 Jun 2024
Ranked List Truncation for Large Language Model-based Re-Ranking Chuan Meng Negar Arabzadeh Arian Askari Mohammad Aliannejadi Maarten de Rijke LRM 37 13 0 28 Apr 2024
ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval Kelong Mao Chenlong Deng Haonan Chen Fengran Mo Zheng Liu Tetsuya Sakai Zhicheng Dou KELM 39 11 0 21 Apr 2024
FecTek: Enhancing Term Weight in Lexicon-Based Retrieval with Feature Context and Term-level Knowledge Zunran Wang Zhonghua Li Wei Shen Qi Ye Liqiang Nie 25 0 0 18 Apr 2024
LLM-Augmented Retrieval: Enhancing Retrieval Models Through Language Models and Doc-Level Embedding Mingrui Wu Sheng Cao KELM RALM 38 3 0 08 Apr 2024
SPLADE-v3: New baselines for SPLADE Carlos Lassance Hervé Déjean Thibault Formal S. Clinchant 21 23 0 11 Mar 2024
Improving Retrieval in Theme-specific Applications using a Corpus Topical Taxonomy SeongKu Kang Shivam Agarwal Bowen Jin Dongha Lee Hwanjo Yu Jiawei Han 52 6 0 07 Mar 2024
Multimodal Learned Sparse Retrieval with Probabilistic Expansion Control Thong Nguyen Mariya Hendriksen Andrew Yates Maarten de Rijke 40 7 0 27 Feb 2024
Assessing generalization capability of text ranking models in Polish Slawomir Dadas Malgorzata Grkebowiec 34 2 0 22 Feb 2024
PIRB: A Comprehensive Benchmark of Polish Dense and Hybrid Text Retrieval Methods Slawomir Dadas Michal Perelkiewicz Rafal Poswiata 41 3 0 20 Feb 2024
Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval Guangyuan Ma Xing Wu Zijia Lin Songlin Hu 21 3 0 20 Jan 2024
Translate-Distill: Learning Cross-Language Dense Retrieval by Translation and Distillation Eugene Yang Dawn J Lawrie J. Mayfield Douglas W. Oard Scott Miller FedML VLM 38 8 0 09 Jan 2024
Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective Haoyi Xiong Xuhong Li Xiaofei Zhang Jiamin Chen Xinhao Sun Yuchen Li Zeyi Sun Mengnan Du XAI 35 8 0 09 Jan 2024
PEFA: Parameter-Free Adapters for Large-scale Embedding-based Retrieval Models Wei-Cheng Chang Jyun-Yu Jiang Jiong Zhang Mutasem Al-Darabsah C. Teo Cho-Jui Hsieh Hsiang-Fu Yu S. Vishwanathan RALM 19 2 0 05 Dec 2023
Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval Fan Jiang Qiongkai Xu Tom Drummond Trevor Cohn 11 2 0 27 Nov 2023
Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking Shengyao Zhuang Bing Liu Bevan Koopman Guido Zuccon RALM 27 46 0 20 Oct 2023
CarExpert: Leveraging Large Language Models for In-Car Conversational Question Answering Md. Rony Christian Suess Sinchana Ramakanth Bhat Viju Sudhi Julia Schneider Maximilian Vogel Roman Teucher Ken E. Friedl S. Sahoo 21 9 0 14 Oct 2023
RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Models Ronak Pradeep Sahel Sharifymoghaddam Jimmy Lin ALM 29 36 0 26 Sep 2023
Resources for Brewing BEIR: Reproducible Reference Models and an Official Leaderboard Ehsan Kamalloo Nandan Thakur Carlos Lassance Xueguang Ma Jheng-Hong Yang Jimmy J. Lin 20 15 0 13 Jun 2023
Adapting Learned Sparse Retrieval for Long Documents Thong Nguyen Sean MacAvaney Andrew Yates 13 9 0 29 May 2023
NAIL: Lexical Retrieval Indices with Efficient Non-Autoregressive Decoders Livio Baldini Soares D. Gillick Jeremy R. Cole Tom Kwiatkowski 24 1 0 23 May 2023
DAPR: A Benchmark on Document-Aware Passage Retrieval Kexin Wang Nils Reimers Iryna Gurevych 11 5 0 23 May 2023
BERM: Training the Balanced and Extractable Representation for Matching to Improve Generalization Ability of Dense Retrieval Shicheng Xu Liang Pang Huawei Shen Xueqi Cheng 8 11 0 18 May 2023
NevIR: Negation in Neural Information Retrieval Orion Weller Dawn J Lawrie Benjamin Van Durme MU 54 18 0 12 May 2023
Parameter-Efficient Sparse Retrievers and Rerankers using Adapters Vaishali Pal Carlos Lassance Hervé Déjean S. Clinchant 103 3 0 23 Mar 2023
How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrieval Sheng-Chieh Lin Akari Asai Minghan Li Barlas Oğuz Jimmy J. Lin Yashar Mehdad Wen-tau Yih Xilun Chen 26 93 0 15 Feb 2023
LexLIP: Lexicon-Bottlenecked Language-Image Pre-Training for Large-Scale Image-Text Retrieval Ziyang Luo Pu Zhao Can Xu Xiubo Geng Tao Shen Chongyang Tao Jing Ma Qingwen Lin Daxin Jiang VLM CLIP 17 3 0 06 Feb 2023
A Study on FGSM Adversarial Training for Neural Retrieval Simon Lupart S. Clinchant AAML 24 7 0 25 Jan 2023
An Experimental Study on Pretraining Transformers from Scratch for IR Carlos Lassance Hervé Déjean S. Clinchant 21 11 0 25 Jan 2023
In Defense of Cross-Encoders for Zero-Shot Retrieval G. Rosa L. Bonifacio Vitor Jeronymo Hugo Queiroz Abonizio Marzieh Fadaee R. Lotufo Rodrigo Nogueira 21 18 0 12 Dec 2022
Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency Gaps Hiroki Iida Naoaki Okazaki 34 4 0 08 Nov 2022
When Language Model Meets Private Library Daoguang Zan Bei Chen Zeqi Lin Bei Guan Yongji Wang Jian-Guang Lou ALM 74 71 0 31 Oct 2022