PROD: Progressive Distillation for Dense Retrieval

27 September 2022

Papers citing "PROD: Progressive Distillation for Dense Retrieval"

28 / 28 papers shown

Title
MURR: Model Updating with Regularized Replay for Searching a Document Stream Eugene Yang Nicola Tonellotto Dawn J Lawrie Sean MacAvaney James Mayfield Douglas W. Oard Scott Miller KELM 33 0 0 14 Apr 2025
Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation Abdelrahman Abdallah Bhawna Piryani Jamshid Mozafari Mohammed Ali Adam Jatowt 79 1 0 21 Feb 2025
Hypencoder: Hypernetworks for Information Retrieval Julian Killingback Hansi Zeng Hamed Zamani 101 1 0 07 Feb 2025
PairDistill: Pairwise Relevance Distillation for Dense Retrieval Chao-Wei Huang Yun-Nung Chen 28 1 0 02 Oct 2024
Leveraging Estimated Transferability Over Human Intuition for Model Selection in Text Ranking Jun Bai Zhuofan Chen Zhenzi Li Hanhua Hong Jianfei Zhang Chen Li Chenghua Lin Wenge Rong 14 0 0 24 Sep 2024
Applications of Knowledge Distillation in Remote Sensing: A Survey Yassine Himeur N. Aburaed O. Elharrouss Iraklis Varlamis Shadi Atalla W. Mansoor Hussain Al Ahmad 29 4 0 18 Sep 2024
Domain Adaptation of Multilingual Semantic Search -- Literature Review Anna Bringmann Anastasia Zhukova VLM 20 0 0 05 Feb 2024
Translate-Distill: Learning Cross-Language Dense Retrieval by Translation and Distillation Eugene Yang Dawn J Lawrie J. Mayfield Douglas W. Oard Scott Miller FedML VLM 36 8 0 09 Jan 2024
Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization Shiqi Wang Yeqin Zhang Cam-Tu Nguyen 17 2 0 30 Dec 2023
Efficient Title Reranker for Fast and Improved Knowledge-Intense NLP Ziyi Chen Jize Jiang Daqian Zuo Heyi Tao Jun Yang Yuxiang Wei 21 0 0 19 Dec 2023
Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiency Yuxuan Wang Hong Lyu 11 1 0 05 Jun 2023
GripRank: Bridging the Gap between Retrieval and Generation via the Generative Knowledge Improved Passage Ranking Jiaqi Bai Hongcheng Guo Jiaheng Liu Jian Yang Xinnian Liang Zhao Yan Zhoujun Li RALM 19 14 0 29 May 2023
Task-agnostic Distillation of Encoder-Decoder Language Models Chen Zhang Yang Yang Jingang Wang Dawei Song 27 4 0 21 May 2023
AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators Xingwei He Zheng-Wen Lin Yeyun Gong Alex Jin Hang Zhang Chen Lin Jian Jiao S. Yiu Nan Duan Weizhu Chen 28 184 0 29 Mar 2023
How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrieval Sheng-Chieh Lin Akari Asai Minghan Li Barlas Oğuz Jimmy J. Lin Yashar Mehdad Wen-tau Yih Xilun Chen 19 93 0 15 Feb 2023
Adam: Dense Retrieval Distillation with Adaptive Dark Examples Chongyang Tao Chang Liu Tao Shen Can Xu Xiubo Geng Binxing Jiao Daxin Jiang 23 3 0 20 Dec 2022
LEAD: Liberal Feature-based Distillation for Dense Retrieval Hao-Lun Sun Xiao Liu Yeyun Gong Anlei Dong Jing Lu Yan Zhang Linjun Yang Rangan Majumder Nan Duan 37 2 0 10 Dec 2022
LED: Lexicon-Enlightened Dense Retriever for Large-Scale Retrieval Kai Zhang Chongyang Tao Tao Shen Can Xu Xiubo Geng Binxing Jiao Daxin Jiang RALM 19 24 0 29 Aug 2022
MiniDisc: Minimal Distillation Schedule for Language Model Compression Chen Zhang Yang Yang Qifan Wang Jiahao Liu Jingang Wang Wei Yu Wu Dawei Song 42 4 0 29 May 2022
ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval Yuxiang Lu Yiding Liu Jiaxiang Liu Yunsheng Shi Zhengjie Huang ... Hao Tian Hua-Hong Wu Shuaiqiang Wang Dawei Yin Haifeng Wang 112 58 0 18 May 2022
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher Mehdi Rezagholizadeh A. Jafari Puneeth Salad Pranav Sharma Ali Saheb Pasand A. Ghodsi 60 17 0 16 Oct 2021
$Understanding Dataset Difficulty with $\mathcal{V}$-Usable Information$ Understanding Dataset Difficulty with $\mathcal{V}$ -Usable Information Kawin Ethayarajh Yejin Choi Swabha Swayamdipta 159 229 0 16 Oct 2021
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking Ruiyang Ren Yingqi Qu Jing Liu Wayne Xin Zhao Qiaoqiao She Hua-Hong Wu Haifeng Wang Ji-Rong Wen 124 247 0 14 Oct 2021
SPLADE v2: Sparse Lexical and Expansion Model for Information Retrieval Thibault Formal Carlos Lassance Benjamin Piwowarski S. Clinchant 194 186 0 21 Sep 2021
PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrieval Ruiyang Ren Shangwen Lv Yingqi Qu Jing Liu Wayne Xin Zhao Qiaoqiao She Hua-Hong Wu Haifeng Wang Ji-Rong Wen 118 90 0 13 Aug 2021
Distilling Knowledge via Knowledge Review Pengguang Chen Shu-Lin Liu Hengshuang Zhao Jiaya Jia 147 419 0 19 Apr 2021
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering Yingqi Qu Yuchen Ding Jing Liu Kai Liu Ruiyang Ren Xin Zhao Daxiang Dong Hua-Hong Wu Haifeng Wang RALM OffRL 209 593 0 16 Oct 2020
Overview of the TREC 2019 deep learning track Nick Craswell Bhaskar Mitra Emine Yilmaz Daniel Fernando Campos E. Voorhees 174 463 0 17 Mar 2020