Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense
Passage Retrieval

Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval

20 January 2024

Papers citing "Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval"

9 / 9 papers shown

Title
Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval Guangyuan Ma Yongliang Ma Xing Wu Zhenpeng Su Ming Zhou Songlin Hu OOD 36 2 0 20 Aug 2024
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models Shitao Xiao Zheng Liu Yingxia Shao Weidong (Tom) Cai RALM 40 22 0 04 May 2023
CoT-MAE v2: Contextual Masked Auto-Encoder with Multi-view Modeling for Passage Retrieval Xing Wu Guangyuan Ma Peng Wang Meng Lin Zijia Lin Fuzheng Zhang Songlin Hu RALM 16 7 0 05 Apr 2023
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder Shitao Xiao Zheng Liu Yingxia Shao Zhao Cao RALM 115 109 0 24 May 2022
ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval Yuxiang Lu Yiding Liu Jiaxiang Liu Yunsheng Shi Zhengjie Huang ... Hao Tian Hua-Hong Wu Shuaiqiang Wang Dawei Yin Haifeng Wang 112 58 0 18 May 2022
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking Ruiyang Ren Yingqi Qu Jing Liu Wayne Xin Zhao Qiaoqiao She Hua-Hong Wu Haifeng Wang Ji-Rong Wen 124 247 0 14 Oct 2021
Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval Luyu Gao Jamie Callan RALM 152 329 0 12 Aug 2021
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 229 961 0 17 Apr 2021
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering Yingqi Qu Yuchen Ding Jing Liu Kai Liu Ruiyang Ren Xin Zhao Daxiang Dong Hua-Hong Wu Haifeng Wang RALM OffRL 206 593 0 16 Oct 2020