Reduce Catastrophic Forgetting of Dense Retrieval Training with
Teleportation Negatives

Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Negatives

31 October 2022

Arnold Overwijk

Zhiyuan Liu

Papers citing "Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Negatives"

12 / 12 papers shown

Title
LLM-Oriented Retrieval Tuner Si Sun Hanqing Zhang Zhiyuan Liu Jie Bao Dawei Song RALM 23 0 0 04 Mar 2024
Policy-Gradient Training of Language Models for Ranking Ge Gao Jonathan D. Chang Claire Cardie Kianté Brantley Thorsten Joachims 12 2 0 06 Oct 2023
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval Yue Yu Yuchen Zhuang Rongzhi Zhang Yu Meng Jiaming Shen Chao Zhang VLM 30 33 0 18 May 2023
Rethinking Dense Retrieval's Few-Shot Ability Si Sun Yi-Wen Lu Shi Yu Xiangyang Li Zhonghua Li Zhao Cao Zhiyuan Liu Deiming Ye Jie Bao 8 0 0 12 Apr 2023
Text and Code Embeddings by Contrastive Pre-Training Arvind Neelakantan Tao Xu Raul Puri Alec Radford Jesse Michael Han ... Tabarak Khan Toki Sherbakov Joanne Jang Peter Welinder Lilian Weng SSL AI4TS 213 421 0 24 Jan 2022
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking Ruiyang Ren Yingqi Qu Jing Liu Wayne Xin Zhao Qiaoqiao She Hua-Hong Wu Haifeng Wang Ji-Rong Wen 126 248 0 14 Oct 2021
PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrieval Ruiyang Ren Shangwen Lv Yingqi Qu Jing Liu Wayne Xin Zhao Qiaoqiao She Hua-Hong Wu Haifeng Wang Ji-Rong Wen 118 90 0 13 Aug 2021
Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval Luyu Gao Jamie Callan RALM 155 329 0 12 Aug 2021
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul N. Bennett Jiawei Han Xia Song 122 202 0 16 Feb 2021
UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering Barlas Oğuz Xilun Chen Vladimir Karpukhin Stanislav Peshterliev Dmytro Okhonko M. Schlichtkrull Sonal Gupta Yashar Mehdad Scott Yih 203 87 0 29 Dec 2020
Distilling Knowledge from Reader to Retriever for Question Answering Gautier Izacard Edouard Grave RALM 180 251 0 08 Dec 2020
RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering Yingqi Qu Yuchen Ding Jing Liu Kai Liu Ruiyang Ren Xin Zhao Daxiang Dong Hua-Hong Wu Haifeng Wang RALM OffRL 209 593 0 16 Oct 2020