Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling

14 April 2021

Papers citing "Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling"

50 / 195 papers shown

Title
Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-ranking D. Gupta Dina Demner-Fushman 29 1 0 07 May 2023
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models Shitao Xiao Zheng Liu Yingxia Shao Weidong (Tom) Cai RALM 45 22 0 04 May 2023
Multivariate Representation Learning for Information Retrieval Hamed Zamani Michael Bendersky DML 24 3 0 27 Apr 2023
A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question Answering Alireza Salemi Juan Altmayer Pizzorno Hamed Zamani 15 14 0 26 Apr 2023
Noise-Robust Dense Retrieval via Contrastive Alignment Post Training Daniel Fernando Campos ChengXiang Zhai Alessandro Magnani 29 4 0 06 Apr 2023
CoT-MAE v2: Contextual Masked Auto-Encoder with Multi-view Modeling for Passage Retrieval Xing Wu Guangyuan Ma Peng Wang Meng Lin Zijia Lin Fuzheng Zhang Songlin Hu RALM 31 7 0 05 Apr 2023
Rethinking the Role of Token Retrieval in Multi-Vector Retrieval Jinhyuk Lee Zhuyun Dai Sai Meher Karthik Duddu Tao Lei Iftekhar Naim Ming-Wei Chang Vincent Zhao 24 15 0 04 Apr 2023
How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrieval Sheng-Chieh Lin Akari Asai Minghan Li Barlas Oğuz Jimmy J. Lin Yashar Mehdad Wen-tau Yih Xilun Chen 34 93 0 15 Feb 2023
Enhancing Model Performance in Multilingual Information Retrieval with Comprehensive Data Engineering Techniques Qi Zhang Zijian Yang Yi-Li Huang Ze Chen Zijian Cai Kangxu Wang Jiewen Zheng Jiarong He Jin Gao LRM VLM 26 1 0 14 Feb 2023
Alloprof: a new French question-answer education dataset and its use in an information retrieval case study Antoine Lefebvre-Brossard Stephane Gazaille Michel C. Desmarais AI4Ed 26 1 0 10 Feb 2023
ControversialQA: Exploring Controversy in Question Answering Zhen Wang Peide Zhu Jie Yang 34 1 0 10 Feb 2023
Augmenting Zero-Shot Dense Retrievers with Plug-in Mixture-of-Memories Suyu Ge Chenyan Xiong Corby Rosset Arnold Overwijk Jiawei Han Paul N. Bennett VLM 41 6 0 07 Feb 2023
EmbedDistill: A Geometric Knowledge Distillation for Information Retrieval Seungyeon Kim A. S. Rawat Manzil Zaheer Sadeep Jayasumana Veeranjaneyulu Sadhanala Wittawat Jitkrittum A. Menon Rob Fergus Surinder Kumar FedML 52 7 0 27 Jan 2023
ExaRanker: Explanation-Augmented Neural Ranker Fernando Ferraretto Thiago Laitz R. Lotufo Rodrigo Nogueira ELM LRM 41 7 0 25 Jan 2023
An Experimental Study on Pretraining Transformers from Scratch for IR Carlos Lassance Hervé Déjean S. Clinchant 28 11 0 25 Jan 2023
Multimodal Inverse Cloze Task for Knowledge-based Visual Question Answering Paul Lerner O. Ferret C. Guinaudeau 29 9 0 11 Jan 2023
Precise Zero-Shot Dense Retrieval without Relevance Labels Luyu Gao Xueguang Ma Jimmy J. Lin Jamie Callan RALM 33 294 0 20 Dec 2022
Adam: Dense Retrieval Distillation with Adaptive Dark Examples Chongyang Tao Chang Liu Tao Shen Can Xu Xiubo Geng Binxing Jiao Daxin Jiang 49 3 0 20 Dec 2022
Query-as-context Pre-training for Dense Passage Retrieval Xing Wu Guangyuan Ma Wanhui Qian Zijia Lin Songlin Hu 35 9 0 19 Dec 2022
CAPSTONE: Curriculum Sampling for Dense Retrieval with Document Expansion Xingwei He Yeyun Gong Alex Jin Hang Zhang Anlei Dong Jian Jiao Siu-Ming Yiu Nan Duan RALM 56 3 0 18 Dec 2022
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers Kun Zhou Xiao Liu Yeyun Gong Wayne Xin Zhao Daxin Jiang Nan Duan Ji-Rong Wen 40 16 0 15 Dec 2022
In Defense of Cross-Encoders for Zero-Shot Retrieval G. Rosa L. Bonifacio Vitor Jeronymo Hugo Queiroz Abonizio Marzieh Fadaee R. Lotufo Rodrigo Nogueira 31 18 0 12 Dec 2022
LEAD: Liberal Feature-based Distillation for Dense Retrieval Hao Sun Xiao Liu Yeyun Gong Anlei Dong Jing Lu Yan Zhang Linjun Yang Rangan Majumder Nan Duan 67 2 0 10 Dec 2022
LawngNLI: A Long-Premise Benchmark for In-Domain Generalization from Short to Long Contexts and for Implication-Based Retrieval William F. Bruno Dan Roth ELM AILaw 30 6 0 06 Dec 2022
CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrieval Minghan Li Sheng-Chieh Lin Barlas Oğuz Asish Ghoshal Jimmy J. Lin Yashar Mehdad Wen-tau Yih Xilun Chen 32 26 0 18 Nov 2022
Task-aware Retrieval with Instructions Akari Asai Timo Schick Patrick Lewis Xilun Chen Gautier Izacard Sebastian Riedel Hannaneh Hajishirzi Wen-tau Yih 45 88 0 16 Nov 2022
RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models Shitao Xiao Zheng Liu RALM 32 2 0 16 Nov 2022
Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Negatives Si Sun Chenyan Xiong Yue Yu Arnold Overwijk Zhiyuan Liu Jie Bao 45 6 0 31 Oct 2022
COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning Yue Yu Chenyan Xiong Si Sun Chao Zhang Arnold Overwijk VLM OOD 57 22 0 27 Oct 2022
Bridging the Training-Inference Gap for Dense Phrase Retrieval Gyuwan Kim Jinhyuk Lee Barlas Oğuz Wenhan Xiong Yizhe Zhang Yashar Mehdad William Yang Wang 48 2 0 25 Oct 2022
Cross-document Event Coreference Search: Task, Dataset and Modeling Alon Eirew Avi Caciularu Ido Dagan 50 10 0 23 Oct 2022
SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval Kun Zhou Yeyun Gong Xiao Liu Wayne Xin Zhao Yelong Shen ... Jing Lu Rangan Majumder Ji-Rong Wen Nan Duan Weizhu Chen 44 33 0 21 Oct 2022
Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking Tim Baumgärtner Leonardo F. R. Ribeiro Nils Reimers Iryna Gurevych 37 6 0 19 Oct 2022
FiD-Light: Efficient and Effective Retrieval-Augmented Text Generation Sebastian Hofstatter Jiecao Chen K. Raman Hamed Zamani RALM 70 77 0 28 Sep 2022
PROD: Progressive Distillation for Dense Retrieval Zhenghao Lin Yeyun Gong Xiao Liu Hang Zhang Chen Lin ... Jian Jiao Jing Lu Daxin Jiang Rangan Majumder Nan Duan 51 27 0 27 Sep 2022
Unified Generative & Dense Retrieval for Query Rewriting in Sponsored Search Akash Kumar Mohankumar Bhargav Dodla K. Gururaj Amit Singh RALM 34 6 0 13 Sep 2022
LED: Lexicon-Enlightened Dense Retriever for Large-Scale Retrieval Kai Zhang Chongyang Tao Tao Shen Can Xu Xiubo Geng Binxing Jiao Daxin Jiang RALM 34 24 0 29 Aug 2022
ConTextual Masked Auto-Encoder for Dense Passage Retrieval Xing Wu Guangyuan Ma Meng Lin Zijia Lin Zhongyuan Wang Songlin Hu RALM 33 24 0 16 Aug 2022
CorpusBrain: Pre-train a Generative Retrieval Model for Knowledge-Intensive Language Tasks Jiangui Chen Ruqing Zhang Jiafeng Guo Yu-an Liu Yixing Fan Xueqi Cheng RALM 43 59 0 16 Aug 2022
Evaluating Dense Passage Retrieval using Transformers Nima Sadri 17 0 0 15 Aug 2022
Continuous Active Learning Using Pretrained Transformers Nima Sadri G. Cormack KELM 29 2 0 15 Aug 2022
Disentangled Modeling of Domain and Relevance for Adaptable Dense Retrieval Jingtao Zhan Qingyao Ai Yiqun Liu Jiaxin Mao Xiaohui Xie Hao Fei Shaoping Ma 43 10 0 11 Aug 2022
Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval Zehan Li Nan Yang Liang Wang Furu Wei 34 8 0 08 Aug 2022
Low-Resource Dense Retrieval for Open-Domain Question Answering: A Comprehensive Survey Xiaoyu Shen Svitlana Vakulenko Marco Del Tredici Gianni Barlacchi Bill Byrne Adria de Gispert RALM VLM 30 20 0 05 Aug 2022
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers Weng Lam Tam Xiao Liu Kaixuan Ji Lilong Xue Xing Zhang Yuxiao Dong Jiahua Liu Maodi Hu Jie Tang VPVLM 35 27 0 14 Jul 2022
NGAME: Negative Mining-aware Mini-batching for Extreme Classification Kunal Dahiya Nilesh Gupta Deepak Saini Akshay Soni Yajun Wang ... Sonu Mehta Ramachandran Ramjee Sumeet Agarwal Purushottam Kar Manik Varma 44 35 0 10 Jul 2022
An Efficiency Study for SPLADE Models Carlos Lassance S. Clinchant 48 70 0 08 Jul 2022
Trial2Vec: Zero-Shot Clinical Trial Document Similarity Search using Self-Supervision Zifeng Wang Jimeng Sun 39 23 0 29 Jun 2022
Are We There Yet? A Decision Framework for Replacing Term Based Retrieval with Dense Retrieval Systems Sebastian Hofstatter Nick Craswell Bhaskar Mitra Hamed Zamani Allan Hanbury 43 5 0 26 Jun 2022
No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval G. Rosa L. Bonifacio Vitor Jeronymo Hugo Queiroz Abonizio Marzieh Fadaee R. Lotufo Rodrigo Nogueira 32 26 0 06 Jun 2022