Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring

22 April 2019

Jason Weston

Papers citing "Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring"

50 / 60 papers shown

Title
Theoretical Guarantees for LT-TTD: A Unified Transformer-based Architecture for Two-Level Ranking Systems Ayoub Abraich 40 0 0 07 May 2025
A Survey of Model Architectures in Information Retrieval Zhichao Xu Fengran Mo Zhiqi Huang Crystina Zhang Puxuan Yu Bei Wang Jimmy J. Lin Vivek Srikumar KELM 3DV 48 2 0 21 Feb 2025
Speechworthy Instruction-tuned Language Models Hyundong Justin Cho Nicolaas Jedema Leonardo F. R. Ribeiro Karishma Sharma Pedro Szekely Alessandro Moschitti Ruben Janssen Jonathan May ALM 42 1 0 23 Sep 2024
An Encoding--Searching Separation Perspective on Bi-Encoder Neural Search Danbinaerin Han Akiko Aizawa Sihun Lee 21 0 0 02 Aug 2024
EAVE: Efficient Product Attribute Value Extraction via Lightweight Sparse-layer Interaction Li Yang Qifan Wang Jianfeng Chi Jiahao Liu Jingang Wang Fuli Feng Zenglin Xu Yi Fang Lifu Huang Dongfang Liu 28 1 0 10 Jun 2024
Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality Ensembles Abhijnan Nath Huma Jamil Shafiuddin Rehan Ahmed George Baker Rahul Ghosh James H. Martin Nathaniel Blanchard Nikhil Krishnaswamy 32 2 0 13 Apr 2024
Event-enhanced Retrieval in Real-time Search Yanan Zhang Xiaoling Bai Tianhua Zhou 29 1 0 09 Apr 2024
Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization Shiqi Wang Yeqin Zhang Cam-Tu Nguyen 20 2 0 30 Dec 2023
Do We Run How We Say We Run? Formalization and Practice of Governance in OSS Communities Mahasweta Chakraborti Curtis Atkisson Stefan Stanciulescu V. Filkov Seth Frey 39 5 0 25 Sep 2023
Towards General Text Embeddings with Multi-stage Contrastive Learning Zehan Li Xin Zhang Yanzhao Zhang Dingkun Long Pengjun Xie Meishan Zhang 52 338 0 07 Aug 2023
Improving Text Semantic Similarity Modeling through a 3D Siamese Network Jianxiang Zang Hui Liu 3DPC 20 2 0 18 Jul 2023
LEA: Improving Sentence Similarity Robustness to Typos Using Lexical Attention Bias Mario Almagro Emilio Almazán Diego Ortego David Jiménez 21 3 0 06 Jul 2023
Knowledge Graph-Augmented Language Models for Knowledge-Grounded Dialogue Generation Minki Kang Jin Myung Kwak Jinheon Baek Sung Ju Hwang RALM 14 57 0 30 May 2023
Model-Based Simulation for Optimising Smart Reply Benjamin Towle Ke Zhou 30 1 0 26 May 2023
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding Yu Zhang Hao Cheng Zhihong Shen Xiaodong Liu Yejiang Wang Jianfeng Gao 24 13 0 23 May 2023
From Zero to Hero: Harnessing Transformers for Biomedical Named Entity Recognition in Zero- and Few-shot Contexts Milos Kosprdic Nikola Prodanović Adela Ljajić Bojana Bašaragin Nikola Milosevic MedIm 18 5 0 05 May 2023
Revisiting the Role of Similarity and Dissimilarity in Best Counter Argument Retrieval Hongguang Shi Shuirong Cao Cam-Tu Nguyen 16 2 0 18 Apr 2023
Rethinking the Role of Token Retrieval in Multi-Vector Retrieval Jinhyuk Lee Zhuyun Dai Sai Meher Karthik Duddu Tao Lei Iftekhar Naim Ming-Wei Chang Vincent Zhao 19 15 0 04 Apr 2023
Dialogue-Contextualized Re-ranking for Medical History-Taking Jian Zhu Ilya Valmianski Anitha Kannan 19 1 0 04 Apr 2023
MWE as WSD: Solving Multiword Expression Identification with Word Sense Disambiguation Joshua Tanner J. Hoffman 16 1 0 12 Mar 2023
Opening up Minds with Argumentative Dialogues Youmna Farag C. Brand Jacopo Amidei P. Piwek Tom Stafford Svetlana Stoyanchev Andreas Vlachos AI4CE 13 5 0 16 Jan 2023
You Truly Understand What I Need: Intellectual and Friendly Dialogue Agents grounding Knowledge and Persona J. Lim Myunghoon Kang Yuna Hur Seung-Ju Jung Jinsung Kim ... Dongyub Lee Hyesung Ji Donghoon Shin Seung Wook Kim Heu-Jeoung Lim HILM 20 8 0 06 Jan 2023
Fine-Grained Distillation for Long Document Retrieval Yucheng Zhou Tao Shen Xiubo Geng Chongyang Tao Guodong Long Can Xu Daxin Jiang RALM 19 28 0 20 Dec 2022
RHO ( $ρ$ ): Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding Ziwei Ji Zihan Liu Nayeon Lee Tiezheng Yu Bryan Wilie Mini Zeng Pascale Fung HILM 17 53 0 03 Dec 2022
A Survey for Efficient Open Domain Question Answering Qin Zhang Shan Chen Dongkuan Xu Qingqing Cao Xiaojun Chen Trevor Cohn Meng Fang 26 33 0 15 Nov 2022
Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems Songbo Hu Ivan Vulić Fangyu Liu Anna Korhonen 32 0 0 07 Nov 2022
Controllable Factuality in Document-Grounded Dialog Systems Using a Noisy Channel Model Nico Daheim David Thulke Christian Dugast Hermann Ney HILM 19 4 0 31 Oct 2022
Improving Bilingual Lexicon Induction with Cross-Encoder Reranking Yaoyiran Li Fangyu Liu Ivan Vulić Anna Korhonen 34 10 0 30 Oct 2022
Deploying a Retrieval based Response Model for Task Oriented Dialogues Lahari Poddar Gyuri Szarvas Cheng Wang Jorge A. Balazs Pavel Danchenko P. Ernst 8 0 0 25 Oct 2022
Privacy-Preserved Neural Graph Similarity Learning Yupeng Hou Wayne Xin Zhao Yaliang Li Ji-Rong Wen 25 1 0 21 Oct 2022
Hierarchical Multi-Interest Co-Network For Coarse-Grained Ranking Xu Yuan Chengjun Xu Qiwei Chen Tao Zhuang Hongjie Chen C. Li Junfeng Ge AI4TS 19 0 0 19 Oct 2022
Learning Job Titles Similarity from Noisy Skill Labels Rabih Zbib Lucas Lacasa Alvarez Federico Retyk Rus Poves Juan Aizpuru H. Fabregat Vaidotas Šimkus Emília Garcia Casademont 19 3 0 01 Jul 2022
Neural Retriever and Go Beyond: A Thesis Proposal Man Luo 30 1 0 31 May 2022
Fast and Light-Weight Answer Text Retrieval in Dialogue Systems H. Wan S. Patel J. William Murdock Saloni Potdar Sachindra Joshi 30 1 0 27 May 2022
CORAL: Contextual Response Retrievability Loss Function for Training Dialog Generation Models Bishal Santra Ravi Ghadia Manish Gupta Pawan Goyal OffRL 15 0 0 21 May 2022
CascadER: Cross-Modal Cascading for Knowledge Graph Link Prediction Tara Safavi Doug Downey Tom Hope 19 6 0 16 May 2022
Diversifying Neural Dialogue Generation via Negative Distillation Yiwei Li Shaoxiong Feng Bin Sun Kan Li 27 10 0 05 May 2022
DialAug: Mixing up Dialogue Contexts in Contrastive Learning for Robust Conversational Modeling Lahari Poddar Peiyao Wang J. Reinspach 11 5 0 15 Apr 2022
SemSup: Semantic Supervision for Simple and Scalable Zero-shot Generalization Austin W. Hanjie A. Deshpande Karthik Narasimhan VLM 27 2 0 26 Feb 2022
Improving Biomedical Information Retrieval with Neural Retrievers Man Luo Arindam Mitra Tejas Gokhale Chitta Baral 33 32 0 19 Jan 2022
GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval Kexin Wang Nandan Thakur Nils Reimers Iryna Gurevych VLM 22 149 0 14 Dec 2021
Understanding and Improving the Exemplar-based Generation for Open-domain Conversation Seungju Han Beomsu Kim Seokjun Seo Enkhbayar Erdenee Buru Chang 28 3 0 13 Dec 2021
Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identity Kurt Shuster Jack Urbanek Arthur Szlam Jason Weston HILM 13 24 0 10 Dec 2021
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction Keshav Santhanam Omar Khattab Jon Saad-Falcon Christopher Potts Matei A. Zaharia 34 382 0 02 Dec 2021
Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similarity Sheshera Mysore Arman Cohan Tom Hope 11 39 0 16 Nov 2021
Advances in Multi-turn Dialogue Comprehension: A Survey Zhuosheng Zhang Hai Zhao 21 21 0 11 Oct 2021
The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design Yoav Levine Noam Wies Daniel Jannai D. Navon Yedid Hoshen Amnon Shashua AI4CE 27 36 0 09 Oct 2021
Situated Dialogue Learning through Procedural Environment Generation Prithviraj Ammanabrolu Renee Jia Mark O. Riedl 101 14 0 07 Oct 2021
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Fangyu Liu Yunlong Jiao Jordan Massiah Emine Yilmaz Serhii Havrylov SSL 87 29 0 27 Sep 2021
An Evaluation Dataset and Strategy for Building Robust Multi-turn Response Selection Model Kijong Han Seojin Lee Wooin Lee Joosung Lee Donghun Lee AAML 25 5 0 10 Sep 2021