ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2212.02027
  4. Cited By
Retrieval as Attention: End-to-end Learning of Retrieval and Reading
  within a Single Transformer

Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
5 December 2022
Zhengbao Jiang
Luyu Gao
Jun Araki
Haibo Ding
Zhiruo Wang
Jamie Callan
Graham Neubig
    RALM
ArXiv (abs)PDFHTMLGithub (83★)

Papers citing "Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer"

42 / 42 papers shown
Equipping Retrieval-Augmented Large Language Models with Document Structure Awareness
Equipping Retrieval-Augmented Large Language Models with Document Structure Awareness
Lingnan Xu
Chong Feng
Kaiyuan Zhang
Liu Zhengyong
Wenqiang Xu
Fanqing Meng
RALM
136
0
0
05 Oct 2025
SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation
SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation
Weihang Su
Anzhe Xie
Jiaxin Mao
Jianming Long
Jiaxin Mao
Ziyi Ye
Yiqun Liu
Yiqun Liu
187
0
0
21 Aug 2025
MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented Generation
MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented GenerationIEEE International Conference on Data Engineering (ICDE), 2025
Wenlong Wu
Haofen Wang
Bohan Li
Peixuan Huang
X. Zhao
Lei Liang
120
4
0
05 Aug 2025
Dynamic and Parametric Retrieval-Augmented Generation
Dynamic and Parametric Retrieval-Augmented GenerationAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2025
Weihang Su
Jiaxin Mao
Jingtao Zhan
Qian Dong
Yiqun Liu
RALM
165
7
0
07 Jun 2025
ImpRAG: Retrieval-Augmented Generation with Implicit Queries
ImpRAG: Retrieval-Augmented Generation with Implicit Queries
Wenzheng Zhang
Xi Lin
K. Stratos
Anuj Kumar
Mingda Chen
RALM3DVVLM
291
1
0
02 Jun 2025
IterKey: Iterative Keyword Generation with LLMs for Enhanced Retrieval Augmented Generation
IterKey: Iterative Keyword Generation with LLMs for Enhanced Retrieval Augmented Generation
Kazuki Hayashi
Hidetaka Kamigaito
Shinya Kouda
Taro Watanabe
RALM
350
3
0
13 May 2025
DioR: Adaptive Cognitive Detection and Contextual Retrieval Optimization for Dynamic Retrieval-Augmented Generation
DioR: Adaptive Cognitive Detection and Contextual Retrieval Optimization for Dynamic Retrieval-Augmented GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2025
Hanghui Guo
Jia Zhu
Shimin Di
Weijie Shi
Zhangze Chen
Jiajie Xu
436
2
0
14 Apr 2025
Attention Reveals More Than Tokens: Training-Free Long-Context Reasoning with Attention-guided Retrieval
Yuwei Zhang
Jayanth Srinivasa
Gaowen Liu
Jingbo Shang
LRMLLMAGRALM
319
3
0
12 Mar 2025
Few-Shot Multilingual Open-Domain QA from 5 Examples
Few-Shot Multilingual Open-Domain QA from 5 Examples
Fan Jiang
Tom Drummond
Trevor Cohn
327
0
0
27 Feb 2025
You Only Use Reactive Attention Slice For Long Context Retrieval
You Only Use Reactive Attention Slice For Long Context Retrieval
Yun Joon Soh
Hanxian Huang
Yuandong Tian
Jishen Zhao
RALM
217
1
0
03 Sep 2024
Enhancing and Accelerating Large Language Models via Instruction-Aware
  Contextual Compression
Enhancing and Accelerating Large Language Models via Instruction-Aware Contextual Compression
Haowen Hou
Fei Ma
Binwen Bai
Xinxin Zhu
Fei Yu
200
4
0
28 Aug 2024
FastFiD: Improve Inference Efficiency of Open Domain Question Answering
  via Sentence Selection
FastFiD: Improve Inference Efficiency of Open Domain Question Answering via Sentence SelectionAnnual Meeting of the Association for Computational Linguistics (ACL), 2024
Yufei Huang
Xu Han
Maosong Sun
238
3
0
12 Aug 2024
Think-then-Act: A Dual-Angle Evaluated Retrieval-Augmented Generation
Think-then-Act: A Dual-Angle Evaluated Retrieval-Augmented Generation
Yige Shen
Hao Jiang
Hua Qu
Jihong Zhao
RALMLRM
228
1
0
18 Jun 2024
PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large
  Language Models as Decision Makers
PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers
Myeonghwa Lee
Seonho An
Min-Soo Kim
3DVRALM
204
37
0
18 Jun 2024
RE-RAG: Improving Open-Domain QA Performance and Interpretability with
  Relevance Estimator in Retrieval-Augmented Generation
RE-RAG: Improving Open-Domain QA Performance and Interpretability with Relevance Estimator in Retrieval-Augmented GenerationConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Kiseung Kim
Jay-Yoon Lee
RALM
305
13
0
09 Jun 2024
Chain of Agents: Large Language Models Collaborating on Long-Context
  Tasks
Chain of Agents: Large Language Models Collaborating on Long-Context Tasks
Yusen Zhang
Ruoxi Sun
Yanfei Chen
Tomas Pfister
Rui Zhang
Sercan O. Arik
RALMAI4CELLMAG
345
164
0
04 Jun 2024
Manipulating Large Language Models to Increase Product Visibility
Manipulating Large Language Models to Increase Product Visibility
Aounon Kumar
Himabindu Lakkaraju
270
19
0
11 Apr 2024
Towards Better Generalization in Open-Domain Question Answering by
  Mitigating Context Memorization
Towards Better Generalization in Open-Domain Question Answering by Mitigating Context Memorization
Zixuan Zhang
R. Reddy
Kevin Small
Tong Zhang
Heng Ji
275
3
0
02 Apr 2024
DRAGIN: Dynamic Retrieval Augmented Generation based on the Information
  Needs of Large Language Models
DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024
Weihang Su
Yichen Tang
Jiaxin Mao
Zhijing Wu
Yiqun Liu
3DVRALMAI4TSSyDa
334
51
0
15 Mar 2024
Unsupervised Real-Time Hallucination Detection based on the Internal
  States of Large Language Models
Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024
Weihang Su
Changyue Wang
Jiaxin Mao
Hu Yiran
Zhijing Wu
Yujia Zhou
Yiqun Liu
HILM
338
63
0
11 Mar 2024
RNNs are not Transformers (Yet): The Key Bottleneck on In-context
  Retrieval
RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval
Kaiyue Wen
Xingyu Dang
Kaifeng Lyu
423
48
0
28 Feb 2024
Pre-training Cross-lingual Open Domain Question Answering with
  Large-scale Synthetic Supervision
Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic Supervision
Fan Jiang
Tom Drummond
Trevor Cohn
CLIPELMLRM
307
5
0
26 Feb 2024
Instruction-tuned Language Models are Better Knowledge Learners
Instruction-tuned Language Models are Better Knowledge Learners
Zhengbao Jiang
Zhiqing Sun
Weijia Shi
Pedro Rodriguez
Chunting Zhou
Graham Neubig
Xi Lin
Anuj Kumar
Srinivasan Iyer
KELM
305
55
0
20 Feb 2024
Metacognitive Retrieval-Augmented Large Language Models
Metacognitive Retrieval-Augmented Large Language Models
Yujia Zhou
Zheng Liu
Jiajie Jin
Jian-yun Nie
Zhicheng Dou
RALMKELMAIFinLRM
138
35
0
18 Feb 2024
An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge
  Graph-Integrated Collaboration
An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration
Yihao Li
Ru Zhang
Jianyi Liu
LRM
343
25
0
07 Feb 2024
The What, Why, and How of Context Length Extension Techniques in Large
  Language Models -- A Detailed Survey
The What, Why, and How of Context Length Extension Techniques in Large Language Models -- A Detailed Survey
Saurav Pawar
S.M. Towhidul Islam Tonmoy
S. M. M. Zaman
Vinija Jain
Vasu Sharma
Amitava Das
218
44
0
15 Jan 2024
Large Language Models for Social Networks: Applications, Challenges, and
  Solutions
Large Language Models for Social Networks: Applications, Challenges, and Solutions
Jingying Zeng
Richard Huang
Waleed Malik
Langxuan Yin
Bojan Babic
Danny Shacham
Xiao Yan
Jaewon Yang
Qi He
231
11
0
04 Jan 2024
Evaluating Generative Ad Hoc Information Retrieval
Evaluating Generative Ad Hoc Information Retrieval
Lukas Gienapp
Harrisen Scells
Niklas Deckers
Janek Bevendorff
Shuai Wang
...
Maik Fröbe
Guide Zucoon
Benno Stein
Matthias Hagen
Martin Potthast
RALM
429
24
0
08 Nov 2023
1-PAGER: One Pass Answer Generation and Evidence Retrieval
1-PAGER: One Pass Answer Generation and Evidence RetrievalConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Palak Jain
Livio Baldini Soares
Tom Kwiatkowski
RALM
178
9
0
25 Oct 2023
How Do Large Language Models Capture the Ever-changing World Knowledge?
  A Review of Recent Advances
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent AdvancesConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Zihan Zhang
Meng Fang
Lingxi Chen
Mohammad-Reza Namazi-Rad
Jun Wang
KELM
244
40
0
11 Oct 2023
Retrieval meets Long Context Large Language Models
Retrieval meets Long Context Large Language ModelsInternational Conference on Learning Representations (ICLR), 2023
Peng Xu
Ming-Yu Liu
Xianchao Wu
Lawrence C. McAfee
Chen Zhu
Zihan Liu
Sandeep Subramanian
Evelina Bakhturina
Mohammad Shoeybi
Bryan Catanzaro
RALMLRM
459
114
0
04 Oct 2023
LeanDojo: Theorem Proving with Retrieval-Augmented Language Models
LeanDojo: Theorem Proving with Retrieval-Augmented Language ModelsNeural Information Processing Systems (NeurIPS), 2023
Kaiyu Yang
Aidan M. Swope
Alex Gu
Rahul Chalamala
Peiyang Song
Shixing Yu
Saad Godil
R. Prenger
Anima Anandkumar
RALM
398
342
0
27 Jun 2023
Extending Context Window of Large Language Models via Positional
  Interpolation
Extending Context Window of Large Language Models via Positional Interpolation
Shouyuan Chen
Sherman Wong
Liangjian Chen
Yuandong Tian
447
687
0
27 Jun 2023
Long-range Language Modeling with Self-retrieval
Long-range Language Modeling with Self-retrievalTransactions of the Association for Computational Linguistics (TACL), 2023
Ohad Rubin
Jonathan Berant
RALMKELM
232
32
0
23 Jun 2023
GLIMMER: generalized late-interaction memory reranker
GLIMMER: generalized late-interaction memory reranker
Michiel de Jong
Yury Zemlyanskiy
Nicholas FitzGerald
Sumit Sanghai
William W. Cohen
Joshua Ainslie
RALM
232
9
0
17 Jun 2023
Robust Natural Language Understanding with Residual Attention Debiasing
Robust Natural Language Understanding with Residual Attention DebiasingAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Fei Wang
James Y. Huang
Tianyi Yan
Wenxuan Zhou
Muhao Chen
170
13
0
28 May 2023
Landmark Attention: Random-Access Infinite Context Length for
  Transformers
Landmark Attention: Random-Access Infinite Context Length for TransformersNeural Information Processing Systems (NeurIPS), 2023
Amirkeivan Mohtashami
Martin Jaggi
LLMAG
344
197
0
25 May 2023
Query Rewriting for Retrieval-Augmented Large Language Models
Query Rewriting for Retrieval-Augmented Large Language Models
Xinbei Ma
Yeyun Gong
Pengcheng He
Hai Zhao
Nan Duan
KELMLRM
251
198
0
23 May 2023
ReGen: Zero-Shot Text Classification via Training Data Generation with
  Progressive Dense Retrieval
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Yue Yu
Yuchen Zhuang
Rongzhi Zhang
Yu Meng
Jiaming Shen
Chao Zhang
VLM
202
40
0
18 May 2023
Active Retrieval Augmented Generation
Active Retrieval Augmented GenerationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Zhengbao Jiang
Frank F. Xu
Luyu Gao
Zhiqing Sun
Qian Liu
Jane Dwivedi-Yu
Yiming Yang
Jamie Callan
Graham Neubig
RALM
405
508
0
11 May 2023
BRENT: Bidirectional Retrieval Enhanced Norwegian Transformer
BRENT: Bidirectional Retrieval Enhanced Norwegian TransformerNordic Conference of Computational Linguistics (NODALIDA), 2023
Lucas Georges Gabriel Charpentier
Sondre Wold
David Samuel
Egil Rønningstad
KELMRALM
193
2
0
19 Apr 2023
Billion-scale similarity search with GPUs
Billion-scale similarity search with GPUsIEEE Transactions on Big Data (TBD), 2017
Jeff Johnson
Matthijs Douze
Edouard Grave
1.0K
4,630
0
28 Feb 2017
1
Page 1 of 1