ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2112.04426
  4. Cited By
Improving language models by retrieving from trillions of tokens

Improving language models by retrieving from trillions of tokens

8 December 2021
Sebastian Borgeaud
A. Mensch
Jordan Hoffmann
Trevor Cai
Eliza Rutherford
Katie Millican
George van den Driessche
Jean-Baptiste Lespiau
Bogdan Damoc
Aidan Clark
Diego de Las Casas
Aurelia Guy
Jacob Menick
Roman Ring
Tom Hennigan
Saffron Huang
Lorenzo Maggiore
Chris Jones
Albin Cassirer
Andy Brock
Michela Paganini
G. Irving
Oriol Vinyals
Simon Osindero
Karen Simonyan
Jack W. Rae
Erich Elsen
Laurent Sifre
    KELM
    RALM
ArXivPDFHTML

Papers citing "Improving language models by retrieving from trillions of tokens"

50 / 722 papers shown
Title
Towards Efficient Generative Large Language Model Serving: A Survey from
  Algorithms to Systems
Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems
Xupeng Miao
Gabriele Oliaro
Zhihao Zhang
Xinhao Cheng
Hongyi Jin
Tianqi Chen
Zhihao Jia
63
76
0
23 Dec 2023
RealGen: Retrieval Augmented Generation for Controllable Traffic
  Scenarios
RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarios
Wenhao Ding
Yulong Cao
Ding Zhao
Chaowei Xiao
Marco Pavone
19
22
0
19 Dec 2023
Jack of All Tasks, Master of Many: Designing General-purpose
  Coarse-to-Fine Vision-Language Model
Jack of All Tasks, Master of Many: Designing General-purpose Coarse-to-Fine Vision-Language Model
Shraman Pramanick
Guangxing Han
Rui Hou
Sayan Nag
Ser-Nam Lim
Nicolas Ballas
Qifan Wang
Rama Chellappa
Amjad Almahairi
VLM
MLLM
42
29
0
19 Dec 2023
Retrieval-Augmented Generation for Large Language Models: A Survey
Retrieval-Augmented Generation for Large Language Models: A Survey
Yunfan Gao
Yun Xiong
Xinyu Gao
Kangxiang Jia
Jinliu Pan
Yuxi Bi
Yi Dai
Jiawei Sun
Meng Wang
Haofen Wang
3DV
RALM
54
1,510
1
18 Dec 2023
kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest
  Neighbor In-Context Learning
kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learning
Wenting Zhao
Ye Liu
Yao Wan
Yibo Wang
Qingyang Wu
Zhongfen Deng
Jiangshu Du
Shuaiqi Liu
Yunlong Xu
Philip S. Yu
44
7
0
17 Dec 2023
AI capabilities can be significantly improved without expensive
  retraining
AI capabilities can be significantly improved without expensive retraining
Tom Davidson
Jean-Stanislas Denain
Pablo Villalobos
Guillem Bas
OffRL
VLM
24
26
0
12 Dec 2023
PaperQA: Retrieval-Augmented Generative Agent for Scientific Research
PaperQA: Retrieval-Augmented Generative Agent for Scientific Research
Jakub Lála
Odhran O'Donoghue
Aleksandar Shtedritski
Sam Cox
Samuel G. Rodriques
Andrew D. White
RALM
75
71
0
08 Dec 2023
SparQ Attention: Bandwidth-Efficient LLM Inference
SparQ Attention: Bandwidth-Efficient LLM Inference
Luka Ribar
Ivan Chelombiev
Luke Hudlass-Galley
Charlie Blake
Carlo Luschi
Douglas Orr
21
46
0
08 Dec 2023
LLM as OS, Agents as Apps: Envisioning AIOS, Agents and the AIOS-Agent
  Ecosystem
LLM as OS, Agents as Apps: Envisioning AIOS, Agents and the AIOS-Agent Ecosystem
Yingqiang Ge
Yujie Ren
Wenyue Hua
Shuyuan Xu
Juntao Tan
Yongfeng Zhang
LLMAG
17
27
0
06 Dec 2023
Scaling Laws for Adversarial Attacks on Language Model Activations
Scaling Laws for Adversarial Attacks on Language Model Activations
Stanislav Fort
18
14
0
05 Dec 2023
PEFA: Parameter-Free Adapters for Large-scale Embedding-based Retrieval
  Models
PEFA: Parameter-Free Adapters for Large-scale Embedding-based Retrieval Models
Wei-Cheng Chang
Jyun-Yu Jiang
Jiong Zhang
Mutasem Al-Darabsah
C. Teo
Cho-Jui Hsieh
Hsiang-Fu Yu
S. Vishwanathan
RALM
19
2
0
05 Dec 2023
A Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepedia
A Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepedia
Giovanni Monea
Maxime Peyrard
Martin Josifoski
Vishrav Chaudhary
Jason Eisner
Emre Kiciman
Hamid Palangi
Barun Patra
Robert West
KELM
51
12
0
04 Dec 2023
UniIR: Training and Benchmarking Universal Multimodal Information
  Retrievers
UniIR: Training and Benchmarking Universal Multimodal Information Retrievers
Cong Wei
Yang Chen
Haonan Chen
Hexiang Hu
Ge Zhang
Jie Fu
Alan Ritter
Wenhu Chen
37
50
0
28 Nov 2023
Rethinking Privacy in Machine Learning Pipelines from an Information
  Flow Control Perspective
Rethinking Privacy in Machine Learning Pipelines from an Information Flow Control Perspective
Lukas Wutschitz
Boris Köpf
Andrew J. Paverd
Saravan Rajmohan
Ahmed Salem
Shruti Tople
Santiago Zanella Béguelin
Menglin Xia
Victor Rühle
38
13
0
27 Nov 2023
Transforming organic chemistry research paradigms: moving from manual
  efforts to the intersection of automation and artificial intelligence
Transforming organic chemistry research paradigms: moving from manual efforts to the intersection of automation and artificial intelligence
Chengchun Liu
Yuntian Chen
Fanyang Mo
14
1
0
26 Nov 2023
Walking a Tightrope -- Evaluating Large Language Models in High-Risk
  Domains
Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domains
Chia-Chien Hung
Wiem Ben-Rim
Lindsay Frost
Lars Bruckner
Carolin (Haas) Lawrence
AILaw
ALM
ELM
25
9
0
25 Nov 2023
Calibrated Language Models Must Hallucinate
Calibrated Language Models Must Hallucinate
Adam Tauman Kalai
Santosh Vempala
HILM
22
75
0
24 Nov 2023
Probabilistic Tree-of-thought Reasoning for Answering
  Knowledge-intensive Complex Questions
Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex Questions
S. Cao
Jiajie Zhang
Jiaxin Shi
Xin Lv
Zijun Yao
Qingwen Tian
Juanzi Li
Lei Hou
LRM
29
13
0
23 Nov 2023
Minimizing Factual Inconsistency and Hallucination in Large Language
  Models
Minimizing Factual Inconsistency and Hallucination in Large Language Models
Muneeswaran Irulandi
Shreya Saxena
Siva Prasad
M. V. Sai Prakash
Advaith Shankar
V. Varun
Vishal Vaddina
Saisubramaniam Gopalakrishnan
HILM
27
5
0
23 Nov 2023
Retrieval-Augmented Layout Transformer for Content-Aware Layout
  Generation
Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation
Daichi Horita
Naoto Inoue
Kotaro Kikuchi
Kota Yamaguchi
Kiyoharu Aizawa
3DV
14
12
0
22 Nov 2023
Advancing Transformer Architecture in Long-Context Large Language
  Models: A Comprehensive Survey
Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey
Yunpeng Huang
Jingwei Xu
Junyu Lai
Zixu Jiang
Taolue Chen
...
Xiaoxing Ma
Lijuan Yang
Zhou Xin
Shupeng Li
Penghao Zhao
LLMAG
KELM
31
54
0
21 Nov 2023
TPTU-v2: Boosting Task Planning and Tool Usage of Large Language
  Model-based Agents in Real-world Systems
TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systems
Yilun Kong
Jingqing Ruan
Yihong Chen
Bin Zhang
Tianpeng Bao
...
Xiaoru Hu
Hangyu Mao
Ziyue Li
Xingyu Zeng
Rui Zhao
LLMAG
37
37
0
19 Nov 2023
Augmenting Unsupervised Reinforcement Learning with Self-Reference
Augmenting Unsupervised Reinforcement Learning with Self-Reference
Andrew Zhao
Erle Zhu
Rui Lu
Matthieu Lin
Yong-Jin Liu
Gao Huang
SSL
31
1
0
16 Nov 2023
Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language
  Models
Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Models
W. Yu
Hongming Zhang
Xiaoman Pan
Kaixin Ma
Hongwei Wang
Dong Yu
KELM
RALM
LRM
65
102
0
15 Nov 2023
How Well Do Large Language Models Truly Ground?
How Well Do Large Language Models Truly Ground?
Hyunji Lee
Se June Joo
Chaeeun Kim
Joel Jang
Doyoung Kim
Kyoung-Woon On
Minjoon Seo
HILM
25
6
0
15 Nov 2023
Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term
  Memory
Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memory
Lei Liu
Xiaoyan Yang
Yue Shen
Binbin Hu
Zhiqiang Zhang
Jinjie Gu
Guannan Zhang
LRM
LLMAG
KELM
43
18
0
15 Nov 2023
Learning Knowledge-Enhanced Contextual Language Representations for
  Domain Natural Language Understanding
Learning Knowledge-Enhanced Contextual Language Representations for Domain Natural Language Understanding
Ruyao Xu
Taolin Zhang
Chengyu Wang
Zhongjie Duan
Cen Chen
Minghui Qiu
Dawei Cheng
Xiaofeng He
Weining Qian
27
0
0
12 Nov 2023
Trends in Integration of Knowledge and Large Language Models: A Survey
  and Taxonomy of Methods, Benchmarks, and Applications
Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications
Zhangyin Feng
Weitao Ma
Weijiang Yu
Lei Huang
Haotian Wang
Qianglong Chen
Weihua Peng
Xiaocheng Feng
Bing Qin
Ting Liu
KELM
21
37
0
10 Nov 2023
AI-native Interconnect Framework for Integration of Large Language Model
  Technologies in 6G Systems
AI-native Interconnect Framework for Integration of Large Language Model Technologies in 6G Systems
Sasu Tarkoma
Roberto Morabito
Jaakko Sauvola
23
19
0
10 Nov 2023
Evaluating Generative Ad Hoc Information Retrieval
Evaluating Generative Ad Hoc Information Retrieval
Lukas Gienapp
Harrisen Scells
Niklas Deckers
Janek Bevendorff
Shuai Wang
...
Maik Frobe
Guide Zucoon
Benno Stein
Matthias Hagen
Martin Potthast
RALM
37
11
0
08 Nov 2023
Evaluating the Effectiveness of Retrieval-Augmented Large Language
  Models in Scientific Document Reasoning
Evaluating the Effectiveness of Retrieval-Augmented Large Language Models in Scientific Document Reasoning
Sai Munikoti
Anurag Acharya
S. Wagle
Sameera Horawalavithana
LRM
19
5
0
07 Nov 2023
A Survey of Large Language Models Attribution
A Survey of Large Language Models Attribution
Dongfang Li
Zetian Sun
Xinshuo Hu
Zhenyu Liu
Ziyang Chen
Baotian Hu
Aiguo Wu
Min Zhang
HILM
13
49
0
07 Nov 2023
Learn to Refuse: Making Large Language Models More Controllable and
  Reliable through Knowledge Scope Limitation and Refusal Mechanism
Learn to Refuse: Making Large Language Models More Controllable and Reliable through Knowledge Scope Limitation and Refusal Mechanism
Lang Cao
13
13
0
02 Nov 2023
ChipNeMo: Domain-Adapted LLMs for Chip Design
ChipNeMo: Domain-Adapted LLMs for Chip Design
Mingjie Liu
Teodor-Dumitru Ene
Robert M. Kirby
Chris Cheng
N. Pinckney
...
Pratik P Suthar
Varun Tej
Walker J. Turner
Kaizhe Xu
Haoxin Ren
42
140
0
31 Oct 2023
Defining a New NLP Playground
Defining a New NLP Playground
Sha Li
Chi Han
Pengfei Yu
Carl N. Edwards
Manling Li
...
Yi Ren Fung
Charles Yu
Joel R. Tetreault
Eduard H. Hovy
Heng Ji
31
5
0
31 Oct 2023
General-Purpose Retrieval-Enhanced Medical Prediction Model Using
  Near-Infinite History
General-Purpose Retrieval-Enhanced Medical Prediction Model Using Near-Infinite History
Junu Kim
Chaeeun Shim
Bosco Seong Kyu Yang
Chami Im
Sung Yoon Lim
Han-Gil Jeong
Edward Choi
17
8
0
31 Oct 2023
TeacherLM: Teaching to Fish Rather Than Giving the Fish, Language
  Modeling Likewise
TeacherLM: Teaching to Fish Rather Than Giving the Fish, Language Modeling Likewise
Nan He
Hanyu Lai
Chenyang Zhao
Zirui Cheng
Junting Pan
...
Zhaohui Hou
Zhiyuan Huang
Shaoqing Lu
Ding Liang
Mingjie Zhan
LRM
15
12
0
29 Oct 2023
Knowledge Corpus Error in Question Answering
Knowledge Corpus Error in Question Answering
Yejoon Lee
Philhoon Oh
James Thorne
21
2
0
27 Oct 2023
Woodpecker: Hallucination Correction for Multimodal Large Language
  Models
Woodpecker: Hallucination Correction for Multimodal Large Language Models
Shukang Yin
Chaoyou Fu
Sirui Zhao
Tong Bill Xu
Hao Wang
Dianbo Sui
Yunhang Shen
Ke Li
Xingguo Sun
Enhong Chen
VLM
MLLM
35
114
0
24 Oct 2023
Large Search Model: Redefining Search Stack in the Era of LLMs
Large Search Model: Redefining Search Stack in the Era of LLMs
Liang Wang
Nan Yang
Xiaolong Huang
Linjun Yang
Rangan Majumder
Furu Wei
LRM
KELM
28
13
0
23 Oct 2023
PRCA: Fitting Black-Box Large Language Models for Retrieval Question
  Answering via Pluggable Reward-Driven Contextual Adapter
PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual Adapter
Haoyan Yang
Zhitao Li
Yong Zhang
Jianzong Wang
Ning Cheng
Ming Li
Jing Xiao
RALM
6
27
0
23 Oct 2023
The Law and NLP: Bridging Disciplinary Disconnects
The Law and NLP: Bridging Disciplinary Disconnects
Robert Mahari
Dominik Stammbach
Elliott Ash
Alex Pentland
AILaw
22
7
0
22 Oct 2023
Knowledge-Augmented Language Model Verification
Knowledge-Augmented Language Model Verification
Jinheon Baek
Soyeong Jeong
Minki Kang
Jong C. Park
Sung Ju Hwang
RALM
34
13
0
19 Oct 2023
Reliable Academic Conference Question Answering: A Study Based on Large
  Language Model
Reliable Academic Conference Question Answering: A Study Based on Large Language Model
Zhiwei Huang
Long Jin
Junjie Wang
Mingchen Tu
Yin Hua
Zhiqiang Liu
Jiawei Meng
Hua-zeng Chen
Wen Zhang
26
0
0
19 Oct 2023
Emptying the Ocean with a Spoon: Should We Edit Models?
Emptying the Ocean with a Spoon: Should We Edit Models?
Yuval Pinter
Michael Elhadad
KELM
20
26
0
18 Oct 2023
If the Sources Could Talk: Evaluating Large Language Models for Research
  Assistance in History
If the Sources Could Talk: Evaluating Large Language Models for Research Assistance in History
Giselle Gonzalez Garcia
Christian Weilbach
15
6
0
16 Oct 2023
RegaVAE: A Retrieval-Augmented Gaussian Mixture Variational Auto-Encoder
  for Language Modeling
RegaVAE: A Retrieval-Augmented Gaussian Mixture Variational Auto-Encoder for Language Modeling
Jingcheng Deng
Liang Pang
Huawei Shen
Xueqi Cheng
RALM
19
10
0
16 Oct 2023
Farzi Data: Autoregressive Data Distillation
Farzi Data: Autoregressive Data Distillation
Noveen Sachdeva
Zexue He
Wang-Cheng Kang
Jianmo Ni
D. Cheng
Julian McAuley
DD
19
3
0
15 Oct 2023
Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language Models
Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language Models
Wenqi Jiang
Marco Zeller
R. Waleffe
Torsten Hoefler
Gustavo Alonso
47
16
0
15 Oct 2023
CarExpert: Leveraging Large Language Models for In-Car Conversational
  Question Answering
CarExpert: Leveraging Large Language Models for In-Car Conversational Question Answering
Md. Rony
Christian Suess
Sinchana Ramakanth Bhat
Viju Sudhi
Julia Schneider
Maximilian Vogel
Roman Teucher
Ken E. Friedl
S. Sahoo
26
9
0
14 Oct 2023
Previous
123...789...131415
Next