ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2002.08910
  4. Cited By
How Much Knowledge Can You Pack Into the Parameters of a Language Model?
v1v2v3v4 (latest)

How Much Knowledge Can You Pack Into the Parameters of a Language Model?

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2025
10 February 2020
Adam Roberts
Colin Raffel
Noam M. Shazeer
    KELM
ArXiv (abs)PDFHTML

Papers citing "How Much Knowledge Can You Pack Into the Parameters of a Language Model?"

50 / 627 papers shown
Title
AmbigDocs: Reasoning across Documents on Different Entities under the
  Same Name
AmbigDocs: Reasoning across Documents on Different Entities under the Same Name
Yoonsang Lee
Xi Ye
Eunsol Choi
135
16
0
18 Apr 2024
De-DSI: Decentralised Differentiable Search Index
De-DSI: Decentralised Differentiable Search Index
Petru Neague
Marcel Gregoriadis
Johan Pouwelse
158
3
0
18 Apr 2024
MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memory
MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memory
Ali Modarressi
Abdullatif Köksal
Ayyoob Imani
Mohsen Fayyaz
Hinrich Schütze
KELM
302
19
0
17 Apr 2024
Towards Practical Tool Usage for Continually Learning LLMs
Towards Practical Tool Usage for Continually Learning LLMs
Jerry Huang
Prasanna Parthasarathi
Mehdi Rezagholizadeh
Sarath Chandar
CLLKELM
124
7
0
14 Apr 2024
The Hallucinations Leaderboard -- An Open Effort to Measure
  Hallucinations in Large Language Models
The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Models
Giwon Hong
Aryo Pradipta Gema
Rohit Saxena
Xiaotang Du
Ping Nie
...
Laura Perez-Beltrachini
Max Ryabinin
Xuanli He
Clémentine Fourrier
Pasquale Minervini
LRMHILM
173
12
0
08 Apr 2024
Context versus Prior Knowledge in Language Models
Context versus Prior Knowledge in Language Models
Kevin Du
Vésteinn Snaebjarnarson
Niklas Stoehr
Jennifer C. White
Aaron Schein
Robert Bamler
158
16
0
06 Apr 2024
Scope Ambiguities in Large Language Models
Scope Ambiguities in Large Language Models
Gaurav Kamath
Sebastian Schuster
Sowmya Vajjala
Siva Reddy
107
11
0
05 Apr 2024
Learning to Plan and Generate Text with Citations
Learning to Plan and Generate Text with Citations
Constanza Fierro
Reinald Kim Amplayo
Fantine Huot
Nicola De Cao
Joshua Maynez
Shashi Narayan
Mirella Lapata
126
24
0
04 Apr 2024
Scalable Model Editing via Customized Expert Networks
Scalable Model Editing via Customized Expert Networks
Zihan Yao
Yu He
Tianyu Qi
Ming Li
KELM
111
6
0
03 Apr 2024
Towards Better Generalization in Open-Domain Question Answering by
  Mitigating Context Memorization
Towards Better Generalization in Open-Domain Question Answering by Mitigating Context Memorization
Zixuan Zhang
R. Reddy
Kevin Small
Tong Zhang
Heng Ji
138
1
0
02 Apr 2024
Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing
  Positional Bias in LLMs
Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs
Zheng Zhang
Fan Yang
Ziyan Jiang
Zheng Chen
Zhengyang Zhao
Chengyuan Ma
Liang Zhao
Yang Liu
91
7
0
01 Apr 2024
Robust and Scalable Model Editing for Large Language Models
Robust and Scalable Model Editing for Large Language Models
Yingfa Chen
Zhengyan Zhang
Xu Han
Chaojun Xiao
Zhiyuan Liu
Chen Chen
Kuai Li
Tao Yang
Maosong Sun
KELM
71
2
0
26 Mar 2024
FIT-RAG: Black-Box RAG with Factual Information and Token Reduction
FIT-RAG: Black-Box RAG with Factual Information and Token Reduction
Yuren Mao
Xuemei Dong
Wenyi Xu
Yunjun Gao
Bin Wei
Ying Zhang
95
16
0
21 Mar 2024
Exploring Chinese Humor Generation: A Study on Two-Part Allegorical
  Sayings
Exploring Chinese Humor Generation: A Study on Two-Part Allegorical Sayings
Rongwu Xu
159
3
0
16 Mar 2024
Monotonic Representation of Numeric Properties in Language Models
Monotonic Representation of Numeric Properties in Language Models
Benjamin Heinzerling
Kentaro Inui
KELMMILM
144
10
0
15 Mar 2024
Knowledge Conflicts for LLMs: A Survey
Knowledge Conflicts for LLMs: A Survey
Rongwu Xu
Zehan Qi
Zhijiang Guo
Cunxiang Wang
Hongru Wang
Yue Zhang
Wei Xu
509
164
0
13 Mar 2024
Harnessing Multi-Role Capabilities of Large Language Models for
  Open-Domain Question Answering
Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question Answering
Hongda Sun
Yuxuan Liu
Chengwei Wu
Haiyu Yan
Cheng Tai
Xin Gao
Shuo Shang
Rui Yan
125
15
0
08 Mar 2024
KnowledgeVIS: Interpreting Language Models by Comparing
  Fill-in-the-Blank Prompts
KnowledgeVIS: Interpreting Language Models by Comparing Fill-in-the-Blank Prompts
Adam Joseph Coscia
Alex Endert
VLM
104
13
0
07 Mar 2024
Brilla AI: AI Contestant for the National Science and Maths Quiz
Brilla AI: AI Contestant for the National Science and Maths Quiz
George Boateng
Jonathan Abrefah Mensah
Kevin Takyi Yeboah
William Edor
Andrew Kojo Mensah-Onumah
Naafi Dasana Ibrahim
Nana Sam Yeboah
64
2
0
04 Mar 2024
Follow My Instruction and Spill the Beans: Scalable Data Extraction from
  Retrieval-Augmented Generation Systems
Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systems
Zhenting Qi
Hanlin Zhang
Eric Xing
Sham Kakade
Hima Lakkaraju
SILM
165
36
0
27 Feb 2024
Evaluating Robustness of Generative Search Engine on Adversarial Factual
  Questions
Evaluating Robustness of Generative Search Engine on Adversarial Factual Questions
Xuming Hu
Xiaochuan Li
Junzhe Chen
Hai-Tao Zheng
Yangning Li
...
Yasheng Wang
Qun Liu
Lijie Wen
Philip S. Yu
Zhijiang Guo
AAMLELM
101
5
0
25 Feb 2024
Ranking Entities along Conceptual Space Dimensions with LLMs: An
  Analysis of Fine-Tuning Strategies
Ranking Entities along Conceptual Space Dimensions with LLMs: An Analysis of Fine-Tuning Strategies
Nitesh Kumar
Usashi Chatterjee
Steven Schockaert
104
1
0
23 Feb 2024
Can Language Models Act as Knowledge Bases at Scale?
Can Language Models Act as Knowledge Bases at Scale?
Qiyuan He
Yizhong Wang
Wenya Wang
KELMLRM
104
15
0
22 Feb 2024
Retrieval Helps or Hurts? A Deeper Dive into the Efficacy of Retrieval
  Augmentation to Language Models
Retrieval Helps or Hurts? A Deeper Dive into the Efficacy of Retrieval Augmentation to Language Models
Seiji Maekawa
Hayate Iso
Sairam Gurajada
Nikita Bhutani
RALMKELM
154
17
0
21 Feb 2024
Instruction-tuned Language Models are Better Knowledge Learners
Instruction-tuned Language Models are Better Knowledge Learners
Zhengbao Jiang
Zhiqing Sun
Weijia Shi
Pedro Rodriguez
Chunting Zhou
Graham Neubig
Xi Lin
Anuj Kumar
Srinivasan Iyer
KELM
133
49
0
20 Feb 2024
TrustScore: Reference-Free Evaluation of LLM Response Trustworthiness
TrustScore: Reference-Free Evaluation of LLM Response Trustworthiness
Danna Zheng
Danyang Liu
Mirella Lapata
Jeff Z. Pan
HILM
131
10
0
19 Feb 2024
Discerning and Resolving Knowledge Conflicts through Adaptive Decoding
  with Contextual Information-Entropy Constraint
Discerning and Resolving Knowledge Conflicts through Adaptive Decoding with Contextual Information-Entropy Constraint
Xiaowei Yuan
Zhao Yang
Yequan Wang
Shengping Liu
Jun Zhao
Kang Liu
93
22
0
19 Feb 2024
KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning
  over Knowledge Graph
KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph
Jinhao Jiang
Kun Zhou
Wayne Xin Zhao
Yang Song
Chen Zhu
Hengshu Zhu
Ji-Rong Wen
LLMAGRALM
86
50
0
17 Feb 2024
LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video
  Editing
LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing
Bryan Wang
Yuliang Li
Zhaoyang Lv
Haijun Xia
Yan Xu
Raj Sodhi
129
71
0
15 Feb 2024
Copyright Traps for Large Language Models
Copyright Traps for Large Language Models
Matthieu Meeus
Igor Shilov
Manuel Faysse
Yves-Alexandre de Montjoye
159
27
0
14 Feb 2024
Summing Up the Facts: Additive Mechanisms Behind Factual Recall in LLMs
Summing Up the Facts: Additive Mechanisms Behind Factual Recall in LLMs
Bilal Chughtai
Alan Cooney
Neel Nanda
HILMKELM
112
28
0
11 Feb 2024
CigaR: Cost-efficient Program Repair with LLMs
CigaR: Cost-efficient Program Repair with LLMs
Dávid Hidvégi
K. Etemadi
Sofia Bobadilla
Martin Monperrus
124
28
0
09 Feb 2024
Large Language Models for Captioning and Retrieving Remote Sensing
  Images
Large Language Models for Captioning and Retrieving Remote Sensing Images
João Daniel Silva
João Magalhães
D. Tuia
Bruno Martins
104
34
0
09 Feb 2024
The Queen of England is not England's Queen: On the Lack of Factual
  Coherency in PLMs
The Queen of England is not England's Queen: On the Lack of Factual Coherency in PLMs
Paul Youssef
Jorg Schlotterer
Christin Seifert
KELM
151
3
0
02 Feb 2024
RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
Parth Sarthi
Salman Abdullah
Aditi Tuli
Shubh Khanna
Anna Goldie
Christopher D. Manning
RALM
185
215
0
31 Jan 2024
Desiderata for the Context Use of Question Answering Systems
Desiderata for the Context Use of Question Answering Systems
Sagi Shaier
Lawrence E Hunter
Katharina von der Wense
173
6
0
31 Jan 2024
K-QA: A Real-World Medical Q&A Benchmark
K-QA: A Real-World Medical Q&A Benchmark
Itay Manes
Naama Ronn
David Cohen
Ran Ilan Ber
Zehavi Horowitz-Kugler
Gabriel Stanovsky
LM&MAHILMAI4MH
135
16
0
25 Jan 2024
Blinded by Generated Contexts: How Language Models Merge Generated and
  Retrieved Contexts When Knowledge Conflicts?
Blinded by Generated Contexts: How Language Models Merge Generated and Retrieved Contexts When Knowledge Conflicts?
Hexiang Tan
Fei Sun
Wanli Yang
Yuanzhuo Wang
Qi Cao
Xueqi Cheng
310
28
0
22 Jan 2024
Question Translation Training for Better Multilingual Reasoning
Question Translation Training for Better Multilingual Reasoning
Wenhao Zhu
Shujian Huang
Fei Yuan
Shuaijie She
Jiajun Chen
Alexandra Birch
LRM
226
41
0
15 Jan 2024
Editing Arbitrary Propositions in LLMs without Subject Labels
Editing Arbitrary Propositions in LLMs without Subject Labels
Itai Feigenbaum
Devansh Arpit
Huan Wang
Shelby Heinecke
Juan Carlos Niebles
Weiran Yao
Caiming Xiong
Silvio Savarese
KELM
75
2
0
15 Jan 2024
Navigating Uncertainty: Optimizing API Dependency for Hallucination
  Reduction in Closed-Book Question Answering
Navigating Uncertainty: Optimizing API Dependency for Hallucination Reduction in Closed-Book Question Answering
Pierre Erbacher
Louis Falissard
Vincent Guigue
Laure Soulier
HILMRALM
83
4
0
03 Jan 2024
Align on the Fly: Adapting Chatbot Behavior to Established Norms
Align on the Fly: Adapting Chatbot Behavior to Established Norms
Chunpu Xu
Steffi Chern
Ethan Chern
Ge Zhang
Zekun Wang
Ruibo Liu
Jing Li
Jie Fu
Pengfei Liu
99
22
0
26 Dec 2023
LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models
  via MoE-Style Plugin
LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin
Shihan Dou
Enyu Zhou
Yan Liu
Songyang Gao
Jun Zhao
...
Jiang Zhu
Rui Zheng
Tao Gui
Tao Gui
Xuanjing Huang
CLLMoEKELM
131
49
0
15 Dec 2023
The Earth is Flat because...: Investigating LLMs' Belief towards
  Misinformation via Persuasive Conversation
The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversation
Rongwu Xu
Brian S. Lin
Shujian Yang
Tianqi Zhang
Weiyan Shi
Tianwei Zhang
Zhixuan Fang
Wei Xu
Han Qiu
278
73
0
14 Dec 2023
Helping Language Models Learn More: Multi-dimensional Task Prompt for
  Few-shot Tuning
Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning
Jinta Weng
Jiarui Zhang
Yue Hu
Daidong Fa
Xiaofeng Xu
Heyan Huang
71
2
0
13 Dec 2023
DUnE: Dataset for Unified Editing
DUnE: Dataset for Unified Editing
Afra Feyza Akyürek
Eric Pan
Garry Kuwanto
Derry Wijaya
KELM
111
18
0
27 Nov 2023
Minimizing Factual Inconsistency and Hallucination in Large Language
  Models
Minimizing Factual Inconsistency and Hallucination in Large Language Models
Muneeswaran Irulandi
Shreya Saxena
Siva Prasad
M. V. Sai Prakash
Advaith Shankar
V. Varun
Vishal Vaddina
Saisubramaniam Gopalakrishnan
HILM
103
6
0
23 Nov 2023
Physical Reasoning and Object Planning for Household Embodied Agents
Physical Reasoning and Object Planning for Household Embodied Agents
Ayush Agrawal
Raghav Prabhakar
Anirudh Goyal
Dianbo Liu
LM&RoLRM
62
3
0
22 Nov 2023
Unifying Corroborative and Contributive Attributions in Large Language
  Models
Unifying Corroborative and Contributive Attributions in Large Language Models
Theodora Worledge
Judy Hanwen Shen
Nicole Meister
Caleb Winston
Carlos Guestrin
TDI
158
13
0
20 Nov 2023
On Retrieval Augmentation and the Limitations of Language Model Training
On Retrieval Augmentation and the Limitations of Language Model Training
Ting-Rui Chiang
Xinyan Velocity Yu
Joshua Robinson
Ollie Liu
Isabelle Lee
Dani Yogatama
RALM
104
0
0
16 Nov 2023
Previous
12345...111213
Next