Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2203.16747
Cited By
How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis
Findings (Findings), 2022
31 March 2022
Shaobo Li
Xiaoguang Li
Lifeng Shang
Zhenhua Dong
Chengjie Sun
Bingquan Liu
Zhenzhou Ji
Xin Jiang
Qun Liu
KELM
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis"
39 / 39 papers shown
When Bias Pretends to Be Truth: How Spurious Correlations Undermine Hallucination Detection in LLMs
Shaowen Wang
Yiqi Dong
Ruinian Chang
Tansheng Zhu
Yuebo Sun
Kaifeng Lyu
Jian Li
HILM
319
0
0
10 Nov 2025
Facts in Stats: Impacts of Pretraining Diversity on Language Model Generalization
Tina Behnia
Puneesh Deora
Christos Thrampoulidis
100
0
0
17 Oct 2025
Why Language Models Hallucinate
Adam Tauman Kalai
Ofir Nachum
Santosh Vempala
Edwin Zhang
HILM
LRM
379
75
0
04 Sep 2025
Evaluating the Unseen Capabilities: How Many Theorems Do LLMs Know?
Xiang Li
Jiayi Xin
Qi Long
Weijie J. Su
ELM
161
1
0
01 Jun 2025
Why and How LLMs Hallucinate: Connecting the Dots with Subsequence Associations
Yiyou Sun
Y. Gai
Lijie Chen
Abhilasha Ravichander
Yejin Choi
Basel Alomair
HILM
380
10
0
17 Apr 2025
KSHSeek: Data-Driven Approaches to Mitigating and Detecting Knowledge-Shortcut Hallucinations in Generative Models
Zhenting Wang
Zhongxin Liu
Ying Li
Hongyu Sun
Meng Xu
Yuqing Zhang
He Wang
Gaofei Wu
Y. Zhang
HILM
380
1
0
25 Mar 2025
BiasEdit: Debiasing Stereotyped Language Models via Model Editing
Xin Xu
Wei Xu
Ningyu Zhang
Julian McAuley
KELM
357
11
0
11 Mar 2025
Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Xinyue Cui
Johnny Tian-Zheng Wei
Swabha Swayamdipta
Robin Jia
WaLM
553
8
0
06 Mar 2025
IPL: Leveraging Multimodal Large Language Models for Intelligent Product Listing
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Kang Chen
Qingheng Zhang
Chengbao Lian
Yixin Ji
Xuwei Liu
Shuguang Han
Guoqiang Wu
Fei Huang
Jufeng Chen
127
6
0
22 Oct 2024
On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMs
Nitay Calderon
Roi Reichart
358
24
0
27 Jul 2024
Knowledge Mechanisms in Large Language Models: A Survey and Perspective
Meng Wang
Yunzhi Yao
Ziwen Xu
Shuofei Qiao
Shumin Deng
...
Yong Jiang
Pengjun Xie
Fei Huang
Huajun Chen
Ningyu Zhang
332
60
0
22 Jul 2024
Look Within, Why LLMs Hallucinate: A Causal Perspective
He Li
Haoang Chi
Mingyu Liu
Wenjing Yang
LRM
189
10
0
14 Jul 2024
How Do Large Language Models Acquire Factual Knowledge During Pretraining?
Hoyeon Chang
Jinho Park
Seonghyeon Ye
Sohee Yang
Youngkyung Seo
Du-Seong Chang
Minjoon Seo
KELM
330
83
0
17 Jun 2024
ProbGate at EHRSQL 2024: Enhancing SQL Query Generation Accuracy through Probabilistic Threshold Filtering and Error Handling
Sangryul Kim
Donghee Han
Sehyun Kim
193
5
0
25 Apr 2024
Entropy Guided Extrapolative Decoding to Improve Factuality in Large Language Models
Souvik Das
Lifeng Jin
Linfeng Song
Haitao Mi
Baolin Peng
Dong Yu
HILM
255
4
0
14 Apr 2024
Knowledge Conflicts for LLMs: A Survey
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Rongwu Xu
Zehan Qi
Zhijiang Guo
Cunxiang Wang
Hongru Wang
Yue Zhang
Wei Xu
1.1K
202
0
13 Mar 2024
InfuserKI: Enhancing Large Language Models with Knowledge Graphs via Infuser-Guided Knowledge Integration
Fali Wang
Runxue Bao
Suhang Wang
Wenchao Yu
Yanchi Liu
Wei Cheng
Haifeng Chen
KELM
233
24
0
18 Feb 2024
The Queen of England is not England's Queen: On the Lack of Factual Coherency in PLMs
Paul Youssef
Jorg Schlotterer
Christin Seifert
KELM
308
3
0
02 Feb 2024
BayesPrompt: Prompting Large-Scale Pre-Trained Language Models on Few-shot Inference via Debiased Domain Abstraction
International Conference on Learning Representations (ICLR), 2024
Jiangmeng Li
Fei Song
Yifan Jin
Jingyao Wang
Changwen Zheng
Gang Hua
Hui Xiong
VLM
324
8
0
25 Jan 2024
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems
Tianyu Cui
Yanling Wang
Chuanpu Fu
Yong Xiao
Sijia Li
...
Junwu Xiong
Xinyu Kong
ZuJie Wen
Ke Xu
Qi Li
315
98
0
11 Jan 2024
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models
Junyi Li
Jie Chen
Ruiyang Ren
Xiaoxue Cheng
Wayne Xin Zhao
Jian-Yun Nie
Ji-Rong Wen
HILM
260
107
0
06 Jan 2024
Data Management For Large Language Models: A Survey
Zige Wang
Wanjun Zhong
Yufei Wang
Qi Zhu
Fei Mi
Baojun Wang
Lifeng Shang
Xin Jiang
Qun Liu
LM&MA
223
13
0
04 Dec 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
Lei Huang
Weijiang Yu
Weitao Ma
Weihong Zhong
Zhangyin Feng
...
Qianglong Chen
Weihua Peng
Xiaocheng Feng
Bing Qin
Ting Liu
LRM
HILM
437
1,930
0
09 Nov 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Paul Youssef
Osman Alperen Koracs
Meijie Li
Jorg Schlotterer
Christin Seifert
KELM
305
26
0
25 Oct 2023
Impact of Co-occurrence on Factual Knowledge of Large Language Models
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Cheongwoong Kang
Jaesik Choi
KELM
215
25
0
12 Oct 2023
Faithful Knowledge Graph Explanations for Commonsense Reasoning
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Weihe Zhai
A. Zubiaga
264
0
0
07 Oct 2023
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
Computational Linguistics (CL), 2023
Yue Zhang
Yafu Li
Leyang Cui
Deng Cai
Lemao Liu
...
Longyue Wang
Anh Tuan Luu
Freda Shi
Shuming Shi
Shuming Shi
LRM
RALM
HILM
710
812
0
03 Sep 2023
Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neurons
AAAI Conference on Artificial Intelligence (AAAI), 2023
Yuheng Chen
Pengfei Cao
Yubo Chen
Kang Liu
Jun Zhao
KELM
329
59
0
25 Aug 2023
On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook
International Journal of Computer Vision (IJCV), 2023
Mingyuan Fan
Chengyu Wang
Cen Chen
Yang Liu
Jun Huang
HILM
309
13
0
31 Jul 2023
Generating Benchmarks for Factuality Evaluation of Language Models
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Dor Muhlgay
Ori Ram
Inbal Magar
Yoav Levine
Nir Ratner
Yonatan Belinkov
Omri Abend
Kevin Leyton-Brown
Amnon Shashua
Y. Shoham
HILM
247
123
0
13 Jul 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap
IEEE Transactions on Knowledge and Data Engineering (TKDE), 2023
Shirui Pan
Linhao Luo
Yufei Wang
Chen Chen
Jiapu Wang
Xindong Wu
KELM
507
1,131
0
14 Jun 2023
Examining the Emergence of Deductive Reasoning in Generative Language Models
Peter Belcak
Luca A. Lanzendörfer
Roger Wattenhofer
ReLM
ELM
LRM
AI4CE
144
0
0
31 May 2023
Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Sherzod Hakimov
David Schlangen
VLM
191
8
0
23 May 2023
"According to ...": Prompting Language Models Improves Quoting from Pre-Training Data
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Orion Weller
Marc Marone
Nathaniel Weir
Dawn J Lawrie
Daniel Khashabi
Benjamin Van Durme
HILM
307
58
0
22 May 2023
Causality-aware Concept Extraction based on Knowledge-guided Prompting
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Siyu Yuan
Deqing Yang
Jinxi Liu
Shuyu Tian
Jiaqing Liang
Yanghua Xiao
R. Xie
340
15
0
03 May 2023
The Life Cycle of Knowledge in Big Language Models: A Survey
Machine Intelligence Research (MIR), 2023
Boxi Cao
Hongyu Lin
Xianpei Han
Le Sun
KELM
266
30
0
14 Mar 2023
A Review of the Role of Causality in Developing Trustworthy AI Systems
Niloy Ganguly
Dren Fazlija
Maryam Badar
M. Fisichella
Sandipan Sikdar
...
Koustav Rudra
Manolis Koubarakis
Gourab K. Patro
W. Z. E. Amri
Wolfgang Nejdl
CML
321
26
0
14 Feb 2023
A Survey of Knowledge Enhanced Pre-trained Language Models
IEEE Transactions on Knowledge and Data Engineering (TKDE), 2022
Linmei Hu
Zeyi Liu
Ziwang Zhao
Lei Hou
Liqiang Nie
Juanzi Li
KELM
VLM
451
196
0
11 Nov 2022
Towards Faithful Model Explanation in NLP: A Survey
Computational Linguistics (CL), 2022
Qing Lyu
Marianna Apidianaki
Chris Callison-Burch
XAI
527
166
0
22 Sep 2022
1
