v1v2v3v4 (latest)

How Much Knowledge Can You Pack Into the Parameters of a Language Model?

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2025

10 February 2020

Papers citing "How Much Knowledge Can You Pack Into the Parameters of a Language Model?"

50 / 627 papers shown

Title
Retrieval Augmentation Reduces Hallucination in Conversation Kurt Shuster Spencer Poff Moya Chen Douwe Kiela Jason Weston HILM 172 823 0 15 Apr 2021
Designing a Minimal Retrieve-and-Read System for Open-Domain Question Answering Sohee Yang Minjoon Seo RALM 63 8 0 15 Apr 2021
Static Embeddings as Efficient Knowledge Bases? Philipp Dufter Nora Kassner Hinrich Schütze 77 20 0 14 Apr 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 142 55 0 12 Apr 2021
What's the best place for an AI conference, Vancouver or ______: Why completing comparative questions is difficult Avishai Zagoury Einat Minkov Idan Szpektor William W. Cohen ELM 76 6 0 05 Apr 2021
Annotating Columns with Pre-trained Language Models Yoshihiko Suhara Jinfeng Li Yuliang Li Dan Zhang cCaugatay Demiralp Chen Chen W. Tan LMTD 90 96 0 05 Apr 2021
CURIE: An Iterative Querying Approach for Reasoning About Situations Dheeraj Rajagopal Aman Madaan Niket Tandon Yiming Yang Shrimai Prabhumoye Abhilasha Ravichander Peter Clark Eduard H. Hovy ReLM LRM 84 6 0 01 Apr 2021
Value-aware Approximate Attention Ankit Gupta Jonathan Berant 101 6 0 17 Mar 2021
Towards Few-Shot Fact-Checking via PerplexityNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025 Nayeon Lee Yejin Bang Andrea Madotto Madian Khabsa Pascale Fung AAML 97 94 0 17 Mar 2021
Get Your Vitamin C! Robust Fact Verification with Contrastive EvidenceNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025 Tal Schuster Adam Fisch Regina Barzilay 142 249 0 15 Mar 2021
Hurdles to Progress in Long-form Question Answering Kalpesh Krishna Aurko Roy Mohit Iyyer 138 216 0 10 Mar 2021
Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answering Aman Jain Mayank Kothyari Vishwajeet Kumar Preethi Jyothi Ganesh Ramakrishnan Soumen Chakrabarti 100 39 0 09 Mar 2021
Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Do P. Schramowski Cigdem Turan Nico Andersen Constantin Rothkopf Kristian Kersting 189 314 0 08 Mar 2021
Do Transformer Modifications Transfer Across Implementations and Applications? Sharan Narang Hyung Won Chung Yi Tay W. Fedus Thibault Févry ... Wei Li Nan Ding Jake Marcus Adam Roberts Colin Raffel 170 130 0 23 Feb 2021
Pruning the Index Contents for Memory Efficient Open-Domain QA Martin Fajcik Martin Docekal Karel Ondrej Pavel Smrz 127 8 0 21 Feb 2021
Quiz-Style Question Generation for News Stories Á. Lelkes Vinh Q. Tran Cong Yu 102 44 0 18 Feb 2021
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul N. Bennett Jiawei Han Xia Song 229 208 0 16 Feb 2021
PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them Patrick Lewis Yuxiang Wu Linqing Liu Pasquale Minervini Heinrich Küttler Aleksandra Piktus Pontus Stenetorp Sebastian Riedel RALM 192 249 0 13 Feb 2021
When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Data Peter Hase Joey Tianyi Zhou XAI 203 90 0 03 Feb 2021
Neural Data Augmentation via Example Extrapolation Kenton Lee Kelvin Guu Luheng He Timothy Dozat Hyung Won Chung 94 73 0 02 Feb 2021
Measuring and Improving Consistency in Pretrained Language Models Yanai Elazar Nora Kassner Shauli Ravfogel Abhilasha Ravichander Eduard H. Hovy Hinrich Schütze Yoav Goldberg HILM 442 400 0 01 Feb 2021
Transformer-Based Models for Question Answering on COVID19 Hillary Ngai Yoona Park John Chen Mahboobeh Parsapoor OOD 85 21 0 16 Jan 2021
ComQA:Compositional Question Answering via Hierarchical Graph Neural NetworksThe Web Conference (WWW), 2024 Bingning Wang Ting Yao Weipeng Chen Jingfang Xu Xiaochuan Wang CoGe 107 6 0 16 Jan 2021
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity W. Fedus Barret Zoph Noam M. Shazeer MoE 366 2,615 0 11 Jan 2021
Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering Fengbin Zhu Wenqiang Lei Chao Wang Jianming Zheng Soujanya Poria Tat-Seng Chua RALM 376 267 0 04 Jan 2021
Analyzing Commonsense Emergence in Few-shot Knowledge Models Jeff Da Ronan Le Bras Ximing Lu Yejin Choi Antoine Bosselut AI4MH KELM 264 42 0 01 Jan 2021
Rider: Reader-Guided Passage Reranking for Open-Domain Question Answering Yuning Mao Pengcheng He Xiaodong Liu Yelong Shen Jianfeng Gao Jiawei Han Weizhu Chen OOD LRM 307 38 0 01 Jan 2021
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned Sewon Min Jordan L. Boyd-Graber Chris Alberti Danqi Chen Eunsol Choi ... Dmytro Okhonko Michael Schlichtkrull Sonal Gupta Yashar Mehdad Anuj Kumar 134 64 0 01 Jan 2021
Studying Strategically: Learning to Mask for Closed-book QA Qinyuan Ye Belinda Z. Li Sinong Wang Benjamin Bolte Hao Ma Anuj Kumar Xiang Ren Madian Khabsa OffRL 136 12 0 31 Dec 2020
A Memory Efficient Baseline for Open Domain Question Answering Gautier Izacard Fabio Petroni Lucas Hosseini Nicola De Cao Sebastian Riedel Edouard Grave MQ 94 44 0 30 Dec 2020
UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering Barlas Oğuz Xilun Chen Vladimir Karpukhin Stanislav Peshterliev Dmytro Okhonko Michael Schlichtkrull Sonal Gupta Yashar Mehdad Scott Yih 328 92 0 29 Dec 2020
Learning Dense Representations of Phrases at ScaleAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Jinhyuk Lee Mujeen Sung Jaewoo Kang Danqi Chen RALM DML NAI 157 123 0 23 Dec 2020
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown Basel Alomair Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 832 2,189 0 14 Dec 2020
KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning Bin He Xin Jiang Jinghui Xiao Qun Liu 157 18 0 07 Dec 2020
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig UQCV 222 478 0 02 Dec 2020
Modifying Memories in Transformer Models Chen Zhu A. S. Rawat Manzil Zaheer Srinadh Bhojanapalli Daliang Li Felix X. Yu Sanjiv Kumar KELM 177 219 0 01 Dec 2020
Are Pre-trained Language Models Knowledgeable to Ground Open Domain Dialogues? Yufan Zhao Wei Wu Can Xu 103 9 0 19 Nov 2020
NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Bases Tara Safavi Jing Zhu Danai Koutra 167 13 0 15 Nov 2020
Entity Linking in 100 LanguagesConference on Empirical Methods in Natural Language Processing (EMNLP), 2025 Jan A. Botha Zifei Shan D. Gillick VLM 86 81 0 05 Nov 2020
Differentiable Open-Ended Commonsense ReasoningNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025 Bill Yuchen Lin Haitian Sun Bhuwan Dhingra Manzil Zaheer Xiang Ren William W. Cohen ReLM LRM 114 43 0 24 Oct 2020
Pre-training Text-to-Text Transformers for Concept-centric Common SenseInternational Conference on Learning Representations (ICLR), 2025 Wangchunshu Zhou Dong-Ho Lee Ravi Kiran Selvam Seyeon Lee Bill Yuchen Lin Xiang Ren LRM VLM 73 72 0 24 Oct 2020
mT5: A massively multilingual pre-trained text-to-text transformer Linting Xue Noah Constant Adam Roberts Mihir Kale Rami Al-Rfou Aditya Siddhant Aditya Barua Colin Raffel 398 2,721 0 22 Oct 2020
Probing and Fine-tuning Reading Comprehension Models for Few-shot Event Extraction Rui Feng Jie Yuan Chao Zhang 86 22 0 21 Oct 2020
Is Retriever Merely an Approximator of Reader? Sohee Yang Minjoon Seo RALM 103 41 0 21 Oct 2020
X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models Zhengbao Jiang Antonios Anastasopoulos Jun Araki Haibo Ding Graham Neubig HILM KELM 182 146 0 13 Oct 2020
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs Jena D. Hwang Chandra Bhagavatula Ronan Le Bras Jeff Da Keisuke Sakaguchi Antoine Bosselut Yejin Choi 178 430 0 12 Oct 2020
Using Type Information to Improve Entity Coreference Resolution Sopan Khosla Carolyn Rose NAI 98 19 0 12 Oct 2020
Assessing Phrasal Representation and Composition in Transformers Lang-Chi Yu Allyson Ettinger CoGe 149 68 0 08 Oct 2020
Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems Andrea Madotto Samuel Cahyawijaya Genta Indra Winata Yan Xu Zihan Liu Mohammad Kachuee Pascale Fung 133 64 0 28 Sep 2020
Answering Complex Open-Domain Questions with Multi-Hop Dense RetrievalInternational Conference on Learning Representations (ICLR), 2025 Wenhan Xiong Xiang Lorraine Li Srini Iyer Jingfei Du Patrick Lewis ... Yashar Mehdad Anuj Kumar Sebastian Riedel Douwe Kiela Barlas Oğuz 120 203 0 27 Sep 2020