v1v2v3v4 (latest)

How Much Knowledge Can You Pack Into the Parameters of a Language Model?

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2025

10 February 2020

Papers citing "How Much Knowledge Can You Pack Into the Parameters of a Language Model?"

27 / 627 papers shown

Title
Generation-Augmented Retrieval for Open-domain Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Yuning Mao Pengcheng He Xiaodong Liu Yelong Shen Jianfeng Gao Jiawei Han Weizhu Chen RALM 214 268 0 17 Sep 2020
Language Models as Knowledge Bases: On Entity Representations, Storage Capacity, and Paraphrased QueriesConference of the European Chapter of the Association for Computational Linguistics (EACL), 2025 Benjamin Heinzerling Kentaro Inui KELM 150 140 0 20 Aug 2020
Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets Patrick Lewis Pontus Stenetorp Sebastian Riedel OOD ELM 203 192 0 06 Aug 2020
Neural Language Generation: Formulation, Methods, and Evaluation Cristina Garbacea Qiaozhu Mei 201 29 0 31 Jul 2020
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering Shayne Longpre Yi Lu Joachim Daiber ELM HILM 181 182 0 30 Jul 2020
Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering Gautier Izacard Edouard Grave RALM 246 1,305 0 02 Jul 2020
Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledge Pat Verga Haitian Sun Livio Baldini Soares William W. Cohen KELM 131 50 0 02 Jul 2020
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval Lee Xiong Chenyan Xiong Ye Li Kwok-Fung Tang Jialin Liu Paul N. Bennett Junaid Ahmed Arnold Overwijk 284 1,324 0 01 Jul 2020
Knowledge-Aware Language Model Pretraining Corby Rosset Chenyan Xiong M. Phan Xia Song Paul N. Bennett Saurabh Tiwary KELM 153 84 0 29 Jun 2020
Are Pretrained Language Models Symbolic Reasoners Over Knowledge? Nora Kassner Benno Kroje Hinrich Schütze ReLM LRM 58 4 0 18 Jun 2020
Misinformation Has High Perplexity Nayeon Lee Yejin Bang Andrea Madotto Pascale Fung 112 31 0 08 Jun 2020
Language Models as Fact Checkers? Nayeon Lee Belinda Z. Li Sinong Wang Anuj Kumar Hao Ma Madian Khabsa KELM HILM LRM 113 78 0 07 Jun 2020
GMAT: Global Memory Augmentation for Transformers Ankit Gupta Jonathan Berant RALM 129 51 0 05 Jun 2020
A Survey on Transfer Learning in Natural Language Processing Zaid Alyafeai Maged S. Alshaibani Irfan Ahmad 137 77 0 31 May 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 1.6K 46,810 0 28 May 2020
UnifiedQA: Crossing Format Boundaries With a Single QA System Daniel Khashabi Sewon Min Tushar Khot Ashish Sabharwal Oyvind Tafjord Peter Clark Hannaneh Hajishirzi 405 766 0 02 May 2020
Probing Contextual Language Models for Common Ground with Visual Representations Gabriel Ilharco Rowan Zellers Ali Farhadi Hannaneh Hajishirzi 204 14 0 01 May 2020
Interpretable Entity Representations through Large-Scale Typing Yasumasa Onoe Greg Durrett 106 20 0 30 Apr 2020
Progressively Pretrained Dense Corpus Index for Open-Domain Question AnsweringConference of the European Chapter of the Association for Computational Linguistics (EACL), 2025 Wenhan Xiong Hong Wang Wenjie Wang RALM 138 17 0 30 Apr 2020
Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTubeConference on Empirical Methods in Natural Language Processing (EMNLP), 2025 Jack Hessel Zhenhai Zhu Bo Pang Radu Soricut 81 4 0 29 Apr 2020
Entities as Experts: Sparse Memory Access with Entity Supervision Thibault Févry Livio Baldini Soares Nicholas FitzGerald Eunsol Choi Tom Kwiatkowski RALM 242 164 0 15 Apr 2020
Explaining Question Answering Models through Text Generation Veronica Latcinnik Jonathan Berant LRM 156 52 0 12 Apr 2020
Dense Passage Retrieval for Open-Domain Question Answering Vladimir Karpukhin Barlas Oğuz Sewon Min Patrick Lewis Ledell Yu Wu Sergey Edunov Danqi Chen Anuj Kumar RALM 446 4,260 0 10 Apr 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 251 1,592 0 27 Feb 2020
REALM: Retrieval-Augmented Language Model Pre-TrainingInternational Conference on Machine Learning (ICML), 2024 Kelvin Guu Kenton Lee Zora Tung Panupong Pasupat Ming-Wei Chang RALM 391 2,329 0 10 Feb 2020
Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering Akari Asai Kazuma Hashimoto Hannaneh Hajishirzi R. Socher Caiming Xiong RALM KELM LRM 228 297 0 24 Nov 2019
How Decoding Strategies Affect the Verifiability of Generated Text Luca Massarelli Fabio Petroni Aleksandra Piktus Myle Ott Tim Rocktaschel Vassilis Plachouras Fabrizio Silvestri Sebastian Riedel 236 51 0 09 Nov 2019