Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers

24 May 2020

Anne Lauscher

Olga Majewska

Leonardo F. R. Ribeiro

Nikolai Rozanov

Papers citing "Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers"

21 / 21 papers shown

Title
Efficient Domain Adaptation of Sentence Embeddings Using Adapters Tim Schopf Dennis Schneider Florian Matthes 26 5 0 06 Jul 2023
Text-To-KG Alignment: Comparing Current Methods on Classification Tasks Sondre Wold Lilja Ovrelid Erik Velldal 17 3 0 05 Jun 2023
InforMask: Unsupervised Informative Masking for Language Model Pretraining Nafis Sadeq Canwen Xu Julian McAuley 19 13 0 21 Oct 2022
The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection Sondre Wold KELM 14 4 0 03 Oct 2022
ConceptNet infused DialoGPT for Underlying Commonsense Understanding and Reasoning in Dialogue Response Generation Ye Liu Wolfgang Maier Wolfgang Minker Stefan Ultes 41 2 0 29 Sep 2022
On the Limitations of Sociodemographic Adaptation with Transformers Chia-Chien Hung Anne Lauscher Dirk Hovy Simone Paolo Ponzetto Goran Glavavs 14 0 0 01 Aug 2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers Jonas Pfeiffer Naman Goyal Xi Victoria Lin Xian Li James Cross Sebastian Riedel Mikel Artetxe LRM 35 138 0 12 May 2022
Geographic Adaptation of Pretrained Language Models Valentin Hofmann Goran Glavavs Nikola Ljubevsić J. Pierrehumbert Hinrich Schütze VLM 21 16 0 16 Mar 2022
Efficient Hierarchical Domain Adaptation for Pretrained Language Models Alexandra Chronopoulou Matthew E. Peters Jesse Dodge 16 42 0 16 Dec 2021
SocialBERT -- Transformers for Online SocialNetwork Language Modelling I. Karpov Nick Kartashev 14 3 0 13 Nov 2021
Knowledge-Enhanced Evidence Retrieval for Counterargument Generation Yohan Jo Haneul Yoo Jinyeong Bak Alice H. Oh Chris Reed Eduard H. Hovy RALM 38 12 0 19 Sep 2021
xGQA: Cross-Lingual Visual Question Answering Jonas Pfeiffer Gregor Geigle Aishwarya Kamath Jan-Martin O. Steitz Stefan Roth Ivan Vulić Iryna Gurevych 19 56 0 13 Sep 2021
Sustainable Modular Debiasing of Language Models Anne Lauscher Tobias Lüken Goran Glavas 47 120 0 08 Sep 2021
Scientia Potentia Est -- On the Role of Knowledge in Computational Argumentation Anne Lauscher Henning Wachsmuth Iryna Gurevych Goran Glavavs 25 31 0 01 Jul 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 22 51 0 12 Apr 2021
Structural Adapters in Pretrained Language Models for AMR-to-text Generation Leonardo F. R. Ribeiro Yue Zhang Iryna Gurevych 33 69 0 16 Mar 2021
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 11 126 0 31 Dec 2020
AdapterDrop: On the Efficiency of Adapters in Transformers Andreas Rucklé Gregor Geigle Max Glockner Tilman Beck Jonas Pfeiffer Nils Reimers Iryna Gurevych 19 254 0 22 Oct 2020
K-BERT: Enabling Language Representation with Knowledge Graph Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Qi Ju Haotang Deng Ping Wang 229 778 0 17 Sep 2019
Knowledge Enhanced Contextual Word Representations Matthew E. Peters Mark Neumann IV RobertL.Logan Roy Schwartz Vidur Joshi Sameer Singh Noah A. Smith 224 656 0 09 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018