K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters

5 February 2020

Xuanjing Huang

Papers citing "K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters"

50 / 97 papers shown

Title
DA-Ada: Learning Domain-Aware Adapter for Domain Adaptive Object Detection H. Li Rui Zhang Hantao Yao X. Zhang Yifan Hao Xinkai Song Xiaqing Li Yongwei Zhao Ling Li Yunji Chen ObjD VLM 31 3 0 11 Oct 2024
Exploiting the Semantic Knowledge of Pre-trained Text-Encoders for Continual Learning Lu Yu Hesong Li Ying Fu J. Weijer Changsheng Xu CLL 47 1 0 02 Aug 2024
Train-Attention: Meta-Learning Where to Focus in Continual Knowledge Learning Yeongbin Seo Dongha Lee Jinyoung Yeo CLL KELM 82 1 0 24 Jul 2024
DIEKAE: Difference Injection for Efficient Knowledge Augmentation and Editing of Large Language Models Alessio Galatolo Meriem Beloucif Katie Winkle 33 0 0 15 Jun 2024
SememeLM: A Sememe Knowledge Enhanced Method for Long-tail Relation Representation Shuyi Li Shaojuan Wu Xiaowang Zhang Zhiyong Feng 39 0 0 13 Jun 2024
LLM Augmented LLMs: Expanding Capabilities through Composition Rachit Bansal Bidisha Samanta Siddharth Dalmia Nitish Gupta Shikhar Vashishth Sriram Ganapathy Abhishek Bapna Prateek Jain Partha P. Talukdar CLL 21 34 0 04 Jan 2024
Online Continual Knowledge Learning for Language Models Yuhao Wu Tongjun Shi Karthick Sharma Chun Seah Shuhao Zhang CLL KELM 23 4 0 16 Nov 2023
Unlearn What You Want to Forget: Efficient Unlearning for LLMs Jiaao Chen Diyi Yang MU 27 136 0 31 Oct 2023
Cascaded Multi-task Adaptive Learning Based on Neural Architecture Search Yingying Gao Shilei Zhang Zihao Cui Chao Deng Junlan Feng 15 0 0 23 Oct 2023
Matrix Compression via Randomized Low Rank and Low Precision Factorization R. Saha Varun Srivastava Mert Pilanci 18 19 0 17 Oct 2023
Federated Class-Incremental Learning with Prompting Jiale Liu Yu-Wei Zhan Chong-Yu Zhang Xin Luo Zhen-Duo Chen Yinwei Wei CLL FedML 21 2 0 13 Oct 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning J. Wang Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 26 4 0 26 Sep 2023
Evaluating the Ripple Effects of Knowledge Editing in Language Models Roi Cohen Eden Biran Ori Yoran Amir Globerson Mor Geva KELM 40 155 0 24 Jul 2023
Efficient Domain Adaptation of Sentence Embeddings Using Adapters Tim Schopf Dennis Schneider Florian Matthes 26 5 0 06 Jul 2023
Parameter-efficient Dysarthric Speech Recognition Using Adapter Fusion and Householder Transformation Jinzi Qi Hugo Van hamme 38 3 0 12 Jun 2023
Plug-and-Play Document Modules for Pre-trained Models Chaojun Xiao Zhengyan Zhang Xu Han Chi-Min Chan Yankai Lin Zhiyuan Liu Xiangyang Li Zhonghua Li Zhao Cao Maosong Sun KELM 22 5 0 28 May 2023
How Fragile is Relation Extraction under Entity Replacements? Yiwei Wang Bryan Hooi Fei Wang Yujun Cai Yuxuan Liang Wenxuan Zhou Jing Tang Manjuan Duan Muhao Chen 56 5 0 22 May 2023
EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains Frank Mtumbuka Steven Schockaert 34 0 0 22 May 2023
ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain Mike Zhang Rob van der Goot Barbara Plank 16 14 0 20 May 2023
Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering Qianglong Chen Guohai Xu Mingshi Yan Ji Zhang Fei Huang Luo Si Yin Zhang 18 9 0 14 May 2023
CSED: A Chinese Semantic Error Diagnosis Corpus Bo Sun Baoxin Wang Yixuan Wang Wanxiang Che Dayong Wu Shijin Wang Ting Liu 35 4 0 09 May 2023
Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond Ensheng Shi Yanlin Wang Hongyu Zhang Lun Du Shi Han Dongmei Zhang Hongbin Sun 33 42 0 11 Apr 2023
Sentence-Level Relation Extraction via Contrastive Learning with Descriptive Relation Prompts Jiewen Zheng Ze Chen 25 2 0 11 Apr 2023
Bridging the Language Gap: Knowledge Injected Multilingual Question Answering Zhichao Duan Xiuxing Li Zhengyan Zhang Zhenyu Li Ning Liu Jianyong Wang 19 8 0 06 Apr 2023
Generating multiple-choice questions for medical question answering with distractors and cue-masking Damien Sileo Kanimozhi Uma Marie-Francine Moens 35 5 0 13 Mar 2023
SMoA: Sparse Mixture of Adapters to Mitigate Multiple Dataset Biases Yanchen Liu Jing Yang Yan Chen Jing Liu Huaqin Wu MoE 44 2 0 28 Feb 2023
LabelPrompt: Effective Prompt-based Learning for Relation Classification W. Zhang Xiaoning Song Zhenhua Feng Tianyang Xu Xiaojun Wu VLM 32 4 0 16 Feb 2023
Cluster-Level Contrastive Learning for Emotion Recognition in Conversations Kailai Yang Tianlin Zhang Hassan Alhuzali Sophia Ananiadou 29 43 0 07 Feb 2023
An Empirical Study on the Transferability of Transformer Modules in Parameter-Efficient Fine-Tuning Mohammad AkbarTajari S. Rajaee Mohammad Taher Pilehvar 11 2 0 01 Feb 2023
One Model for All Domains: Collaborative Domain-Prefix Tuning for Cross-Domain NER Xiang Chen Lei Li Q. Fei Ningyu Zhang Chuanqi Tan Yong-jia Jiang Fei Huang Huajun Chen 23 23 0 25 Jan 2023
Adaptive Pattern Extraction Multi-Task Learning for Multi-Step Conversion Estimations Xuewen Tao Mingming Ha Xiaobo Guo Qiongxu Ma Ho Kei Cheng Wenfang Lin 16 0 0 06 Jan 2023
Injecting Domain Knowledge in Language Models for Task-Oriented Dialogue Systems Denis Emelin Daniele Bonadiman Sawsan Alqahtani Yi Zhang Saab Mansour 13 17 0 15 Dec 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 19 121 0 11 Nov 2022
LegoNet: A Fast and Exact Unlearning Architecture Sihao Yu Fei Sun J. Guo Ruqing Zhang Xueqi Cheng MU 37 7 0 28 Oct 2022
Towards Language-driven Scientific AI José Manuél Gómez-Pérez 26 0 0 27 Oct 2022
Adapters for Enhanced Modeling of Multilingual Knowledge and Text Yifan Hou Wenxiang Jiao Mei-Jun Liu Carl Allen Zhaopeng Tu Mrinmaya Sachan 26 11 0 24 Oct 2022
An Empirical Revisiting of Linguistic Knowledge Fusion in Language Understanding Tasks Changlong Yu Tianyi Xiao Lingpeng Kong Yangqiu Song Wilfred Ng 30 3 0 24 Oct 2022
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding Qiming Peng Yinxu Pan Wenjin Wang Bin Luo Zhenyu Zhang ... Shi Feng Yu Sun Hao Tian Hua-Hong Wu Haifeng Wang 8 83 0 12 Oct 2022
Calibrating Factual Knowledge in Pretrained Language Models Qingxiu Dong Damai Dai Yifan Song Jingjing Xu Zhifang Sui Lei Li KELM 232 82 0 07 Oct 2022
Granularity-aware Adaptation for Image Retrieval over Multiple Tasks Jon Almazán ByungSoo Ko Geonmo Gu Diane Larlus Yannis Kalantidis ObjD VLM 30 7 0 05 Oct 2022
The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection Sondre Wold KELM 29 4 0 03 Oct 2022
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning Qianglong Chen Feng-Lin Li Guohai Xu Ming Yan Ji Zhang Yin Zhang 29 22 0 01 Aug 2022
1Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Task Zhiyong Wang Ge Zhang Nineli Lashkarashvili 16 3 0 08 Jun 2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers Jonas Pfeiffer Naman Goyal Xi Victoria Lin Xian Li James Cross Sebastian Riedel Mikel Artetxe LRM 40 139 0 12 May 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing Chengyu Wang Minghui Qiu Chen Shi Taolin Zhang Tingting Liu Lei Li J. Wang Ming Wang Jun Huang W. Lin 11 21 0 30 Apr 2022
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models Joel Jang Seonghyeon Ye Changho Lee Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Minjoon Seo CLL KELM 27 91 0 29 Apr 2022
Plug-and-Play Adaptation for Continuously-updated QA Kyungjae Lee Wookje Han Seung-won Hwang Hwaran Lee Joonsuk Park Sang-Woo Lee KELM 17 16 0 27 Apr 2022
Knowledgeable Salient Span Mask for Enhancing Language Models as Knowledge Base Cunxiang Wang Fuli Luo Yanyang Li Runxin Xu Fei Huang Yue Zhang KELM 31 2 0 17 Apr 2022
XLMRQA: Open-Domain Question Answering on Vietnamese Wikipedia-based Textual Knowledge Source Kiet Van Nguyen Phong Nguyen-Thuan Do N. D. Nguyen Tin Van Huynh A. Nguyen N. Nguyen 29 6 0 14 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 28 455 0 10 Apr 2022