Transformer-Patcher: One Mistake worth One Neuron

24 January 2023

Jie Zhou

Papers citing "Transformer-Patcher: One Mistake worth One Neuron"

50 / 126 papers shown

Title
In-Context Editing: Learning Knowledge from Self-Induced Distributions Siyuan Qi Bangcheng Yang Kailin Jiang Xiaobo Wang Jiaqi Li Yifan Zhong Yaodong Yang Zilong Zheng KELM 101 8 0 17 Jun 2024
RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning Haoyu Wang Tianci Liu Ruirui Li Monica Cheng Tuo Zhao Jing Gao 29 7 0 16 Jun 2024
Towards Lifelong Learning of Large Language Models: A Survey Junhao Zheng Shengjie Qiu Chengming Shi Qianli Ma KELM CLL 28 14 0 10 Jun 2024
Time Sensitive Knowledge Editing through Efficient Finetuning Xiou Ge Ali Mousavi Edouard Grave Armand Joulin Kun Qian Benjamin Han Mostafa Arefiyan Yunyao Li KELM 36 7 0 06 Jun 2024
Outdated Issue Aware Decoding for Reasoning Questions on Edited Knowledge Zengkui Sun Yijin Liu Jiaan Wang Fandong Meng Jinan Xu Yufeng Chen Jie Zhou KELM 35 0 0 05 Jun 2024
Decoupled Alignment for Robust Plug-and-Play Adaptation Haozheng Luo Jiahao Yu Wenxin Zhang Jialong Li Jerry Yao-Chieh Hu Xingyu Xing Han Liu 43 10 0 03 Jun 2024
Editing the Mind of Giants: An In-Depth Exploration of Pitfalls of Knowledge Editing in Large Language Models Cheng-Hsun Hsueh Paul Kuo-Ming Huang Tzu-Han Lin Che-Wei Liao Hung-Chieh Fang Chao-Wei Huang Yun-Nung Chen KELM 36 5 0 03 Jun 2024
DAFNet: Dynamic Auxiliary Fusion for Sequential Model Editing in Large Language Models Taolin Zhang Qizhou Chen Dongyang Li Chengyu Wang Xiaofeng He Longtao Huang Hui Xue Junyuan Huang CLL KELM 40 3 0 31 May 2024
MEMoE: Enhancing Model Editing with Mixture of Experts Adaptors Renzhi Wang Piji Li KELM 32 3 0 29 May 2024
Semantic are Beacons: A Semantic Perspective for Unveiling Parameter-Efficient Fine-Tuning in Knowledge Learning Renzhi Wang Piji Li 35 4 0 28 May 2024
Large Scale Knowledge Washing Yu-Xiang Wang Ruihan Wu Zexue He X. Chen Julian McAuley MU KELM 75 5 0 26 May 2024
Linearly Controlled Language Generation with Performative Guarantees Emily Cheng Marco Baroni Carmen Amo Alonso 40 3 0 24 May 2024
WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models Peng Wang Zexi Li Ningyu Zhang Ziwen Xu Yunzhi Yao Yong-jia Jiang Pengjun Xie Fei Huang Huajun Chen KELM CLL 45 20 0 23 May 2024
Large Language Model Bias Mitigation from the Perspective of Knowledge Editing Ruizhe Chen Yichen Li Zikai Xiao Zuo-Qiang Liu KELM 36 13 0 15 May 2024
Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learning Qizhou Chen Taolin Zhang Xiaofeng He Dongyang Li Chengyu Wang Longtao Huang Hui Xue CLL KELM 43 10 0 06 May 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 39 63 0 25 Apr 2024
TAXI: Evaluating Categorical Knowledge Editing for Language Models Derek Powell Walter Gerych Thomas Hartvigsen KELM 36 7 0 23 Apr 2024
From Matching to Generation: A Survey on Generative Information Retrieval Xiaoxi Li Jiajie Jin Yujia Zhou Yuyao Zhang Peitian Zhang Yutao Zhu Zhicheng Dou 3DV 67 46 0 23 Apr 2024
MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memory Ali Modarressi Abdullatif Köksal Ayyoob Imani Mohsen Fayyaz Hinrich Schütze KELM 104 9 0 17 Apr 2024
Towards Practical Tool Usage for Continually Learning LLMs Jerry Huang Prasanna Parthasarathi Mehdi Rezagholizadeh Sarath Chandar CLL KELM 56 4 0 14 Apr 2024
Scalable Model Editing via Customized Expert Networks Zihan Yao Yu He Tianyu Qi Ming Li KELM 35 4 0 03 Apr 2024
UniArk: Improving Generalisation and Consistency for Factual Knowledge Extraction through Debiasing Yijun Yang Jie He Pinzhen Chen Víctor Gutiérrez-Basulto Jeff Z. Pan KELM HILM 16 0 0 01 Apr 2024
Robust and Scalable Model Editing for Large Language Models Yingfa Chen Zhengyan Zhang Xu Han Chaojun Xiao Zhiyuan Liu Chen Chen Kuai Li Tao Yang Maosong Sun KELM 28 2 0 26 Mar 2024
Detoxifying Large Language Models via Knowledge Editing Meng Wang Ningyu Zhang Ziwen Xu Zekun Xi Shumin Deng Yunzhi Yao Qishen Zhang Linyi Yang Jindong Wang Huajun Chen KELM 38 54 0 21 Mar 2024
BadEdit: Backdooring large language models by model editing Yanzhou Li Tianlin Li Kangjie Chen Jian Zhang Shangqing Liu Wenhan Wang Tianwei Zhang Yang Liu SyDa AAML KELM 56 50 0 20 Mar 2024
Larimar: Large Language Models with Episodic Memory Control Payel Das Subhajit Chaudhury Elliot Nelson Igor Melnyk Sarath Swaminathan ... Vijil Chenthamarakshan Jiří Jirí Navrátil Soham Dan Pin-Yu Chen CLL KELM 35 18 0 18 Mar 2024
Ethos: Rectifying Language Models in Orthogonal Parameter Space Lei Gao Yue Niu Tingting Tang A. Avestimehr Murali Annavaram MU 32 10 0 13 Mar 2024
VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark Han Huang Haitian Zhong Tao Yu Qiang Liu Shu Wu Liang Wang Tien-Ping Tan VLM KELM 33 8 0 12 Mar 2024
Editing Conceptual Knowledge for Large Language Models Xiaohan Wang Shengyu Mao Ningyu Zhang Shumin Deng Yunzhi Yao Yue Shen Lei Liang Jinjie Gu Huajun Chen KELM 32 13 0 10 Mar 2024
"Flex Tape Can't Fix That": Bias and Misinformation in Edited Language Models Karina Halevy Anna Sotnikova Badr AlKhamissi Syrielle Montariol Antoine Bosselut KELM 34 3 0 29 Feb 2024
Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models Derong Xu Ziheng Zhang Zhihong Zhu Zhenxi Lin Qidong Liu ... Wanyu Wang Yuyang Ye Xiangyu Zhao Yefeng Zheng Enhong Chen KELM 27 9 0 28 Feb 2024
InstructEdit: Instruction-based Knowledge Editing for Large Language Models Ningyu Zhang Bo Tian Siyuan Cheng Xiaozhuan Liang Yi Hu Kouying Xue Yanjie Gou Xi Chen Huajun Chen KELM 40 4 0 25 Feb 2024
Stable Knowledge Editing in Large Language Models Zihao Wei Liang Pang Hanxing Ding Jingcheng Deng Huawei Shen Xueqi Cheng KELM 77 9 0 20 Feb 2024
Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers Zihan Qiu Zeyu Huang Youcheng Huang Jie Fu KELM 30 5 0 19 Feb 2024
Investigating Multi-Hop Factual Shortcuts in Knowledge Editing of Large Language Models Tianjie Ju Yijin Chen Xinwei Yuan Zhuosheng Zhang Wei Du Yubin Zheng Gongshen Liu KELM 20 6 0 19 Feb 2024
InfuserKI: Enhancing Large Language Models with Knowledge Graphs via Infuser-Guided Knowledge Integration Fali Wang Runxue Bao Suhang Wang Wenchao Yu Yanchi Liu Wei Cheng Haifeng Chen KELM 13 8 0 18 Feb 2024
EVEDIT: Event-based Knowledge Editing with Deductive Editing Boundaries Jiateng Liu Pengfei Yu Yuji Zhang Sha Li Zixuan Zhang Heng Ji KELM 24 16 0 17 Feb 2024
Navigating the Dual Facets: A Comprehensive Evaluation of Sequential Memory Editing in Large Language Models Zihao Lin Mohammad Beigi Hongxuan Li Yufan Zhou Yuxiang Zhang Qifan Wang Wenpeng Yin Lifu Huang KELM 16 8 0 16 Feb 2024
Retrieval-Augmented Generation: Is Dense Passage Retrieval Retrieving? Benjamin Z. Reichman Larry Heck 16 7 0 16 Feb 2024
Long-form evaluation of model editing Domenic Rosati Robie Gonzales Jinkun Chen Xuemin Yu Melis Erkan Yahya Kayani Satya Deepika Chavatapalli Frank Rudzicz Hassan Sajjad KELM 14 10 0 14 Feb 2024
Knowledge Editing on Black-box Large Language Models Xiaoshuai Song Zhengyang Wang Keqing He Guanting Dong Yutao Mou Jinxu Zhao Weiran Xu KELM 31 2 0 13 Feb 2024
What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement Xisen Jin Xiang Ren KELM CLL 18 6 0 02 Feb 2024
SWEA: Updating Factual Knowledge in Large Language Models via Subject Word Embedding Altering Xiaopeng Li Shasha Li Shezheng Song Huijun Liu Bing Ji ... Jun Ma Jie Yu Xiaodong Liu Jing Wang Weimin Zhang KELM 37 4 0 31 Jan 2024
From Understanding to Utilization: A Survey on Explainability for Large Language Models Haoyan Luo Lucia Specia 48 20 0 23 Jan 2024
DeepEdit: Knowledge Editing as Decoding with Constraints Yiwei Wang Muhao Chen Nanyun Peng Kai-Wei Chang KELM 21 26 0 19 Jan 2024
Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue Jia-Chen Gu Haoyang Xu Jun-Yu Ma Pan Lu Zhen-Hua Ling Kai-Wei Chang Nanyun Peng KELM 28 34 0 09 Jan 2024
MPN: Leveraging Multilingual Patch Neuron for Cross-lingual Model Editing Nianwen Si Hao Zhang Weiqiang Zhang KELM 19 6 0 06 Jan 2024
A Comprehensive Study of Knowledge Editing for Large Language Models Ningyu Zhang Yunzhi Yao Bo Tian Peng Wang Shumin Deng ... Lei Liang Zhiqiang Zhang Xiao-Jun Zhu Jun Zhou Huajun Chen KELM 30 76 0 02 Jan 2024
MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRA Lang Yu Qin Chen Jie Zhou Liang He KELM 15 45 0 19 Dec 2023
Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers Chi-Pin Huang Kai-Po Chang Chung-Ting Tsai Yung-Hsuan Lai Fu-En Yang Yu-Chiang Frank Wang DiffM 11 46 0 29 Nov 2023