Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting

20 May 2018

Papers citing "Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting"

50 / 231 papers shown

Title
Beyond Unimodal Learning: The Importance of Integrating Multiple Modalities for Lifelong Learning F. Sarfraz Bahram Zonooz Elahe Arani CLL 164 4 0 04 May 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 321 145 0 25 Apr 2024
Continual Few-shot Event Detection via Hierarchical Augmentation Networks Chenlong Zhang Pengfei Cao Yubo Chen Kang Liu Qing Cui Mengshu Sun Jun Zhao 204 4 0 26 Mar 2024
On the Laplace Approximation as Model Selection Criterion for Gaussian Processes Andreas Besginow J. D. Hüwel Thomas Pawellek Christian Beecks Markus Lange-Hegermann 111 0 0 14 Mar 2024
Semantic Residual Prompts for Continual LearningEuropean Conference on Computer Vision (ECCV), 2024 Martin Menabue Emanuele Frascaroli Matteo Boschini E. Sangineto Lorenzo Bonicelli Angelo Porrello Simone Calderara CLL VLM 287 23 0 11 Mar 2024
Continual Learning and Catastrophic Forgetting Gido M. van de Ven Nicholas Soures Dhireesha Kudithipudi 222 88 0 08 Mar 2024
CorpusBrain++: A Continual Generative Pre-Training Framework for Knowledge-Intensive Language Tasks Jiafeng Guo Changjiang Zhou Ruqing Zhang Jiangui Chen Maarten de Rijke Yixing Fan Xueqi Cheng CLL 164 10 0 26 Feb 2024
Making Pre-trained Language Models Better Continual Few-Shot Relation Extractors Shengkun Ma Jiale Han Yi Liang Bo Cheng CLL VLM 180 13 0 24 Feb 2024
Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models Didi Zhu Zhongyi Sun Zexi Li Zhenyuan Zhang Ke Yan Shouhong Ding Kun Kuang Chao Wu CLL KELM MoMe 194 41 0 19 Feb 2024
Active Preference Learning for Large Language Models William Muldrew Peter Hayes Mingtian Zhang David Barber 155 42 0 12 Feb 2024
Elastic Feature Consolidation for Cold Start Exemplar-Free Incremental LearningInternational Conference on Learning Representations (ICLR), 2024 Simone Magistri Tomaso Trinci Albin Soutif--Cormerais Joost van de Weijer Andrew D. Bagdanov 271 33 0 06 Feb 2024
Continual Learning via Sequential Function-Space Variational Inference Tim G. J. Rudner Freddie Bickford-Smith Qixuan Feng Yee Whye Teh Y. Gal 154 49 0 28 Dec 2023
Learning and Forgetting Unsafe Examples in Large Language Models Jiachen Zhao Zhun Deng David Madras James Zou Mengye Ren MU KELM CLL 319 24 0 20 Dec 2023
Catastrophic Forgetting in Deep Learning: A Comprehensive TaxonomyJournal of the Brazilian Computer Society (JBCS), 2023 Everton L. Aleixo J. Colonna Marco Cristo Everlandio Fernandes CLL 195 45 0 16 Dec 2023
Continual Learning with Low Rank Adaptation Martin Wistuba Prabhu Teja Sivaprasad Lukas Balles Giovanni Zappella CLL 161 23 0 29 Nov 2023
When Meta-Learning Meets Online and Continual Learning: A Survey Jaehyeon Son Soochan Lee Gunhee Kim OOD CLL 277 21 0 09 Nov 2023
Lifelong Sequence Generation with Dynamic Module Expansion and Adaptation Chengwei Qin Junwon Lee Shafiq Joty CLL 362 16 0 15 Oct 2023
Towards guarantees for parameter isolation in continual learning Giulia Lanzillotta Sidak Pal Singh Benjamin Grewe Thomas Hofmann 194 0 0 02 Oct 2023
HyperMask: Adaptive Hypernetwork-based Masks for Continual LearningNeural Networks (Neural Netw.), 2023 Kamil Ksiazek Przemysław Spurek CLL 436 7 0 29 Sep 2023
Mitigating the Alignment Tax of RLHFConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Yong Lin Hangyu Lin Wei Xiong Shizhe Diao Zeming Zheng ... Han Zhao Nan Jiang Heng Ji Xingtai Lv Tong Zhang MoMe CLL 435 119 0 12 Sep 2023
Incorporating Neuro-Inspired Adaptability for Continual Learning in Artificial Intelligence Liyuan Wang Xingxing Zhang Qian Li Mingtian Zhang Hang Su Jun Zhu Yi Zhong 151 78 0 29 Aug 2023
Towards Accelerated Model Training via Bayesian Data SelectionNeural Information Processing Systems (NeurIPS), 2023 Zhijie Deng Peng Cui Jun Zhu 223 11 0 21 Aug 2023
A Sparse Quantized Hopfield Network for Online-Continual MemoryNature Communications (Nat. Commun.), 2023 Nick Alonso J. Krichmar 212 12 0 27 Jul 2023
Tangent Model Composition for Ensembling and Continual Fine-tuningIEEE International Conference on Computer Vision (ICCV), 2023 Tianlin Liu Stefano Soatto LRM MoMe CLL 189 23 0 16 Jul 2023
Learning Expressive Priors for Generalization and Uncertainty Estimation in Neural NetworksInternational Conference on Machine Learning (ICML), 2023 Dominik Schnaus Jongseok Lee Zorah Lähner Rudolph Triebel UQCV BDL 169 3 0 15 Jul 2023
Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximationsProbabilistic Engineering Mechanics (PEM), 2023 Wyatt Bridgman Reese E. Jones Mohammad Khalil 148 2 0 12 Jul 2023
An Efficient General-Purpose Modular Vision Model via Multi-Task Heterogeneous Training Z. Chen Mingyu Ding Songlin Yang Wei Zhan Masayoshi Tomizuka Erik Learned-Miller Chuang Gan MoE 103 8 0 29 Jun 2023
Learnability and Algorithm for Continual LearningInternational Conference on Machine Learning (ICML), 2023 Gyuhak Kim Changnan Xiao Tatsuya Konishi Yinan Han CLL 241 35 0 22 Jun 2023
One-Shot Machine Unlearning with Mnemonic CodeAsian Conference on Machine Learning (ACML), 2023 Tomoya Yamashita Masanori Yamada Takashi Shibata MU 98 2 0 09 Jun 2023
Overcoming the Stability Gap in Continual Learning Md Yousuf Harun Christopher Kanan AI4CE 404 14 0 02 Jun 2023
Low-rank extended Kalman filtering for online learning of neural networks from streaming data Peter Chang Gerardo Duran-Martín Alexander Y. Shestopaloff Matt Jones Kevin P. Murphy BDL 291 25 0 31 May 2023
Domain Incremental Lifelong Learning in an Open WorldAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yinpei Dai Hao Lang Yinhe Zheng Yu Bowen Fei Huang Yongbin Li CLL 163 5 0 11 May 2023
DualHSIC: HSIC-Bottleneck and Alignment for Continual LearningInternational Conference on Machine Learning (ICML), 2023 Zifeng Wang Zheng Zhan Yifan Gong Yucai Shao Stratis Ioannidis Yanzhi Wang Jennifer Dy CLL 216 19 0 30 Apr 2023
The Ideal Continual Learner: An Agent That Never ForgetsInternational Conference on Machine Learning (ICML), 2023 Liangzu Peng Paris V. Giampouras René Vidal CLL 451 34 0 29 Apr 2023
Remind of the Past: Incremental Learning with Analogical Prompts Zhiheng Ma Xiaopeng Hong Beinan Liu Yabin Wang Pinyue Guo Huiyun Li CLL 175 3 0 24 Mar 2023
SIESTA: Efficient Online Continual Learning with Sleep Md Yousuf Harun Jhair Gallardo Tyler L. Hayes Ronald Kemker Christopher Kanan CLL 307 26 0 19 Mar 2023
Fixed Design Analysis of Regularization-Based Continual Learning Haoran Li Jingfeng Wu Vladimir Braverman CLL 185 16 0 17 Mar 2023
Curvature-Sensitive Predictive Coding with Approximate Laplace Monte Carlo Umais Zahid Qinghai Guo Karl J. Friston Zafeirios Fountas 124 4 0 09 Mar 2023
A Survey on Uncertainty Quantification Methods for Deep Learning Wenchong He Zhe Jiang Tingsong Xiao Zelin Xu Yukun Li BDL UQCV AI4CE 545 51 0 26 Feb 2023
Example Forgetting: A Novel Approach to Explain and Interpret Deep Neural Networks in Seismic InterpretationIEEE Transactions on Geoscience and Remote Sensing (TGRS), 2023 Ryan Benkert Oluwaseun Joseph Aribido Ghassan AlRegib 124 9 0 24 Feb 2023
Gaussian Switch Sampling: A Second Order Approach to Active LearningIEEE Transactions on Artificial Intelligence (IEEE TAI), 2023 Ryan Benkert Mohit Prabhushankar Ghassan Al-Regib Armin Pacharmi E. Corona AAML 185 12 0 16 Feb 2023
Efficient Parametric Approximations of Neural Network Function Space DistanceInternational Conference on Machine Learning (ICML), 2023 Nikita Dhawan Sicong Huang Juhan Bae Roger C. Grosse 230 5 0 07 Feb 2023
A Comprehensive Survey of Continual Learning: Theory, Method and ApplicationIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 689 1,022 0 31 Jan 2023
Forgetful Active Learning with Switch Events: Efficient Sampling for Out-of-Distribution DataInternational Conference on Information Photonics (ICIP), 2022 Ryan Benkert Mohit Prabhushankar Ghassan AlRegib OODD OOD 129 10 0 12 Jan 2023
Explaining Deep Models through Forgettable Learning DynamicsInternational Conference on Information Photonics (ICIP), 2021 Ryan Benkert Oluwaseun Joseph Aribido Ghassan AlRegib FAtt 120 9 0 10 Jan 2023
Latent Spectral Regularization for Continual LearningPattern Recognition Letters (PR), 2023 Emanuele Frascaroli Riccardo Benaglia Matteo Boschini Luca Moschella Cosimo Fiorini Emanuele Rodolà Simone Calderara BDL CLL 195 5 0 09 Jan 2023
On Sequential Bayesian Inference for Continual LearningEntropy (Entropy), 2023 Samuel Kessler Adam D. Cobb Tim G. J. Rudner S. Zohren Stephen J. Roberts CLL BDL 245 10 0 04 Jan 2023
Self-Activating Neural Ensembles for Continual Reinforcement Learning Sam Powers Eliot Xing Abhinav Gupta KELM CLL 156 6 0 31 Dec 2022
Sparse Coding in a Dual Memory System for Lifelong LearningAAAI Conference on Artificial Intelligence (AAAI), 2022 F. Sarfraz Elahe Arani Bahram Zonooz CLL 129 29 0 28 Dec 2022
GMM-IL: Image Classification using Incrementally Learnt, Independent Probabilistic Models for Small Sample SizesIEEE Access (IEEE Access), 2022 P. Johnston Keiller Nogueira Kevin Swingler CLL 174 4 0 01 Dec 2022