Memory Efficient Continual Learning with Transformers

9 March 2022

Papers citing "Memory Efficient Continual Learning with Transformers"

33 / 33 papers shown

Title
CleaR: Towards Robust and Generalized Parameter-Efficient Fine-Tuning for Noisy Label Learning Yeachan Kim Junho Kim SangKeun Lee NoLa AAML 27 2 0 31 Oct 2024
Fine-grained Attention I/O Complexity: Comprehensive Analysis for Backward Passes Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao-quan Song Yufa Zhou 44 15 0 12 Oct 2024
Brain-inspired continual pre-trained learner via silent synaptic consolidation Xuming Ran Juntao Yao Yusong Wang Mingkun Xu Dianbo Liu AAML CLL 13 0 0 08 Oct 2024
Background Adaptation with Residual Modeling for Exemplar-Free Class-Incremental Semantic Segmentation Anqi Zhang Guangyu Gao CLL VLM 31 4 0 13 Jul 2024
PI-Whisper: An Adaptive and Incremental ASR Framework for Diverse and Evolving Speaker Characteristics Amir Nassereldine Dancheng Liu Chenhui Xu Jinjun Xiong 29 0 0 21 Jun 2024
Controlling Forgetting with Test-Time Data in Continual Learning Vaibhav Singh Rahaf Aljundi Eugene Belilovsky CLL VLM KELM 19 3 0 19 Jun 2024
Towards Lifelong Learning of Large Language Models: A Survey Junhao Zheng Shengjie Qiu Chengming Shi Qianli Ma KELM CLL 28 14 0 10 Jun 2024
Rehearsal-free Federated Domain-incremental Learning Rui Sun Haoran Duan Jiahua Dong Varun Ojha Tejal Shah R. Ranjan CLL 36 1 0 22 May 2024
Towards Modular LLMs by Building and Reusing a Library of LoRAs O. Ostapenko Zhan Su E. Ponti Laurent Charlin Nicolas Le Roux Matheus Pereira Lucas Page-Caccia Alessandro Sordoni MoMe 27 30 0 18 May 2024
Q-Tuning: Queue-based Prompt Tuning for Lifelong Few-shot Language Learning Yanhui Guo Shaoyuan Xu Jinmiao Fu Jia-Wei Liu Chaosheng Dong Bryan Wang VLM CLL 27 5 0 22 Apr 2024
Adaptive Memory Replay for Continual Learning James Seale Smith Lazar Valkov Shaunak Halbe V. Gutta Rogerio Feris Z. Kira Leonid Karlinsky 14 6 0 18 Apr 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 27 8 0 27 Mar 2024
Reconstruct before Query: Continual Missing Modality Learning with Decomposed Prompt Collaboration Shu Zhao Xiaohan Zou Tan Yu Huijuan Xu 25 1 0 17 Mar 2024
DAM: Dynamic Adapter Merging for Continual Video QA Learning Feng Cheng Ziyang Wang Yi-Lin Sung Yan-Bo Lin Mohit Bansal Gedas Bertasius CLL MoMe 23 10 0 13 Mar 2024
Premonition: Using Generative Models to Preempt Future Data Changes in Continual Learning Mark D Mcdonnell Dong Gong Ehsan Abbasnejad A. Hengel VLM DiffM 65 3 0 12 Mar 2024
Balancing the Causal Effects in Class-Incremental Learning Junhao Zheng Ruiyan Wang Chongzhi Zhang Hu Feng Qianli Ma CML CLL 26 0 0 15 Feb 2024
Dynamic Transformer Architecture for Continual Learning of Multimodal Tasks Yuliang Cai Mohammad Rostami 27 4 0 27 Jan 2024
Continual Learning with Low Rank Adaptation Martin Wistuba Prabhu Teja Sivaprasad Lukas Balles Giovanni Zappella CLL 23 10 0 29 Nov 2023
Class Incremental Learning with Pre-trained Vision-Language Models Xialei Liu Xusheng Cao Haori Lu Jia-Wen Xiao Andrew D. Bagdanov Ming-Ming Cheng VLM 17 6 0 31 Oct 2023
Visually Grounded Continual Language Learning with Selective Specialization Kyra Ahrens Lennart Bengtson Jae Hee Lee Stefan Wermter 8 0 0 24 Oct 2023
Primal Dual Continual Learning: Balancing Stability and Plasticity through Adaptive Memory Allocation Juan Elenter Navid Naderializadeh Tara Javidi Alejandro Ribeiro CLL 10 1 0 29 Sep 2023
A Natural Gas Consumption Forecasting System for Continual Learning Scenarios based on Hoeffding Trees with Change Point Detection Mechanism Radek Svoboda Sebastian Basterrech Jedrzej Kozal Jan Platoš Michal Wo'zniak 11 3 0 07 Sep 2023
A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning Zhenyi Wang Enneng Yang Li Shen Heng-Chiao Huang KELM MU 29 45 0 16 Jul 2023
Towards Robust and Efficient Continual Language Learning Adam Fisch Amal Rannen-Triki Razvan Pascanu J. Bornschein Angeliki Lazaridou E. Gribovskaya MarcÁurelio Ranzato CLL 11 1 0 11 Jul 2023
RanPAC: Random Projections and Pre-trained Models for Continual Learning Mark D Mcdonnell Dong Gong Amin Parvaneh Ehsan Abbasnejad A. Hengel VLM CLL 27 95 0 05 Jul 2023
LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning Bo Liu Yifeng Zhu Chongkai Gao Yihao Feng Qian Liu Yuke Zhu Peter Stone CLL 27 103 0 05 Jun 2023
On the Usage of Continual Learning for Out-of-Distribution Generalization in Pre-trained Language Models of Code M. Weyssow Xin Zhou Kisub Kim David Lo H. Sahraoui CLL KELM 14 6 0 06 May 2023
I2I: Initializing Adapters with Improvised Knowledge Tejas Srinivasan Furong Jia Mohammad Rostami Jesse Thomason CLL 18 6 0 04 Apr 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 19 585 0 31 Jan 2023
Continual Learning with Transformers for Image Classification B. Ermiş Giovanni Zappella Martin Wistuba Aditya Rawal Cédric Archambeau CLL 41 21 0 28 Jun 2022
Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks Zixuan Ke Hu Xu Bing-Quan Liu CLL 216 81 0 06 Dec 2021
Transferability and Hardness of Supervised Classification Tasks Anh Tran Cuong V Nguyen Tal Hassner 134 163 0 21 Aug 2019
Selfless Sequential Learning Rahaf Aljundi Marcus Rohrbach Tinne Tuytelaars CLL 21 113 0 14 Jun 2018