Memory Bounds for Continual Learning

Memory Bounds for Continual Learning

22 April 2022

Christos H. Papadimitriou

Papers citing "Memory Bounds for Continual Learning"

18 / 18 papers shown

Title
Fine-grained Attention I/O Complexity: Comprehensive Analysis for Backward Passes Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao-quan Song Yufa Zhou 52 15 0 12 Oct 2024
Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning Mohammadamin Banayeeanzade Mahdi Soltanolkotabi Mohammad Rostami CLL LRM 53 1 0 29 Aug 2024
A Statistical Theory of Regularization-Based Continual Learning Xuyang Zhao Huiyuan Wang Weiran Huang Wei Lin 27 12 0 10 Jun 2024
Disentangling and Mitigating the Impact of Task Similarity for Continual Learning Naoki Hiratani CLL 35 2 0 30 May 2024
Last Iterate Convergence of Incremental Methods and Applications in Continual Learning Xu Cai Jelena Diakonikolas 23 5 0 11 Mar 2024
On Limitations of the Transformer Architecture Binghui Peng Srini Narayanan Christos H. Papadimitriou 11 32 0 13 Feb 2024
The I/O Complexity of Attention, or How Optimal is Flash Attention? Barna Saha Christopher Ye 19 5 0 12 Feb 2024
The sample complexity of multi-distribution learning Binghui Peng 22 8 0 07 Dec 2023
The complexity of non-stationary reinforcement learning Christos H. Papadimitriou Binghui Peng 19 2 0 13 Jul 2023
Memory-Query Tradeoffs for Randomized Convex Optimization X. Chen Binghui Peng 21 6 0 21 Jun 2023
The Ideal Continual Learner: An Agent That Never Forgets Liangzu Peng Paris V. Giampouras René Vidal CLL 106 26 0 29 Apr 2023
Fixed Design Analysis of Regularization-Based Continual Learning Haoran Li Jingfeng Wu Vladimir Braverman CLL 15 9 0 17 Mar 2023
Near Optimal Memory-Regret Tradeoff for Online Learning Binghui Peng A. Rubinstein CLL 13 10 0 03 Mar 2023
Theory on Forgetting and Generalization of Continual Learning Sen Lin Peizhong Ju Yitao Liang Ness B. Shroff CLL 23 40 0 12 Feb 2023
Online Prediction in Sub-linear Space Binghui Peng Fred Zhang 18 16 0 16 Jul 2022
The Complexity of Dynamic Least-Squares Regression Shunhua Jiang Binghui Peng Omri Weinstein 15 4 0 01 Jan 2022
When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning? Gavin Brown Mark Bun Vitaly Feldman Adam D. Smith Kunal Talwar 245 80 0 11 Dec 2020
Sample Complexity Bounds on Differentially Private Learning via Communication Complexity Vitaly Feldman David Xiao 164 71 0 25 Feb 2014