On-Device Training Under 256KB Memory

30 June 2022

Chuang Gan

Song Han

ArXiv PDF HTML

Papers citing "On-Device Training Under 256KB Memory"

33 / 33 papers shown

Title
Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning Le-Trung Nguyen Ael Quélennec Van-Tam Nguyen Enzo Tartaglione 43 0 0 08 May 2025
TActiLE: Tiny Active LEarning for wearable devices Massimo Pavan Claudio Galimberti Manuel Roveri 19 0 0 02 May 2025
EFFACT: A Highly Efficient Full-Stack FHE Acceleration Platform Yi Huang Xinsheng Gong Xiangyu Kong Dibei Chen Jianfeng Zhu ... Liangwei Li Mingyu Gao Shaojun Wei Aoyang Zhang Leibo Liu 14 0 0 22 Apr 2025
RANa: Retrieval-Augmented Navigation G. Monaci Rafael Sampaio de Rezende Romain Deffayet G. Csurka G. Bono Hervé Déjean S. Clinchant Christian Wolf 29 9 0 04 Apr 2025
Benchmarking Ultra-Low-Power $μ$ NPUs Josh Millar Yushan Huang Sarab Sethi Hamed Haddadi Anil Madhavapeddy BDL 56 0 0 28 Mar 2025
Dynamic Gradient Sparse Update for Edge Training I-Hsuan Li Tian-Sheuan Chang 66 1 0 23 Mar 2025
PRIOT: Pruning-Based Integer-Only Transfer Learning for Embedded Systems Honoka Anada Sefutsu Ryu Masayuki Usui Tatsuya Kaneko Shinya Takamaeda-Yamazaki 44 1 0 21 Mar 2025
Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam Tianjin Huang Haotian Hu Zhenyu (Allen) Zhang Gaojie Jin X. Li ... Tianlong Chen Lu Liu Qingsong Wen Zhangyang Wang Shiwei Liu MQ 35 0 0 24 Feb 2025
Privacy-Enhanced Training-as-a-Service for On-Device Intelligence: Concept, Architectural Scheme, and Open Problems Zhiyuan Wu Sheng Sun Yuwei Wang Min Liu Bo Gao Tianliu He Wen Wang 59 0 0 24 Feb 2025
COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Training Haocheng Xi Han Cai Ligeng Zhu Y. Lu Kurt Keutzer Jianfei Chen Song Han MQ 63 9 0 25 Oct 2024
Breaking the Memory Wall for Heterogeneous Federated Learning via Model Splitting Chunlin Tian Li Li Kahou Tam Yebo Wu Chengzhong Xu FedML 24 1 0 12 Oct 2024
Self-Learning for Personalized Keyword Spotting on Ultra-Low-Power Audio Sensors Manuele Rusci Francesco Paci Marco Fariselli Eric Flamand Tinne Tuytelaars 25 0 0 22 Aug 2024
Accelerate Intermittent Deep Inference Ziliang Zhang 13 0 0 01 Jul 2024
ReDistill: Residual Encoded Distillation for Peak Memory Reduction of CNNs Fang Chen Gourav Datta Mujahid Al Rafi Hyeran Jeon Meng Tang 91 1 0 06 Jun 2024
One-Shot Image Restoration Deborah Pereg SupR 29 1 0 26 Apr 2024
Lifelong Intelligence Beyond the Edge using Hyperdimensional Computing Xiaofan Yu Anthony Thomas Ivannia Gomez Moreno Louis Gutierrez Tajana Simunic 38 3 0 07 Mar 2024
Body-Area Capacitive or Electric Field Sensing for Human Activity Recognition and Human-Computer Interaction: A Comprehensive Survey Sizhen Bian Mengxi Liu Bo Zhou P. Lukowicz Michele Magno 24 12 0 11 Jan 2024
Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraint Ael Quélennec Enzo Tartaglione Pavlo Mozharovskyi Van-Tam Nguyen 26 2 0 08 Dec 2023
AI-native Interconnect Framework for Integration of Large Language Model Technologies in 6G Systems Sasu Tarkoma Roberto Morabito Jaakko Sauvola 23 19 0 10 Nov 2023
TinyFormer: Efficient Transformer Design and Deployment on Tiny Devices Jianlei Yang Jiacheng Liao Fanding Lei Meichen Liu Junyi Chen Lingkun Long Han Wan Bei Yu Weisheng Zhao MoE 33 2 0 03 Nov 2023
Federated learning compression designed for lightweight communications Lucas Grativol Ribeiro Mathieu Léonardon Guillaume Muller Virginie Fresse Matthieu Arzel FedML 25 3 0 23 Oct 2023
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition Samuel Horváth Stefanos Laskaridis Shashank Rajput Hongyi Wang BDL 26 4 0 28 Aug 2023
TinyAD: Memory-efficient anomaly detection for time series data in Industrial IoT Yuting Sun Tong Chen Quoc Viet Hung Nguyen Hongzhi Yin 21 12 0 07 Mar 2023
DSD $^2$ : Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free? Victor Quétu Enzo Tartaglione 24 7 0 02 Mar 2023
On-Device Unsupervised Image Segmentation Junhuan Yang Yi Sheng Yu-zhao Zhang Weiwen Jiang Lei Yang 22 12 0 24 Feb 2023
Efficient On-device Training via Gradient Filtering Yuedong Yang Guihong Li R. Marculescu 31 18 0 01 Jan 2023
Hopf Physical Reservoir Computer for Reconfigurable Sound Recognition M. R. E. U. Shougat Xiaofu Li Siyao Shao K. McGarvey E. Perkins 14 11 0 20 Dec 2022
On-device Training: A First Overview on Existing Systems Shuai Zhu Thiemo Voigt Jeonggil Ko Fatemeh Rahimian 29 14 0 01 Dec 2022
Enhancing Efficiency in Multidevice Federated Learning through Data Selection Fan Mo Mohammad Malekzadeh S. Chatterjee F. Kawsar Akhil Mathur FedML 30 2 0 08 Nov 2022
OLLA: Optimizing the Lifetime and Location of Arrays to Reduce the Memory Usage of Neural Networks Benoit Steiner Mostafa Elhoushi Jacob Kahn James Hegarty 29 8 0 24 Oct 2022
Benchmarking TinyML Systems: Challenges and Direction Colby R. Banbury Vijay Janapa Reddi Max Lam William Fu A. Fazel ... Jae-sun Seo Jeff Sieracki Urmish Thakker Marian Verhelst Poonam Yadav 98 228 0 10 Mar 2020
Ordering Chaos: Memory-Aware Scheduling of Irregularly Wired Neural Networks for Edge Devices Byung Hoon Ahn Jinwon Lee J. Lin Hsin-Pai Cheng Jilei Hou H. Esmaeilzadeh 62 54 0 04 Mar 2020
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,326 0 05 Nov 2016