MCUNet: Tiny Deep Learning on IoT Devices

20 July 2020

Chuang Gan

Song Han

ArXiv PDF HTML

Papers citing "MCUNet: Tiny Deep Learning on IoT Devices"

50 / 171 papers shown

Title
SoD $^2$ : Statically Optimizing Dynamic Deep Neural Network Wei Niu Gagan Agrawal Bin Ren 30 4 0 29 Feb 2024
T3DNet: Compressing Point Cloud Models for Lightweight 3D Recognition Zhiyuan Yang Yunjiao Zhou Lihua Xie Jianfei Yang 3DPC 30 1 0 29 Feb 2024
CiMNet: Towards Joint Optimization for DNN Architecture and Configuration for Compute-In-Memory Hardware Souvik Kundu Anthony Sarah Vinay Joshi O. J. Omer S. Subramoney 19 0 0 19 Feb 2024
UR2M: Uncertainty and Resource-Aware Event Detection on Microcontrollers Hong Jia Young D. Kwon Dong Ma Nhat Pham Lorena Qendro Tam N. Vu Cecilia Mascolo 17 2 0 14 Feb 2024
DTMM: Deploying TinyML Models on Extremely Weak IoT Devices with Pruning Lixiang Han Zhen Xiao Zhenjiang Li 35 5 0 17 Jan 2024
MicroNAS: Zero-Shot Neural Architecture Search for MCUs Ye Qiao Haocheng Xu Yifan Zhang Sitao Huang 17 3 0 17 Jan 2024
Q-Segment: Segmenting Images In-Sensor for Vessel-Based Medical Diagnosis Pietro Bonazzi Yawei Li Sizhen Bian Michele Magno 17 0 0 15 Dec 2023
Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraint Ael Quélennec Enzo Tartaglione Pavlo Mozharovskyi Van-Tam Nguyen 26 2 0 08 Dec 2023
Efficient Neural Networks for Tiny Machine Learning: A Comprehensive Review M. Lê Pierre Wolinski Julyan Arbel 32 8 0 20 Nov 2023
CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programs Hanpeng Hu Junwei Su Juntao Zhao Yanghua Peng Yibo Zhu Haibin Lin Chuan Wu 16 1 0 16 Nov 2023
TinyFormer: Efficient Transformer Design and Deployment on Tiny Devices Jianlei Yang Jiacheng Liao Fanding Lei Meichen Liu Junyi Chen Lingkun Long Han Wan Bei Yu Weisheng Zhao MoE 33 2 0 03 Nov 2023
Like an Open Book? Read Neural Network Architecture with Simple Power Analysis on 32-bit Microcontrollers Raphael Joud Pierre-Alain Moëllic S. Pontié J. Rigaud 11 4 0 02 Nov 2023
PockEngine: Sparse and Efficient Fine-tuning in a Pocket Ligeng Zhu Lanxiang Hu Ji Lin Wei-Chen Wang Wei-Ming Chen Chuang Gan Song Han 25 19 0 26 Oct 2023
MCUFormer: Deploying Vision Transformers on Microcontrollers with Limited Memory Yinan Liang Ziwei Wang Xiuwei Xu Yansong Tang Jie Zhou Jiwen Lu 21 9 0 25 Oct 2023
NetDistiller: Empowering Tiny Deep Learning via In-Situ Distillation Shunyao Zhang Y. Fu Shang Wu Jyotikrishna Dass Haoran You Yingyan Lin Lin UQCV FedML 21 0 0 24 Oct 2023
Fully Onboard Low-Power Localization with Semantic Sensor Fusion on a Nano-UAV using Floor Plans Nicky Zimmerman H. Müller Michele Magno Luca Benini 23 3 0 19 Oct 2023
Cost-Driven Hardware-Software Co-Optimization of Machine Learning Pipelines Ravit Sharma W. Romaszkan Feiqian Zhu Puneet Gupta Ankur Mehta 11 0 0 11 Oct 2023
Enabling Resource-efficient AIoT System with Cross-level Optimization: A survey Sicong Liu Bin Guo Cheng Fang Ziqi Wang Shiyan Luo Zimu Zhou Zhiwen Yu AI4CE 23 22 0 27 Sep 2023
A Machine Learning-oriented Survey on Tiny Machine Learning Luigi Capogrosso Federico Cunico D. Cheng Franco Fummi Marco Cristani SyDa MU 24 33 0 21 Sep 2023
Grassroots Operator Search for Model Edge Adaptation Hadjer Benmeziane K. E. Maghraoui Hamza Ouarnoughi Smail Niar 19 0 0 20 Sep 2023
Fault Injection on Embedded Neural Networks: Impact of a Single Instruction Skip Clément Gaine Pierre-Alain Moëllic O. Potin J. Dutertre AAML SILM 18 1 0 31 Aug 2023
Computation-efficient Deep Learning for Computer Vision: A Survey Yulin Wang Yizeng Han Chaofei Wang Shiji Song Qi Tian Gao Huang VLM 26 20 0 27 Aug 2023
TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge Young D. Kwon Rui Li Stylianos I. Venieris Jagmohan Chauhan Nicholas D. Lane Cecilia Mascolo 19 8 0 19 Jul 2023
Flexible and Fully Quantized Ultra-Lightweight TinyissimoYOLO for Ultra-Low-Power Edge Systems Julian Moosmann H. Mueller Nicky Zimmerman Georg Rutishauser Luca Benini Michele Magno 25 8 0 12 Jul 2023
Search-time Efficient Device Constraints-Aware Neural Architecture Search Oshin Dutta Tanu Kanvar Sumeet Agarwal 28 3 0 10 Jul 2023
SysNoise: Exploring and Benchmarking Training-Deployment System Inconsistency Yan Wang Yuhang Li Ruihao Gong Aishan Liu Yanfei Wang ... Yongqiang Yao Yunchen Zhang Tianzi Xiao F. Yu Xianglong Liu AAML 32 0 0 01 Jul 2023
NetBooster: Empowering Tiny Deep Learning By Standing on the Shoulders of Deep Giants Zhongzhi Yu Y. Fu Jiayi Yuan Haoran You Yingyan Lin 26 1 0 23 Jun 2023
Binary domain generalization for sparsifying binary neural networks Riccardo Schiavone Francesco Galati Maria A. Zuluaga MQ 19 0 0 23 Jun 2023
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration Ji Lin Jiaming Tang Haotian Tang Shang Yang Wei-Ming Chen Wei-Chen Wang Guangxuan Xiao Xingyu Dang Chuang Gan Song Han EDL MQ 36 463 0 01 Jun 2023
Combining Multi-Objective Bayesian Optimization with Reinforcement Learning for TinyML M. Deutel G. Kontes Christopher Mutschler Jürgen Teich 41 0 0 23 May 2023
TinyissimoYOLO: A Quantized, Low-Memory Footprint, TinyML Object Detection Network for Low Power Microcontrollers Julian Moosmann Marco Giordano Christian Vogt Michele Magno MQ ObjD 11 20 0 22 May 2023
AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing Hadjer Benmeziane C. Lammie I. Boybat M. Rasch M. Le Gallo ... Smail Niar Hamza Ouarnoughi V. Narayanan A. Sebastian K. E. Maghraoui 19 7 0 17 May 2023
DietCNN: Multiplication-free Inference for Quantized CNNs Swarnava Dey P. Dasgupta P. Chakrabarti MQ 50 1 0 09 May 2023
MEMA Runtime Framework: Minimizing External Memory Accesses for TinyML on Microcontrollers Andrew Sabot Vikas Natesh H. T. Kung W. Ting 19 3 0 12 Apr 2023
TinyReptile: TinyML with Federated Meta-Learning Haoyu Ren Darko Anicic Thomas Runkler 25 16 0 11 Apr 2023
Common Subexpression-based Compression and Multiplication of Sparse Constant Matrices Emre Bilgili A. Yurdakul 13 0 0 26 Mar 2023
Energy-efficient Task Adaptation for NLP Edge Inference Leveraging Heterogeneous Memory Architectures Zirui Fu Aleksandre Avaliani M. Donato 39 1 0 25 Mar 2023
EdgeTran: Co-designing Transformers for Efficient Inference on Mobile Edge Platforms Shikhar Tuli N. Jha 34 3 0 24 Mar 2023
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices Chen Tang Li Lyna Zhang Huiqiang Jiang Jiahang Xu Ting Cao Quanlu Zhang Yuqing Yang Zhi Wang Mao Yang 20 11 0 17 Mar 2023
HyT-NAS: Hybrid Transformers Neural Architecture Search for Edge Devices Lotfi Abdelkrim Mecharbat Hadjer Benmeziane Hamza Ouarnoughi Smail Niar ViT 27 4 0 08 Mar 2023
TinyAD: Memory-efficient anomaly detection for time series data in Industrial IoT Yuting Sun Tong Chen Quoc Viet Hung Nguyen Hongzhi Yin 21 12 0 07 Mar 2023
EcoTTA: Memory-Efficient Continual Test-time Adaptation via Self-distilled Regularization Jun S. Song Jungsoo Lee In So Kweon Sungha Choi TTA 31 83 0 03 Mar 2023
Full Stack Optimization of Transformer Inference: a Survey Sehoon Kim Coleman Hooper Thanakul Wattanawong Minwoo Kang Ruohan Yan ... Qijing Huang Kurt Keutzer Michael W. Mahoney Y. Shao A. Gholami MQ 28 100 0 27 Feb 2023
MetaLDC: Meta Learning of Low-Dimensional Computing Classifiers for Fast On-Device Adaption Yejia Liu Shijin Duan Xiaolin Xu Shaolei Ren 27 4 0 23 Feb 2023
A Survey on Efficient Training of Transformers Bohan Zhuang Jing Liu Zizheng Pan Haoyu He Yuetian Weng Chunhua Shen 20 47 0 02 Feb 2023
SHINE: Deep Learning-Based Accessible Parking Management System Dhiraj Neupane A. Bhattarai Sunil Aryal Mohamed Reda Bouadjenek Uk-Min Seok Jong-Hoon Seok 17 21 0 02 Feb 2023
Efficient On-device Training via Gradient Filtering Yuedong Yang Guihong Li R. Marculescu 31 18 0 01 Jan 2023
Person Detection Using an Ultra Low-resolution Thermal Imager on a Low-cost MCU Maarten Vandersteegen Wouter Reusen Kristof Van Beeck Toon Goedemé 15 2 0 16 Dec 2022
Colab NAS: Obtaining lightweight task-specific convolutional neural networks following Occam's razor Andrea Mattia Garavagno D. Leonardis A. Frisoli 25 1 0 15 Dec 2022
CODEBench: A Neural Architecture and Hardware Accelerator Co-Design Framework Shikhar Tuli Chia-Hao Li Ritvik Sharma N. Jha 28 13 0 07 Dec 2022