MCUNet: Tiny Deep Learning on IoT Devices

20 July 2020

Chuang Gan

Song Han

ArXiv PDF HTML

Papers citing "MCUNet: Tiny Deep Learning on IoT Devices"

50 / 171 papers shown

Title
On-device Training: A First Overview on Existing Systems Shuai Zhu Thiemo Voigt Jeonggil Ko Fatemeh Rahimian 29 14 0 01 Dec 2022
Pex: Memory-efficient Microcontroller Deep Learning through Partial Execution Edgar Liberis Nicholas D. Lane 13 3 0 30 Nov 2022
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models Guangxuan Xiao Ji Lin Mickael Seznec Hao Wu Julien Demouth Song Han MQ 61 731 0 18 Nov 2022
Multi-Objective Evolutionary for Object Detection Mobile Architectures Search Haichao Zhang Jiashi Li Xin Xia K. Hao Xuefeng Xiao 39 2 0 05 Nov 2022
Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models Muyang Li Ji Lin Chenlin Meng Stefano Ermon Song Han Jun-Yan Zhu DiffM 32 45 0 03 Nov 2022
Edge Impulse: An MLOps Platform for Tiny Machine Learning Shawn Hymel Colby R. Banbury Daniel Situnayake A. Elium Carl Ward ... Louis Moreau Dmitry Maslov A. Beavis Jan Jongboom Vijay Janapa Reddi VLM LRM 40 95 0 02 Nov 2022
MinUn: Accurate ML Inference on Microcontrollers Shikhar Jaiswal R. Goli Aayan Kumar Vivek Seshadri Rahul Sharma 21 2 0 29 Oct 2022
Demand Layering for Real-Time DNN Inference with Minimized Memory Usage Min-Zhi Ji Saehanseul Yi Chang-Mo Koo Sol Ahn Dongjoo Seo N. Dutt Jong-Chan Kim 40 16 0 08 Oct 2022
Improving the Performance of DNN-based Software Services using Automated Layer Caching M. Abedi Yanni Iouannou Pooyan Jamshidi Hadi Hemmati 20 0 0 18 Sep 2022
Self-Attentive Pooling for Efficient Deep Learning Fang Chen Gourav Datta Souvik Kundu P. Beerel 74 6 0 16 Sep 2022
On-Device Domain Generalization Kaiyang Zhou Yuanhan Zhang Yuhang Zang Jingkang Yang Chen Change Loy Ziwei Liu OOD 20 6 0 15 Sep 2022
Hardware Accelerator and Neural Network Co-Optimization for Ultra-Low-Power Audio Processing Devices Christoph Gerum Adrian Frischknecht T. Hald Paul Palomero Bernardo Konstantin Lubeck Oliver Bringmann 32 10 0 08 Sep 2022
Incremental Online Learning Algorithms Comparison for Gesture and Visual Smart Sensors Alessandro Avi Andrea Albanese Davide Brunelli 11 9 0 01 Sep 2022
DeepPicarMicro: Applying TinyML to Autonomous Cyber Physical Systems Michael Bechtel QiTao Weng H. Yun BDL 21 7 0 23 Aug 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 40 3 0 22 Aug 2022
Restructurable Activation Networks Kartikeya Bhardwaj James Ward Caleb Tung Dibakar Gope Lingchuan Meng Igor Fedorov A. Chalfin P. Whatmough Danny Loh 25 5 0 17 Aug 2022
DASS: Differentiable Architecture Search for Sparse neural networks H. Mousavi Mohammad Loni Mina Alibeigi Masoud Daneshtalab 31 9 0 14 Jul 2022
Sparsifying Binary Networks Riccardo Schiavone Maria A. Zuluaga MQ 11 0 0 11 Jul 2022
An Ultra-low Power TinyML System for Real-time Visual Processing at Edge Kunran Xu Huawei Zhang Yishi Li Yuhao Zhang Rui Lai Yi Liu 14 22 0 11 Jul 2022
Device-Cloud Collaborative Recommendation via Meta Controller Jiangchao Yao Feng Wang Xichen Ding Shaohu Chen Bo Han Jingren Zhou Hongxia Yang 26 17 0 07 Jul 2022
YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors Chien-Yao Wang Alexey Bochkovskiy H. Liao ObjD 27 6,222 0 06 Jul 2022
On-Device Training Under 256KB Memory Ji Lin Ligeng Zhu Wei-Ming Chen Wei-Chen Wang Chuang Gan Song Han MQ 25 194 0 30 Jun 2022
Edge Security: Challenges and Issues Xin Jin Charalampos Katsis Fan Sang Jiahao Sun A. Kundu Ramana Rao Kompella 39 8 0 14 Jun 2022
Compilation and Optimizations for Efficient Machine Learning on Embedded Systems Xiaofan Zhang Yao Chen Cong Hao Sitao Huang Yuhong Li Deming Chen 25 1 0 06 Jun 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks Y. Fu Haichuan Yang Jiayi Yuan Meng Li Cheng Wan Raghuraman Krishnamoorthi Vikas Chandra Yingyan Lin 28 18 0 02 Jun 2022
Machine Learning for Microcontroller-Class Hardware: A Review Swapnil Sayan Saha S. Sandha Mani B. Srivastava 19 117 0 29 May 2022
Toward smart composites: small-scale, untethered prediction and control for soft sensor/actuator systems Sarah Aguasvivas Manzano V. Sundaram Artemis Xu K. Ly M. Rentschler R. Shepherd N. Correll 19 5 0 22 May 2022
Energy-efficient Deployment of Deep Learning Applications on Cortex-M based Microcontrollers using Deep Compression M. Deutel Philipp Woller Christopher Mutschler Jürgen Teich 45 4 0 20 May 2022
Perspectives on Incorporating Expert Feedback into Model Updates Valerie Chen Umang Bhatt Hoda Heidari Adrian Weller Ameet Talwalkar 30 11 0 13 May 2022
Reducing Neural Architecture Search Spaces with Training-Free Statistics and Computational Graph Clustering T. Ingolfsson Mark Vero Xiaying Wang Lorenzo Lamberti Luca Benini Matteo Spallanzani GNN 11 3 0 29 Apr 2022
Enable Deep Learning on Mobile Devices: Methods, Systems, and Applications Han Cai Ji Lin Yujun Lin Zhijian Liu Haotian Tang Hanrui Wang Ligeng Zhu Song Han 19 107 0 25 Apr 2022
Pruning In Time (PIT): A Lightweight Network Architecture Optimizer for Temporal Convolutional Networks Matteo Risso Alessio Burrello Daniele Jahier Pagliari Francesco Conti Lorenzo Lamberti Enrico Macii Luca Benini M. Poncino 21 10 0 28 Mar 2022
Q-PPG: Energy-Efficient PPG-based Heart Rate Monitoring on Wearable Devices Alessio Burrello Daniele Jahier Pagliari Matteo Risso Simone Benatti Enrico Macii Luca Benini M. Poncino 16 41 0 24 Mar 2022
FlexBlock: A Flexible DNN Training Accelerator with Multi-Mode Block Floating Point Support Seock-Hwan Noh Jahyun Koo Seunghyun Lee Jongse Park Jaeha Kung AI4CE 21 17 0 13 Mar 2022
An Empirical Study of Low Precision Quantization for TinyML Shaojie Zhuo Hongyu Chen R. Ramakrishnan Tommy Chen Chen Feng Yi-Rung Lin Parker Zhang Liang Shen MQ 27 13 0 10 Mar 2022
A Brain-Inspired Low-Dimensional Computing Classifier for Inference on Tiny Devices Shijin Duan Xiaolin Xu Shaolei Ren 26 12 0 09 Mar 2022
YONO: Modeling Multiple Heterogeneous Neural Networks on Microcontrollers Young D. Kwon Jagmohan Chauhan Cecilia Mascolo 16 13 0 08 Mar 2022
Dynamic ConvNets on Tiny Devices via Nested Sparsity Matteo Grimaldi Luca Mocerino A. Cipolletta A. Calimera 8 6 0 07 Mar 2022
Improving the Energy Efficiency and Robustness of tinyML Computer Vision using Log-Gradient Input Images Qianyun Lu B. Murmann 11 6 0 04 Mar 2022
Embedding Temporal Convolutional Networks for Energy-Efficient PPG-Based Heart Rate Monitoring Alessio Burrello Daniele Jahier Pagliari Pierangelo Maria Rapa Matilde Semilia Matteo Risso T. Polonelli M. Poncino Luca Benini Simone Benatti 16 23 0 01 Mar 2022
Towards Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search Chunhui Zhang Xiaoming Yuan Qianyun Zhang Guangxu Zhu Lei Cheng Ning Zhang FedML OOD 13 15 0 23 Feb 2022
TinyM $^2$ Net: A Flexible System Algorithm Co-designed Multimodal Learning Framework for Tiny Devices Hasib-Al Rashid Pretom Roy Ovi Carl E. Busart A. Gangopadhyay T. Mohsenin 22 11 0 09 Feb 2022
Egeria: Efficient DNN Training with Knowledge-Guided Layer Freezing Yiding Wang D. Sun Kai Chen Fan Lai Mosharaf Chowdhury 25 44 0 17 Jan 2022
UDC: Unified DNAS for Compressible TinyML Models Igor Fedorov Ramon Matas Hokchhay Tann Chu Zhou Matthew Mattina P. Whatmough AI4CE 21 13 0 15 Jan 2022
MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection Zhenhong Sun Ming Lin Xiuyu Sun Zhiyu Tan Hao Li Rong Jin 15 32 0 26 Nov 2021
AnalogNets: ML-HW Co-Design of Noise-robust TinyML Models and Always-On Analog Compute-in-Memory Accelerator Chuteng Zhou F. García-Redondo Julian Büchel I. Boybat Xavier Timoneda Comas S. Nandakumar Shidhartha Das A. Sebastian M. Le Gallo P. Whatmough 25 16 0 10 Nov 2021
MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning Ji Lin Wei-Ming Chen Han Cai Chuang Gan Song Han 26 152 0 28 Oct 2021
Demystifying and Generalizing BinaryConnect Abhishek Sharma Yaoliang Yu Eyyub Sari Mahdi Zolnouri V. Nia MQ 17 8 0 25 Oct 2021
Network Augmentation for Tiny Deep Learning Han Cai Chuang Gan Ji Lin Song Han 17 29 0 17 Oct 2021
Differentiable Network Pruning for Microcontrollers Edgar Liberis Nicholas D. Lane 10 18 0 15 Oct 2021