Optimizing the Deployment of Tiny Transformers on Low-Power MCUs

Optimizing the Deployment of Tiny Transformers on Low-Power MCUs

3 April 2024

Victor J. B. Jung

Alessio Burrello

Francesco Conti

Luca Benini

Papers citing "Optimizing the Deployment of Tiny Transformers on Low-Power MCUs"

6 / 6 papers shown

Title
Transformer-Based Fault-Tolerant Control for Fixed-Wing UAVs Using Knowledge Distillation and In-Context Adaptation Francisco Giral Ignacio Gómez Ricardo Vinuesa S. L. Clainche 32 2 0 05 Nov 2024
Future-Proofing Mobile Networks: A Digital Twin Approach to Multi-Signal Management Roberto Morabito Bivek Pandey Paulius Daubaris Yasith R Wanigarathna Sasu Tarkoma 43 0 0 22 Jul 2024
A Tiny Transformer for Low-Power Arrhythmia Classification on Microcontrollers Paola Busia M. A. Scrugli Victor J. B. Jung Luca Benini Paolo Meloni 30 7 0 16 Feb 2024
Hydra Attention: Efficient Attention with Many Heads Daniel Bolya Cheng-Yang Fu Xiaoliang Dai Peizhao Zhang Judy Hoffman 99 76 0 15 Sep 2022
Benchmarking TinyML Systems: Challenges and Direction Colby R. Banbury Vijay Janapa Reddi Max Lam William Fu A. Fazel ... Jae-sun Seo Jeff Sieracki Urmish Thakker Marian Verhelst Poonam Yadav 109 228 0 10 Mar 2020
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 950 20,567 0 17 Apr 2017