v1v2v3v4v5 (latest)

Compressing RNNs for IoT devices by 15-38x using Kronecker Products

7 June 2019

Papers citing "Compressing RNNs for IoT devices by 15-38x using Kronecker Products"

21 / 21 papers shown

Title
Efficient Zero-Order Federated Finetuning of Language Models for Resource-Constrained Devices Mohamed Aboelenien Ahmed Kilian Pfeiffer R. Khalili Heba Khdr J. Henkel FedML 441 0 0 14 Feb 2025
DiffuseKronA: A Parameter Efficient Fine-tuning Method for Personalized Diffusion Models Shyam Marjit Harshit Singh Nityanand Mathur Sayak Paul Chia-Mu Yu Pin-Yu Chen DiffM 265 12 0 27 Feb 2024
TQCompressor: improving tensor decomposition methods in neural networks via permutations V. Abronin A. Naumov D. Mazur D. Bystrov K. Tsarova Ar. Melnikov Ivan Oseledets S. Dolgov R. Brasher M. Perelshtein 185 9 0 29 Jan 2024
From array algebra to energy efficiency on GPUs: Data and hardware shapes with dimension-lifting to optimize memory-processor layouts L. Mullin 121 1 0 19 Jun 2023
Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast TrainingJournal of Systems Engineering and Electronics (JSEE), 2023 Xinwei Ou Zhangxin Chen Ce Zhu Yipeng Liu 184 9 0 22 Mar 2023
SeKron: A Decomposition Method Supporting Many Factorization Structures Marawan Gamal Abdel Hameed A. Mosleh Marzieh S. Tahaei V. Nia 158 1 0 12 Oct 2022
CoCoFL: Communication- and Computation-Aware Federated Learning via Partial NN Freezing and Quantization Kilian Pfeiffer Martin Rapp R. Khalili J. Henkel FedML 304 15 0 10 Mar 2022
DISTREAL: Distributed Resource-Aware Learning in Heterogeneous Systems Martin Rapp R. Khalili Kilian Pfeiffer J. Henkel 253 20 0 16 Dec 2021
Kronecker Decomposition for GPT Compression Ali Edalati Marzieh S. Tahaei Ahmad Rashid V. Nia J. Clark Mehdi Rezagholizadeh 199 40 0 15 Oct 2021
Convolutional Neural Network Compression through Generalized Kronecker Product Decomposition Marawan Gamal Abdel Hameed Marzieh S. Tahaei A. Mosleh V. Nia 151 30 0 29 Sep 2021
Compacting Deep Neural Networks for Internet of Things: Methods and ApplicationsIEEE Internet of Things Journal (IEEE IoT Journal), 2021 Ke Zhang Hanbo Ying Hongning Dai Lin Li Yuangyuang Peng Keyi Guo Hongfang Yu 258 45 0 20 Mar 2021
Doping: A technique for efficient compression of LSTM models using sparse structured additive matricesConference on Machine Learning and Systems (MLSys), 2021 Urmish Thakker P. Whatmough Zhi-Gang Liu Matthew Mattina Jesse G. Beu 105 7 0 14 Feb 2021
Paralinguistic Privacy Protection at the Edge Ranya Aloufi Hamed Haddadi David E. Boyle 220 15 0 04 Nov 2020
Rank and run-time aware compression of NLP Applications Urmish Thakker Jesse G. Beu Dibakar Gope Ganesh S. Dasika Matthew Mattina 106 11 0 06 Oct 2020
High Throughput Matrix-Matrix Multiplication between Asymmetric Bit-Width Operands Dibakar Gope Jesse G. Beu Matthew Mattina 165 6 0 03 Aug 2020
Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers Zhuohan Li Eric Wallace Sheng Shen Kevin Lin Kurt Keutzer Dan Klein Joseph E. Gonzalez 279 152 0 26 Feb 2020
Federated Learning for Resource-Constrained IoT Devices: Panoramas and State-of-the-art Ahmed Imteaj Urmish Thakker Maroun Touma Jian Li M. Amini 190 74 0 25 Feb 2020
Compressing Language Models using Doped Kronecker Products Urmish Thakker Paul Whatamough Zhi-Gang Liu Matthew Mattina Jesse G. Beu 199 10 0 24 Jan 2020
DARB: A Density-Aware Regular-Block Pruning for Deep Neural NetworksAAAI Conference on Artificial Intelligence (AAAI), 2019 Ao Ren Tao Zhang Yuhao Wang Sheng Lin Zhaoyang Han Yen-kuang Chen Yuan Xie Yanzhi Wang 282 11 0 19 Nov 2019
Ternary MobileNets via Per-Layer Hybrid Filter Banks Dibakar Gope Jesse G. Beu Urmish Thakker Matthew Mattina MQ 145 15 0 04 Nov 2019
Run-Time Efficient RNN Compression for Inference on Edge Devices Urmish Thakker Jesse G. Beu Dibakar Gope Ganesh S. Dasika Matthew Mattina 236 20 0 12 Jun 2019