Stable Low-rank Tensor Decomposition for Compression of Convolutional Neural Network

European Conference on Computer Vision (ECCV), 2020

12 August 2020

Papers citing "Stable Low-rank Tensor Decomposition for Compression of Convolutional Neural Network"

50 / 89 papers shown

Title
D-com: Accelerating Iterative Processing to Enable Low-rank Decomposition of Activations Faraz Tahmasebi Michael Pelluer Hyoukjun Kwon 56 0 0 15 Oct 2025
BALF: Budgeted Activation-Aware Low-Rank Factorization for Fine-Tuning-Free Model Compression David González Martínez 108 0 0 29 Sep 2025
Efficient CNN Compression via Multi-method Low Rank Factorization and Feature Map Similarity M. Kokhazadeh G. Keramidas V. Kelefouras 3DV 63 0 0 29 Sep 2025
QR-LoRA: QR-Based Low-Rank Adaptation for Efficient Fine-Tuning of Large Language Models Jessica Liang Anirudh Bharadwaj 56 1 0 29 Aug 2025
Low-Rank Tensor Decompositions for the Theory of Neural Networks Ricardo Augusto Borsoi K. Usevich Marianne Clausel 67 1 0 25 Aug 2025
Quantized Neural Networks for Microcontrollers: A Comprehensive Review of Methods, Platforms, and Applications Hamza A. Abushahla Dara Varam Ariel J. N. Panopio Mohamed I. AlHajri MQ 271 0 0 20 Aug 2025
Unpacking the Implicit Norm Dynamics of Sharpness-Aware Minimization in Tensorized Models Tianxiao Cao Kyohei Atarashi H. Kashima 170 0 0 14 Aug 2025
Dynamic Rank Adjustment for Accurate and Efficient Neural Network Training Hyuntak Shin Aecheon Jung Sungeun Hong Sunwoo Lee 84 0 0 12 Aug 2025
FGFP: A Fractional Gaussian Filter and Pruning for Deep Neural Networks Compression Kuan-Ting Tu Po-Hsien Yu Yu-Syuan Tseng Shao-Yi Chien 38 0 0 30 Jul 2025
Identifiability of Deep Polynomial Neural Networks K. Usevich Clara Dérand Ricardo Augusto Borsoi Marianne Clausel 167 3 0 20 Jun 2025
Multi-Scale Tensorial Summation and Dimensional Reduction Guided Neural Network for Edge Detection Lei Xu Mehmet Yamaç Mete Ahishali Moncef Gabbouj 168 0 0 22 Apr 2025
Multi-level Cellular Automata for FLIM networks Felipe C. R. Salvagnini Jancarlo F. Gomes C. A. N. Santos S. Guimarães Alexandre X. Falcão 136 0 0 15 Apr 2025
Layer-wise Update Aggregation with Recycling for Communication-Efficient Federated Learning Jisoo Kim Sungmin Kang Sunwoo Lee FedML 155 0 0 14 Mar 2025
Long Sequence Modeling with Attention Tensorization: From Sequence to Tensor LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Aosong Feng Rex Ying Leandros Tassiulas 190 2 0 28 Oct 2024
PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers in a resource-limited Context Maximilian Augustin Syed Shakib Sarwar Mostafa Elhoushi Sai Qian Zhang Yuecheng Li B. D. Salvo 181 1 0 23 Oct 2024
Improved Off-policy Reinforcement Learning in Biological Sequence Design Haksub Kim Minsu Kim Taeyoung Yun Sanghyeok Choi Emmanuel Bengio Alex Hernández-García Jinkyoo Park OffRL 184 1 0 06 Oct 2024
Revisiting Trace Norm Minimization for Tensor Tucker Completion: A Direct Multilinear Rank Learning ApproachPattern Recognition (Pattern Recogn.), 2024 Xueke Tong Hancheng Zhu Lei Cheng Yik-Chung Wu 159 5 0 08 Sep 2024
Reduced storage direct tensor ring decomposition for convolutional neural networks compressionNeural Networks (NN), 2024 Mateusz Gabor R. Zdunek 309 0 0 17 May 2024
Surgical Feature-Space Decomposition of LLMs: Why, When and How?Annual Meeting of the Association for Computational Linguistics (ACL), 2024 Arnav Chavan Nahush Lele Deepak Gupta 195 3 0 17 May 2024
Characterizing the Accuracy - Efficiency Trade-off of Low-rank Decomposition in Language Models Chakshu Moar Michael Pellauer Hyoukjun Kwon 110 4 0 10 May 2024
AB-Training: A Communication-Efficient Approach for Distributed Low-Rank Learning D. Coquelin Katherina Flügel Marie Weiel Nicholas Kiefer Muhammed Öz Charlotte Debus Achim Streit Markus Goetz 288 0 0 02 May 2024
BiPer: Binary Neural Networks using a Periodic Function Edwin Vargas Claudia V. Correa Carlos Hinojosa Henry Arguello MQ 317 10 0 01 Apr 2024
Tensor network compressibility of convolutional models Sukhbinder Singh S. Jahromi Roman Orus 120 4 0 21 Mar 2024
ELRT: Efficient Low-Rank Training for Compact Convolutional Neural Networks Yang Sui Miao Yin Yu Gong Jinqi Xiao Huy Phan Bo Yuan 215 9 0 18 Jan 2024
Harnessing Orthogonality to Train Low-Rank Neural NetworksEuropean Conference on Artificial Intelligence (ECAI), 2024 D. Coquelin Katharina Flügel Marie Weiel Nicholas Kiefer Charlotte Debus Achim Streit Markus Goetz 273 4 0 16 Jan 2024
Convolutional Neural Network Compression via Dynamic Parameter Rank PruningIEEE Access (IEEE Access), 2024 Manish Sharma Jamison Heard Eli Saber Panos P. Markopoulos 200 3 0 15 Jan 2024
conv_einsum: A Framework for Representation and Fast Evaluation of Multilinear Operations in Convolutional Tensorial Neural Networks Tahseen Rabbani Jiahao Su Xiaoyu Liu David Chan Geoffrey Sangston Furong Huang 167 1 0 07 Jan 2024
Heroes: Lightweight Federated Learning with Neural Composition and Adaptive Local Update in Heterogeneous Edge NetworksIEEE Conference on Computer Communications (INFOCOM), 2023 Jiaming Yan Jianchun Liu Shilong Wang Hong-Ze Xu Haifeng Liu Jianhua Zhou FedML 165 8 0 04 Dec 2023
Towards Higher Ranks via Adversarial Weight PruningNeural Information Processing Systems (NeurIPS), 2023 Yuchuan Tian Hanting Chen Tianyu Guo Chao Xu Yunhe Wang 191 4 0 29 Nov 2023
Hessian Aware Low-Rank Perturbation for Order-Robust Continual LearningIEEE Transactions on Knowledge and Data Engineering (TKDE), 2023 Jiaqi Li Yuanhao Lai Rui Wang Changjian Shui Sabyasachi Sahoo Charles Ling Shichun Yang Boyu Wang Christian Gagné Fan Zhou CLL 298 2 0 26 Nov 2023
Lite it fly: An All-Deformable-Butterfly NetworkIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2023 Rui Lin Jason Chun Lok Li Jiajun Zhou Binxiao Huang Jie Ran Ngai Wong 149 1 0 14 Nov 2023
Video Frame Interpolation with Many-to-many Splatting and Spatial Selective RefinementIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Ping Hu Simon Niklaus Lu Zhang Stan Sclaroff Kate Saenko 139 8 0 29 Oct 2023
Matrix Compression via Randomized Low Rank and Low Precision FactorizationNeural Information Processing Systems (NeurIPS), 2023 R. Saha Varun Srivastava Mert Pilanci 197 30 0 17 Oct 2023
Tensor Ring Optimized Quantum-Enhanced Tensor Neural Networks Debanjan Konar Dheeraj Peddireddy Vaneet Aggarwal B. K. Panigrahi 187 1 0 02 Oct 2023
LAPP: Layer Adaptive Progressive Pruning for Compressing CNNs from Scratch P. Zhai K. Guo Fan Liu Xiaofen Xing Xiangmin Xu 236 3 0 25 Sep 2023
A Differentiable Framework for End-to-End Learning of Hybrid Structured Compression Moonjung Eo Suhyun Kang Wonjong Rhee 167 2 0 21 Sep 2023
Quantization Aware Factorization for Deep Neural Network CompressionJournal of Artificial Intelligence Research (JAIR), 2023 Daria Cherniuk Stanislav Abukhovich Anh-Huy Phan Ivan Oseledets A. Cichocki Julia Gusak MQ 144 5 0 08 Aug 2023
Forward and Inverse Approximation Theory for Linear Temporal Convolutional NetworksInternational Conference on Geometric Science of Information (GSI), 2023 Hao Jiang Qianxiao Li AI4TS 194 2 0 29 May 2023
Tensor Decomposition for Model Reduction in Neural Networks: A ReviewIEEE Circuits and Systems Magazine (IEEE CAS Magazine), 2023 Xingyi Liu Keshab K. Parhi 156 22 0 26 Apr 2023
STen: Productive and Efficient Sparsity in PyTorch Andrei Ivanov Nikoli Dryden Tal Ben-Nun Saleh Ashkboos Torsten Hoefler 173 6 0 15 Apr 2023
Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast TrainingJournal of Systems Engineering and Electronics (JSEE), 2023 Xinwei Ou Zhangxin Chen Ce Zhu Yipeng Liu 168 9 0 22 Mar 2023
Modality-Agnostic Variational Compression of Implicit Neural RepresentationsInternational Conference on Machine Learning (ICML), 2023 Jonathan Richard Schwarz Jihoon Tack Yee Whye Teh Jaeho Lee Jinwoo Shin 240 28 0 23 Jan 2023
Tensor Networks Meet Neural Networks: A Survey and Future Perspectives Xinjian Zhao Yu Pan Zenglin Xu Xiangli Yang Guangxi Li A. Cichocki Andrzej Cichocki 509 35 0 22 Jan 2023
HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural NetworksAAAI Conference on Artificial Intelligence (AAAI), 2023 Jinqi Xiao Chengming Zhang Yu Gong Miao Yin Yang Sui Lizhi Xiang Dingwen Tao Bo Yuan 250 27 0 20 Jan 2023
TDC: Towards Extremely Efficient CNNs on GPUs via Hardware-Aware Tucker DecompositionACM SIGPLAN Symposium on Principles & Practice of Parallel Programming (PPoPP), 2022 Lizhi Xiang Miao Yin Chengming Zhang Aravind Sukumaran-Rajam P. Sadayappan Bo Yuan Dingwen Tao 3DV 189 9 0 07 Nov 2022
SeKron: A Decomposition Method Supporting Many Factorization Structures Marawan Gamal Abdel Hameed A. Mosleh Marzieh S. Tahaei V. Nia 146 1 0 12 Oct 2022
SVD-NAS: Coupling Low-Rank Approximation and Neural Architecture SearchIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2022 Zhewen Yu C. Bouganis 88 7 0 22 Aug 2022
Canonical convolutional neural networksIEEE International Joint Conference on Neural Network (IJCNN), 2022 Lokesh Veeramacheneni Moritz Wolter Reinhard Klein Jochen Garcke 135 4 0 03 Jun 2022
Decomposed Temporal Dynamic CNN: Efficient Time-Adaptive Network for Text-Independent Speaker Verification Explained with Speaker Activation Map Seong-Hu Kim Hyeonuk Nam Yong-Hwa Park 137 10 0 29 Mar 2022
How to Train Unstable Looped Tensor Network Anh-Huy Phan Konstantin Sobolev Dmitry Ermilov Igor Vorona Nikolay Kozyrskiy P. Tichavský A. Cichocki 107 3 0 05 Mar 2022