Training Acceleration of Low-Rank Decomposed Networks using Sequential
Freezing and Rank Quantization

Training Acceleration of Low-Rank Decomposed Networks using Sequential Freezing and Rank Quantization

7 September 2023

Habib Hajimolahoseini

Yang Liu

Papers citing "Training Acceleration of Low-Rank Decomposed Networks using Sequential Freezing and Rank Quantization"

8 / 8 papers shown

Title
Accelerating the Low-Rank Decomposed Models Habib Hajimolahoseini Walid Ahmed Austin Wen Yang Liu 16 0 0 24 Jul 2024
Is 3D Convolution with 5D Tensors Really Necessary for Video Analysis? Habib Hajimolahoseini Walid Ahmed Austin Wen Yang Liu 18 0 0 23 Jul 2024
Single Parent Family: A Spectrum of Family Members from a Single Pre-Trained Foundation Model Habib Hajimolahoseini Mohammad Hassanpour Foozhan Ataiefard Boxing Chen Yang Liu 18 2 0 28 Jun 2024
SwiftLearn: A Data-Efficient Training Method of Deep Learning Models using Importance Sampling Habib Hajimolahoseini Omar Mohamed Awad Walid Ahmed Austin Wen Saina Asani ... Farnoosh Javadi Mehdi Ahmadi Foozhan Ataiefard Kangling Liu Yang Liu 13 2 0 25 Nov 2023
Speeding up Resnet Architecture with Layers Targeted Low Rank Decomposition Walid Ahmed Habib Hajimolahoseini Austin Wen Yang Liu 22 7 0 21 Sep 2023
Improving Resnet-9 Generalization Trained on Small Datasets Omar Mohamed Awad Habib Hajimolahoseini Michael Lim Gurpreet Gosal Walid Ahmed Yang Liu Gordon Deng 31 2 0 07 Sep 2023
A Short Study on Compressing Decoder-Based Language Models Tianda Li Yassir El Mesbahi I. Kobyzev Ahmad Rashid A. Mahmud Nithin Anchuri Habib Hajimolahoseini Yang Liu Mehdi Rezagholizadeh 82 25 0 16 Oct 2021
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 279 39,083 0 01 Sep 2014