FreezeOut: Accelerate Training by Progressively Freezing Layers

FreezeOut: Accelerate Training by Progressively Freezing Layers

15 June 2017

Papers citing "FreezeOut: Accelerate Training by Progressively Freezing Layers"

13 / 13 papers shown

Title
ICE-Pruning: An Iterative Cost-Efficient Pruning Pipeline for Deep Neural Networks Wenhao Hu Paul Henderson José Cano 30 0 0 12 May 2025
Frozen Layers: Memory-efficient Many-fidelity Hyperparameter Optimization Timur Carstensen Neeratyoy Mallik Frank Hutter Martin Rapp AI4CE 24 0 0 14 Apr 2025
Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Sampling Minhyuk Seo Hyunseo Koh Jonghyun Choi 31 1 0 19 Oct 2024
Dynamic nsNet2: Efficient Deep Noise Suppression with Early Exiting Riccardo Miccini Alaa Zniber Clément Laroche Tobias Piechowiak Martin Schoeberl Luca Pezzarossa Ouassim Karrakchou J. Sparsø Mounir Ghogho 25 1 0 31 Aug 2023
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models Jean Kaddour Oscar Key Piotr Nawrot Pasquale Minervini Matt J. Kusner 17 41 0 12 Jul 2023
Benchmarking Deep Learning Frameworks for Automated Diagnosis of Ocular Toxoplasmosis: A Comprehensive Approach to Classification and Segmentation Syed Samiul Alam Samiul Based Shuvo Shams Nafisa Ali F. Ahmed Arbil Chakma Yeonggul Jang 10 5 0 18 May 2023
On Efficient Training of Large-Scale Deep Learning Models: A Literature Review Li Shen Yan Sun Zhiyuan Yu Liang Ding Xinmei Tian Dacheng Tao VLM 28 40 0 07 Apr 2023
Text recognition on images using pre-trained CNN Afgani Fajar Rizky N. Yudistira Edy Santoso VLM 18 4 0 10 Feb 2023
GlueFL: Reconciling Client Sampling and Model Masking for Bandwidth Efficient Federated Learning Shiqi He Qifan Yan Feijie Wu Lanjun Wang Mathias Lécuyer Ivan Beschastnikh FedML 34 7 0 03 Dec 2022
Aergia: Leveraging Heterogeneity in Federated Learning Systems Bart Cox L. Chen Jérémie Decouchant FedML 27 11 0 12 Oct 2022
Towards Adversarial Evaluations for Inexact Machine Unlearning Shashwat Goel Ameya Prabhu Amartya Sanyal Ser-Nam Lim Philip H. S. Torr Ponnurangam Kumaraguru AAML ELM MU 26 45 0 17 Jan 2022
Reservoir Transformers Sheng Shen Alexei Baevski Ari S. Morcos Kurt Keutzer Michael Auli Douwe Kiela 27 17 0 30 Dec 2020
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,634 0 03 Jul 2012