Rethinking Weight Decay For Efficient Neural Network Pruning

Rethinking Weight Decay For Efficient Neural Network Pruning

20 November 2020

Vincent Gripon

Mathieu Léonardon

Papers citing "Rethinking Weight Decay For Efficient Neural Network Pruning"

13 / 13 papers shown

Title
FLoCoRA: Federated learning compression with low-rank adaptation Lucas Grativol Ribeiro Mathieu Léonardon Guillaume Muller Virginie Fresse Matthieu Arzel AI4CE 21 1 0 20 Jun 2024
Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers A. Bambhaniya Amir Yazdanbakhsh Suvinay Subramanian Sheng-Chun Kao Shivani Agrawal Utku Evci Tushar Krishna 54 16 0 07 Feb 2024
Effective Multi-Stage Training Model For Edge Computing Devices In Intrusion Detection Thua Huynh Trong Thanh Nguyen Hoang 17 3 0 31 Jan 2024
Federated learning compression designed for lightweight communications Lucas Grativol Ribeiro Mathieu Léonardon Guillaume Muller Virginie Fresse Matthieu Arzel FedML 25 3 0 23 Oct 2023
ThinResNet: A New Baseline for Structured Convolutional Networks Pruning Hugo Tessier Ghouti Boukli Hacene Vincent Gripon 16 1 0 22 Sep 2023
A Strong and Simple Deep Learning Baseline for BCI MI Decoding Yassine El Ouahidi Vincent Gripon Bastien Pasdeloup Ghaith Bouallegue Nicolas Farrugia G. Lioi BDL 19 4 0 11 Sep 2023
Towards Sparsification of Graph Neural Networks Hongwu Peng Deniz Gurevin Shaoyi Huang Tong Geng Weiwen Jiang O. Khan Caiwen Ding GNN 30 24 0 11 Sep 2022
Energy Consumption Analysis of pruned Semantic Segmentation Networks on an Embedded GPU Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel David Bertrand T. Hannagan GNN SSeg 3DPC 17 2 0 13 Jun 2022
Leveraging Structured Pruning of Convolutional Neural Networks Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel David Bertrand T. Hannagan CVBM 13 1 0 13 Jun 2022
Pruning Graph Convolutional Networks to select meaningful graph frequencies for fMRI decoding Yassine El Ouahidi Hugo Tessier G. Lioi Nicolas Farrugia Bastien Pasdeloup Vincent Gripon GNN 21 2 0 09 Mar 2022
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 183 1,027 0 06 Mar 2020
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 222 382 0 05 Mar 2020
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 294 10,216 0 16 Nov 2016