Learning the Number of Neurons in Deep Networks

19 November 2016

Papers citing "Learning the Number of Neurons in Deep Networks"

50 / 204 papers shown

Title
Tin-Tin: Towards Tiny Learning on Tiny Devices with Integer-based Neural Network Training Yi Hu Jinhang Zuo Eddie Zhang Bob Iannucci Carlee Joe-Wong 37 0 0 13 Apr 2025
MDP: Multidimensional Vision Model Pruning with Latency Constraint Xinglong Sun Barath Lakshmanan Maying Shen Shiyi Lan Jingde Chen Jose M. Alvarez VLM 62 0 0 02 Apr 2025
Regularization can make diffusion models more efficient Mahsa Taheri Johannes Lederer 100 0 0 13 Feb 2025
Advancing Weight and Channel Sparsification with Enhanced Saliency Xinglong Sun Maying Shen Hongxu Yin Lei Mao Pavlo Molchanov Jose M. Alvarez 54 1 0 05 Feb 2025
$Sparse Deep Learning Models with the $\ell_1$ Regularization$ Sparse Deep Learning Models with the $\ell_1$ Regularization Lixin Shen Rui Wang Yuesheng Xu Mingsong Yan 25 0 0 05 Aug 2024
Multi-Dimensional Pruning: Joint Channel, Layer and Block Pruning with Latency Constraint Xinglong Sun Barath Lakshmanan Maying Shen Shiyi Lan Jingde Chen Jose Alvarez VLM 44 3 0 17 Jun 2024
Subspace Node Pruning Joshua Offergeld Marcel van Gerven Nasir Ahmad 46 0 0 26 May 2024
Multi-level projection with exponential parallel speedup; Application to sparse auto-encoders neural networks Guillaume Perez Michel Barlaud 34 0 0 03 May 2024
Rethinking Pruning for Vision-Language Models: Strategies for Effective Sparsity and Performance Restoration Shwai He Ang Li Tianlong Chen VLM 62 1 0 03 Apr 2024
DRIVE: Dual Gradient-Based Rapid Iterative Pruning Dhananjay Saikumar Blesson Varghese 30 0 0 01 Apr 2024
Enhanced Sparsification via Stimulative Training Shengji Tang Weihao Lin Hancheng Ye Peng Ye Chong Yu Baopu Li Tao Chen 40 2 0 11 Mar 2024
LayerCollapse: Adaptive compression of neural networks Soheil Zibakhsh Shabgahi Mohammad Soheil Shariff F. Koushanfar AI4CE 20 1 0 29 Nov 2023
Efficient Neural Networks for Tiny Machine Learning: A Comprehensive Review M. Lê Pierre Wolinski Julyan Arbel 34 8 0 20 Nov 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets A. D. Cunha Francesco d’Amore Emanuele Natale MLT 27 1 0 16 Nov 2023
AICSD: Adaptive Inter-Class Similarity Distillation for Semantic Segmentation Amir M. Mansourian Rozhan Ahmadi S. Kasaei 44 2 0 08 Aug 2023
$Performance of $\ell_1$ Regularization for Sparse Convex Optimization$ Performance of $\ell_1$ Regularization for Sparse Convex Optimization Kyriakos Axiotis T. Yasuda 30 0 0 14 Jul 2023
A Proximal Algorithm for Network Slimming Kevin Bui Fanghui Xue Fredrick Park Y. Qi Jack Xin 3DPC 15 2 0 02 Jul 2023
Explainable Lifelong Stream Learning Based on "Glocal" Pairwise Fusion C. K. Loo W. S. Liew S. Wermter CLL 13 0 0 23 Jun 2023
Magnitude Attention-based Dynamic Pruning Jihye Back Namhyuk Ahn Jang-Hyun Kim 32 2 0 08 Jun 2023
Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast Training Xinwei Ou Zhangxin Chen Ce Zhu Yipeng Liu 36 2 0 22 Mar 2023
Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers Sungmin Cha Sungjun Cho Dasol Hwang Honglak Lee Taesup Moon Moontae Lee MU 44 35 0 27 Jan 2023
Pruning Very Deep Neural Network Channels for Efficient Inference Yihui He 35 1 0 14 Nov 2022
MGiaD: Multigrid in all dimensions. Efficiency and robustness by coarsening in resolution and channel dimensions Antonia van Betteray Matthias Rottmann Karsten Kahl 31 2 0 10 Nov 2022
Soft Masking for Cost-Constrained Channel Pruning Ryan Humble Maying Shen J. Latorre Eric Darve1 J. Álvarez 22 14 0 04 Nov 2022
Structural Pruning via Latency-Saliency Knapsack Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez 37 47 0 13 Oct 2022
Double Attention-based Lightweight Network for Plant Pest Recognition Sivasubramaniam Janarthan S. Thuseethan Sutharshan Rajasegarar John Yearwood 24 2 0 04 Oct 2022
Sequential Attention for Feature Selection T. Yasuda M. Bateni Lin Chen Matthew Fahrbach Gang Fu Vahab Mirrokni 39 11 0 29 Sep 2022
Learning sparse auto-encoders for green AI image coding Cyprien Gille F. Guyard Marc Antonini Michel Barlaud 16 3 0 09 Sep 2022
Entropy Induced Pruning Framework for Convolutional Neural Networks Yihe Lu Ziyu Guan Yaming Yang Maoguo Gong Wei Zhao Kaiyuan Feng 38 2 0 13 Aug 2022
DropNet: Reducing Neural Network Complexity via Iterative Pruning Chong Min John Tan Mehul Motani 32 52 0 14 Jul 2022
Scaling Private Deep Learning with Low-Rank and Sparse Gradients Ryuichi Ito Seng Pei Liew Tsubasa Takahashi Yuya Sasaki Makoto Onizuka 30 1 0 06 Jul 2022
Compression-aware Training of Neural Networks using Frank-Wolfe Max Zimmer Christoph Spiegel Sebastian Pokutta 29 9 0 24 May 2022
Statistical Guarantees for Approximate Stationary Points of Simple Neural Networks Mahsa Taheri Fang Xie Johannes Lederer 29 0 0 09 May 2022
Online Continual Learning for Embedded Devices Tyler L. Hayes Christopher Kanan CLL 40 54 0 21 Mar 2022
Provable and Efficient Continual Representation Learning Yingcong Li Mingchen Li Ulugbek S. Kamilov Samet Oymak CLL 30 11 0 03 Mar 2022
Optimal channel selection with discrete QCQP Yeonwoo Jeong Deokjae Lee Gaon An Changyong Son Hyun Oh Song 16 1 0 24 Feb 2022
Impact of Parameter Sparsity on Stochastic Gradient MCMC Methods for Bayesian Deep Learning Meet P. Vadera Adam D. Cobb Brian Jalaian Benjamin M. Marlin BDL 23 2 0 08 Feb 2022
Pruning-aware Sparse Regularization for Network Pruning Nanfei Jiang Xu Zhao Chaoyang Zhao Yongqi An Ming Tang Jinqiao Wang 3DPC 24 12 0 18 Jan 2022
Challenges and Opportunities in Approximate Bayesian Deep Learning for Intelligent IoT Systems Meet P. Vadera Benjamin M. Marlin UQCV BDL 18 5 0 03 Dec 2021
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI Jiangchao Yao Shengyu Zhang Yang Yao Feng Wang Jianxin Ma ... Kun Kuang Chao-Xiang Wu Fei Wu Jingren Zhou Hongxia Yang 24 91 0 11 Nov 2021
When to Prune? A Policy towards Early Structural Pruning Maying Shen Pavlo Molchanov Hongxu Yin J. Álvarez VLM 28 53 0 22 Oct 2021
HALP: Hardware-Aware Latency Pruning Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez VLM 46 13 0 20 Oct 2021
Mining the Weights Knowledge for Optimizing Neural Network Structures Mengqiao Han Xiabi Liu Zhaoyang Hai Xin Duan 11 1 0 11 Oct 2021
Convolutional Neural Network Compression through Generalized Kronecker Product Decomposition Marawan Gamal Abdel Hameed Marzieh S. Tahaei A. Mosleh V. Nia 47 25 0 29 Sep 2021
Searching for Minimal Optimal Neural Networks L. Ho Vu C. Dinh 8 4 0 27 Sep 2021
Layer-wise Model Pruning based on Mutual Information Chun Fan Jiwei Li Xiang Ao Fei Wu Yuxian Meng Xiaofei Sun 48 19 0 28 Aug 2021
Layer Adaptive Node Selection in Bayesian Neural Networks: Statistical Guarantees and Implementation Details Sanket R. Jantre Shrijita Bhattacharya T. Maiti BDL 10 13 0 25 Aug 2021
Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNN Xiaohan Ding Tianxiang Hao Jungong Han Yuchen Guo Guiguang Ding 27 11 0 30 Jul 2021
Lockout: Sparse Regularization of Neural Networks Gilmer Valdes W. Arbelo Y. Interian J. Friedman 19 2 0 15 Jul 2021
Content-Aware Convolutional Neural Networks Yong Guo Yaofo Chen Mingkui Tan Kui Jia Jian Chen Jingdong Wang 36 8 0 30 Jun 2021