Learning Sparse Networks Using Targeted Dropout

Learning Sparse Networks Using Targeted Dropout

31 May 2019

Siddhartha Rao Kamalakara

Geoffrey E. Hinton

Papers citing "Learning Sparse Networks Using Targeted Dropout"

18 / 18 papers shown

Title
Regularization can make diffusion models more efficient Mahsa Taheri Johannes Lederer 98 0 0 13 Feb 2025
AdaFSNet: Time Series Classification Based on Convolutional Network with a Adaptive and Effective Kernel Size Configuration Haoxiao Wang Bo Peng Jianhua Zhang Xu Cheng AI4TS 39 1 0 28 Apr 2024
Learning Prescriptive ReLU Networks Wei-Ju Sun Asterios Tsiourvas 21 2 0 01 Jun 2023
Dropout Reduces Underfitting Zhuang Liu Zhi-Qin John Xu Joseph Jin Zhiqiang Shen Trevor Darrell 37 36 0 02 Mar 2023
Extremely Simple Activation Shaping for Out-of-Distribution Detection Andrija Djurisic Nebojsa Bozanic Arjun Ashok Rosanne Liu OODD 169 150 0 20 Sep 2022
A Survey on Dropout Methods and Experimental Verification in Recommendation Yongqian Li Weizhi Ma C. L. Philip Chen M. Zhang Yiqun Liu Shaoping Ma Yue Yang 33 9 0 05 Apr 2022
Layer-wise Model Pruning based on Mutual Information Chun Fan Jiwei Li Xiang Ao Fei Wu Yuxian Meng Xiaofei Sun 46 19 0 28 Aug 2021
Differentiable Subset Pruning of Transformer Heads Jiaoda Li Ryan Cotterell Mrinmaya Sachan 37 53 0 10 Aug 2021
Boosting Co-teaching with Compression Regularization for Label Noise Yingyi Chen Xin Shen S. Hu Johan A. K. Suykens NoLa 37 45 0 28 Apr 2021
SeReNe: Sensitivity based Regularization of Neurons for Structured Sparsity in Neural Networks Enzo Tartaglione Andrea Bragagnolo Francesco Odierna A. Fiandrotti Marco Grangetto 40 18 0 07 Feb 2021
LOss-Based SensiTivity rEgulaRization: towards deep sparse neural networks Enzo Tartaglione Andrea Bragagnolo A. Fiandrotti Marco Grangetto ODL UQCV 15 34 0 16 Nov 2020
Pruning Convolutional Filters using Batch Bridgeout Najeeb Khan Ian Stavness 19 3 0 23 Sep 2020
Maximum Roaming Multi-Task Learning Lucas Pascal Pietro Michiardi Xavier Bost B. Huet Maria A. Zuluaga 31 31 0 17 Jun 2020
A Framework for Neural Network Pruning Using Gibbs Distributions Alex Labach S. Valaee 9 5 0 08 Jun 2020
Gradient Monitored Reinforcement Learning Mohammed Sharafath Abdul Hameed Gavneet Singh Chadha Andreas Schwung S. Ding 28 10 0 25 May 2020
A multimodal deep learning approach for named entity recognition from social media M. Asgari-Chenaghlu M. Feizi-Derakhshi Leili Farzinvash M. Balafar C. Motamed 19 28 0 19 Jan 2020
Relational Reasoning Network (RRN) for Anatomical Landmarking N. Torosdagli Syed Muhammad Anwar P. Verma D. Liberton Janice S. Lee Wade W. Han Ulas Bagci 27 3 0 08 Apr 2019
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,636 0 03 Jul 2012