ResearchTrend.AI
The effect of Target Normalization and Momentum on Dying ReLU

The effect of Target Normalization and Momentum on Dying ReLU

Isac Arnekvist
J. Carvalho
Danica Kragic
J. A. Stork
ArXivPDFHTML

Papers citing "The effect of Target Normalization and Momentum on Dying ReLU"

5 / 5 papers shown
Title
AP: Selective Activation for De-sparsifying Pruned Neural Networks
AP: Selective Activation for De-sparsifying Pruned Neural Networks
Shiyu Liu
Rohan Ghosh
Dylan Tan
Mehul Motani
AAML
26
0
0
09 Dec 2022
DeepDiagnosis: Automatically Diagnosing Faults and Recommending Actionable Fixes in Deep Learning Programs
DeepDiagnosis: Automatically Diagnosing Faults and Recommending Actionable Fixes in Deep Learning Programs
Mohammad Wardat
Breno Dantas Cruz
Wei Le
Hridesh Rajan
30
52
0
07 Dec 2021
Regularization by Misclassification in ReLU Neural Networks
Regularization by Misclassification in ReLU Neural Networks
Elisabetta Cornacchia
Jan Hązła
Ido Nachum
Amir Yehudayoff
NoLa
25
2
0
03 Nov 2021
Review: Deep Learning in Electron Microscopy
Review: Deep Learning in Electron Microscopy
Jeffrey M. Ede
44
79
0
17 Sep 2020
Deeply learned face representations are sparse, selective, and robust
Deeply learned face representations are sparse, selective, and robust
Yi Sun
Xiaogang Wang
Xiaoou Tang
CVBM
252
921
0
03 Dec 2014