Comparison of non-linear activation functions for deep neural networks on MNIST classification task

8 April 2018

Papers citing "Comparison of non-linear activation functions for deep neural networks on MNIST classification task"

32 / 32 papers shown

Title
Efficient Quantum Convolutional Neural Networks for Image Classification: Overcoming Hardware Constraints Peter Röseler Oliver Schaudt Helmut Berg Christian Bauckhage Matthias Koch 304 1 0 09 May 2025
Dual Policy Reinforcement Learning for Real-time Rebalancing in Bike-sharing Systems Jiaqi Liang Sanjay Dominik Jena Defeng Liu Andrea Lodi Thibaut Vidal 228 0 0 02 Jun 2024
Single- vs. Dual-Policy Reinforcement Learning for Dynamic Bike Rebalancing Jiaqi Liang Defeng Liu Sanjay Dominik Jena Andrea Lodi Thibaut Vidal 242 3 0 05 Feb 2024
Physical Layer Authentication and Security Design in the Machine Learning EraIEEE Communications Surveys and Tutorials (COMST), 2023 T. M. Hoang Alireza Vahid H. Tuan L. Hanzo 246 35 0 16 May 2023
A Hybrid Brain-Computer Interface Using Motor Imagery and SSVEP Based on Convolutional Neural NetworkBrain-Apparatus Communication: A Journal of Bacomics (JBCB), 2022 Wen-Lin Luo Wanguang Yin Quanying Liu Youzhi Qu 122 7 0 10 Dec 2022
Semi-Supervised Confidence-Level-based Contrastive Discrimination for Class-Imbalanced Semantic Segmentation Kangcheng Liu 121 17 0 28 Nov 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directionsJournal of Machine Learning for Modeling and Computing (JMLMC), 2022 Ameya Dilip Jagtap George Karniadakis AI4CE 443 89 0 06 Sep 2022
Simple and complex spiking neurons: perspectives and analysis in a simple STDP scenario D. L. Manna Alex Vicente-Sola Paul Kirkland Trevor Bihl G. D. Caterina 135 23 0 28 Jun 2022
An Inexact Augmented Lagrangian Algorithm for Training Leaky ReLU Neural Network with Group SparsityJournal of machine learning research (JMLR), 2022 Wei Liu Xin Liu Xiaojun Chen 155 14 0 11 May 2022
Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations G. Shamir Dong Lin HAI OffRL 143 8 0 14 Feb 2022
Crash Data Augmentation Using Conditional Generative Adversarial Networks (CGAN) for Improving Safety Performance Functions M. Zarei B. Hellinga 134 3 0 21 Dec 2021
CGAN-EB: A Non-parametric Empirical Bayes Method for Crash Hotspot Identification Using Conditional Generative Adversarial Networks: A Simulated Crash Data Study M. Zarei B. Hellinga P. Izadpanah CML 113 12 0 13 Dec 2021
Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPs Sameera Ramasinghe Simon Lucey 249 154 0 30 Nov 2021
$A New Multifractal-based Deep Learning Model for Text Mining$ A New Multifractal-based Deep Learning Model for Text MiningInformation Processing & Management (IPM), 2021 Zhenhua Wang Ming Ren Dong Gao AI4CE 90 21 0 27 Nov 2021
Biologically Inspired Oscillating Activation Functions Can Bridge the Performance Gap between Biological and Artificial Neurons Matthew Mithra Noel Shubham Bharadwaj Venkataraman Muthiah-Nakarajan Praneet Dutta G. B. Amali 170 6 0 07 Nov 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 308 909 0 29 Sep 2021
A Survey on Machine Learning Techniques for Auto Labeling of Video, Audio, and Text Data Shikun Zhang Omid Jafari P. Nagarkar VLM 76 29 0 08 Sep 2021
Central and Non-central Limit Theorems arising from the Scattering Transform and its Neural Activation GeneralizationSIAM Journal on Mathematical Analysis (SIAM J. Math. Anal.), 2020 Gi-Ren Liu Yuan-Chung Sheu Hau‐Tieng Wu 89 5 0 21 Nov 2020
MILR: Mathematically Induced Layer Recovery for Plaintext Space Error Correction of CNNsDependable Systems and Networks (DSN), 2020 Jonathan Ponader S. Kundu Yan Solihin 105 9 0 28 Oct 2020
Smooth activations and reproducibility in deep networks G. Shamir Dong Lin Lorenzo Coviello 214 24 0 20 Oct 2020
QReLU and m-QReLU: Two novel quantum activation functions to aid medical diagnostics Luca Parisi D. Neagu R. Ma F. Campean MedIm 89 58 0 15 Oct 2020
Effects of the Nonlinearity in Activation Functions on the Performance of Deep Learning Models N. Kulathunga N. R. Ranasinghe D. Vrinceanu Zackary Kinsman Lei Huang Yunjiao Wang 74 9 0 14 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 772 88 0 17 Sep 2020
SPLASH: Learnable Activation Functions for Improving Accuracy and Adversarial Robustness Mohammadamin Tavakoli Forest Agostinelli Pierre Baldi AAML FAtt 266 42 0 16 Jun 2020
A survey on modern trainable activation functionsNeural Networks (NN), 2020 Andrea Apicella Francesco Donnarumma Francesco Isgrò R. Prevete 196 458 0 02 May 2020
A new neural-network-based model for measuring the strength of a pseudorandom binary sequenceInternational Journal of Advances in Applied Sciences (IJAAS), 2019 Ahmed Alamer B. Soh 50 0 0 09 Oct 2019
On the Impact of the Activation Function on Deep Neural Networks Training Soufiane Hayou Arnaud Doucet Judith Rousseau ODL 200 217 0 19 Feb 2019
A simple and efficient architecture for trainable activation functions Andrea Apicella Francesco Isgrò R. Prevete 139 40 0 08 Feb 2019
Multivariate Forecasting of Crude Oil Spot Prices using Neural Networks Ganapathy S. Natarajan Aishwarya Ashok 65 3 0 21 Nov 2018
Activation Functions: Comparison of trends in Practice and Research for Deep Learning S. Bodenstedt Dominik Rivoir A. Gachagan S. T. Mees 234 1,382 0 08 Nov 2018
A Methodology for Automatic Selection of Activation Functions to Design Hybrid Deep Neural Networks Alberto Marchisio Muhammad Abdullah Hanif Semeen Rehman Maurizio Martina Mohamed Bennai 120 11 0 27 Oct 2018
Nonparametric regression using deep neural networks with ReLU activation function Johannes Schmidt-Hieber 532 912 0 22 Aug 2017