Review and Comparison of Commonly Used Activation Functions for Deep Neural Networks

15 October 2020

Papers citing "Review and Comparison of Commonly Used Activation Functions for Deep Neural Networks"

14 / 14 papers shown

Title
Advancing Constrained Monotonic Neural Networks: Achieving Universal Approximation Beyond Bounded Activations Davide Sartor Alberto Sinigaglia Gian Antonio Susto 22 0 0 05 May 2025
DiGRAF: Diffeomorphic Graph-Adaptive Activation Function Krishna Sri Ipsit Mantri Xinzhi Wang Carola-Bibiane Schönlieb Bruno Ribeiro Beatrice Bevilacqua Moshe Eliasof GNN 44 1 0 02 Jul 2024
Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Survey Guoping Xu Xiaxia Wang Xinglong Wu Xuesong Leng Yongchao Xu 3DPC 27 8 0 02 May 2024
Using convolutional neural networks for stereological characterization of 3D hetero-aggregates based on synthetic STEM data Lukas Fuchs Tom Kirstein Christoph Mahr O. Furat Valentin Baric Andreas Rosenauer Lutz Mädler Volker Schmidt 3DV 16 3 0 27 Oct 2023
TaLU: A Hybrid Activation Function Combining Tanh and Rectified Linear Unit to Enhance Neural Networks M. Hasan Md. Ali Hossain Azmain Yakin Srizon Abu Sayeed 10 0 0 08 May 2023
iPINNs: Incremental learning for Physics-informed neural networks Aleksandr Dekhovich M. Sluiter David Tax Miguel A. Bessa AI4CE DiffM 10 10 0 10 Apr 2023
Neuronal architecture extracts statistical temporal patterns Sandra Nestler M. Helias M. Gilson AI4TS 11 0 0 24 Jan 2023
Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling Ahmed Elnaggar Hazem Essam Wafaa Salah-Eldin Walid Moustafa Mohamed Elkerdawy Charlotte Rochereau B. Rost 136 84 0 16 Jan 2023
APTx: better activation function than MISH, SWISH, and ReLU's variants used in deep learning Ravin Kumar 11 5 0 10 Sep 2022
Deep Learning Models for Detecting Malware Attacks Pascal Maniriho A. N. Mahmood M. Chowdhury AAML 11 1 0 08 Sep 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directions Ameya Dilip Jagtap George Karniadakis AI4CE 29 71 0 06 Sep 2022
Blind Estimation of a Doubly Selective OFDM Channel: A Deep Learning Algorithm and Theory T. Getu N. Golmie D. Griffith 11 2 0 30 May 2022
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 14 635 0 29 Sep 2021
Neural ODE to model and prognose thermoacoustic instability Jayesh M. Dhadphale Vishnu R Unni A. Saha R. Sujith 13 13 0 24 Jun 2021