The Quest for the Golden Activation Function

2 August 2018

Papers citing "The Quest for the Golden Activation Function"

10 / 10 papers shown

Title
Bayesian optimization for sparse neural networks with trainable activation functions M. Fakhfakh Lotfi Chaari 23 2 0 10 Apr 2023
Efficient Activation Function Optimization through Surrogate Modeling G. Bingham Risto Miikkulainen 32 2 0 13 Jan 2023
Nish: A Novel Negative Stimulated Hybrid Activation Function Yildiray Anagün Ş. Işık 32 2 0 17 Oct 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directions Ameya Dilip Jagtap George Karniadakis AI4CE 45 71 0 06 Sep 2022
Neural Networks with A La Carte Selection of Activation Functions Moshe Sipper 32 7 0 24 Jun 2022
Evolution of Activation Functions for Deep Learning-Based Image Classification Raz Lapid Moshe Sipper 32 11 0 24 Jun 2022
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 46 650 0 29 Sep 2021
AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks G. Bingham Risto Miikkulainen ODL 29 4 0 18 Sep 2021
A survey on modern trainable activation functions Andrea Apicella Francesco Donnarumma Francesco Isgrò R. Prevete 36 368 0 02 May 2020
Activation Functions: Comparison of trends in Practice and Research for Deep Learning S. Bodenstedt Dominik Rivoir A. Gachagan S. T. Mees 39 1,271 0 08 Nov 2018