Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1412.6830
Cited By
v1
v2
v3 (latest)
Learning Activation Functions to Improve Deep Neural Networks
International Conference on Learning Representations (ICLR), 2014
21 December 2014
Forest Agostinelli
Matthew Hoffman
Peter Sadowski
Pierre Baldi
ODL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Learning Activation Functions to Improve Deep Neural Networks"
50 / 158 papers shown
Quantum Variational Activation Functions Empower Kolmogorov-Arnold Networks
Jiun-Cheng Jiang
Morris Yu-Chao Huang
Tianlong Chen
Hsi-Sheng Goan
119
1
0
17 Sep 2025
Developing Training Procedures for Piecewise-linear Spline Activation Functions in Neural Networks
William H Patty
LLMSV
134
0
0
17 Sep 2025
Don't Forget the Nonlinearity: Unlocking Activation Functions in Efficient Fine-Tuning
Bo Yin
Xingyi Yang
Xinchao Wang
150
1
0
16 Sep 2025
BubbleOKAN: A Physics-Informed Interpretable Neural Operator for High-Frequency Bubble Dynamics
Yunhao Zhang
Lin Cheng
Aswin Gnanaskandan
Ameya D. Jagtap
Ameya D. Jagtap
AI4CE
198
0
0
05 Aug 2025
Kolmogorov-Arnold Networks in Low-Data Regimes: A Comparative Study with Multilayer Perceptrons
Farhad Pourkamali-Anaraki
290
9
0
16 Sep 2024
Controlled Learning of Pointwise Nonlinearities in Neural-Network-Like Architectures
Applied and Computational Harmonic Analysis (ACHA), 2024
Michael Unser
Alexis Goujon
Stanislas Ducotterd
291
2
0
23 Aug 2024
Efficient Search for Customized Activation Functions with Gradient Descent
Lukas Strack
Mahmoud Safari
Katharina Eggensperger
211
2
0
13 Aug 2024
KAN we improve on HEP classification tasks? Kolmogorov-Arnold Networks applied to an LHC physics example
Computing and Software for Big Science (CSBS), 2024
Johannes Erdmann
F. Mausolf
Jan Lukas Späh
687
6
0
05 Aug 2024
Your Network May Need to Be Rewritten: Network Adversarial Based on High-Dimensional Function Graph Decomposition
Xiaoyan Su
Yinghao Zhu
Run Li
AAML
305
0
0
04 May 2024
Nonlinearity Enhanced Adaptive Activation Functions
David Yevick
237
1
0
29 Mar 2024
An In-Depth Analysis of Data Reduction Methods for Sustainable Deep Learning
Open Research Europe (ORE), 2024
Víctor Toscano-Durán
Javier Perera-Lago
Eduardo Paluzo-Hidalgo
Rocio Gonzalez-Diaz
Miguel A. Gutiérrez-Naranjo
Matteo Rucco
228
4
0
22 Mar 2024
Enhancing Sequential Model Performance with Squared Sigmoid TanH (SST) Activation Under Data Constraints
B. Subramanian
Rathinaraja Jeyaraj
Akhrorjon Akhmadjon Ugli Rakhmonov
144
0
0
14 Feb 2024
Adaptive Activation Functions for Predictive Modeling with Sparse Experimental Data
Farhad Pourkamali-Anaraki
Tahamina Nasrin
Robert E. Jensen
Amy M. Peterson
Christopher J. Hansen
202
11
0
08 Feb 2024
Physics-informed Deep Learning to Solve Three-dimensional Terzaghi Consolidation Equation: Forward and Inverse Problems
The Arabian journal for science and engineering (AJSE), 2024
Biao Yuan
Ana Heitor
He Wang
Xiaohui Chen
AI4CE
PINN
240
5
0
08 Jan 2024
A Novel Paradigm for Neural Computation: X-Net with Learnable Neurons and Adaptable Structure
Yanjie Li
Weijun Li
Lina Yu
Min Wu
Jinyi Liu
...
Xin Ning
Yugui Zhang
Baoli Lu
Jian Xu
Shuang Li
246
2
0
03 Jan 2024
Optimal Nonlinearities Improve Generalization Performance of Random Features
Asian Conference on Machine Learning (ACML), 2023
Samet Demir
Zafer Dogan
MLT
120
4
0
28 Sep 2023
Homotopy Relaxation Training Algorithms for Infinite-Width Two-Layer ReLU Neural Networks
Journal of Scientific Computing (J. Sci. Comput.), 2023
Yahong Yang
Qipin Chen
Wenrui Hao
317
7
0
26 Sep 2023
Linear Oscillation: A Novel Activation Function for Vision Transformer
Juyoung Yun
LLMSV
229
0
0
25 Aug 2023
Optimizing Performance of Feedforward and Convolutional Neural Networks through Dynamic Activation Functions
Chinmay Rane
Kanishka Tyagi
M. Manry
AI4CE
ODL
157
4
0
10 Aug 2023
Learning Specialized Activation Functions for Physics-informed Neural Networks
Communications in Computational Physics (Commun. Comput. Phys.), 2023
Honghui Wang
Lu Lu
Shiji Song
Gao Huang
PINN
AI4CE
188
30
0
08 Aug 2023
ENN: A Neural Network with DCT Adaptive Activation Functions
IEEE Journal on Selected Topics in Signal Processing (JSTSP), 2023
Marc Martinez-Gost
Ana I. Pérez-Neira
M. Lagunas
AAML
298
14
0
02 Jul 2023
A Melting Pot of Evolution and Learning
Genetic Programming Theory and Practice (GPTP), 2023
Moshe Sipper
Achiya Elyasaf
Tomer Halperin
Zvika Haramaty
Raz Lapid
Eyal Segal
Itai Tzruia
Snir Vitrack Tamam
BDL
131
0
0
08 Jun 2023
Physical Layer Authentication and Security Design in the Machine Learning Era
IEEE Communications Surveys and Tutorials (COMST), 2023
T. M. Hoang
Alireza Vahid
H. Tuan
L. Hanzo
293
47
0
16 May 2023
When Deep Learning Meets Polyhedral Theory: A Survey
Joey Huchette
Gonzalo Muñoz
Thiago Serra
Calvin Tsay
AI4CE
674
45
0
29 Apr 2023
Empirical study of the modulus as activation function in computer vision applications
Engineering applications of artificial intelligence (Eng. Appl. Artif. Intell.), 2023
Iván Vallés-Pérez
E. Soria-Olivas
M. Martínez-Sober
Antonio J. Serrano
Joan Vila-Francés
J. Gómez-Sanchís
154
20
0
15 Jan 2023
Efficient Activation Function Optimization through Surrogate Modeling
Neural Information Processing Systems (NeurIPS), 2023
G. Bingham
Risto Miikkulainen
398
8
0
13 Jan 2023
Increasing biases can be more efficient than increasing weights
IEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2023
C. Metta
M. Fantozzi
Andrea Papini
G. Amato
Matteo Bergamaschi
S. Galfrè
Alessandro Marchetti
Michelangelo Vegliò
Maurizio Parton
F. Morandin
557
7
0
03 Jan 2023
Neural Network Verification as Piecewise Linear Optimization: Formulations for the Composition of Staircase Functions
Tu Anh-Nguyen
Joey Huchette
172
2
0
27 Nov 2022
Bayesian Neural Networks for Macroeconomic Analysis
Journal of Econometrics (JE), 2022
Niko Hauzenberger
Florian Huber
K. Klieber
Massimiliano Marcellino
BDL
218
14
0
09 Nov 2022
Improving Lipschitz-Constrained Neural Networks by Learning Activation Functions
Journal of machine learning research (JMLR), 2022
Stanislas Ducotterd
Alexis Goujon
Pakshal Bohra
Dimitris Perdios
Sebastian Neumayer
M. Unser
247
19
0
28 Oct 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directions
Journal of Machine Learning for Modeling and Computing (JMLMC), 2022
Ameya Dilip Jagtap
George Karniadakis
AI4CE
618
94
0
06 Sep 2022
Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples
Hezekiah J. Branch
Jonathan Rodriguez Cefalu
Jeremy McHugh
Leyla Hujer
Aditya Bahl
Daniel del Castillo Iglesias
Ron Heichman
Ramesh Darwishi
ELM
SILM
AAML
215
74
0
05 Sep 2022
Consensus Function from an
L
p
q
−
L_p^q-
L
p
q
−
norm Regularization Term for its Use as Adaptive Activation Functions in Neural Networks
Juan Heredia Juesas
José Á. Martínez-Lorenzo
109
0
0
30 Jun 2022
Neural Networks with A La Carte Selection of Activation Functions
SN Computer Science (SN Comput. Sci.), 2021
Moshe Sipper
195
8
0
24 Jun 2022
Evolution of Activation Functions for Deep Learning-Based Image Classification
Raz Lapid
Moshe Sipper
146
13
0
24 Jun 2022
Piecewise Linear Neural Networks and Deep Learning
Nature Reviews Methods Primers (NRMP), 2022
Qinghua Tao
Li Li
Xiaolin Huang
Xiangming Xi
Shuning Wang
Johan A. K. Suykens
152
39
0
18 Jun 2022
On the Number of Regions of Piecewise Linear Neural Networks
Journal of Computational and Applied Mathematics (JCAM), 2022
Alexis Goujon
Arian Etemadi
M. Unser
289
17
0
17 Jun 2022
Deep Learning Models of the Discrete Component of the Galactic Interstellar Gamma-Ray Emission
Alexander Shmakov
Mohammadamin Tavakoli
Pierre Baldi
C. Karwin
Alex Broughton
S. Murgia
80
1
0
06 Jun 2022
Optimal Activation Functions for the Random Features Regression Model
International Conference on Learning Representations (ICLR), 2022
Jianxin Wang
José Bento
264
4
0
31 May 2022
Tackling Multiple Tasks with One Single Learning Framework
Michael Yang
BDL
122
0
0
29 May 2022
Neuronal diversity can improve machine learning for physics and beyond
Scientific Reports (Sci Rep), 2022
A. Choudhary
Anil Radhakrishnan
J. Lindner
S. Sinha
W. Ditto
AI4CE
195
4
0
09 Apr 2022
Learning the Proximity Operator in Unfolded ADMM for Phase Retrieval
IEEE Signal Processing Letters (SPL), 2022
Pierre-Hugo Vial
P. Magron
Thomas Oberlin
Cédric Févotte
169
5
0
04 Apr 2022
Using Computational Intelligence for solving the Ornstein-Zernike equation
Edwin Bedolla
209
0
0
17 Nov 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark
S. Dubey
S. Singh
B. B. Chaudhuri
405
963
0
29 Sep 2021
PowerLinear Activation Functions with application to the first layer of CNNs
Kamyar Nasiri
Kamaledin Ghiasi-Shirazi
217
0
0
20 Aug 2021
Piecewise Linear Units Improve Deep Neural Networks
Jordan Inturrisi
Suiyang Khoo
Abbas Kouzani
Riccardo M. Pagliarella
215
4
0
02 Aug 2021
Tensor-based framework for training flexible neural networks
Yassine Zniyed
K. Usevich
S. Miron
D. Brie
126
1
0
25 Jun 2021
Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions
Ameya Dilip Jagtap
Yeonjong Shin
Kenji Kawaguchi
George Karniadakis
ODL
286
159
0
20 May 2021
Learning specialized activation functions with the Piecewise Linear Unit
IEEE International Conference on Computer Vision (ICCV), 2021
Yucong Zhou
Zezhou Zhu
Zhaobai Zhong
160
17
0
08 Apr 2021
Deep ensembles based on Stochastic Activation Selection for Polyp Segmentation
A. Lumini
L. Nanni
Gianluca Maguolo
SSeg
210
3
0
02 Apr 2021
1
2
3
4
Next
Page 1 of 4
