Is it Time to Swish? Comparing Deep Learning Activation Functions Across
NLP tasks

Is it Time to Swish? Comparing Deep Learning Activation Functions Across NLP tasks

9 January 2019

Papers citing "Is it Time to Swish? Comparing Deep Learning Activation Functions Across NLP tasks"

11 / 11 papers shown

Title
Swish-T : Enhancing Swish Activation with Tanh Bias for Improved Neural Network Performance Youngmin Seo Jinha Kim Unsang Park 34 0 0 01 Jul 2024
How important are activation functions in regression and classification? A survey, performance comparison, and future directions Ameya Dilip Jagtap George Karniadakis AI4CE 37 71 0 06 Sep 2022
Simple and complex spiking neurons: perspectives and analysis in a simple STDP scenario D. L. Manna Alex Vicente-Sola Paul Kirkland Trevor Bihl G. D. Caterina 30 21 0 28 Jun 2022
Wide and Deep Neural Networks Achieve Optimality for Classification Adityanarayanan Radhakrishnan M. Belkin Caroline Uhler 27 18 0 29 Apr 2022
A fast accurate fine-grain object detection model based on YOLOv4 deep neural network Anisha Roy Rikhi Bose Jayabrata Bhaduri 27 217 0 30 Oct 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 41 643 0 29 Sep 2021
Hidden Unit Specialization in Layered Neural Networks: ReLU vs. Sigmoidal Activation Elisa Oostwal Michiel Straat Michael Biehl MLT 56 54 0 16 Oct 2019
Overparameterized Neural Networks Implement Associative Memory Adityanarayanan Radhakrishnan M. Belkin Caroline Uhler BDL 35 71 0 26 Sep 2019
Deep Learning for CSI Feedback Based on Superimposed Coding Chaojin Qing Bin Cai Qingyao Yang Jiafan Wang Chuan Huang 11 42 0 27 Jul 2019
Text Processing Like Humans Do: Visually Attacking and Shielding NLP Systems Steffen Eger Gözde Gül Sahin Andreas Rucklé Ji-Ung Lee Claudia Schulz Mohsen Mesgar Krishnkant Swarnkar Edwin Simpson Iryna Gurevych AAML 46 156 0 27 Mar 2019
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 258 13,368 0 25 Aug 2014