Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units

16 March 2016

Papers citing "Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units"

50 / 62 papers shown

Title
Analytic Convolutional Layer: A Step to Analytic Neural Network Jingmao Cui Donglai Tao Linmi Tao Ruiyang Liu Yu Cheng 31 0 0 03 Jul 2024
Fast TRAC: A Parameter-Free Optimizer for Lifelong Reinforcement Learning Aneesh Muppidi Zhiyu Zhang Heng Yang 34 4 0 26 May 2024
Hidden Synergy: $L_1$ Weight Normalization and 1-Path-Norm Regularization Aditya Biswas 41 0 0 29 Apr 2024
Directions of Curvature as an Explanation for Loss of Plasticity Alex Lewandowski Haruto Tanaka Dale Schuurmans Marlos C. Machado 19 5 0 30 Nov 2023
Maintaining Plasticity in Continual Learning via Regenerative Regularization Saurabh Kumar Henrik Marklund Benjamin Van Roy CLL KELM 34 16 0 23 Aug 2023
Learn to Enhance the Negative Information in Convolutional Neural Network Zhicheng Cai Chenglei Peng Qiu Shen 16 0 0 18 Jun 2023
Bringing regularized optimal transport to lightspeed: a splitting method adapted for GPUs Jacob Lindbäck Zesen Wang Mikael Johansson OT 40 1 0 29 May 2023
A Comparative Study of Face Detection Algorithms for Masked Face Detection Sahel Mohammad Iqbal Danush Shekar Subhankar Mishra CVBM 23 0 0 18 May 2023
Densely Connected $G$ -invariant Deep Neural Networks with Signed Permutation Representations Devanshu Agrawal James Ostrowski AI4CE 36 0 0 08 Mar 2023
Towards NeuroAI: Introducing Neuronal Diversity into Artificial Neural Networks Fenglei Fan Yingxin Li Hanchuan Peng T. Zeng Fei-Yue Wang 25 5 0 23 Jan 2023
Deep Diversity-Enhanced Feature Representation of Hyperspectral Images Jinhui Hou Zhiyu Zhu Junhui Hou Hui Liu Huanqiang Zeng Deyu Meng 18 6 0 15 Jan 2023
Learnable Heterogeneous Convolution: Learning both topology and strength Rongzhen Zhao Zhenzhi Wu Qikun Zhang 29 6 0 13 Jan 2023
Retinex Image Enhancement Based on Sequential Decomposition With a Plug-and-Play Framework Tingting Wu Wei Wu Ying Yang Fenglei Fan T. Zeng 25 10 0 11 Oct 2022
Dynamical Isometry for Residual Networks Advait Gadhikar R. Burkholz ODL AI4CE 40 2 0 05 Oct 2022
FaceTopoNet: Facial Expression Recognition using Face Topology Learning Mojtaba Kolahdouzi Alireza Sepas-Moghaddam Ali Etemad 3DH CVBM 27 7 0 13 Sep 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directions Ameya Dilip Jagtap George Karniadakis AI4CE 37 71 0 06 Sep 2022
On the Number of Regions of Piecewise Linear Neural Networks Alexis Goujon Arian Etemadi M. Unser 44 13 0 17 Jun 2022
Most Activation Functions Can Win the Lottery Without Excessive Depth R. Burkholz MLT 71 18 0 04 May 2022
Update Compression for Deep Neural Networks on the Edge Bo Chen A. Bakhshi Gustavo E. A. P. A. Batista Brian Ng Tat-Jun Chin 24 17 0 09 Mar 2022
Activation Functions: Dive into an optimal activation function V. Bansal FAtt 21 2 0 24 Feb 2022
Training Thinner and Deeper Neural Networks: Jumpstart Regularization Carles Roger Riera Molina Camilo Rey Thiago Serra Eloi Puertas O. Pujol 27 4 0 30 Jan 2022
RMNet: Equivalently Removing Residual Connection from Networks Fanxu Meng Hao Cheng Jia-Xin Zhuang Ke Li Xing Sun 23 11 0 01 Nov 2021
Channel redundancy and overlap in convolutional neural networks with channel-wise NNK graphs David Bonet Antonio Ortega Javier Ruiz-Hidalgo Sarath Shekkizhar GNN 33 7 0 18 Oct 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 41 641 0 29 Sep 2021
Real Time Monocular Vehicle Velocity Estimation using Synthetic Data Robert McCraith Lukás Neumann Andrea Vedaldi 26 3 0 16 Sep 2021
Existence, Stability and Scalability of Orthogonal Convolutional Neural Networks E. M. Achour Franccois Malgouyres Franck Mamalet 16 20 0 12 Aug 2021
Shortest-Path Constrained Reinforcement Learning for Sparse Reward Tasks Sungryull Sohn Sungtae Lee Jongwook Choi H. V. Seijen Mehdi Fatemi Honglak Lee 111 3 0 13 Jul 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 274 2,603 0 04 May 2021
Learning with Hyperspherical Uniformity Weiyang Liu Rongmei Lin Zhen Liu Li Xiong Bernhard Schölkopf Adrian Weller 37 35 0 02 Mar 2021
Exploring Emotion Features and Fusion Strategies for Audio-Video Emotion Recognition Hengshun Zhou Debin Meng Yuanyuan Zhang Xiaojiang Peng Jun Du Kai Wang Yu Qiao 39 64 0 27 Dec 2020
Unknown Presentation Attack Detection against Rational Attackers Ali Khodabakhsh Zahid Akhtar AAML 29 4 0 04 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 34 79 0 17 Sep 2020
The VISIONE Video Search System: Exploiting Off-the-Shelf Text Search Engines for Large-Scale Video Retrieval Giuseppe Amato Paolo Bolettieri F. Carrara Franca Debole Fabrizio Falchi Claudio Gennaro Lucia Vadicamo Claudio Vairo 20 17 0 06 Aug 2020
Rethinking Depthwise Separable Convolutions: How Intra-Kernel Correlations Lead to Improved MobileNets D. Haase Manuel Amthor 20 132 0 30 Mar 2020
TAdam: A Robust Stochastic Gradient Optimizer Wendyam Eric Lionel Ilboudo Taisuke Kobayashi Kenji Sugimoto ODL 16 12 0 29 Feb 2020
Natural-Logarithm-Rectified Activation Function in Convolutional Neural Networks Yang Liu Jianpeng Zhang Chao Gao Jinghua Qu Lixin Ji FAtt 13 23 0 10 Aug 2019
Recent Advances in Deep Learning for Object Detection Xiongwei Wu Doyen Sahoo S. Hoi VLM ObjD 32 794 0 10 Aug 2019
Deep learning in ultrasound imaging Ruud J. G. van Sloun Regev Cohen Yonina C. Eldar 20 226 0 05 Jul 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 69 542 0 04 Jul 2019
A Constructive Approach for One-Shot Training of Neural Networks Using Hypercube-Based Topological Coverings W. B. Daniel Enoch Yeung 18 2 0 09 Jan 2019
Parameter-Free Spatial Attention Network for Person Re-Identification Haoran Wang Yue Fan Zexin Wang L. Jiao Bernt Schiele 3DPC 32 75 0 29 Nov 2018
Deep Learning for Generic Object Detection: A Survey Li Liu Wanli Ouyang Xiaogang Wang Paul Fieguth Jie Chen Xinwang Liu M. Pietikäinen ObjD VLM OOD 72 2,420 0 06 Sep 2018
Object Detection with Deep Learning: A Review Zhong-Qiu Zhao Peng Zheng Shou-tao Xu Xindong Wu ObjD 42 3,951 0 15 Jul 2018
Magnetic Resonance Spectroscopy Quantification using Deep Learning Nima Hatami M. Sdika H. Ratiney 13 41 0 19 Jun 2018
Parsimonious Bayesian deep networks Mingyuan Zhou BDL 13 8 0 22 May 2018
Speaker-independent raw waveform model for glottal excitation Lauri Juvela Vassilis Tsiaras Bajibabu Bollepalli Manu Airaksinen Junichi Yamagishi P. Alku 11 39 0 25 Apr 2018
Deep Facial Expression Recognition: A Survey Shan Li Weihong Deng 151 1,280 0 23 Apr 2018
Improving GANs Using Optimal Transport Tim Salimans Han Zhang Alec Radford Dimitris N. Metaxas OT GAN 16 322 0 15 Mar 2018
Exponential Discriminative Metric Embedding in Deep Learning Bowen Wu Zhangling Chen Jun Wang Hua-Ming Wu 33 10 0 07 Mar 2018
L2-Nonexpansive Neural Networks Haifeng Qian M. Wegman 22 74 0 22 Feb 2018