Towards Understanding the Importance of Shortcut Connections in Residual Networks

10 September 2019

Papers citing "Towards Understanding the Importance of Shortcut Connections in Residual Networks"

7 / 7 papers shown

Title
Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks Jim Zhao Sidak Pal Singh Aurélien Lucchi AI4CE 41 0 0 04 Nov 2024
Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron Weihang Xu S. Du 29 16 0 20 Feb 2023
SML:Enhance the Network Smoothness with Skip Meta Logit for CTR Prediction Wenlong Deng Lang Lang Z. Liu B. Liu 21 0 0 09 Oct 2022
Nearly Minimax Algorithms for Linear Bandits with Shared Representation Jiaqi Yang Qi Lei Jason D. Lee S. Du 35 16 0 29 Mar 2022
A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth Yiping Lu Chao Ma Yulong Lu Jianfeng Lu Lexing Ying MLT 31 78 0 11 Mar 2020
On a Sparse Shortcut Topology of Artificial Neural Networks Fenglei Fan Dayang Wang Hengtao Guo Qikui Zhu Pingkun Yan Ge Wang Hengyong Yu 38 21 0 22 Nov 2018
Representing smooth functions as compositions of near-identity functions with implications for deep network optimization Peter L. Bartlett S. Evans Philip M. Long 68 31 0 13 Apr 2018