Magnitude and Angle Dynamics in Training Single ReLU Neurons

27 September 2022

Papers citing "Magnitude and Angle Dynamics in Training Single ReLU Neurons"

2 / 2 papers shown

Title
Don't Fear Peculiar Activation Functions: EUAF and Beyond Qianchao Wang Shijun Zhang Dong Zeng Zhaoheng Xie Hengtao Guo Feng-Lei Fan Tieyong Zeng 21 3 0 12 Jul 2024
Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding Zhengqing Wu Berfin Simsek Francois Ged ODL 32 0 0 08 Feb 2024