A Comprehensive and Modularized Statistical Framework for Gradient Norm
Equality in Deep Neural Networks

A Comprehensive and Modularized Statistical Framework for Gradient Norm Equality in Deep Neural Networks

1 January 2020

Lei Deng

Papers citing "A Comprehensive and Modularized Statistical Framework for Gradient Norm Equality in Deep Neural Networks"

9 / 9 papers shown

Title
SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms Xingrun Xing Zheng Zhang Ziyi Ni Shitao Xiao Yiming Ju Siqi Fan Yequan Wang Jiajun Zhang Guoqi Li 32 7 0 05 Jun 2024
Deep Directly-Trained Spiking Neural Networks for Object Detection Qiaoyi Su Yuhong Chou Yifan Hu Jianing Li Shijie Mei Ziyang Zhang Guoqiu Li ObjD 11 65 0 21 Jul 2023
Spike-driven Transformer Man Yao Jiakui Hu Zhaokun Zhou Liuliang Yuan Yonghong Tian Boxing Xu Guoqi Li 21 109 0 04 Jul 2023
Probabilistic Modeling: Proving the Lottery Ticket Hypothesis in Spiking Neural Network Man Yao Yu-Liang Chou Guangshe Zhao Xiawu Zheng Yonghong Tian Boxing Xu Guoqi Li 28 4 0 20 May 2023
Attention Spiking Neural Networks Man Yao Guangshe Zhao Hengyu Zhang Yifan Hu Lei Deng Yonghong Tian Bo Xu Guoqi Li 25 157 0 28 Sep 2022
Advancing Spiking Neural Networks towards Deep Residual Learning Yifan Hu Lei Deng Yujie Wu Man Yao Guoqi Li 16 78 0 15 Dec 2021
Towards Efficient Full 8-bit Integer DNN Online Training on Resource-limited Devices without Batch Normalization Yukuan Yang Xiaowei Chi Lei Deng Tianyi Yan Feng Gao Guoqi Li MQ 16 6 0 27 May 2021
Going Deeper With Directly-Trained Larger Spiking Neural Networks Hanle Zheng Yujie Wu Lei Deng Yifan Hu Guoqi Li 6 495 0 29 Oct 2020
Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks Lechao Xiao Yasaman Bahri Jascha Narain Sohl-Dickstein S. Schoenholz Jeffrey Pennington 220 347 0 14 Jun 2018