Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks

25 February 2016

Papers citing "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

50 / 957 papers shown

Title
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 25 29,969 0 01 Mar 2022
Bitwidth Heterogeneous Federated Learning with Progressive Weight Dequantization Jaehong Yoon Geondo Park Wonyong Jeong Sung Ju Hwang FedML 19 19 0 23 Feb 2022
Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network Abhinav Grover Philippe Nadeau C. Grebe Jonathan Kelly 19 9 0 19 Feb 2022
ST-MoE: Designing Stable and Transferable Sparse Expert Models Barret Zoph Irwan Bello Sameer Kumar Nan Du Yanping Huang J. Dean Noam M. Shazeer W. Fedus MoE 24 181 0 17 Feb 2022
Learning Smooth Neural Functions via Lipschitz Regularization Hsueh-Ti Derek Liu Francis Williams Alec Jacobson Sanja Fidler Or Litany 11 96 0 16 Feb 2022
Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations G. Shamir Dong Lin HAI OffRL 23 6 0 14 Feb 2022
Robust Training of Neural Networks Using Scale Invariant Architectures Zhiyuan Li Srinadh Bhojanapalli Manzil Zaheer Sashank J. Reddi Surinder Kumar 19 27 0 02 Feb 2022
PostGAN: A GAN-Based Post-Processor to Enhance the Quality of Coded Speech Srikanth Korse N. Pia Kishan Gupta Guillaume Fuchs 39 14 0 31 Jan 2022
Speckle-based optical cryptosystem and its application for human face recognition via deep learning Qi Zhao Huanhao Li Zhipeng Yu Chi Man Woo T. Zhong Shengfu Cheng Yuanjin Zheng Honglin Liu Jie Tian Puxiang Lai CVBM 6 23 0 26 Jan 2022
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape Devansh Bisla Jing Wang A. Choromańska 25 34 0 20 Jan 2022
A ConvNet for the 2020s Zhuang Liu Hanzi Mao Chaozheng Wu Christoph Feichtenhofer Trevor Darrell Saining Xie ViT 42 4,967 0 10 Jan 2022
BP-Net: Cuff-less, Calibration-free, and Non-invasive Blood Pressure Estimation via a Generic Deep Convolutional Architecture Soheil Zabihi E. Rahimian Fatemeh Marefat A. Asif P. Mohseni Arash Mohammadi OOD 6 1 0 31 Dec 2021
Artifact Reduction in Fundus Imaging using Cycle Consistent Adversarial Neural Networks S. Koushik Dr. K. G. Srinivasa GAN MedIm 9 0 0 25 Dec 2021
Robust Recommendation with Implicit Feedback via Eliminating the Effects of Unexpected Behaviors Jie Chen Lifen Jiang Chunmei Ma Huazhi Sun 17 0 0 21 Dec 2021
Improving Surrogate Gradient Learning in Spiking Neural Networks via Regularization and Normalization Nandan Meda 16 0 0 13 Dec 2021
Quality-Aware Multimodal Biometric Recognition Sobhan Soleymani Ali Dabouei Fariborz Taherkhani Seyed Mehdi Iranmanesh J. Dawson Nasser M. Nasrabadi CVBM 22 3 0 10 Dec 2021
Implicit Feature Refinement for Instance Segmentation Lufan Ma Tiancai Wang Bin Dong Jiangpeng Yan Xiu Li Xiangyu Zhang ISeg 17 5 0 09 Dec 2021
More layers! End-to-end regression and uncertainty on tabular data with deep learning Ivan Bondarenko OOD LMTD UQCV 17 4 0 07 Dec 2021
Parameter Efficient Deep Probabilistic Forecasting O. Sprangers Sebastian Schelter Maarten de Rijke BDL AI4TS 25 21 0 06 Dec 2021
A Daily Tourism Demand Prediction Framework Based on Multi-head Attention CNN: The Case of The Foreign Entrant in South Korea Dong-Keon Kim S. K. Shyn Donghee Kim Seungwoo Jang Kwangsu Kim AI4TS 8 6 0 01 Dec 2021
Adversarial Attacks Against Deep Generative Models on Data: A Survey Hui Sun Tianqing Zhu Zhiqiu Zhang Dawei Jin Wanlei Zhou AAML 37 42 0 01 Dec 2021
Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation Zechun Liu Kwang-Ting Cheng Dong Huang Eric P. Xing Zhiqiang Shen MQ 25 102 0 29 Nov 2021
ReAct: Out-of-distribution Detection With Rectified Activations Yiyou Sun Chuan Guo Yixuan Li OODD 19 454 0 24 Nov 2021
Bi-Discriminator Class-Conditional Tabular GAN Mohammad Esmaeilpour Nourhene Chaalia Adel Abusitta François-Xavier Devailly Wissem Maazoun P. Cardinal 8 12 0 12 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 73 83 0 08 Nov 2021
GraN-GAN: Piecewise Gradient Normalization for Generative Adversarial Networks Vineeth S. Bhaskara Tristan Aumentado-Armstrong Allan D. Jepson Alex Levinshtein GAN 30 5 0 04 Nov 2021
Scale-Aware Dynamic Network for Continuous-Scale Super-Resolution Hanlin Wu Ning Ni Li-bao Zhang SupR 25 4 0 29 Oct 2021
Is High Variance Unavoidable in RL? A Case Study in Continuous Control Johan Bjorck Carla P. Gomes Kilian Q. Weinberger 57 23 0 21 Oct 2021
Robust Semi-Supervised Classification using GANs with Self-Organizing Maps Ronald Fick P. Gader Alina Zare 17 0 0 19 Oct 2021
Chunked Autoregressive GAN for Conditional Waveform Synthesis Max Morrison Rithesh Kumar Kundan Kumar Prem Seetharaman Aaron Courville Yoshua Bengio GAN 36 68 0 19 Oct 2021
UniFed: A Unified Framework for Federated Learning on Non-IID Image Features Meirui Jiang Xiaoxiao Li Xiaofei Zhang Michael Kamp Qianming Dou FedML OOD 32 0 0 19 Oct 2021
A Riemannian Mean Field Formulation for Two-layer Neural Networks with Batch Normalization Chao Ma Lexing Ying MLT 14 2 0 17 Oct 2021
On the Security Risks of AutoML Ren Pang Zhaohan Xi S. Ji Xiapu Luo Ting Wang AAML 16 10 0 12 Oct 2021
MARVEL: Raster Manga Vectorization via Primitive-wise Deep Reinforcement Learning H. Su Jianwei Niu Xuefeng Liu Jiahe Cui Ji Wan AI4TS 15 1 0 10 Oct 2021
Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptation Shiqi Yang Yaxing Wang Joost van de Weijer Luis Herranz Shangling Jui TTA 31 238 0 08 Oct 2021
Speeding up Deep Model Training by Sharing Weights and Then Unsharing Shuo Yang Le Hou Xiaodan Song Qiang Liu Denny Zhou 110 9 0 08 Oct 2021
ParaDiS: Parallelly Distributable Slimmable Neural Networks A. Ozerov Anne Lambert S. Kumaraswamy UQCV MoE 24 1 0 06 Oct 2021
SSFL: Tackling Label Deficiency in Federated Learning via Personalized Self-Supervision Chaoyang He Zhengyu Yang Erum Mushtaq Sunwoo Lee Mahdi Soltanolkotabi A. Avestimehr FedML 98 36 0 06 Oct 2021
Improved architectures and training algorithms for deep operator networks Sifan Wang Hanwen Wang P. Perdikaris AI4CE 47 105 0 04 Oct 2021
A Novel Structured Natural Gradient Descent for Deep Learning Weihua Liu Xiabi Liu ODL 16 0 0 21 Sep 2021
AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks G. Bingham Risto Miikkulainen ODL 24 4 0 18 Sep 2021
Predicting the outcome of team movements -- Player time series analysis using fuzzy and deep methods for representation learning Omid Shokrollahi Bahman Rohani A. Nobakhti AI4TS 14 2 0 13 Sep 2021
Tensor Normalization and Full Distribution Training Wolfgang Fuhl OOD 19 4 0 06 Sep 2021
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization Yi Guo Huan Yuan Jianchao Tan Zhangyang Wang Sen Yang Ji Liu 20 46 0 06 Sep 2021
On-target Adaptation Dequan Wang Shaoteng Liu Sayna Ebrahimi Evan Shelhamer Trevor Darrell TTA 29 19 0 02 Sep 2021
Calibrating Class Activation Maps for Long-Tailed Visual Recognition Chi Zhang Guosheng Lin Lvlong Lai Henghui Ding Qingyao Wu 21 1 0 29 Aug 2021
Variational voxelwise rs-fMRI representation learning: Evaluation of sex, age, and neuropsychiatric signatures Eloy P. T. Geenjaar Tonya White Vince D. Calhoun 19 1 0 29 Aug 2021
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain Guangyao Chen Peixi Peng Li Ma Jia Li Lin Du Yonghong Tian AAML OOD 27 89 0 19 Aug 2021
Logit Attenuating Weight Normalization Aman Gupta R. Ramanath Jun Shi Anika Ramachandran Sirou Zhou Mingzhou Zhou S. Keerthi 32 1 0 12 Aug 2021
Out-of-Domain Generalization from a Single Source: An Uncertainty Quantification Approach Xi Peng Fengchun Qiao Long Zhao OOD 37 34 0 05 Aug 2021