Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks

25 February 2016

Papers citing "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

50 / 957 papers shown

Title
UNIF: United Neural Implicit Functions for Clothed Human Reconstruction and Animation Shenhan Qian Jiale Xu Ziwei Liu Liqian Ma Shenghua Gao 3DH 21 12 0 20 Jul 2022
Moment Centralization based Gradient Descent Optimizers for Convolutional Neural Networks Sumanth Sadu S. Dubey S. Sreeja ODL 19 1 0 19 Jul 2022
Improving Deep Neural Network Random Initialization Through Neuronal Rewiring Leonardo F. S. Scabini B. De Baets Odemir M. Bruno AI4CE 23 6 0 17 Jul 2022
Riemannian Natural Gradient Methods Jiang Hu Ruicheng Ao Anthony Man-Cho So Minghan Yang Zaiwen Wen 19 10 0 15 Jul 2022
Progressively-connected Light Field Network for Efficient View Synthesis Peng Wang Yuan-Bin Liu Guying Lin Jiatao Gu Lingjie Liu Taku Komura Wenping Wang 3DH 36 9 0 10 Jul 2022
Cross-receptive Focused Inference Network for Lightweight Image Super-Resolution Wenjie Li Juncheng Li Guangwei Gao Jiantao Zhou Jian Yang Guo-Jun Qi SupR 24 30 0 06 Jul 2022
$L_2$ BN: Enhancing Batch Normalization by Equalizing the $L_2$ Norms of Features Zhennan Wang Kehan Li Runyi Yu Yian Zhao Pengchong Qiao Chang-rui Liu Fan Xu Xiangyang Ji Guoli Song Jie Chen 14 0 0 06 Jul 2022
Meta-Learning over Time for Destination Prediction Tasks M. Tenzer Z. Rasheed Khurram Hassan-Shafique Nuno Vasconcelos AI4TS 17 6 0 29 Jun 2022
Short-Term Plasticity Neurons Learning to Learn and Forget Hector Garcia Rodriguez Qinghai Guo Timoleon Moraitis 13 12 0 28 Jun 2022
Reducing Annotation Need in Self-Explanatory Models for Lung Nodule Diagnosis Jiahao Lu Chong Yin Oswin Krause Kenny Erleben M. B. Nielsen S. Darkner MedIm 16 3 0 27 Jun 2022
SAQAM: Spatial Audio Quality Assessment Metric Pranay Manocha Anurag Kumar Buye Xu Anjali Menon I. D. Gebru V. Ithapu P. Calamia 7 9 0 24 Jun 2022
Balancing Discriminability and Transferability for Source-Free Domain Adaptation Jogendra Nath Kundu Akshay Ravindra Kulkarni Suvaansh Bhambri Deepesh Mehta Shreyas Kulkarni Varun Jampani R. Venkatesh Babu TTA 19 89 0 16 Jun 2022
Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction Kaifeng Lyu Zhiyuan Li Sanjeev Arora FAtt 35 69 0 14 Jun 2022
On the explainable properties of 1-Lipschitz Neural Networks: An Optimal Transport Perspective M. Serrurier Franck Mamalet Thomas Fel Louis Bethune Thibaut Boissin AAML FAtt 22 4 0 14 Jun 2022
Confidence Score for Source-Free Unsupervised Domain Adaptation Jonghyun Lee Dahuin Jung Junho Yim Sung-Hoon Yoon TTA 13 70 0 14 Jun 2022
SDQ: Stochastic Differentiable Quantization with Mixed Precision Xijie Huang Zhiqiang Shen Shichao Li Zechun Liu Xianghong Hu Jeffry Wicaksana Eric P. Xing Kwang-Ting Cheng MQ 16 33 0 09 Jun 2022
A Unification Framework for Euclidean and Hyperbolic Graph Neural Networks Mehrdad Khatir Nurendra Choudhary Sutanay Choudhury Khushbu Agarwal Chandan K. Reddy 17 3 0 09 Jun 2022
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 21 71 0 08 Jun 2022
Canonical convolutional neural networks Lokesh Veeramacheneni Moritz Wolter Reinhard Klein Jochen Garcke 13 3 0 03 Jun 2022
StyleTTS: A Style-Based Generative Model for Natural and Diverse Text-to-Speech Synthesis Yinghao Aaron Li Cong Han N. Mesgarani 33 38 0 30 May 2022
Batch Normalization Is Blind to the First and Second Derivatives of the Loss Zhanpeng Zhou Wen Shen Huixin Chen Ling Tang Quanshi Zhang 28 2 0 30 May 2022
On Bridging the Gap between Mean Field and Finite Width in Deep Random Neural Networks with Batch Normalization Amir Joudaki Hadi Daneshmand Francis R. Bach AI4CE 19 2 0 25 May 2022
Kernel Normalized Convolutional Networks Reza Nasirigerdeh Reihaneh Torkzadehmahani Daniel Rueckert Georgios Kaissis 13 2 0 20 May 2022
FairNorm: Fair and Fast Graph Neural Network Training Öykü Deniz Köse Yanning Shen AI4CE 11 4 0 20 May 2022
Effect of Batch Normalization on Noise Resistant Property of Deep Learning Models Omobayode Fagbohungbe Lijun Qian 24 10 0 15 May 2022
A Tale of Two Flows: Cooperative Learning of Langevin Flow and Normalizing Flow Toward Energy-Based Model Jianwen Xie Y. Zhu J. Li Ping Li 21 50 0 13 May 2022
$α$ -GAN: Convergence and Estimation Guarantees Gowtham R. Kurri Monica Welfert Tyler Sypherd Lalitha Sankar GAN 82 7 0 12 May 2022
Learned Vertex Descent: A New Direction for 3D Human Model Fitting Enric Corona Gerard Pons-Moll Guillem Alenyà Francesc Moreno-Noguer 3DH 22 39 0 12 May 2022
Attracting and Dispersing: A Simple Approach for Source-free Domain Adaptation Shiqi Yang Yaxing Wang Kai Wang Shangling Jui Joost van de Weijer 24 131 0 09 May 2022
Impact of L1 Batch Normalization on Analog Noise Resistant Property of Deep Learning Models Omobayode Fagbohungbe Lijun Qian 27 0 0 07 May 2022
Learning Sequential Latent Variable Models from Multimodal Time Series Data Oliver Limoyo Trevor Ablett Jonathan Kelly 17 5 0 21 Apr 2022
Contrastive Test-Time Adaptation Dian Chen Dequan Wang Trevor Darrell Sayna Ebrahimi TTA 14 254 0 21 Apr 2022
FenceNet: Fine-grained Footwork Recognition in Fencing Kevin Zhu Alexander Wong J. McPhee 19 17 0 20 Apr 2022
BEHM-GAN: Bandwidth Extension of Historical Music using Generative Adversarial Networks Eloi Moliner Vesa Valimaki 16 18 0 13 Apr 2022
Attention U-Net as a surrogate model for groundwater prediction M. L. Taccari J. Nuttall Xiaohui Chen He-Nan Wang B. Minnema P. Jimack AI4CE 24 16 0 09 Apr 2022
A Survey on Dropout Methods and Experimental Verification in Recommendation Y. Li Weizhi Ma C. L. Philip Chen M. Zhang Yiqun Liu Shaoping Ma Yue Yang 30 9 0 05 Apr 2022
Online Convolutional Re-parameterization Mu Hu Junyi Feng Jiashen Hua Baisheng Lai Jianqiang Huang Xiaojin Gong Xiansheng Hua 11 26 0 02 Apr 2022
Testing Feedforward Neural Networks Training Programs Houssem Ben Braiek Foutse Khomh AAML 11 14 0 01 Apr 2022
Quantized GAN for Complex Music Generation from Dance Videos Ye Zhu Kyle Olszewski Yuehua Wu Panos Achlioptas Menglei Chai Yan Yan Sergey Tulyakov MGen 25 44 0 01 Apr 2022
Logit Normalization for Long-tail Object Detection Liang Zhao Yao Teng Limin Wang 26 10 0 31 Mar 2022
Zero-shot meta-learning for small-scale data from human subjects Julie Jiang Kristina Lerman Emilio Ferrara 14 1 0 29 Mar 2022
Long-Tailed Recognition via Weight Balancing Shaden Alshammari Yu-xiong Wang Deva Ramanan Shu Kong MQ 17 140 0 27 Mar 2022
Sylph: A Hypernetwork Framework for Incremental Few-shot Object Detection Li Yin Juan-Manuel Perez-Rua Kevin J Liang ObjD 14 35 0 25 Mar 2022
CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training Haitian Zheng Zhe-nan Lin Jingwan Lu Scott D. Cohen Eli Shechtman Connelly Barnes Jianming Zhang N. Xu Sohrab Amirghodsi Jiebo Luo GAN 38 53 0 22 Mar 2022
A survey on GANs for computer vision: Recent research, analysis and taxonomy Guillermo Iglesias Edgar Talavera Alberto Díaz-Álvarez EGVM AI4TS 13 58 0 21 Mar 2022
Neural Predictor for Black-Box Adversarial Attacks on Speech Recognition Marie Biolková Bac Nguyen AAML 17 2 0 18 Mar 2022
On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis Dominik Rivoir Isabel Funke Stefanie Speidel 19 15 0 15 Mar 2022
Source-free Video Domain Adaptation by Learning Temporal Consistency for Action Recognition Yuecong Xu Jianfei Yang Haozhi Cao Keyu Wu Min-man Wu Zhenghua Chen TTA 21 31 0 09 Mar 2022
Model-agnostic out-of-distribution detection using combined statistical tests Federico Bergamin Pierre-Alexandre Mattei Jakob Drachmann Havtorn Hugo Senetaire Hugo Schmutz Lars Maaløe Søren Hauberg J. Frellsen OODD 15 18 0 02 Mar 2022
A Multi-Scale Time-Frequency Spectrogram Discriminator for GAN-based Non-Autoregressive TTS Haohan Guo Hui Lu Xixin Wu H. Meng 86 7 0 02 Mar 2022