Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks

25 February 2016

Papers citing "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

50 / 957 papers shown

Title
RepMode: Learning to Re-parameterize Diverse Experts for Subcellular Structure Prediction Donghao Zhou Chunbin Gu Junde Xu Furui Liu Qiong Wang Guangyong Chen Pheng-Ann Heng MoE 13 4 0 20 Dec 2022
Framewise WaveGAN: High Speed Adversarial Vocoder in Time Domain with Very Low Computational Complexity Ahmed Mustafa J. Valin Jan Büthe Paris Smaragdis Mike Goodwin 17 4 0 08 Dec 2022
3D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Models Gimin Nam Mariem Khlifi Andrew Rodriguez Alberto Tono Linqi Zhou Paul Guerrero DiffM 23 68 0 01 Dec 2022
NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and Animation Ziyan Wang Giljoo Nam Tuur Stuyck Stephen Lombardi Chen Cao Jason M. Saragih Michael Zollhoefer Jessica Hodgins Christoph Lassner 3DH 25 19 0 01 Dec 2022
CHIMLE: Conditional Hierarchical IMLE for Multimodal Conditional Image Synthesis Shichong Peng Alireza Moazeni Ke Li DiffM 25 2 0 25 Nov 2022
TrustGAN: Training safe and trustworthy deep learning models through generative adversarial networks Hélion Marie du Mas des Bourboux 19 1 0 25 Nov 2022
Data-Adaptive Discriminative Feature Localization with Statistically Guaranteed Interpretation Ben Dai Xiaotong Shen Lingzhi Chen Chunlin Li Wei Pan FAtt 11 1 0 18 Nov 2022
Path Independent Equilibrium Models Can Better Exploit Test-Time Computation Cem Anil Ashwini Pokle Kaiqu Liang Johannes Treutlein Yuhuai Wu Shaojie Bai Zico Kolter Roger C. Grosse 27 16 0 18 Nov 2022
Data-driven modeling of Landau damping by physics-informed neural networks Yilan Qin Jiayu Ma M. Jiang C. Dong H. Fu Liang Wang Wen-jie Cheng Yaqiu Jin PINN AI4CE 13 7 0 02 Nov 2022
SADT: Combining Sharpness-Aware Minimization with Self-Distillation for Improved Model Generalization Masud An Nur Islam Fahim Jani Boutellier 32 0 0 01 Nov 2022
Audio Time-Scale Modification with Temporal Compressing Networks Ernie Chu Ju-Ting Chen Chia-Ping Chen 12 0 0 31 Oct 2022
A comprehensive study on self-supervised distillation for speaker representation learning Zhengyang Chen Yao Qian Bing Han Y. Qian Michael Zeng SSL 31 16 0 28 Oct 2022
Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANs Reo Yoneyama Ryuichi Yamamoto Kentaro Tachibana 18 4 0 28 Oct 2022
High Fidelity Neural Audio Compression Alexandre Défossez Jade Copet Gabriel Synnaeve Yossi Adi 11 595 0 24 Oct 2022
Federated Learning and Meta Learning: Approaches, Applications, and Directions Xiaonan Liu Yansha Deng Arumugam Nallanathan M. Bennis 46 32 0 24 Oct 2022
Investigating self-supervised, weakly supervised and fully supervised training approaches for multi-domain automatic speech recognition: a study on Bangladeshi Bangla Ahnaf Mozib Samin M. Kobir Md. Mushtaq Shahriyar Rafee M. F. Ahmed Mehedi Hasan Partha Ghosh Shafkat Kibria M. S. Rahman SSL 18 0 0 24 Oct 2022
HesScale: Scalable Computation of Hessian Diagonals Mohamed Elsayed A. R. Mahmood 14 7 0 20 Oct 2022
DisC-VC: Disentangled and F0-Controllable Neural Voice Conversion Chihiro Watanabe Hirokazu Kameoka DRL 24 0 0 20 Oct 2022
ARAH: Animatable Volume Rendering of Articulated Human SDFs Shaofei Wang Katja Schwarz Andreas Geiger Siyu Tang 3DH 24 130 0 18 Oct 2022
What Makes Convolutional Models Great on Long Sequence Modeling? Yuhong Li Tianle Cai Yi Zhang De-huai Chen Debadeepta Dey VLM 34 95 0 17 Oct 2022
Equivariance-aware Architectural Optimization of Neural Networks Kaitlin Maile Dennis G. Wilson Patrick Forré AI4CE 39 9 0 11 Oct 2022
Mining Causality from Continuous-time Dynamics Models: An Application to Tsunami Forecasting Fan Wu Sanghyun Hong Dobsub Rim Noseong Park Kookjin Lee AI4TS 29 1 0 10 Oct 2022
On skip connections and normalisation layers in deep optimisation L. MacDonald Jack Valmadre Hemanth Saratchandran Simon Lucey ODL 19 1 0 10 Oct 2022
Single Image Super-Resolution Based on Capsule Neural Networks George Correa de Araujo Hélio Pedrini SupR 21 0 0 06 Oct 2022
PathProx: A Proximal Gradient Algorithm for Weight Decay Regularized Deep Neural Networks Liu Yang Jifan Zhang Joseph Shenouda Dimitris Papailiopoulos Kangwook Lee Robert D. Nowak 48 1 0 06 Oct 2022
Dynamical Isometry for Residual Networks Advait Gadhikar R. Burkholz ODL AI4CE 32 2 0 05 Oct 2022
Random Weight Factorization Improves the Training of Continuous Neural Representations Sifan Wang Hanwen Wang Jacob H. Seidman P. Perdikaris 21 9 0 03 Oct 2022
3D UX-Net: A Large Kernel Volumetric ConvNet Modernizing Hierarchical Transformer for Medical Image Segmentation Ho Hin Lee Shunxing Bao Yuankai Huo Bennett A. Landman OOD MedIm 54 133 0 29 Sep 2022
Batch Normalization Explained Randall Balestriero Richard G. Baraniuk AAML 28 16 0 29 Sep 2022
Breaking Time Invariance: Assorted-Time Normalization for RNNs Cole Pospisil Vasily Zadorozhnyy Qiang Ye 14 0 0 28 Sep 2022
3D Neural Sculpting (3DNS): Editing Neural Signed Distance Functions Petros Tzathas Petros Maragos A. Roussos 13 6 0 28 Sep 2022
Image Classification using Sequence of Pixels Gajraj Kuldeep 6 0 0 23 Sep 2022
Amortized Variational Inference: A Systematic Review Ankush Ganguly Sanjana Jain Ukrit Watchareeruetai 20 14 0 22 Sep 2022
An Initial study on Birdsong Re-synthesis Using Neural Vocoders Rhythm Bhatia Tomi Kinnunen 13 1 0 21 Sep 2022
Batch Layer Normalization, A new normalization layer for CNNs and RNN A. Ziaee Erion cCano 6 11 0 19 Sep 2022
Causes of Catastrophic Forgetting in Class-Incremental Semantic Segmentation Tobias Kalb Jürgen Beyerer CLL 25 8 0 16 Sep 2022
TEDL: A Two-stage Evidential Deep Learning Method for Classification Uncertainty Quantification Xue Li Wei Shen Denis Xavier Charles UQCV EDL 30 3 0 12 Sep 2022
Motion Robust High-Speed Light-Weighted Object Detection With Event Camera Bing-Quan Liu Chang Xu Wen Yang Huai Yu Lei Yu 25 35 0 24 Aug 2022
Evaluating Continual Test-Time Adaptation for Contextual and Semantic Domain Shifts Tommie Kerssies Mert Kilickaya Joaquin Vanschoren OOD TTA 28 7 0 18 Aug 2022
Orthogonal Gated Recurrent Unit with Neumann-Cayley Transformation Edison Mucllari Vasily Zadorozhnyy Cole Pospisil D. Nguyen Qiang Ye 25 3 0 12 Aug 2022
Cross Section Doppler Broadening prediction using Physically Informed Deep Neural Networks Arthur Pignet L. Leal Vaibhav Jaiswal 29 0 0 11 Aug 2022
Leveraging Endo- and Exo-Temporal Regularization for Black-box Video Domain Adaptation Yuecong Xu Jianfei Yang Haozhi Cao Min-man Wu Xiaoli Li Lihua Xie Zhenghua Chen 36 4 0 10 Aug 2022
Physics-informed Deep Super-resolution for Spatiotemporal Data Pu Ren Chengping Rao Yang Liu Zihan Ma Qi Wang Jianxin Wang Hao-Lun Sun 24 13 0 02 Aug 2022
Improving the Trainability of Deep Neural Networks through Layerwise Batch-Entropy Regularization David Peer Bart Keulen Sebastian Stabinger J. Piater A. Rodríguez-Sánchez 29 6 0 01 Aug 2022
Minimal Neural Atlas: Parameterizing Complex Surfaces with Minimal Charts and Distortion Weng Fei Low Gim Hee Lee 22 6 0 29 Jul 2022
Training a universal instance segmentation network for live cell images of various cell types and imaging modalities Tianqi Guo Yin Wang Luis Solorio J. Allebach SSeg OOD 17 3 0 28 Jul 2022
Neural Strands: Learning Hair Geometry and Appearance from Multi-View Images R. Rosu Shunsuke Saito Ziyan Wang Chenglei Wu Sven Behnke Giljoo Nam 3DH 25 35 0 28 Jul 2022
Concurrent Subsidiary Supervision for Unsupervised Source-Free Domain Adaptation Jogendra Nath Kundu Suvaansh Bhambri Akshay Ravindra Kulkarni Hiran Sarkar Varun Jampani R. Venkatesh Babu 36 26 0 27 Jul 2022
Equivariance and Invariance Inductive Bias for Learning from Insufficient Data Tan Wang Qianru Sun Sugiri Pranata J. Karlekar Hanwang Zhang SSL 31 19 0 25 Jul 2022
Respecting Time Series Properties Makes Deep Time Series Forecasting Perfect Li Shen Yuning Wei Yangzhu Wang AI4TS 14 8 0 22 Jul 2022