Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks

25 February 2016

Papers citing "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

50 / 957 papers shown

Title
BAE-Net: A Low complexity and high fidelity Bandwidth-Adaptive neural network for speech super-resolution Guochen Yu Xiguang Zheng Nan Li Runqiang Han C. Zheng Chen Zhang Chao Zhou Qi Huang Bin Yu 59 5 0 21 Dec 2023
Relightable Gaussian Codec Avatars Shunsuke Saito Gabriel Schwartz Tomas Simon Junxuan Li Giljoo Nam 3DGS 31 68 0 06 Dec 2023
Unknown Sample Discovery for Source Free Open Set Domain Adaptation C. S. Jahan Andreas E. Savakis TTA 13 2 0 05 Dec 2023
Analyzing and Improving the Training Dynamics of Diffusion Models Tero Karras M. Aittala J. Lehtinen Janne Hellsten Timo Aila S. Laine 28 153 0 05 Dec 2023
BCN: Batch Channel Normalization for Image Classification Afifa Khaled Chao Li Jia Ning Kun He 15 6 0 01 Dec 2023
Improving Normalization with the James-Stein Estimator Seyedalireza Khoshsirat Chandra Kambhamettu 18 5 0 01 Dec 2023
Weight Norm Control I. Loshchilov 16 1 0 19 Nov 2023
Versatile Medical Image Segmentation Learned from Multi-Source Datasets via Model Self-Disambiguation Xiaoyang Chen Hao Zheng Yuemeng Li Yuncong Ma Liang Ma Hongming Li Yong-Xian Fan 28 7 0 17 Nov 2023
Tabular Few-Shot Generalization Across Heterogeneous Feature Spaces Max Zhu Katarzyna Kobalczyk Andrija Petrović Mladen Nikolic M. Schaar Boris Delibasic Petro Lio 25 2 0 16 Nov 2023
RepQ: Generalizing Quantization-Aware Training for Re-Parametrized Architectures Anastasiia Prutianova Alexey Zaytsev Chung-Kuei Lee Fengyu Sun Ivan Koryakovskiy MQ 10 0 0 09 Nov 2023
Improved weight initialization for deep and narrow feedforward neural network Hyunwoo Lee Yunho Kim Seungyeop Yang Hayoung Choi ODL 12 3 0 07 Nov 2023
Visual-information-driven model for crowd simulation using temporal convolutional network Xuanwen Liang Eric Wai-Ming Lee 30 1 0 06 Nov 2023
Neural Collage Transfer: Artistic Reconstruction via Material Manipulation Ganghun Lee Minji Kim Yunsu Lee M. Lee Byoung-Tak Zhang DiffM 19 2 0 03 Nov 2023
TorchDEQ: A Library for Deep Equilibrium Models Zhengyang Geng J. Zico Kolter VLM 52 12 0 28 Oct 2023
Addressing GAN Training Instabilities via Tunable Classification Losses Monica Welfert Gowtham R. Kurri Kyle Otstot Lalitha Sankar 25 8 0 27 Oct 2023
Instance-wise Linearization of Neural Network for Model Interpretation Zhimin Li Shusen Liu B. Kailkhura Timo Bremer Valerio Pascucci MILM FAtt 10 0 0 25 Oct 2023
Enhancing Accuracy-Privacy Trade-off in Differentially Private Split Learning Ngoc Duy Pham K. Phan Naveen Chilamkurti 19 3 0 22 Oct 2023
Learning to Generate Parameters of ConvNets for Unseen Image Data Shiye Wang Kaituo Feng Changsheng Li Ye Yuan Guoren Wang 23 1 0 18 Oct 2023
Zipformer: A faster and better encoder for automatic speech recognition Zengwei Yao Liyong Guo Xiaoyu Yang Wei Kang Fangjun Kuang Yifan Yang Zengrui Jin Long Lin Daniel Povey VLM 25 64 0 17 Oct 2023
RefConv: Re-parameterized Refocusing Convolution for Powerful ConvNets Zhicheng Cai Xiaohan Ding Qiu Shen Xun Cao 25 18 0 16 Oct 2023
Understanding, Predicting and Better Resolving Q-Value Divergence in Offline-RL Yang Yue Rui Lu Bingyi Kang Shiji Song Gao Huang OffRL 27 16 0 06 Oct 2023
Neural Field Representations of Articulated Objects for Robotic Manipulation Planning Phillip Grote Joaquim Ortiz de Haro Marc Toussaint Ozgur S. Oguz 198 1 0 14 Sep 2023
EGIC: Enhanced Low-Bit-Rate Generative Image Compression Guided by Semantic Segmentation Nikolai Korber Eduard Kromer Andreas Siebert S. Hauke Daniel Mueller-Gritschneder Björn Schuller DiffM VLM 18 4 0 06 Sep 2023
Adaptive Model Pruning and Personalization for Federated Learning over Wireless Networks Xiaonan Liu T. Ratnarajah M. Sellathurai Yonina C. Eldar 29 4 0 04 Sep 2023
Trust your Good Friends: Source-free Domain Adaptation by Reciprocal Neighborhood Clustering Shiqi Yang Yaxing Wang Joost van de Weijer Luis Herranz Shangling Jui Jian Yang TTA 28 11 0 01 Sep 2023
SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models Xin Zhang Dong Zhang Shimin Li Yaqian Zhou Xipeng Qiu 25 61 0 31 Aug 2023
A2Q: Accumulator-Aware Quantization with Guaranteed Overflow Avoidance Ian Colbert Alessandro Pappalardo Jakoba Petri-Koenig MQ 8 9 0 25 Aug 2023
Understanding the Role of Layer Normalization in Label-Skewed Federated Learning Guojun Zhang Mahdi Beitollahi Alex Bie Xi Chen FedML MLT AI4CE 22 1 0 18 Aug 2023
An Expert's Guide to Training Physics-informed Neural Networks Sifan Wang Shyam Sankaran Hanwen Wang P. Perdikaris PINN 28 96 0 16 Aug 2023
Consistency Regularization for Generalizable Source-free Domain Adaptation Longxiang Tang Kai Li Chunming He Yulun Zhang Xiu Li TTA 30 15 0 03 Aug 2023
Investigating and Improving Latent Density Segmentation Models for Aleatoric Uncertainty Quantification in Medical Imaging M. Valiuddin Christiaan G. A. Viviers R. V. Sloun Peter H. N. de With Fons van der Sommen UQCV 26 2 0 31 Jul 2023
Convex Geometry of ReLU-layers, Injectivity on the Ball and Local Reconstruction Daniel Haider Martin Ehler Péter Balázs 8 5 0 18 Jul 2023
A Novel Application of Conditional Normalizing Flows: Stellar Age Inference with Gyrochronology P. Van-Lane J. Speagle S. Douglas 14 1 0 17 Jul 2023
GBT: Two-stage transformer framework for non-stationary time series forecasting Li Shen Yuning Wei Yangzhu Wang AI4TS 19 23 0 17 Jul 2023
FourierHandFlow: Neural 4D Hand Representation Using Fourier Query Flow Jihyun Lee Junbong Jang Donghwan Kim Minhyuk Sung Tae-Kyun Kim 3DH 19 4 0 16 Jul 2023
Single Domain Generalization via Normalised Cross-correlation Based Convolutions Weiqin Chuah Ruwan Tennakoon R. Hoseinnezhad David Suter A. Bab-Hadiashar OOD 22 3 0 12 Jul 2023
Leveraging Variational Autoencoders for Parameterized MMSE Estimation Michael Baur B. Fesl Wolfgang Utschick 11 8 0 11 Jul 2023
Hyperspherical Embedding for Point Cloud Completion Junming Zhang Haomeng Zhang Ram Vasudevan Matthew Johnson-Roberson 3DPC 11 2 0 11 Jul 2023
VINECS: Video-based Neural Character Skinning Zhouyingcheng Liao Vladislav Golyanik Marc Habermann Christian Theobalt 3DH 16 3 0 03 Jul 2023
Residual-based attention and connection to information bottleneck theory in PINNs Sokratis J. Anagnostopoulos Juan Diego Toscano Nikos Stergiopulos George Karniadakis 17 20 0 01 Jul 2023
Spectral Batch Normalization: Normalization in the Frequency Domain Rinor Cakaj Jens Mehnert Bin Yang 16 2 0 29 Jun 2023
Weight Compander: A Simple Weight Reparameterization for Regularization Rinor Cakaj Jens Mehnert B. Yang 12 1 0 29 Jun 2023
Large-scale unsupervised audio pre-training for video-to-speech synthesis Triantafyllos Kefalas Yannis Panagakis M. Pantic VGen 29 3 0 27 Jun 2023
The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks Yuan Cao Difan Zou Yuan-Fang Li Quanquan Gu MLT 29 5 0 20 Jun 2023
FDNet: Focal Decomposed Network for Efficient, Robust and Practical Time Series Forecasting Li Shen Yuning Wei Yangzhu Wang Huaxin Qiu OOD AI4TS 13 7 0 19 Jun 2023
Group Orthogonalization Regularization For Vision Models Adaptation and Robustness Yoav Kurtz Noga Bar Raja Giryes 24 0 0 16 Jun 2023
Understanding Optimization of Deep Learning via Jacobian Matrix and Lipschitz Constant Xianbiao Qi Jianan Wang Lei Zhang 13 0 0 15 Jun 2023
FalconNet: Factorization for the Light-weight ConvNets Zhicheng Cai Qiu Shen 21 11 0 10 Jun 2023
Latent Phrase Matching for Dysarthric Speech Colin S. Lea Dianna Yee Jaya Narain Zifang Huang Lauren Tooley Jeffrey P. Bigham Leah Findlater 19 4 0 08 Jun 2023
On the Design Fundamentals of Diffusion Models: A Survey Ziyi Chang G. Koulieris Hubert P. H. Shum DiffM 29 53 0 07 Jun 2023