Batch Normalization Preconditioning for Neural Network Training

v1v2 (latest)

Batch Normalization Preconditioning for Neural Network Training

2 August 2021

Kyle E. Helfrich

ArXiv (abs)PDF HTML

Papers citing "Batch Normalization Preconditioning for Neural Network Training"

4 / 4 papers shown

Title
Designing Preconditioners for SGD: Local Conditioning, Noise Floors, and Basin Stability Mitchell Scott Tianshi Xu Z. Tang Alexandra Pichette-Emmons Qiang Ye Y. Saad Yuanzhe Xi AI4CE 193 0 0 24 Nov 2025
Preconditioning for Accelerated Gradient Descent Optimization and Regularization Qiang Ye AI4CE 97 0 0 30 Sep 2024
fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functions Alireza Afzal Aghaei 145 75 0 11 Jun 2024
Understanding the Generalization Benefit of Normalization Layers: Sharpness ReductionNeural Information Processing Systems (NeurIPS), 2022 Kaifeng Lyu Zhiyuan Li Sanjeev Arora FAtt 231 86 0 14 Jun 2022