On the impact of activation and normalization in obtaining isometric
embeddings at initialization
Neural Information Processing Systems (NeurIPS), 2023
Papers citing "On the impact of activation and normalization in obtaining isometric embeddings at initialization"
9 / 9 papers shown
Title |
|---|
 Emergence of Globally Attracting Fixed Points in Deep Neural Networks
With Nonlinear ActivationsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2024 |
 Towards Training Without Depth Limits: Batch Normalization Without
Gradient ExplosionInternational Conference on Learning Representations (ICLR), 2023 |
 Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and
Scaling LimitInternational Conference on Learning Representations (ICLR), 2023 |
 Feature Normalization Prevents Collapse of Non-contrastive Learning DynamicsNeural Computation (Neural Comput.), 2023 |
