Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1709.09603
Cited By
v1
v2
v3 (latest)
Riemannian approach to batch normalization
27 September 2017
Minhyung Cho
Jaehyung Lee
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Riemannian approach to batch normalization"
50 / 63 papers shown
Can Training Dynamics of Scale-Invariant Neural Networks Be Explained by the Thermodynamics of an Ideal Gas?
Ildus Sadrtdinov
E. Lobacheva
Ivan Klimov
Mikhail I. Katsnelson
Dmitry Vetrov
AI4CE
180
0
0
10 Nov 2025
Scale Equivariant Graph Metanetworks
Ioannis Kalogeropoulos
Giorgos Bouritsas
Yannis Panagakis
392
15
0
15 Jun 2024
Learning-Rate-Free Stochastic Optimization over Riemannian Manifolds
Daniel Dodd
Louis Sharrock
Christopher Nemeth
257
1
0
04 Jun 2024
Federated Learning on Riemannian Manifolds with Differential Privacy
Zhenwei Huang
Wen Huang
Pratik Jawanpuria
Bamdev Mishra
FedML
188
7
0
15 Apr 2024
Continuous-time Riemannian SGD and SVRG Flows on Wasserstein Probabilistic Space
Mingyang Yi
Bohan Wang
340
0
0
24 Jan 2024
Accelerating hyperbolic t-SNE
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2024
Martin Skrodzki
Hunter van Geffen
Nicolas F. Chaves-de-Plaza
T. Höllt
E. Eisemann
Klaus Hildebrandt
246
8
0
23 Jan 2024
Block-Diagonal Orthogonal Relation and Matrix Entity for Knowledge Graph Embedding
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Yihua Zhu
Hidetoshi Shimodaira
273
1
0
11 Jan 2024
Analyzing and Improving the Training Dynamics of Diffusion Models
Computer Vision and Pattern Recognition (CVPR), 2023
Tero Karras
M. Aittala
J. Lehtinen
Janne Hellsten
Timo Aila
S. Laine
413
334
0
05 Dec 2023
A survey of manifold learning and its applications for multimedia
International Journal of Signal Processing Systems (IJSPS), 2023
Hannes Fassold
186
1
0
08 Sep 2023
Combining Primal and Dual Representations in Deep Restricted Kernel Machines Classifiers
F. Tonin
Panagiotis Patrinos
Johan A. K. Suykens
200
0
0
12 Jun 2023
Exploring the Complexity of Deep Neural Networks through Functional Equivalence
International Conference on Machine Learning (ICML), 2023
Guohao Shen
372
6
0
19 May 2023
A Block Coordinate Descent Method for Nonsmooth Composite Optimization under Orthogonality Constraints
Ganzhao Yuan
185
4
0
07 Apr 2023
Decentralized Riemannian natural gradient methods with Kronecker-product approximations
Jiang Hu
Kangkang Deng
Na Li
Shijie Zhao
171
9
0
16 Mar 2023
Faster Riemannian Newton-type Optimization by Subsampling and Cubic Regularization
Machine-mediated learning (ML), 2023
Yian Deng
Tingting Mu
204
3
0
22 Feb 2023
Auto-Encoding Goodness of Fit
International Conference on Learning Representations (ICLR), 2022
A. Palmer
Zhiyi Chi
Derek Aguiar
J. Bi
304
1
0
12 Oct 2022
MAtt: A Manifold Attention Network for EEG Decoding
Neural Information Processing Systems (NeurIPS), 2022
Yue Pan
Jing-Lun Chou
Chunshan Wei
149
63
0
05 Oct 2022
Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes
Neural Information Processing Systems (NeurIPS), 2022
M. Kodryan
E. Lobacheva
M. Nakhodnov
Dmitry Vetrov
290
19
0
08 Sep 2022
Riemannian Natural Gradient Methods
Jiang Hu
Ruicheng Ao
Anthony Man-Cho So
Minghan Yang
Zaiwen Wen
179
14
0
15 Jul 2022
Contextual Gradient Scaling for Few-Shot Learning
IEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2021
Sang Hyuk Lee
Seunghyun Lee
B. Song
135
8
0
20 Oct 2021
A Riemannian Mean Field Formulation for Two-layer Neural Networks with Batch Normalization
Chao Ma
Lexing Ying
MLT
94
2
0
17 Oct 2021
Tensor Normalization and Full Distribution Training
Wolfgang Fuhl
OOD
207
5
0
06 Sep 2021
Large-Scale Differentially Private BERT
Rohan Anil
Badih Ghazi
Vineet Gupta
Ravi Kumar
Pasin Manurangsi
239
148
0
03 Aug 2021
Batch Normalization Preconditioning for Neural Network Training
Susanna Lange
Kyle E. Helfrich
Qiang Ye
204
14
0
02 Aug 2021
On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay
Neural Information Processing Systems (NeurIPS), 2021
E. Lobacheva
M. Kodryan
Nadezhda Chirkova
A. Malinin
Dmitry Vetrov
290
27
0
29 Jun 2021
Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence
Neural Information Processing Systems (NeurIPS), 2021
A. Labatie
Dominic Masters
Zach Eaton-Rosen
Carlo Luschi
374
21
0
07 Jun 2021
Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks
Neural Information Processing Systems (NeurIPS), 2021
Hidenori Tanaka
D. Kunin
351
39
0
06 May 2021
Weight Rescaling: Effective and Robust Regularization for Deep Neural Networks with Batch Normalization
Ziquan Liu
Yufei Cui
Jia Wan
Yushun Mao
Antoni B. Chan
249
2
0
06 Feb 2021
BN-invariant sharpness regularizes the training model to better generalization
International Joint Conference on Artificial Intelligence (IJCAI), 2019
Mingyang Yi
Huishuai Zhang
Wei Chen
Zhi-Ming Ma
Tie-Yan Liu
183
3
0
08 Jan 2021
Accelerating Training of Batch Normalization: A Manifold Perspective
Conference on Uncertainty in Artificial Intelligence (UAI), 2021
Mingyang Yi
285
3
0
08 Jan 2021
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
D. Kunin
Javier Sagastuy-Breña
Surya Ganguli
Daniel L. K. Yamins
Hidenori Tanaka
343
89
0
08 Dec 2020
Batch Group Normalization
Xiao-Yun Zhou
Jiacheng Sun
Nanyang Ye
Xu Lan
Qijun Luo
Bolin Lai
P. Esperança
Guang-Zhong Yang
Zhenguo Li
264
19
0
04 Dec 2020
Neural Teleportation
M. Armenta
Thierry Judge
Nathan Painchaud
Youssef Skandarani
Carl Lemaire
Gabriel Gibeau Sanchez
Philippe Spino
Pierre-Marc Jodoin
336
20
0
02 Dec 2020
Adaptive and Momentum Methods on Manifolds Through Trivializations
Mario Lezcano Casado
112
8
0
09 Oct 2020
Neural Random Projection: From the Initial Task To the Input Similarity Problem
A. Savushkin
Nikita Benkovich
Dmitry Golubev
117
0
0
09 Oct 2020
Weight and Gradient Centralization in Deep Neural Networks
International Conference on Artificial Neural Networks (ICANN), 2020
Wolfgang Fuhl
Enkelejda Kasneci
ODL
234
20
0
02 Oct 2020
Group Whitening: Balancing Learning Efficiency and Representational Capacity
Lei Huang
Yi Zhou
Li Liu
Fan Zhu
Ling Shao
388
24
0
28 Sep 2020
Normalization Techniques in Training DNNs: Methodology, Analysis and Application
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020
Lei Huang
Jie Qin
Yi Zhou
Fan Zhu
Li Liu
Ling Shao
AI4CE
347
380
0
27 Sep 2020
Optimizing Mode Connectivity via Neuron Alignment
Neural Information Processing Systems (NeurIPS), 2020
N. Joseph Tatro
Pin-Yu Chen
Payel Das
Igor Melnyk
P. Sattigeri
Rongjie Lai
MoMe
678
93
0
05 Sep 2020
Mix Dimension in Poincaré Geometry for 3D Skeleton-based Action Recognition
ACM Multimedia (ACM MM), 2020
Wei Peng
Jingang Shi
Zhaoqiang Xia
Guoying Zhao
GNN
183
63
0
30 Jul 2020
Spherical Perspective on Learning with Normalization Layers
Neurocomputing (Neurocomputing), 2020
Simon Roburin
Yann de Mont-Marin
Andrei Bursuc
Renaud Marlet
P. Pérez
Mathieu Aubry
167
7
0
23 Jun 2020
New Interpretations of Normalization Methods in Deep Learning
Jiacheng Sun
Xiangyong Cao
Hanwen Liang
Weiran Huang
Zewei Chen
Zhenguo Li
176
38
0
16 Jun 2020
Spherical Motion Dynamics: Learning Dynamics of Neural Network with Normalization, Weight Decay, and SGD
Ruosi Wan
Zhanxing Zhu
Xiangyu Zhang
Jian Sun
190
11
0
15 Jun 2020
Structure preserving deep learning
E. Celledoni
Matthias Joachim Ehrhardt
Christian Etmann
R. McLachlan
B. Owren
Carola-Bibiane Schönlieb
Ferdia Sherry
AI4CE
217
47
0
05 Jun 2020
Gradient Centralization: A New Optimization Technique for Deep Neural Networks
European Conference on Computer Vision (ECCV), 2020
Hongwei Yong
Jianqiang Huang
Xiansheng Hua
Lei Zhang
ODL
288
216
0
03 Apr 2020
An Investigation into the Stochasticity of Batch Whitening
Computer Vision and Pattern Recognition (CVPR), 2020
Lei Huang
Lei Zhao
Yi Zhou
Fan Zhu
Li Liu
Ling Shao
211
22
0
27 Mar 2020
Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transform
International Conference on Learning Representations (ICLR), 2020
Jun Li
Fuxin Li
S. Todorovic
203
119
0
04 Feb 2020
An Internal Covariate Shift Bounding Algorithm for Deep Neural Networks by Unitizing Layers' Outputs
Computer Vision and Pattern Recognition (CVPR), 2020
You Huang
Yuanlong Yu
153
8
0
09 Jan 2020
An Exponential Learning Rate Schedule for Deep Learning
International Conference on Learning Representations (ICLR), 2019
Zhiyuan Li
Sanjeev Arora
242
260
0
16 Oct 2019
Boosting CNN beyond Label in Inverse Problems
Eunju Cha
Jaeduck Jang
Junho Lee
Eunha Lee
J. C. Ye
SSL
UQCV
131
8
0
18 Jun 2019
Four Things Everyone Should Know to Improve Batch Normalization
International Conference on Learning Representations (ICLR), 2019
Cecilia Summers
M. Dinneen
187
56
0
09 Jun 2019
1
2
Next
