Eigenvalue Corrected Noisy Natural Gradient

30 November 2018

Papers citing "Eigenvalue Corrected Noisy Natural Gradient"

13 / 13 papers shown

Title
Distributional Training Data Attribution Bruno Mlodozeniec Isaac Reid Sam Power David M. Krueger Murat Erdogdu Richard E. Turner Roger B. Grosse TDI OOD 43 0 0 15 Jun 2025
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 242 1,177 0 07 Jul 2021
KAISA: An Adaptive Second-Order Optimizer Framework for Deep Neural Networks J. G. Pauloski Qi Huang Lei Huang Shivaram Venkataraman Kyle Chard Ian Foster Zhao-jie Zhang 86 29 0 04 Jul 2021
Eigenvalue-corrected Natural Gradient Based on a New Approximation Kai-Xin Gao Xiaolei Liu Zheng-Hai Huang Min Wang Shuangling Wang Zidong Wang Dachuan Xu F. Yu ODL 46 7 0 27 Nov 2020
A Trace-restricted Kronecker-Factored Approximation to Natural Gradient Kai-Xin Gao Xiaolei Liu Zheng-Hai Huang Min Wang Zidong Wang Dachuan Xu F. Yu 65 12 0 21 Nov 2020
A statistical theory of cold posteriors in deep neural networks Laurence Aitchison UQCV BDL 90 70 0 13 Aug 2020
Global inducing point variational posteriors for Bayesian neural networks and deep Gaussian processes Sebastian W. Ober Laurence Aitchison BDL 116 60 0 17 May 2020
Measuring Uncertainty through Bayesian Learning of Deep Neural Network Structure Zhijie Deng Yucen Luo Jun Zhu Bo Zhang UQCV BDL 43 2 0 22 Nov 2019
Dissecting Non-Vacuous Generalization Bounds based on the Mean-Field Approximation Konstantinos Pitas 75 8 0 06 Sep 2019
Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model Guodong Zhang Lala Li Zachary Nado James Martens Sushant Sachdeva George E. Dahl Christopher J. Shallue Roger C. Grosse 122 154 0 09 Jul 2019
The Functional Neural Process Christos Louizos Xiahan Shi Klamer Schutte Max Welling BDL 82 77 0 19 Jun 2019
EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis Chaoqi Wang Roger C. Grosse Sanja Fidler Guodong Zhang 80 124 0 15 May 2019
Functional Variational Bayesian Neural Networks Shengyang Sun Guodong Zhang Jiaxin Shi Roger C. Grosse BDL 71 240 0 14 Mar 2019