Noisy Natural Gradient as Variational Inference

v1v2 (latest)

Noisy Natural Gradient as Variational Inference

6 December 2017

Roger C. Grosse

ArXiv (abs)PDF HTML

Papers citing "Noisy Natural Gradient as Variational Inference"

4 / 104 papers shown

Title
Stochastic natural gradient descent draws posterior samples in function space Samuel L. Smith Daniel Duckworth Semon Rezchikov Quoc V. Le Jascha Narain Sohl-Dickstein BDL 85 6 0 25 Jun 2018
Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam Mohammad Emtiyaz Khan Didrik Nielsen Voot Tangkaratt Wu Lin Y. Gal Akash Srivastava ODL 194 271 0 13 Jun 2018
q-Neurons: Neuron Activations based on Stochastic Jackson's Derivative Operators Frank Nielsen Ke Sun 15 1 0 01 Jun 2018
Understanding Short-Horizon Bias in Stochastic Meta-Optimization Yuhuai Wu Mengye Ren Renjie Liao Roger C. Grosse 109 138 0 06 Mar 2018