TENGraD: Time-Efficient Natural Gradient Descent with Exact Fisher-Block Inversion

7 June 2021

Papers citing "TENGraD: Time-Efficient Natural Gradient Descent with Exact Fisher-Block Inversion"

5 / 5 papers shown

Title
Natural Gradient Methods: Perspectives, Efficient-Scalable Approximations, and Analysis Rajesh Shrestha ODL 16 4 0 06 Mar 2023
Scalable K-FAC Training for Deep Neural Networks with Distributed Preconditioning Lin Zhang S. Shi Wei Wang Bo-wen Li 28 10 0 30 Jun 2022
LAWS: Look Around and Warm-Start Natural Gradient Descent for Quantum Neural Networks Zeyi Tao Jindi Wu Qi Xia Qun Li 23 9 0 05 May 2022
A Mini-Block Fisher Method for Deep Neural Networks Achraf Bahamou D. Goldfarb Yi Ren ODL 32 9 0 08 Feb 2022
Understanding the Effects of Second-Order Approximations in Natural Policy Gradient Reinforcement Learning Brennan Gebotys Alexander Wong David A Clausi 16 2 0 22 Jan 2022