An Improved Empirical Fisher Approximation for Natural Gradient Descent

An Improved Empirical Fisher Approximation for Natural Gradient Descent

10 June 2024

Philip Woodland

Papers citing "An Improved Empirical Fisher Approximation for Natural Gradient Descent"

7 / 7 papers shown

Title
Learning Optimal Prompt Ensemble for Multi-source Visual Prompt Transfer Enming Zhang Liwen Cao Yanru Wu Zijie Zhao Guan Wang Yang Li 45 0 0 09 Apr 2025
FedVSR: Towards Model-Agnostic Federated Learning in Video Super-Resolution Ali Mollaahmadi Dehaghi Hossein KhademSohi Reza Razavi Steve Drew Mohammad Moshirpour FedML 53 0 0 17 Mar 2025
Position: Curvature Matrices Should Be Democratized via Linear Operators Felix Dangel Runa Eschenhagen Weronika Ormaniec Andres Fernandez Lukas Tatzel Agustinus Kristiadi 48 3 0 31 Jan 2025
ISAAC Newton: Input-based Approximate Curvature for Newton's Method Felix Petersen Tobias Sutter Christian Borgelt Dongsung Huh Hilde Kuehne Yuekai Sun Oliver Deussen ODL 23 5 0 01 May 2023
Gradient Descent on Neurons and its Link to Approximate Second-Order Optimization Frederik Benzing ODL 35 23 0 28 Jan 2022
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 278 3,784 0 18 Apr 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018