Derivatives of Stochastic Gradient Descent

24 May 2024

Papers citing "Derivatives of Stochastic Gradient Descent"

7 / 7 papers shown

Title
One-step differentiation of iterative algorithms Jérôme Bolte Edouard Pauwels Samuel Vaiter 64 13 0 23 May 2023
Stochastic Approximation Beyond Gradient for Signal Processing and Machine Learning Aymeric Dieuleveut G. Fort Eric Moulines Hoi-To Wai 51 12 0 22 Feb 2023
A framework for bilevel optimization that enables stochastic and global variance reduction algorithms Mathieu Dagréou Pierre Ablin Samuel Vaiter Thomas Moreau 131 95 0 31 Jan 2022
Amortized Implicit Differentiation for Stochastic Bilevel Optimization Michael Arbel Julien Mairal 103 58 0 29 Nov 2021
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 99 716 0 13 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 284 11,681 0 09 Mar 2017
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 122 405 0 06 Mar 2017