The Geometry of Sign Gradient Descent

The Geometry of Sign Gradient Descent

19 February 2020

Fabian Pedregosa

Nicolas Le Roux

ArXiv (abs)PDF HTML

Papers citing "The Geometry of Sign Gradient Descent"

9 / 9 papers shown

Title
$Stacey: Promoting Stochastic Steepest Descent via Accelerated $\ell_p$-Smooth Nonconvex Optimization$ Stacey: Promoting Stochastic Steepest Descent via Accelerated $\ell_p$ -Smooth Nonconvex Optimization Xinyu Luo Cedar Site Bai Bolian Li Petros Drineas Ruqi Zhang Brian Bullins 28 0 0 07 Jun 2025
LoTA-QAF: Lossless Ternary Adaptation for Quantization-Aware Fine-Tuning Junyu Chen Junzhuo Li Zhen Peng Wenjie Wang Yuxiang Ren Long Shi Xuming Hu MQ 23 0 0 24 May 2025
Faster Acceleration for Steepest Descent Site Bai Brian Bullins ODL 95 1 0 28 Sep 2024
Deconstructing What Makes a Good Optimizer for Language Models Rosie Zhao Depen Morwani David Brandfonbrener Nikhil Vyas Sham Kakade 142 25 0 10 Jul 2024
Nonlinear gradient mappings and stochastic optimization: A general framework with applications to heavy-tail noise D. Jakovetić Dragana Bajović Anit Kumar Sahu S. Kar Nemanja Milošević Dusan Stamenkovic 57 14 0 06 Apr 2022
Revealing and Protecting Labels in Distributed Training Trung D. Q. Dang Om Thakkar Swaroop Indra Ramaswamy Rajiv Mathews Peter Chin Franccoise Beaufays 38 26 0 31 Oct 2021
Hard to Forget: Poisoning Attacks on Certified Machine Unlearning Neil G. Marchant Benjamin I. P. Rubinstein Scott Alfeld MU AAML 95 72 0 17 Sep 2021
On Faster Convergence of Scaled Sign Gradient Descent Xiuxian Li Kuo-Yi Lin Li Li Yiguang Hong Jie-bin Chen ODL 64 11 0 04 Sep 2021
Online Training of Spiking Recurrent Neural Networks with Phase-Change Memory Synapses Yiğit Demirağ Charlotte Frenkel Melika Payvand Giacomo Indiveri 85 17 0 04 Aug 2021