Distributed estimation of the inverse Hessian by determinantal averaging

28 May 2019

Papers citing "Distributed estimation of the inverse Hessian by determinantal averaging"

10 / 10 papers shown

Title
FedSSO: A Federated Server-Side Second-Order Optimization Algorithm Xinteng Ma Renyi Bao Jinpeng Jiang Yang Liu Arthur Jiang Junhua Yan Xin Liu Zhisong Pan FedML 32 6 0 20 Jun 2022
Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches Michal Derezinski 55 5 0 06 Jun 2022
Hessian Averaging in Stochastic Newton Methods Achieves Superlinear Convergence Sen Na Michal Derezinski Michael W. Mahoney 27 16 0 20 Apr 2022
SHED: A Newton-type algorithm for federated learning based on incremental Hessian eigenvector sharing Nicolò Dal Fabbro S. Dey M. Rossi Luca Schenato FedML 29 14 0 11 Feb 2022
Newton-LESS: Sparsification without Trade-offs for the Sketched Newton Update Michal Derezinski Jonathan Lacotte Mert Pilanci Michael W. Mahoney 40 26 0 15 Jul 2021
Sparse sketches with small inversion bias Michal Derezinski Zhenyu Liao Yan Sun Michael W. Mahoney 23 21 0 21 Nov 2020
Precise expressions for random projections: Low-rank approximation and randomized Newton Michal Derezinski Feynman T. Liang Zhenyu A. Liao Michael W. Mahoney 34 23 0 18 Jun 2020
Determinantal Point Processes in Randomized Numerical Linear Algebra Michal Derezinski Michael W. Mahoney 34 77 0 07 May 2020
Exact expressions for double descent and implicit regularization via surrogate random design Michal Derezinski Feynman T. Liang Michael W. Mahoney 27 77 0 10 Dec 2019
Reverse iterative volume sampling for linear regression Michal Derezinski Manfred K. Warmuth 49 43 0 06 Jun 2018