OverSketched Newton: Fast Convex Optimization for Serverless Systems

v1v2v3 (latest)

OverSketched Newton: Fast Convex Optimization for Serverless Systems

21 March 2019

Michael W. Mahoney

Kannan Ramchandran

ArXiv (abs)PDF HTML

Papers citing "OverSketched Newton: Fast Convex Optimization for Serverless Systems"

14 / 14 papers shown

Title
Randomized Polar Codes for Anytime Distributed Machine LearningIEEE Journal on Selected Areas in Information Theory (JSAIT), 2023 Burak Bartan Mert Pilanci 95 4 0 01 Sep 2023
Iterative Sketching for Secure Coded RegressionIEEE Journal on Selected Areas in Information Theory (JSAIT), 2023 Neophytos Charalambides Hessam Mahdavifar Mert Pilanci Alfred Hero 200 3 0 08 Aug 2023
Gradient Coding with Iterative Block Leverage Score SamplingIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2023 Neophytos Charalambides Mert Pilanci Alfred Hero 257 4 0 06 Aug 2023
Secure Linear MDS Coded Matrix InversionAllerton Conference on Communication, Control, and Computing (Allerton), 2022 Neophytos Charalambides Mert Pilanci Alfred Hero 147 5 0 13 Jul 2022
Evaluating Serverless Architecture for Big Data Enterprise Applications Aimer Bhat Madhumonti Roy H. Park 90 5 0 26 Oct 2021
Towards Demystifying Serverless Machine Learning Training Jiawei Jiang Shaoduo Gan Yue Liu Fanlin Wang Gustavo Alonso Ana Klimovic Ankit Singla Wentao Wu Ce Zhang 127 136 0 17 May 2021
LocalNewton: Reducing Communication Bottleneck for Distributed Learning Vipul Gupta Avishek Ghosh Michal Derezinski Rajiv Khanna Kannan Ramchandran Michael W. Mahoney 168 13 0 16 May 2021
BEAR: Sketching BFGS Algorithm for Ultra-High Dimensional Feature Selection in Sublinear MemoryMathematical and Scientific Machine Learning (MSML), 2020 Amirali Aghazadeh Vipul Gupta Alex DeWeese O. O. Koyluoglu Kannan Ramchandran 130 2 0 26 Oct 2020
Utility-based Resource Allocation and Pricing for Serverless Computing Vipul Gupta Soham R. Phade T. Courtade Kannan Ramchandran 128 12 0 18 Aug 2020
Distributed Newton Can Communicate Less and Resist Byzantine Workers Avishek Ghosh R. Maity A. Mazumdar FedML 160 35 0 15 Jun 2020
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine LearningAAAI Conference on Artificial Intelligence (AAAI), 2020 Z. Yao A. Gholami Sheng Shen Mustafa Mustafa Kurt Keutzer Michael W. Mahoney ODL 364 328 0 01 Jun 2020
Communication-Efficient Gradient Coding for Straggler Mitigation in Distributed Learning S. Kadhe O. O. Koyluoglu Kannan Ramchandran 139 14 0 14 May 2020
Serverless Straggler Mitigation using Local Error-Correcting Codes Vipul Gupta Dominic Carrano Yaoqing Yang Vaishaal Shankar T. Courtade Kannan Ramchandran 120 9 0 21 Jan 2020
Large batch size training of neural networks with adversarial training and second-order information Z. Yao A. Gholami Daiyaan Arfeen Richard Liaw Alfons Kemper Kurt Keutzer Michael W. Mahoney ODL 221 46 0 02 Oct 2018