v1v2v3 (latest)

SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives

Neural Information Processing Systems (NeurIPS), 2014

1 July 2014

Papers citing "SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives"

50 / 878 papers shown

Title
Sharper Rates for Separable Minimax and Finite Sum Optimization via Primal-Dual Extragradient MethodsAnnual Conference Computational Learning Theory (COLT), 2022 Yujia Jin Aaron Sidford Kevin Tian 177 33 0 09 Feb 2022
Nesterov Accelerated Shuffling Gradient Method for Convex OptimizationInternational Conference on Machine Learning (ICML), 2022 Trang H. Tran K. Scheinberg Lam M. Nguyen 332 13 0 07 Feb 2022
Finite-Sum Optimization: A New Perspective for Convergence to a Global Solution Lam M. Nguyen Trang H. Tran Marten van Dijk 234 3 0 07 Feb 2022
Variance reduced stochastic optimization over directed graphs with row and column stochastic weightsAsilomar Conference on Signals, Systems and Computers (ACSSC), 2022 Muhammad I. Qureshi Ran Xin S. Kar U. Khan 99 5 0 07 Feb 2022
Distributed Learning With Sparsified Gradient DifferencesIEEE Journal on Selected Topics in Signal Processing (IEEE JSTSP), 2022 Yicheng Chen Rick S. Blum Martin Takáč Brian M. Sadler 218 16 0 05 Feb 2022
Decentralized Stochastic Variance Reduced Extragradient Method Luo Luo Haishan Ye 303 7 0 01 Feb 2022
L-SVRG and L-Katyusha with Adaptive Sampling Boxin Zhao Boxiang Lyu Mladen Kolar 366 3 0 31 Jan 2022
Adaptive Accelerated (Extra-)Gradient Methods with Variance ReductionInternational Conference on Machine Learning (ICML), 2022 Zijian Liu Ta Duy Nguyen Alina Ene Huy Le Nguyen 197 6 0 28 Jan 2022
A dual approach for federated learning Zhenan Fan Huang Fang M. Friedlander FedML 135 3 0 26 Jan 2022
Optimal variance-reduced stochastic approximation in Banach spaces Wenlong Mou K. Khamaru Martin J. Wainwright Peter L. Bartlett Sai Li 233 10 0 21 Jan 2022
Quasi-Newton acceleration of EM and MM algorithms via Broyden $'$ s methodJournal of Computational And Graphical Statistics (JCGS), 2022 Medha Agarwal Jason Xu 108 2 0 15 Jan 2022
Partial Model Averaging in Federated Learning: Performance Guarantees and BenefitsNeurocomputing (Neurocomputing), 2022 Sunwoo Lee Anit Kumar Sahu Chaoyang He Salman Avestimehr FedML 146 22 0 11 Jan 2022
Adaptive Client Sampling in Federated Learning via Online Learning with Bandit Feedback Boxin Zhao Lingxiao Wang Mladen Kolar Ziqi Liu Qing Cui Jun Zhou Chaochao Chen FedML 591 12 0 28 Dec 2021
Accelerated and instance-optimal policy evaluation with linear function approximationSIAM Journal on Mathematics of Data Science (SIMODS), 2021 Tianjiao Li Guanghui Lan A. Pananjady OffRL 195 16 0 24 Dec 2021
Faster Rates for Compressed Federated Learning with Client-Variance ReductionSIAM Journal on Mathematics of Data Science (SIMODS), 2021 Haoyu Zhao Konstantin Burlachenko Zhize Li Peter Richtárik FedML 357 19 0 24 Dec 2021
Decentralized Stochastic Proximal Gradient Descent with Variance Reduction over Time-varying Networks Xuanjie Li Yuedong Xu Jessie Hui Wang Xin Wang John C. S. Lui 172 6 0 20 Dec 2021
LoSAC: An Efficient Local Stochastic Average Control Method for Federated Optimization Huiming Chen Huandong Wang Quanming Yao Yong Li Depeng Jin Qiang Yang FedML 137 6 0 15 Dec 2021
Federated Nearest Neighbor Classification with a Colony of Fruit-Flies: With Supplement Parikshit Ram Kaushik Sinha FedML 151 5 0 14 Dec 2021
A Continuous-time Stochastic Gradient Descent Method for Continuous Data Kexin Jin J. Latz Chenguang Liu Carola-Bibiane Schönlieb 187 9 0 07 Dec 2021
Training Structured Neural Networks Through Manifold Identification and Variance ReductionInternational Conference on Learning Representations (ICLR), 2021 Zih-Syuan Huang Ching-pei Lee AAML 236 10 0 05 Dec 2021
DSAG: A mixed synchronous-asynchronous iterative method for straggler-resilient learningIEEE Transactions on Communications (IEEE Trans. Commun.), 2021 A. Severinson E. Rosnes S. E. Rouayheb Alexandre Graell i Amat 195 2 0 27 Nov 2021
Random-reshuffled SARAH does not need a full gradient computationsOptimization Letters (Optim. Lett.), 2021 Aleksandr Beznosikov Martin Takáč 241 11 0 26 Nov 2021
Distributed Policy Gradient with Variance Reduction in Multi-Agent Reinforcement Learning Xiaoxiao Zhao Jinlong Lei Li Li Jie-bin Chen OffRL 239 4 0 25 Nov 2021
Variance Reduction in Deep Learning: More Momentum is All You Need Lionel Tondji S. Kashubin Moustapha Cissé ODL 163 2 0 23 Nov 2021
Bolstering Stochastic Gradient Descent with Model BuildingTOP - An Official Journal of the Spanish Society of Statistics and Operations Research (TOP), 2021 Ş. Birbil Özgür Martin Gönenç Onay Figen Oztoprak ODL 312 1 0 13 Nov 2021
Linear Speedup in Personalized Collaborative Learning El Mahdi Chayti Sai Praneeth Karimireddy Sebastian U. Stich Nicolas Flammarion Martin Jaggi FedML 418 14 0 10 Nov 2021
Nearly Optimal Linear Convergence of Stochastic Primal-Dual Methods for Linear Programming Haihao Lu Jinwen Yang 252 6 0 10 Nov 2021
DVS: Deep Visibility Series and its Application in Construction Cost Index Forecasting Tianxiang Zhan Yuanpeng He Hanwen Li Fuyuan Xiao AI4TS 26 0 0 07 Nov 2021
AGGLIO: Global Optimization for Locally Convex Functions Debojyoti Dey B. Mukhoty Purushottam Kar 172 2 0 06 Nov 2021
Federated Expectation Maximization with heterogeneity mitigation and variance reduction Hadrien Hendrikx G. Fort Eric Moulines Geneviève Robin FedML 253 7 0 03 Nov 2021
Federated Semi-Supervised Learning with Class Distribution Mismatch Zhiguo Wang Xintong Wang Tian Ding Tsung-Hui Chang FedML 195 15 0 29 Oct 2021
Projection-Free Algorithm for Stochastic Bi-level OptimizationIEEE Transactions on Signal Processing (IEEE TSP), 2021 Zeeshan Akhtar Amrit Singh Bedi Srujan Teja Thomdapu K. Rajawat 329 16 0 22 Oct 2021
Utilizing Redundancy in Cost Functions for Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 166 1 0 21 Oct 2021
Stochastic Primal-Dual Deep Unrolling Junqi Tang Subhadip Mukherjee Carola-Bibiane Schönlieb 331 5 0 19 Oct 2021
Speeding-Up Back-Propagation in DNN: Approximate Outer Product with Memory Eduin E. Hernandez Stefano Rini T. Duman 35 1 0 18 Oct 2021
Nys-Newton: Nyström-Approximated Curvature for Stochastic Optimization Dinesh Singh Hardik Tankaria M. Yamada ODL 251 3 0 16 Oct 2021
Adaptive Elastic Training for Sparse Deep Learning on Heterogeneous Multi-GPU Servers Yujing Ma Florin Rusu Kesheng Wu A. Sim 269 3 0 13 Oct 2021
$$\bar{G}_{mst}$:An Unbiased Stratified Statistic and a Fast Gradient Optimization Algorithm Based on It$ $\bar{G}_{mst}$ :An Unbiased Stratified Statistic and a Fast Gradient Optimization Algorithm Based on It Aixiang Chen 106 0 0 07 Oct 2021
DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization Boyue Li Zhize Li Yuejie Chi 232 23 0 04 Oct 2021
Accelerating Perturbed Stochastic Iterates in Asynchronous Lock-Free Optimization Kaiwen Zhou Anthony Man-Cho So James Cheng 190 1 0 30 Sep 2021
Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic FeaturesConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Bruce W. Lee Yoonna Jang J. Lee VLM 219 101 0 25 Sep 2021
Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic ProgrammingMathematical programming (Math. Program.), 2021 Sen Na M. Anitescu Mladen Kolar 249 43 0 23 Sep 2021
Asynchronous Iterations in Optimization: New Sequence Results and Sharper Algorithmic GuaranteesJournal of machine learning research (JMLR), 2021 Hamid Reza Feyzmahdavian M. Johansson 197 28 0 09 Sep 2021
Asynchronous Federated Learning on Heterogeneous Devices: A Survey Chenhao Xu Youyang Qu Yong Xiang Longxiang Gao FedML 358 325 0 09 Sep 2021
COCO Denoiser: Using Co-Coercivity for Variance Reduction in Stochastic Convex Optimization Manuel Madeira Renato M. P. Negrinho J. Xavier P. Aguiar 106 0 0 07 Sep 2021
L-DQN: An Asynchronous Limited-Memory Distributed Quasi-Newton Method Bugra Can Saeed Soori M. Dehnavi Mert Gurbuzbalaban 220 2 0 20 Aug 2021
Construction Cost Index Forecasting: A Multi-feature Fusion Approach Tianxiang Zhan Yuanpeng He Fuyuan Xiao 228 0 0 18 Aug 2021
FedChain: Chained Algorithms for Near-Optimal Communication Cost in Federated Learning Charlie Hou K. K. Thekumparampil Giulia Fanti Sewoong Oh FedML 241 15 0 16 Aug 2021
FedPAGE: A Fast Local Stochastic Gradient Method for Communication-Efficient Federated Learning Haoyu Zhao Zhize Li Peter Richtárik FedML 147 34 0 10 Aug 2021
Decentralized Composite Optimization with Compression Yao Li Xiaorui Liu Shucheng Zhou Ming Yan Kun Yuan 193 10 0 10 Aug 2021