Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1606.04838
Cited By
v1
v2
v3 (latest)
Optimization Methods for Large-Scale Machine Learning
15 June 2016
Léon Bottou
Frank E. Curtis
J. Nocedal
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Optimization Methods for Large-Scale Machine Learning"
50 / 1,491 papers shown
An Even More Optimal Stochastic Optimization Algorithm: Minibatching and Interpolation Learning
Neural Information Processing Systems (NeurIPS), 2021
Blake E. Woodworth
Nathan Srebro
240
22
0
04 Jun 2021
Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis
Journal of nonlinear science (J. Nonlinear Sci.), 2021
Stephan Wojtowytsch
230
37
0
04 Jun 2021
Debiasing a First-order Heuristic for Approximate Bi-level Optimization
International Conference on Machine Learning (ICML), 2021
Valerii Likhosherstov
Xingyou Song
K. Choromanski
Jared Davis
Adrian Weller
AI4CE
192
5
0
04 Jun 2021
Local Adaptivity in Federated Learning: Convergence and Consistency
Jianyu Wang
Zheng Xu
Zachary Garrett
Zachary B. Charles
Luyang Liu
Gauri Joshi
FedML
236
47
0
04 Jun 2021
Improving Neural Network Robustness via Persistency of Excitation
American Control Conference (ACC), 2021
Kaustubh Sridhar
O. Sokolsky
Insup Lee
James Weimer
AAML
272
22
0
03 Jun 2021
Tight High Probability Bounds for Linear Stochastic Approximation with Fixed Stepsize
Neural Information Processing Systems (NeurIPS), 2021
Alain Durmus
Eric Moulines
A. Naumov
S. Samsonov
Kevin Scaman
Hoi-To Wai
254
27
0
02 Jun 2021
Fine-grained Generalization Analysis of Structured Output Prediction
International Joint Conference on Artificial Intelligence (IJCAI), 2021
Waleed Mustafa
Yunwen Lei
Antoine Ledent
Matthias Kirchler
228
10
0
31 May 2021
Generalized AdaGrad (G-AdaGrad) and Adam: A State-Space Perspective
IEEE Conference on Decision and Control (CDC), 2021
Kushal Chakrabarti
Nikhil Chopra
ODL
AI4CE
177
10
0
31 May 2021
Energy-Efficient and Federated Meta-Learning via Projected Stochastic Gradient Ascent
Global Communications Conference (GLOBECOM), 2021
Anis Elgabli
Chaouki Ben Issaid
Amrit Singh Bedi
M. Bennis
Vaneet Aggarwal
FedML
62
4
0
31 May 2021
Detecting Backdoor in Deep Neural Networks via Intentional Adversarial Perturbations
Information Sciences (Inf. Sci.), 2021
Mingfu Xue
Yinghao Wu
Zhiyu Wu
Yushu Zhang
Jian Wang
Weiqiang Liu
AAML
140
14
0
29 May 2021
A Stochastic Alternating Balance
k
k
k
-Means Algorithm for Fair Clustering
Learning and Intelligent Optimization (LION), 2021
Suyun Liu
Luis Nunes Vicente
270
12
0
29 May 2021
On Linear Stability of SGD and Input-Smoothness of Neural Networks
Neural Information Processing Systems (NeurIPS), 2021
Chao Ma
Lexing Ying
MLT
168
56
0
27 May 2021
SGD with Coordinate Sampling: Theory and Practice
Journal of machine learning research (JMLR), 2021
Rémi Leluc
Franccois Portier
219
6
0
25 May 2021
Online Statistical Inference for Parameters Estimation with Linear-Equality Constraints
Journal of Multivariate Analysis (J. Multivar. Anal.), 2021
Ruiqi Liu
Mingao Yuan
Zuofeng Shang
181
6
0
21 May 2021
A Measure of Research Taste
V. Koltun
David Hafner
79
1
0
17 May 2021
Clustered Sampling: Low-Variance and Improved Representativity for Clients Selection in Federated Learning
International Conference on Machine Learning (ICML), 2021
Yann Fraboni
Richard Vidal
Laetitia Kameni
Marco Lorenzi
FedML
237
241
0
12 May 2021
A Twin Neural Model for Uplift
Mouloud Belbahri
Olivier Gandouet
A. Murua
V. Nia
CML
107
1
0
11 May 2021
A Geometric Analysis of Neural Collapse with Unconstrained Features
Neural Information Processing Systems (NeurIPS), 2021
Zhihui Zhu
Tianyu Ding
Jinxin Zhou
Xiao Li
Chong You
Jeremias Sulam
Qing Qu
310
234
0
06 May 2021
Stochastic gradient descent with noise of machine learning type. Part I: Discrete time analysis
Journal of nonlinear science (J. Nonlinear Sci.), 2021
Stephan Wojtowytsch
237
58
0
04 May 2021
GT-STORM: Taming Sample, Communication, and Memory Complexities in Decentralized Non-Convex Learning
ACM Interational Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), 2021
Xin Zhang
Jia Liu
Zhengyuan Zhu
Elizabeth S. Bentley
240
14
0
04 May 2021
Convergence Analysis and System Design for Federated Learning over Wireless Networks
IEEE Journal on Selected Areas in Communications (JSAC), 2021
Shuo Wan
Jiaxun Lu
Pingyi Fan
Yunfeng Shao
Chenghui Peng
Khaled B. Letaief
182
59
0
30 Apr 2021
Stochastic Mirror Descent for Low-Rank Tensor Decomposition Under Non-Euclidean Losses
IEEE Transactions on Signal Processing (IEEE TSP), 2021
Wenqiang Pu
Shahana Ibrahim
Xiao Fu
Mingyi Hong
261
12
0
29 Apr 2021
ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
International Conference on Machine Learning (ICML), 2021
Jianfei Chen
Lianmin Zheng
Z. Yao
Yi Xu
Ion Stoica
Michael W. Mahoney
Joseph E. Gonzalez
MQ
224
82
0
29 Apr 2021
Feasibility-based Fixed Point Networks
Fixed Point Theory and Algorithms for Sciences and Engineering (PTASE), 2021
Howard Heaton
Samy Wu Fung
A. Gibali
W. Yin
178
32
0
29 Apr 2021
Confined Gradient Descent: Privacy-preserving Optimization for Federated Learning
Yanjun Zhang
Guangdong Bai
Xue Li
Surya Nepal
R. Ko
FedML
90
2
0
27 Apr 2021
Discriminative Bayesian filtering lends momentum to the stochastic Newton method for minimizing log-convex functions
Optimization Letters (Optim. Lett.), 2021
Michael C. Burkhart
273
0
0
27 Apr 2021
Semi-Decentralized Federated Edge Learning for Fast Convergence on Non-IID Data
IEEE Wireless Communications and Networking Conference (WCNC), 2021
Yuchang Sun
Jiawei Shao
Yuyi Mao
Jessie Hui Wang
Jun Zhang
FedML
347
47
0
26 Apr 2021
Solving a class of non-convex min-max games using adaptive momentum methods
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2021
Babak Barazandeh
Davoud Ataee Tarzanagh
George Michailidis
202
15
0
26 Apr 2021
Improved Analysis and Rates for Variance Reduction under Without-replacement Sampling Orders
Xinmeng Huang
Kun Yuan
Xianghui Mao
W. Yin
247
16
0
25 Apr 2021
Random Reshuffling with Variance Reduction: New Analysis and Better Rates
Conference on Uncertainty in Artificial Intelligence (UAI), 2021
Grigory Malinovsky
Alibek Sailanbayev
Peter Richtárik
217
25
0
19 Apr 2021
The mixed deep energy method for resolving concentration features in finite strain hyperelasticity
Journal of Computational Physics (JCP), 2021
J. Fuhg
N. Bouklas
PINN
AI4CE
152
126
0
15 Apr 2021
Sample-based and Feature-based Federated Learning for Unconstrained and Constrained Nonconvex Optimization via Mini-batch SSCA
IEEE Transactions on Signal Processing (IEEE TSP), 2021
Ying Cui
Yangchen Li
Chencheng Ye
FedML
184
9
0
13 Apr 2021
Distributed Learning Systems with First-order Methods
Ji Liu
Ce Zhang
172
46
0
12 Apr 2021
SGD Implicitly Regularizes Generalization Error
Daniel A. Roberts
MLT
138
17
0
10 Apr 2021
Joint Optimization of Communications and Federated Learning Over the Air
IEEE Transactions on Wireless Communications (IEEE TWC), 2021
Xin-Yue Fan
Yue Wang
Yan Huo
Z. Tian
FedML
220
71
0
08 Apr 2021
Quasi-Newton Quasi-Monte Carlo for variational Bayes
Sifan Liu
Art B. Owen
BDL
202
4
0
07 Apr 2021
Training Deep Neural Networks via Branch-and-Bound
Yuanwei Wu
Ziming Zhang
Guanghui Wang
ODL
283
0
0
05 Apr 2021
Finite-Time Convergence Rates of Nonlinear Two-Time-Scale Stochastic Approximation under Markovian Noise
Thinh T. Doan
215
16
0
04 Apr 2021
A proof of convergence for stochastic gradient descent in the training of artificial neural networks with ReLU activation for constant target functions
Zeitschrift für Angewandte Mathematik und Physik (ZAMP), 2021
Arnulf Jentzen
Adrian Riekert
MLT
224
16
0
01 Apr 2021
Research of Damped Newton Stochastic Gradient Descent Method for Neural Network Training
Jingcheng Zhou
Wei Wei
Zhiming Zheng
ODL
66
0
0
31 Mar 2021
Multi-Source Causal Inference Using Control Variates
Wenshuo Guo
S. Wang
Peng Ding
Yixin Wang
Michael I. Jordan
CML
279
24
0
30 Mar 2021
Prediction of Ultrasonic Guided Wave Propagation in Solid-fluid and their Interface under Uncertainty using Machine Learning
Journal of engineering mechanics (J. Eng. Mech.), 2021
Subhayan De
B. Hai
Alireza Doostan
M. Bause
71
2
0
30 Mar 2021
Hierarchical Federated Learning with Quantization: Convergence Analysis and System Design
IEEE Transactions on Wireless Communications (IEEE TWC), 2021
Lumin Liu
Jun Zhang
Shenghui Song
Khaled B. Letaief
FedML
155
126
0
26 Mar 2021
The Gradient Convergence Bound of Federated Multi-Agent Reinforcement Learning with Efficient Communication
IEEE Transactions on Wireless Communications (IEEE TWC), 2021
Xing Xu
Rongpeng Li
Zhifeng Zhao
Honggang Zhang
284
16
0
24 Mar 2021
Adaptive deep density approximation for Fokker-Planck equations
Journal of Computational Physics (JCP), 2021
Keju Tang
Xiaoliang Wan
Qifeng Liao
248
48
0
20 Mar 2021
Distributed Deep Learning Using Volunteer Computing-Like Paradigm
IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), 2021
Medha Atre
B. Jha
Ashwini Rao
379
12
0
16 Mar 2021
Transient growth of accelerated optimization algorithms
IEEE Transactions on Automatic Control (IEEE TAC), 2021
Hesameddin Mohammadi
Samantha Samuelson
M. Jovanović
121
8
0
14 Mar 2021
Efficient Randomized Subspace Embeddings for Distributed Optimization under a Communication Budget
IEEE Journal on Selected Areas in Information Theory (JSAIT), 2021
R. Saha
Mert Pilanci
Andrea J. Goldsmith
246
6
0
13 Mar 2021
A Distributed Optimisation Framework Combining Natural Gradient with Hessian-Free for Discriminative Sequence Training
Neural Networks (NN), 2021
Adnan Haider
Chao Zhang
Florian Kreyssig
P. Woodland
238
8
0
12 Mar 2021
EventGraD: Event-Triggered Communication in Parallel Machine Learning
Neurocomputing (Neurocomputing), 2021
Soumyadip Ghosh
B. Aquino
V. Gupta
FedML
262
9
0
12 Mar 2021
Previous
1
2
3
...
16
17
18
...
28
29
30
Next
Page 17 of 30
Page
of 30
Go
