ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1606.04838
  4. Cited By
Optimization Methods for Large-Scale Machine Learning
v1v2v3 (latest)

Optimization Methods for Large-Scale Machine Learning

15 June 2016
Léon Bottou
Frank E. Curtis
J. Nocedal
ArXiv (abs)PDFHTML

Papers citing "Optimization Methods for Large-Scale Machine Learning"

50 / 1,490 papers shown
An Attention-Based Algorithm for Gravity Adaptation Zone Calibration
An Attention-Based Algorithm for Gravity Adaptation Zone Calibration
Chen Yu
211
5
0
06 Oct 2024
Temporal Predictive Coding for Gradient Compression in Distributed
  Learning
Temporal Predictive Coding for Gradient Compression in Distributed Learning
Adrian Edin
Zheng Chen
Michel Kieffer
Mikael Johansson
203
1
0
03 Oct 2024
Introducing Flexible Monotone Multiple Choice Item Response Theory
  Models and Bit Scales
Introducing Flexible Monotone Multiple Choice Item Response Theory Models and Bit Scales
Joakim Wallmark
Maria Josefsson
Marie Wiberg
86
2
0
02 Oct 2024
On the SAGA algorithm with decreasing step
On the SAGA algorithm with decreasing step
Luis Fredes
Bernard Bercu
Eméric Gbaguidi
227
1
0
02 Oct 2024
Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization
Asymmetry of the Relative Entropy in the Regularization of Empirical Risk MinimizationIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2024
Francisco Daunas
I. Esnaola
S. Perlaza
H. Vincent Poor
286
5
0
02 Oct 2024
SetPINNs: Set-based Physics-informed Neural Networks
SetPINNs: Set-based Physics-informed Neural Networks
Mayank Nagda
Phil Ostheimer
Thomas Specht
Frank Rhein
Fabian Jirasek
Stephan Mandt
Marius Kloft
Sophie Fellenz
PINN3DPC
669
2
0
30 Sep 2024
Unifying back-propagation and forward-forward algorithms through model
  predictive control
Unifying back-propagation and forward-forward algorithms through model predictive control
Lianhai Ren
Qianxiao Li
270
2
0
29 Sep 2024
Online Client Scheduling and Resource Allocation for Efficient Federated
  Edge Learning
Online Client Scheduling and Resource Allocation for Efficient Federated Edge Learning
Zhidong Gao
Zhenxiao Zhang
Yu Zhang
Tongnian Wang
Yanmin Gong
Yuanxiong Guo
330
1
0
29 Sep 2024
Hierarchical Federated Learning with Multi-Timescale Gradient Correction
Hierarchical Federated Learning with Multi-Timescale Gradient CorrectionNeural Information Processing Systems (NeurIPS), 2024
Wenzhi Fang
Dong-Jun Han
Evan Chen
Jianing Zhang
Christopher G. Brinton
206
18
0
27 Sep 2024
Accelerating Multi-Block Constrained Optimization Through Learning to
  Optimize
Accelerating Multi-Block Constrained Optimization Through Learning to Optimize
Ling Liang
Cameron Austin
Haizhao Yang
198
0
0
25 Sep 2024
Super Level Sets and Exponential Decay: A Synergistic Approach to Stable
  Neural Network Training
Super Level Sets and Exponential Decay: A Synergistic Approach to Stable Neural Network TrainingJournal of Artificial Intelligence Research (JAIR), 2024
J. Chaudhary
Dipak Nidhi
J. Heikkonen
H. Merisaari
R. Kanth
162
0
0
25 Sep 2024
Decentralized Federated Learning with Gradient Tracking over
  Time-Varying Directed Networks
Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networks
Duong Thuy Anh Nguyen
Su Wang
Duong Tung Nguyen
Angelia Nedich
H. Vincent Poor
284
2
0
25 Sep 2024
FLeNS: Federated Learning with Enhanced Nesterov-Newton Sketch
FLeNS: Federated Learning with Enhanced Nesterov-Newton SketchBigData Congress [Services Society] (BSS), 2024
Sunny Gupta
Mohit Jindal
Pankhi Kashyap
Pranav Jeevan
Amit Sethi
FedML
262
0
0
23 Sep 2024
DP$^2$-FedSAM: Enhancing Differentially Private Federated Learning
  Through Personalized Sharpness-Aware Minimization
DP2^22-FedSAM: Enhancing Differentially Private Federated Learning Through Personalized Sharpness-Aware Minimization
Zhenxiao Zhang
Yuanxiong Guo
Yanmin Gong
FedML
248
1
0
20 Sep 2024
Shape-informed surrogate models based on signed distance function domain
  encoding
Shape-informed surrogate models based on signed distance function domain encodingJournal of Computational Physics (JCP), 2024
L. Zhang
S. Pagani
Jun Zhang
Francesco Regazzoni
AI4CE
284
3
0
19 Sep 2024
JKO for Landau: a variational particle method for homogeneous Landau
  equation
JKO for Landau: a variational particle method for homogeneous Landau equation
Yan Huang
Li Wang
192
0
0
18 Sep 2024
S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training
S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-trainingNeural Information Processing Systems (NeurIPS), 2024
Yuezhou Hu
Jun-Jie Zhu
Jianfei Chen
421
5
0
13 Sep 2024
Riemannian Federated Learning via Averaging Gradient Streams
Riemannian Federated Learning via Averaging Gradient Streams
Zhenwei Huang
Wen Huang
Pratik Jawanpuria
Bamdev Mishra
FedML
268
3
0
11 Sep 2024
Heterogeneity-Aware Cooperative Federated Edge Learning with Adaptive
  Computation and Communication Compression
Heterogeneity-Aware Cooperative Federated Edge Learning with Adaptive Computation and Communication CompressionIEEE Transactions on Mobile Computing (IEEE TMC), 2024
Zhenxiao Zhang
Zhidong Gao
Yuanxiong Guo
Yanmin Gong
256
9
0
06 Sep 2024
Robust Clustering on High-Dimensional Data with Stochastic Quantization
Robust Clustering on High-Dimensional Data with Stochastic Quantization
Anton Kozyriev
Vladimir Norkin
MQ
341
3
0
03 Sep 2024
Generalized Continuous-Time Models for Nesterov's Accelerated Gradient
  Methods
Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methods
Chanwoong Park
Youngchae Cho
Insoon Yang
208
1
0
02 Sep 2024
Hierarchical Learning and Computing over Space-Ground Integrated Networks
Hierarchical Learning and Computing over Space-Ground Integrated NetworksIEEE Transactions on Mobile Computing (IEEE TMC), 2024
Jingyang Zhu
Yuanming Shi
Yong Zhou
Chunxiao Jiang
Linling Kuang
293
4
0
26 Aug 2024
Predicting path-dependent processes by deep learning
Predicting path-dependent processes by deep learning
Xudong Zheng
Yuecai Han
82
0
0
19 Aug 2024
Point Source Identification Using Singularity Enriched Neural Networks
Point Source Identification Using Singularity Enriched Neural Networks
Tianhao Hu
Bangti Jin
Zhi Zhou
3DPC
168
2
0
17 Aug 2024
Enhancing Sharpness-Aware Minimization by Learning Perturbation Radius
Enhancing Sharpness-Aware Minimization by Learning Perturbation Radius
Xuehao Wang
Weisen Jiang
Shuai Fu
Yu Zhang
AAML
261
1
0
15 Aug 2024
Learning Decisions Offline from Censored Observations with
  ε-insensitive Operational Costs
Learning Decisions Offline from Censored Observations with ε-insensitive Operational Costs
Minxia Chen
Ke Fu
Teng Huang
Miao Bai
OffRL
190
0
0
14 Aug 2024
Online-Score-Aided Federated Learning: Taming the Resource Constraints in Wireless Networks
Online-Score-Aided Federated Learning: Taming the Resource Constraints in Wireless Networks
Md Ferdous Pervej
Minseok Choi
A. Molisch
399
1
0
12 Aug 2024
Incremental Gauss-Newton Descent for Machine Learning
Incremental Gauss-Newton Descent for Machine Learning
Mikalai Korbit
Mario Zanon
ODL
171
0
0
10 Aug 2024
LiD-FL: Towards List-Decodable Federated Learning
LiD-FL: Towards List-Decodable Federated LearningAAAI Conference on Artificial Intelligence (AAAI), 2024
Hong Liu
Liren Shan
Han Bao
Ronghui You
Yuhao Yi
Jiancheng Lv
FedML
483
0
0
09 Aug 2024
Convergence Conditions for Stochastic Line Search Based Optimization of Over-parametrized Models
Convergence Conditions for Stochastic Line Search Based Optimization of Over-parametrized Models
Matteo Lapucci
Davide Pucci
296
1
0
06 Aug 2024
Differentially Private Block-wise Gradient Shuffle for Deep Learning
Differentially Private Block-wise Gradient Shuffle for Deep Learning
Zilong Zhang
FedML
296
0
0
31 Jul 2024
Adaptive Mix for Semi-Supervised Medical Image Segmentation
Adaptive Mix for Semi-Supervised Medical Image Segmentation
Zhiqiang Shen
Peng Cao
Junming Su
Jinzhu Yang
Osmar R. Zaiane
414
0
0
31 Jul 2024
An Effective Dynamic Gradient Calibration Method for Continual Learning
An Effective Dynamic Gradient Calibration Method for Continual Learning
Weichen Lin
Jiaxiang Chen
Ru Huang
Huihua Ding
CLL
278
2
0
30 Jul 2024
PIP: Prototypes-Injected Prompt for Federated Class Incremental Learning
PIP: Prototypes-Injected Prompt for Federated Class Incremental Learning
M. A. Ma'sum
Mahardhika Pratama
Savitha Ramasamy
Lin Liu
Habibullah Habibullah
Ryszard Kowalczyk
CLL
252
4
0
30 Jul 2024
Learning Random Numbers to Realize Appendable Memory System for
  Artificial Intelligence to Acquire New Knowledge after Deployment
Learning Random Numbers to Realize Appendable Memory System for Artificial Intelligence to Acquire New Knowledge after DeploymentbioRxiv (bioRxiv), 2024
Kazunori D Yamada
237
0
0
29 Jul 2024
FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware
  Submodel Extraction
FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel ExtractionNeural Information Processing Systems (NeurIPS), 2024
Feijie Wu
Xingchen Wang
Yaqing Wang
Tianci Liu
Lu Su
Jing Gao
FedML
315
24
0
28 Jul 2024
Many Perception Tasks are Highly Redundant Functions of their Input Data
Many Perception Tasks are Highly Redundant Functions of their Input Data
Rahul Ramesh
Anthony Bisulco
Ronald W. DiTullio
Linran Wei
Vijay Balasubramanian
Kostas Daniilidis
Pratik Chaudhari
337
4
0
18 Jul 2024
Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance
Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance
Haiquan Lu
Xiaotian Liu
Yefan Zhou
Qunli Li
Kurt Keutzer
Michael W. Mahoney
Yujun Yan
Huanrui Yang
Yaoqing Yang
202
2
0
17 Jul 2024
Enhancing Stochastic Optimization for Statistical Efficiency Using
  ROOT-SGD with Diminishing Stepsize
Enhancing Stochastic Optimization for Statistical Efficiency Using ROOT-SGD with Diminishing Stepsize
Tong Zhang
Chris Junchi Li
327
0
0
15 Jul 2024
Stabilized Proximal-Point Methods for Federated Optimization
Stabilized Proximal-Point Methods for Federated Optimization
Xiaowen Jiang
Anton Rodomanov
Sebastian U. Stich
FedML
298
8
0
09 Jul 2024
An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton
  Stepsizes
An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes
Antonio Orvieto
Lin Xiao
307
6
0
05 Jul 2024
Stochastic Differential Equations models for Least-Squares Stochastic
  Gradient Descent
Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent
Adrien Schertzer
Loucas Pillaud-Vivien
227
2
0
02 Jul 2024
Multi-level Reliable Guidance for Unpaired Multi-view Clustering
Multi-level Reliable Guidance for Unpaired Multi-view ClusteringIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2024
Like Xin
Wanqi Yang
Lei Wang
Ming Yang
237
2
0
01 Jul 2024
Deterministic and Stochastic Frank-Wolfe Recursion on Probability Spaces
Deterministic and Stochastic Frank-Wolfe Recursion on Probability Spaces
Di Yu
Shane G. Henderson
R. Pasupathy
156
2
0
29 Jun 2024
Unbiased least squares regression via averaged stochastic gradient
  descent
Unbiased least squares regression via averaged stochastic gradient descent
Nabil Kahalé
279
0
0
26 Jun 2024
Efficient k-means with Individual Fairness via Exponential Tilting
Efficient k-means with Individual Fairness via Exponential Tilting
Shengkun Zhu
Jinshan Zeng
Yuan Sun
Sheng Wang
Xiaodong Li
Zhiyong Peng
278
0
0
24 Jun 2024
Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing
  Backpropagation
Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation
Yuchen Yang
Yingdong Shi
Cheems Wang
Xiantong Zhen
Yuxuan Shi
Jun Xu
245
3
0
24 Jun 2024
Towards Timely Video Analytics Services at the Network Edge
Towards Timely Video Analytics Services at the Network Edge
Xishuo Li
Shan Zhang
Yuejiao Huang
Xiao Ma
Zhiyuan Wang
Hongbin Luo
163
13
0
21 Jun 2024
Information Guided Regularization for Fine-tuning Language Models
Information Guided Regularization for Fine-tuning Language Models
Mandar Sharma
Nikhil Muralidhar
Shengzhe Xu
Raquib Bin Yousuf
Naren Ramakrishnan
293
0
0
20 Jun 2024
Communication-Efficient Adaptive Batch Size Strategies for Distributed
  Local Gradient Methods
Communication-Efficient Adaptive Batch Size Strategies for Distributed Local Gradient Methods
Tim Tsz-Kit Lau
Weijian Li
Chenwei Xu
Han Liu
Mladen Kolar
310
3
0
20 Jun 2024
Previous
12345...282930
Next
Page 4 of 30
Pageof 30