ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2012.02188
  4. Cited By
Stochastic Gradient Descent with Nonlinear Conjugate Gradient-Style
  Adaptive Momentum

Stochastic Gradient Descent with Nonlinear Conjugate Gradient-Style Adaptive Momentum

3 December 2020
Bao Wang
Qiang Ye
    ODL
ArXiv (abs)PDFHTML

Papers citing "Stochastic Gradient Descent with Nonlinear Conjugate Gradient-Style Adaptive Momentum"

10 / 10 papers shown
When Large Language Model Meets Optimization
When Large Language Model Meets OptimizationSwarm and Evolutionary Computation (Swarm Evol. Comput.), 2024
Sen Huang
Kaixiang Yang
Sheng Qi
Rui Wang
373
52
0
16 May 2024
Homotopy Relaxation Training Algorithms for Infinite-Width Two-Layer
  ReLU Neural Networks
Homotopy Relaxation Training Algorithms for Infinite-Width Two-Layer ReLU Neural NetworksJournal of Scientific Computing (J. Sci. Comput.), 2023
Yahong Yang
Qipin Chen
Wenrui Hao
347
7
0
26 Sep 2023
Proximal Implicit ODE Solvers for Accelerating Learning Neural ODEs
Proximal Implicit ODE Solvers for Accelerating Learning Neural ODEs
Justin Baker
Hedi Xia
Yiwei Wang
E. Cherkaev
A. Narayan
Long Chen
Jack Xin
Andrea L. Bertozzi
Stanley J. Osher
Bao Wang
279
10
0
19 Apr 2022
Learning POD of Complex Dynamics Using Heavy-ball Neural ODEs
Learning POD of Complex Dynamics Using Heavy-ball Neural ODEsJournal of Scientific Computing (J. Sci. Comput.), 2022
Justin Baker
E. Cherkaev
A. Narayan
Bao Wang
AI4CE
417
8
0
24 Feb 2022
Training Deep Neural Networks with Adaptive Momentum Inspired by the
  Quadratic Optimization
Training Deep Neural Networks with Adaptive Momentum Inspired by the Quadratic Optimization
Tao Sun
Huaming Ling
Zuoqiang Shi
Dongsheng Li
Bao Wang
ODL
209
13
0
18 Oct 2021
How Does Momentum Benefit Deep Neural Networks Architecture Design? A
  Few Case Studies
How Does Momentum Benefit Deep Neural Networks Architecture Design? A Few Case Studies
Bao Wang
Hedi Xia
T. Nguyen
Stanley Osher
AI4CE
240
13
0
13 Oct 2021
AIR-Net: Adaptive and Implicit Regularization Neural Network for Matrix
  Completion
AIR-Net: Adaptive and Implicit Regularization Neural Network for Matrix CompletionSIAM Journal of Imaging Sciences (SIAM J. Imaging Sci.), 2021
Zhemin Li
Tao Sun
Hongxia Wang
Bao Wang
250
10
0
12 Oct 2021
Practical and Fast Momentum-Based Power Methods
Practical and Fast Momentum-Based Power Methods
Tahseen Rabbani
Apollo Jain
Arjun Rajkumar
Furong Huang
238
5
0
20 Aug 2021
Descending through a Crowded Valley - Benchmarking Deep Learning
  Optimizers
Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers
Robin M. Schmidt
Frank Schneider
Philipp Hennig
ODL
908
195
0
03 Jul 2020
Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate
  and Momentum
Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum
Zeke Xie
Xinrui Wang
Huishuai Zhang
Issei Sato
Masashi Sugiyama
ODL
761
64
0
29 Jun 2020
1
Page 1 of 1