Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1908.10920
Cited By
v1
v2 (latest)
Deep Learning Theory Review: An Optimal Control and Dynamical Systems Perspective
28 August 2019
Guan-Horng Liu
Evangelos A. Theodorou
AI4CE
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Deep Learning Theory Review: An Optimal Control and Dynamical Systems Perspective"
42 / 42 papers shown
Neural Predictive Control to Coordinate Discrete- and Continuous-Time Models for Time-Series Analysis with Control-Theoretical Improvements
Haoran Li
Muhao Guo
Yang Weng
Hanghang Tong
AI4TS
AI4CE
186
2
0
03 Aug 2025
A Statistical Framework for Model Selection in LSTM Networks
Fahad Mostafa
116
1
0
07 Jun 2025
Blending Optimal Control and Biologically Plausible Learning for Noise-Robust Physical Neural Networks
Physical Review Letters (PRL), 2025
S. Sunada
T. Niiyama
Kazutaka Kanno
Rin Nogami
André Röhm
Takato Awano
Atsushi Uchida
AI4CE
455
7
0
26 Feb 2025
Tilted Sharpness-Aware Minimization
Tian Li
Wanrong Zhu
J. Bilmes
364
0
0
30 Oct 2024
Data Selection via Optimal Control for Language Models
International Conference on Learning Representations (ICLR), 2024
Yuxian Gu
Li Dong
Hongning Wang
Y. Hao
Qingxiu Dong
Furu Wei
Minlie Huang
AI4CE
406
31
0
09 Oct 2024
Lipschitz constant estimation for general neural network architectures using control tools
Patricia Pauli
Dennis Gramlich
Frank Allgöwer
347
9
0
02 May 2024
Rethinking the Relationship between Recurrent and Non-Recurrent Neural Networks: A Study in Sparsity
Quincy Hershey
Randy Paffenroth
Harsh Nilesh Pathak
Simon Tavener
387
8
0
01 Apr 2024
PID Control-Based Self-Healing to Improve the Robustness of Large Language Models
Zhuotong Chen
Zihu Wang
Yifan Yang
Qianxiao Li
Zheng Zhang
AAML
348
3
0
31 Mar 2024
Towards a Systems Theory of Algorithms
IEEE Control Systems Letters (L-CSS), 2024
Florian Dorfler
Zhiyu He
Giuseppe Belgioioso
S. Bolognani
John Lygeros
Michael Muehlebach
AI4CE
355
27
0
25 Jan 2024
Asymptotically Fair Participation in Machine Learning Models: an Optimal Control Perspective
Zhuotong Chen
Qianxiao Li
Zheng Zhang
FaML
172
1
0
16 Nov 2023
Improving Robustness via Tilted Exponential Layer: A Communication-Theoretic Perspective
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Bhagyashree Puranik
Ahmad Beirami
Yao Qin
Upamanyu Madhow
AAML
473
1
0
02 Nov 2023
Scrap Your Schedules with PopDescent
Abhinav Pomalapally
B. Mabsout
Renato Mansuco
293
0
0
23 Oct 2023
From Continuous Dynamics to Graph Neural Networks: Neural Diffusion and Beyond
Andi Han
Dai Shi
Lequan Lin
Junbin Gao
AI4CE
GNN
374
33
0
16 Oct 2023
Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares
International Conference on Algorithmic Learning Theory (ALT), 2022
Anant Raj
Melih Barsbey
Mert Gurbuzbalaban
Lingjiong Zhu
Umut Simsekli
305
13
0
02 Jun 2022
Kullback-Leibler control for discrete-time nonlinear systems on continuous spaces
SICE Journal of Control Measurement and System Integration (SICE JCMSI), 2022
Kaito Ito
Kenji Kashima
168
7
0
24 Mar 2022
Optimal learning rate schedules in high-dimensional non-convex optimization problems
Stéphane dÁscoli
Maria Refinetti
Giulio Biroli
261
10
0
09 Feb 2022
There is a Singularity in the Loss Landscape
M. Lowell
178
1
0
12 Jan 2022
Second-Order Neural ODE Optimizer
Guan-Horng Liu
T. Chen
Evangelos A. Theodorou
223
19
0
29 Sep 2021
Dynamic Game Theoretic Neural Optimizer
International Conference on Machine Learning (ICML), 2021
Guan-Horng Liu
T. Chen
Evangelos A. Theodorou
AI4CE
337
6
0
08 May 2021
Generative Adversarial Network: Some Analytical Perspectives
Haoyang Cao
Xin Guo
GAN
373
2
0
25 Apr 2021
ResNet-LDDMM: Advancing the LDDMM Framework using Deep Residual Networks
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
Boulbaba Ben Amor
Sylvain Arguillere
Ling Shao
248
35
0
16 Feb 2021
Physical deep learning based on optimal control of dynamical systems
Physical Review Applied (PR Applied), 2020
Genki Furuhata
T. Niiyama
S. Sunada
PINN
AI4CE
413
19
0
16 Dec 2020
Learn to Synchronize, Synchronize to Learn
Pietro Verzelli
Cesare Alippi
L. Livi
406
31
0
06 Oct 2020
A priori guarantees of finite-time convergence for Deep Neural Networks
Anushree Rankawat
M. Rankawat
Harshal B. Oza
195
0
0
16 Sep 2020
DynamicVAE: Decoupling Reconstruction Error and Disentangled Representation Learning
Huajie Shao
Haohong Lin
Qinmin Yang
Shuochao Yao
Han Zhao
Tarek Abdelzaher
DRL
278
1
0
15 Sep 2020
A Practical Layer-Parallel Training Algorithm for Residual Networks
Qi Sun
Hexin Dong
Zewei Chen
Weizhen Dian
Jiacheng Sun
Yitong Sun
Zhenguo Li
Bin Dong
ODL
350
2
0
03 Sep 2020
Continuous-in-Depth Neural Networks
A. Queiruga
N. Benjamin Erichson
D. Taylor
Michael W. Mahoney
367
54
0
05 Aug 2020
Neural networks with late-phase weights
International Conference on Learning Representations (ICLR), 2020
J. Oswald
Seijin Kobayashi
Alexander Meulemans
Christian Henning
Benjamin Grewe
João Sacramento
382
38
0
25 Jul 2020
A Differential Game Theoretic Neural Optimizer for Training Residual Networks
Guan-Horng Liu
T. Chen
Evangelos A. Theodorou
266
2
0
17 Jul 2020
Responsive Safety in Reinforcement Learning by PID Lagrangian Methods
International Conference on Machine Learning (ICML), 2020
Adam Stooke
Joshua Achiam
Pieter Abbeel
412
391
0
08 Jul 2020
On Lyapunov Exponents for RNNs: Understanding Information Propagation Using Dynamical Systems Tools
Frontiers in Applied Mathematics and Statistics (FAMS), 2020
Ryan H. Vogt
M. P. Touzel
Eli Shlizerman
Guillaume Lajoie
259
56
0
25 Jun 2020
A Dynamical Systems Approach for Convergence of the Bayesian EM Algorithm
O. Romero
Subhro Das
Pin-Yu Chen
S. Pequito
247
1
0
23 Jun 2020
A Shooting Formulation of Deep Learning
François-Xavier Vialard
Roland Kwitt
Susan Wei
Marc Niethammer
227
16
0
18 Jun 2020
Go with the Flow: Adaptive Control for Neural ODEs
Mathieu Chalvidal
Matthew Ricci
Rufin VanRullen
Thomas Serre
355
2
0
16 Jun 2020
SDE approximations of GANs training and its long-run behavior
Journal of Applied Probability (J. Appl. Probab.), 2020
Haoyang Cao
Xin Guo
448
1
0
03 Jun 2020
A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth
International Conference on Machine Learning (ICML), 2020
Yiping Lu
Chao Ma
Yulong Lu
Jianfeng Lu
Lexing Ying
MLT
367
85
0
11 Mar 2020
DDPNOpt: Differential Dynamic Programming Neural Optimizer
International Conference on Learning Representations (ICLR), 2020
Guan-Horng Liu
T. Chen
Evangelos A. Theodorou
348
7
0
20 Feb 2020
Pontryagin Differentiable Programming: An End-to-End Learning and Control Framework
Neural Information Processing Systems (NeurIPS), 2019
Wanxin Jin
Zhaoran Wang
Zhuoran Yang
Shaoshuai Mou
643
118
0
30 Dec 2019
Finite-Time Convergence of Continuous-Time Optimization Algorithms via Differential Inclusions
O. Romero
M. Benosman
110
10
0
18 Dec 2019
Towards Robust and Stable Deep Learning Algorithms for Forward Backward Stochastic Differential Equations
Batuhan Güler
Alexis Laignelet
P. Parpas
OOD
343
18
0
25 Oct 2019
Mean-field Langevin System, Optimal Control and Deep Neural Networks
Kaitong Hu
A. Kazeykina
Zhenjie Ren
267
16
0
16 Sep 2019
Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach
Ryo Karakida
S. Akaho
S. Amari
FedML
683
169
0
04 Jun 2018
1
Page 1 of 1
