An Optimal Control Approach to Deep Learning and Applications to Discrete-Weight Neural Networks

4 March 2018

Papers citing "An Optimal Control Approach to Deep Learning and Applications to Discrete-Weight Neural Networks"

15 / 15 papers shown

Title
Data Selection via Optimal Control for Language Models Yuxian Gu Li Dong Hongning Wang Y. Hao Qingxiu Dong Furu Wei Minlie Huang AI4CE 52 4 0 09 Oct 2024
Online Control-Informed Learning Zihao Liang Tianyu Zhou Zehui Lu Shaoshuai Mou 33 1 0 04 Oct 2024
Neural Delay Differential Equations: System Reconstruction and Image Classification Qunxi Zhu Yao Guo Wei Lin 17 31 0 11 Apr 2023
Deep Generalized Schrödinger Bridge Guan-Horng Liu T. Chen Oswin So Evangelos A. Theodorou OT AI4CE 8 34 0 20 Sep 2022
Likelihood Training of Schrödinger Bridge using Forward-Backward SDEs Theory T. Chen Guan-Horng Liu Evangelos A. Theodorou DiffM OT 174 163 0 21 Oct 2021
An Optimal Control Framework for Joint-channel Parallel MRI Reconstruction without Coil Sensitivities Wanyu Bian Yunmei Chen X. Ye 44 14 0 20 Sep 2021
Machine Learning and Computational Mathematics Weinan E PINN AI4CE 24 61 0 23 Sep 2020
A Differential Game Theoretic Neural Optimizer for Training Residual Networks Guan-Horng Liu T. Chen Evangelos A. Theodorou 21 2 0 17 Jul 2020
Machine Learning and Control Theory A. Bensoussan Yiqun Li Dinh Phan Cao Nguyen M. Tran S. Yam Xiang Zhou AI4CE 24 12 0 10 Jun 2020
Robust Deep Learning as Optimal Control: Insights and Convergence Guarantees Jacob H. Seidman Mahyar Fazlyab V. Preciado George J. Pappas AAML 14 15 0 01 May 2020
A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth Yiping Lu Chao Ma Yulong Lu Jianfeng Lu Lexing Ying MLT 36 78 0 11 Mar 2020
Deep Learning via Dynamical Systems: An Approximation Perspective Qianxiao Li Ting Lin Zuowei Shen AI4TS AI4CE 14 107 0 22 Dec 2019
A Mean-Field Optimal Control Formulation of Deep Learning Weinan E Jiequn Han Qianxiao Li OOD 6 181 0 03 Jul 2018
A Proximal Stochastic Gradient Method with Progressive Variance Reduction Lin Xiao Tong Zhang ODL 84 736 0 19 Mar 2014
Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes Ohad Shamir Tong Zhang 101 570 0 08 Dec 2012