Multi-level Residual Networks from Dynamical Systems View

27 October 2017

Papers citing "Multi-level Residual Networks from Dynamical Systems View"

35 / 35 papers shown

Title
STEP: Staged Parameter-Efficient Pre-training for Large Language Models Kazuki Yano Takumi Ito Jun Suzuki LRM 47 1 0 05 Apr 2025
A Multi-Level Framework for Accelerating Training Transformer Models Longwei Zou Han Zhang Yangdong Deng AI4CE 32 1 0 07 Apr 2024
Rethinking the Relationship between Recurrent and Non-Recurrent Neural Networks: A Study in Sparsity Quincy Hershey Randy Paffenroth Harsh Nilesh Pathak Simon Tavener 64 1 0 01 Apr 2024
Hierarchical deep learning-based adaptive time-stepping scheme for multiscale simulations Asif Hamid Danish Rafiq S. A. Nahvi M. A. Bazaz AI4CE 36 1 0 10 Nov 2023
Neural Stochastic Differential Equations for Robust and Explainable Analysis of Electromagnetic Unintended Radiated Emissions Sumit Kumar Jha Susmit Jha Rickard Ewetz Alvaro Velasquez 10 2 0 27 Sep 2023
Neural Delay Differential Equations: System Reconstruction and Image Classification Qunxi Zhu Yao Guo Wei Lin 15 31 0 11 Apr 2023
Designing with Non-Finite Output Dimension via Fourier Coefficients of Neural Waveforms Jonathan S. Kent 17 0 0 17 Aug 2022
Enhancing Local Geometry Learning for 3D Point Cloud via Decoupling Convolution H. Xiu Xin Liu Weimin Wang Kyoung-Sook Kim T. Shinohara Qiong Chang M. Matsuoka 3DPC 22 0 0 04 Jul 2022
Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules Kazuki Irie Francesco Faccio Jürgen Schmidhuber AI4TS 30 11 0 03 Jun 2022
Automated Progressive Learning for Efficient Training of Vision Transformers Changlin Li Bohan Zhuang Guangrun Wang Xiaodan Liang Xiaojun Chang Yi Yang 23 46 0 28 Mar 2022
Constructing Neural Network-Based Models for Simulating Dynamical Systems Christian Møldrup Legaard Thomas Schranz G. Schweiger Ján Drgovna Basak Falay C. Gomes Alexandros Iosifidis M. Abkar P. Larsen PINN AI4CE 28 93 0 02 Nov 2021
Solving Image PDEs with a Shallow Network Pascal Getreuer P. Milanfar Xiyang Luo 26 1 0 15 Oct 2021
Speeding up Deep Model Training by Sharing Weights and Then Unsharing Shuo Yang Le Hou Xiaodan Song Qiang Liu Denny Zhou 110 9 0 08 Oct 2021
m-RevNet: Deep Reversible Neural Networks with Momentum Duo Li Shangqi Gao 16 5 0 12 Aug 2021
Training of deep residual networks with stochastic MG/OPT Cyrill Planta Alena Kopanicáková Rolf Krause 27 3 0 09 Aug 2021
Stateful ODE-Nets using Basis Function Expansions A. Queiruga N. Benjamin Erichson Liam Hodgkinson Michael W. Mahoney 27 16 0 21 Jun 2021
On the Transformer Growth for Progressive BERT Training Xiaotao Gu Liyuan Liu Hongkun Yu Jing Li C. L. P. Chen Jiawei Han VLM 63 51 0 23 Oct 2020
Learning Differential Equations that are Easy to Solve Jacob Kelly J. Bettencourt Matthew J. Johnson D. Duvenaud 28 111 0 09 Jul 2020
Applications of Koopman Mode Analysis to Neural Networks Iva Manojlovic M. Fonoberova Ryan Mohr Aleksandr Andrejcuk Z. Drmač Y. Kevrekidis Igor Mezić 11 18 0 21 Jun 2020
Machine Learning and Control Theory A. Bensoussan Yiqun Li Dinh Phan Cao Nguyen M. Tran S. Yam Xiang Zhou AI4CE 24 12 0 10 Jun 2020
Fractional Deep Neural Network via Constrained Optimization Harbir Antil R. Khatri R. Löhner Deepanshu Verma 20 29 0 01 Apr 2020
A Derivative-Free Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks Jihun Han Mihai Nica A. Stinchcombe 22 49 0 17 Jan 2020
Scalable Gradients for Stochastic Differential Equations Xuechen Li Ting-Kam Leonard Wong Ricky T. Q. Chen D. Duvenaud 17 310 0 05 Jan 2020
InfoCNF: An Efficient Conditional Continuous Normalizing Flow with Adaptive Solvers T. Nguyen Animesh Garg Richard G. Baraniuk Anima Anandkumar TPM 17 9 0 09 Dec 2019
A Review on Deep Learning in Medical Image Reconstruction Hai-Miao Zhang Bin Dong MedIm 29 122 0 23 Jun 2019
PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network Zichao Long Yiping Lu Bin Dong AI4CE 25 541 0 30 Nov 2018
Data Driven Governing Equations Approximation Using Deep Neural Networks Tong Qin Kailiang Wu D. Xiu PINN 16 270 0 13 Nov 2018
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt D. Duvenaud AI4CE 30 4,925 0 19 Jun 2018
Deep Neural Networks Motivated by Partial Differential Equations Lars Ruthotto E. Haber AI4CE 25 483 0 12 Apr 2018
Functional Gradient Boosting based on Residual Network Perception Atsushi Nitanda Taiji Suzuki 25 25 0 25 Feb 2018
Convolutional Neural Networks combined with Runge-Kutta Methods Mai Zhu Bo Chang Chong Fu AI4CE 33 52 0 24 Feb 2018
Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems M. Raissi P. Perdikaris George Karniadakis PINN 18 265 0 04 Jan 2018
The exploding gradient problem demystified - definition, prevalence, impact, origin, tradeoffs, and solutions George Philipp D. Song J. Carbonell ODL 27 46 0 15 Dec 2017
Reversible Architectures for Arbitrarily Deep Residual Neural Networks B. Chang Lili Meng E. Haber Lars Ruthotto David Begert E. Holtham AI4CE 28 261 0 12 Sep 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016