Reversible Architectures for Arbitrarily Deep Residual Neural Networks

12 September 2017

Papers citing "Reversible Architectures for Arbitrarily Deep Residual Neural Networks"

37 / 37 papers shown

Title
On Dissipativity of Cross-Entropy Loss in Training ResNets Jens Püttschneider T. Faulwasser 25 0 0 29 May 2024
PaReprop: Fast Parallelized Reversible Backpropagation Tyler Lixuan Zhu K. Mangalam 17 1 0 15 Jun 2023
Universal Approximation Property of Hamiltonian Deep Neural Networks M. Zakwan M. d’Angelo Giancarlo Ferrari-Trecate 28 5 0 21 Mar 2023
CQnet: convex-geometric interpretation and constraining neural-network trajectories B. Peters 24 0 0 09 Feb 2023
Certified Invertibility in Neural Networks via Mixed-Integer Programming Tianqi Cui Tom S. Bertalan George J. Pappas M. Morari Ioannis G. Kevrekidis Mahyar Fazlyab AAML 13 2 0 27 Jan 2023
Reversible Column Networks Yuxuan Cai Yi Zhou Qi Han Jianjian Sun Xiangwen Kong Jun Yu Li Xiangyu Zhang VLM 29 53 0 22 Dec 2022
Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules Kazuki Irie Francesco Faccio Jürgen Schmidhuber AI4TS 27 11 0 03 Jun 2022
Momentum Capsule Networks Josef Gugglberger David Peer A. Rodríguez-Sánchez 3DPC 13 1 0 26 Jan 2022
Cell-average based neural network method for hyperbolic and parabolic partial differential equations Changxin Qiu Jue Yan 14 10 0 02 Jul 2021
Stateful ODE-Nets using Basis Function Expansions A. Queiruga N. Benjamin Erichson Liam Hodgkinson Michael W. Mahoney 19 16 0 21 Jun 2021
Memory-Efficient Differentiable Transformer Architecture Search Yuekai Zhao Li Dong Yelong Shen Zhihua Zhang Furu Wei Weizhu Chen ViT 22 17 0 31 May 2021
A unified framework for Hamiltonian deep neural networks C. Galimberti Liang Xu Giancarlo Ferrari-Trecate 11 5 0 27 Apr 2021
No frame left behind: Full Video Action Recognition X. Liu S. Pintea F. Karimi Nejadasl O. Booij J. C. V. Gemert 11 40 0 29 Mar 2021
Almost Surely Stable Deep Dynamics Nathan P. Lawrence Philip D. Loewen M. Forbes Johan U. Backstrom R. Bhushan Gopaluni BDL 27 20 0 26 Mar 2021
JFB: Jacobian-Free Backpropagation for Implicit Networks Samy Wu Fung Howard Heaton Qiuwei Li Daniel McKenzie Stanley Osher W. Yin FedML 30 83 0 23 Mar 2021
Momentum Residual Neural Networks Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 19 56 0 15 Feb 2021
Point-to-set distance functions for weakly supervised segmentation B. Peters 6 1 0 27 Jul 2020
A Differential Game Theoretic Neural Optimizer for Training Residual Networks Guan-Horng Liu T. Chen Evangelos A. Theodorou 9 2 0 17 Jul 2020
Understanding and Mitigating Exploding Inverses in Invertible Neural Networks Jens Behrmann Paul Vicol Kuan-Chieh Jackson Wang Roger C. Grosse J. Jacobsen 8 92 0 16 Jun 2020
Machine Learning and Control Theory A. Bensoussan Yiqun Li Dinh Phan Cao Nguyen M. Tran S. Yam Xiang Zhou AI4CE 16 12 0 10 Jun 2020
Optimizing Neural Networks via Koopman Operator Theory Akshunna S. Dogra William T. Redman 11 49 0 03 Jun 2020
Discretize-Optimize vs. Optimize-Discretize for Time-Series Regression and Continuous Normalizing Flows Derek Onken Lars Ruthotto BDL 24 51 0 27 May 2020
On Information Plane Analyses of Neural Network Classifiers -- A Review Bernhard C. Geiger 24 50 0 21 Mar 2020
Scalable Gradients for Stochastic Differential Equations Xuechen Li Ting-Kam Leonard Wong Ricky T. Q. Chen D. Duvenaud 17 310 0 05 Jan 2020
Optimal checkpointing for heterogeneous chains: how to train deep neural networks with limited memory Julien Herrmann Olivier Beaumont Lionel Eyraud-Dubois J. Herrmann Alexis Joly Alena Shilova BDL 9 29 0 27 Nov 2019
A Review on Deep Learning in Medical Image Reconstruction Hai-Miao Zhang Bin Dong MedIm 21 122 0 23 Jun 2019
Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stability Shaowu Pan Karthik Duraisamy 23 136 0 09 Jun 2019
Neural-networks for geophysicists and their application to seismic data interpretation B. Peters E. Haber J. Granek AI4CE 12 36 0 27 Mar 2019
IMEXnet: A Forward Stable Deep Neural Network E. Haber Keegan Lensink Eran Treister Lars Ruthotto 20 40 0 06 Mar 2019
Invertible Residual Networks Jens Behrmann Will Grathwohl Ricky T. Q. Chen D. Duvenaud J. Jacobsen UQCV TPM 17 617 0 02 Nov 2018
Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network A. Sherstinsky 11 3,588 0 09 Aug 2018
Generative Adversarial Forests for Better Conditioned Adversarial Learning Yan Zuo Gil Avraham Tom Drummond GAN AI4CE 11 8 0 14 May 2018
Deep Neural Networks Motivated by Partial Differential Equations Lars Ruthotto E. Haber AI4CE 17 483 0 12 Apr 2018
Learning Representations for Neural Network-Based Classification Using the Information Bottleneck Principle Rana Ali Amjad Bernhard C. Geiger 10 195 0 27 Feb 2018
Functional Gradient Boosting based on Residual Network Perception Atsushi Nitanda Taiji Suzuki 17 25 0 25 Feb 2018
Convolutional Neural Networks combined with Runge-Kutta Methods Mai Zhu Bo Chang Chong Fu AI4CE 33 52 0 24 Feb 2018
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,740 0 26 Sep 2016