Highway and Residual Networks learn Unrolled Iterative Estimation

22 December 2016

Papers citing "Highway and Residual Networks learn Unrolled Iterative Estimation"

30 / 30 papers shown

Title
Decoding Vision Transformers: the Diffusion Steering Lens Ryota Takatsuki Sonia Joseph Ippei Fujisawa Ryota Kanai DiffM 30 0 0 18 Apr 2025
Federated Learning with Flexible Architectures Jong-Ik Park Carlee Joe-Wong FedML 45 3 0 14 Jun 2024
Adaptive Depth Networks with Skippable Sub-Paths Woochul Kang 33 1 0 27 Dec 2023
Breaking On-device Training Memory Wall: A Systematic Survey Shitian Li Chunlin Tian Kahou Tam Ruirui Ma Li Li 21 2 0 17 Jun 2023
Eliciting Latent Predictions from Transformers with the Tuned Lens Nora Belrose Zach Furman Logan Smith Danny Halawi Igor V. Ostrovsky Lev McKinney Stella Biderman Jacob Steinhardt 22 193 0 14 Mar 2023
Pruning by Active Attention Manipulation Z. Babaiee Lucas Liebenwein Ramin Hasani Daniela Rus Radu Grosu 22 0 0 20 Oct 2022
Entangled Residual Mappings Mathias Lechner Ramin Hasani Z. Babaiee Radu Grosu Daniela Rus T. Henzinger Sepp Hochreiter 8 4 0 02 Jun 2022
Learning Features with Parameter-Free Layers Dongyoon Han Y. Yoo Beomyoung Kim Byeongho Heo 35 8 0 06 Feb 2022
Hidden-Fold Networks: Random Recurrent Residuals Using Sparse Supermasks Ángel López García-Arias Masanori Hashimoto Masato Motomura Jaehoon Yu 31 5 0 24 Nov 2021
Rethinking Architecture Selection in Differentiable NAS Ruochen Wang Minhao Cheng Xiangning Chen Xiaocheng Tang Cho-Jui Hsieh 27 172 0 10 Aug 2021
Layer Folding: Neural Network Depth Reduction using Activation Linearization Amir Ben Dror Niv Zehngut Avraham Raviv E. Artyomov Ran Vitek R. Jevnisek 29 20 0 17 Jun 2021
Pruning and Quantization for Deep Neural Network Acceleration: A Survey Tailin Liang C. Glossner Lei Wang Shaobo Shi Xiaotong Zhang MQ 141 674 0 24 Jan 2021
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 32 2 0 04 Jan 2021
Learning Light-Weight Translation Models from Deep Transformer Bei Li Ziyang Wang Hui Liu Quan Du Tong Xiao Chunliang Zhang Jingbo Zhu VLM 120 40 0 27 Dec 2020
FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training Y. Fu Haoran You Yang Katie Zhao Yue Wang Chaojian Li K. Gopalakrishnan Zhangyang Wang Yingyan Lin MQ 32 32 0 24 Dec 2020
Why Layer-Wise Learning is Hard to Scale-up and a Possible Solution via Accelerated Downsampling Wenchi Ma Miao Yu Kaidong Li Guanghui Wang 14 5 0 15 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 34 79 0 17 Sep 2020
Going in circles is the way forward: the role of recurrence in visual inference R. S. V. Bergen N. Kriegeskorte 17 81 0 26 Mar 2020
A Derivative-Free Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks Jihun Han Mihai Nica A. Stinchcombe 22 49 0 17 Jan 2020
On-Device Machine Learning: An Algorithms and Learning Theory Perspective Sauptik Dhar Junyao Guo Jiayi Liu S. Tripathi Unmesh Kurup Mohak Shah 17 141 0 02 Nov 2019
The streaming rollout of deep networks - towards fully model-parallel execution Volker Fischer Jan M. Köhler Thomas Pfeil 19 16 0 13 Jun 2018
Predict and Constrain: Modeling Cardinality in Deep Structured Prediction Nataly Brukhim Amir Globerson 23 9 0 13 Feb 2018
Sparsely Aggregated Convolutional Networks Ligeng Zhu Ruizhi Deng Michael Maire Zhiwei Deng Greg Mori P. Tan 3DPC 32 9 0 18 Jan 2018
Real-time Semantic Image Segmentation via Spatial Sparsity Zifeng Wu Chunhua Shen Anton Van Den Hengel SSeg 36 64 0 01 Dec 2017
End-to-End Learning for Structured Prediction Energy Networks David Belanger Bishan Yang Andrew McCallum 6 136 0 16 Mar 2017
Feedback Networks Amir Zamir Te-Lin Wu Lin Sun Bokui (William) Shen Jitendra Malik Silvio Savarese 18 209 0 30 Dec 2016
Convolutional Neural Networks Analyzed via Convolutional Sparse Coding V. Papyan Yaniv Romano Michael Elad 56 284 0 27 Jul 2016
Recurrent Highway Networks J. Zilly R. Srivastava Jan Koutník Jürgen Schmidhuber 13 413 0 12 Jul 2016
FractalNet: Ultra-Deep Neural Networks without Residuals Gustav Larsson Michael Maire Gregory Shakhnarovich 43 933 0 24 May 2016
Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortex Q. Liao T. Poggio 213 255 0 13 Apr 2016