Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Papers citing "Visualizing the Loss Landscape of Neural Nets"

39 / 1,039 papers shown

Title
A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation Akhilesh Deepak Gotmare N. Keskar Caiming Xiong R. Socher ODL 9 274 0 29 Oct 2018
Analysis of Atomistic Representations Using Weighted Skip-Connections K. Nicoli Pan Kessel M. Gastegger Kristof T. Schütt 20 0 0 23 Oct 2018
A Modern Take on the Bias-Variance Tradeoff in Neural Networks Brady Neal Sarthak Mittal A. Baratin Vinayak Tantia Matthew Scicluna Simon Lacoste-Julien Ioannis Mitliagkas 21 167 0 19 Oct 2018
Detecting Memorization in ReLU Networks Edo Collins Siavash Bigdeli Sabine Süsstrunk 26 4 0 08 Oct 2018
Continuous-time Models for Stochastic Optimization Algorithms Antonio Orvieto Aurélien Lucchi 11 31 0 05 Oct 2018
Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning Charles H. Martin Michael W. Mahoney AI4CE 16 190 0 02 Oct 2018
Interpreting Adversarial Robustness: A View from Decision Surface in Input Space Fuxun Yu Chenchen Liu Yanzhi Wang Liang Zhao Xiang Chen AAML OOD 31 27 0 29 Sep 2018
A theoretical framework for deep locally connected ReLU network Yuandong Tian PINN 17 10 0 28 Sep 2018
On the loss landscape of a class of deep neural networks with no bad local valleys Quynh N. Nguyen Mahesh Chandra Mukkamala Matthias Hein 6 87 0 27 Sep 2018
Don't Use Large Mini-Batches, Use Local SGD Tao R. Lin Sebastian U. Stich Kumar Kshitij Patel Martin Jaggi 19 429 0 22 Aug 2018
Additional Representations for Improving Synthetic Aperture Sonar Classification Using Convolutional Neural Networks Isaac D. Gerg David P. Williams 22 11 0 08 Aug 2018
Fuzzy Logic Interpretation of Quadratic Networks Fenglei Fan Ge Wang 16 7 0 04 Jul 2018
How To Backdoor Federated Learning Eugene Bagdasaryan Andreas Veit Yiqing Hua D. Estrin Vitaly Shmatikov SILM FedML 13 1,869 0 02 Jul 2018
PCA of high dimensional random walks with comparison to neural network training J. Antognini Jascha Narain Sohl-Dickstein OOD 16 27 0 22 Jun 2018
Learning ReLU Networks via Alternating Minimization Gauri Jagatap C. Hegde 14 11 0 20 Jun 2018
Laplacian Smoothing Gradient Descent Stanley Osher Bao Wang Penghang Yin Xiyang Luo Farzin Barekat Minh Pham A. Lin ODL 12 43 0 17 Jun 2018
Efficient Full-Matrix Adaptive Regularization Naman Agarwal Brian Bullins Xinyi Chen Elad Hazan Karan Singh Cyril Zhang Yi Zhang 8 21 0 08 Jun 2018
Deep Neural Networks with Multi-Branch Architectures Are Less Non-Convex Hongyang R. Zhang Junru Shao Ruslan Salakhutdinov 23 14 0 06 Jun 2018
How Does Batch Normalization Help Optimization? Shibani Santurkar Dimitris Tsipras Andrew Ilyas A. Madry ODL 8 1,521 0 29 May 2018
Input and Weight Space Smoothing for Semi-supervised Learning Safa Cicek Stefano Soatto 14 6 0 23 May 2018
Reducing Parameter Space for Neural Network Training Tong Qin Ling Zhou D. Xiu 6 6 0 22 May 2018
SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning W. Wen Yandan Wang Feng Yan Cong Xu Chunpeng Wu Yiran Chen H. Li 21 49 0 21 May 2018
Nostalgic Adam: Weighting more of the past gradients when designing the adaptive learning rate Haiwen Huang Changzhang Wang Bin Dong ODL 9 59 0 19 May 2018
On Visual Hallmarks of Robustness to Adversarial Malware Alex Huang Abdullah Al-Dujaili Erik Hemberg Una-May O’Reilly AAML 17 7 0 09 May 2018
Stacked U-Nets: A No-Frills Approach to Natural Image Segmentation Sohil Shah P. Ghosh L. Davis Tom Goldstein SSeg 19 55 0 27 Apr 2018
DeepDIVA: A Highly-Functional Python Framework for Reproducible Experiments Michele Alberti Vinaychandran Pondenkandath Marcel Würsch Rolf Ingold Marcus Liwicki 6 27 0 23 Apr 2018
The Loss Surface of XOR Artificial Neural Networks D. Mehta Xiaojun Zhao Edgar A. Bernal D. Wales 24 19 0 06 Apr 2018
Essentially No Barriers in Neural Network Energy Landscape Felix Dräxler K. Veschgini M. Salmhofer Fred Hamprecht MoMe 20 423 0 02 Mar 2018
Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs T. Garipov Pavel Izmailov Dmitrii Podoprikhin Dmitry Vetrov A. Wilson UQCV 17 733 0 27 Feb 2018
Left ventricle segmentation By modelling uncertainty in prediction of deep convolutional neural networks and adaptive thresholding inference Alireza Norouzi Ali Emami S. M. Reza Soroushmehr N. Karimi S. Samavi Kayvan Najarian UQCV 20 1 0 23 Feb 2018
Improved Techniques For Weakly-Supervised Object Localization Junsuk Choe J. Park Hyunjung Shim WSOL 20 7 0 22 Feb 2018
Coulomb Autoencoders E. Sansone Hafiz Tiomoko Ali Jiacheng Sun DRL 21 1 0 10 Feb 2018
Critical Learning Periods in Deep Neural Networks Alessandro Achille Matteo Rovere Stefano Soatto 23 95 0 24 Nov 2017
Decoupled Weight Decay Regularization I. Loshchilov Frank Hutter OffRL 22 2,078 0 14 Nov 2017
End-to-end learning for music audio tagging at scale Jordi Pons Oriol Nieto Matthew Prockup Erik M. Schmidt Andreas F. Ehmann Xavier Serra 30 176 0 07 Nov 2017
Global optimality conditions for deep neural networks Chulhee Yun S. Sra Ali Jadbabaie 121 117 0 08 Jul 2017
Deep Relaxation: partial differential equations for optimizing deep neural networks Pratik Chaudhari Adam M. Oberman Stanley Osher Stefano Soatto G. Carlier 13 153 0 17 Apr 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,888 0 15 Sep 2016
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 175 1,185 0 30 Nov 2014