Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Papers citing "Visualizing the Loss Landscape of Neural Nets"

50 / 1,039 papers shown

Title
Diametrical Risk Minimization: Theory and Computations Matthew Norton J. Royset 22 19 0 24 Oct 2019
Semantic Segmentation of Skin Lesions using a Small Data Set B. Sirmaçek M.P.W. Kivits SSeg 20 4 0 23 Oct 2019
Speech-XLNet: Unsupervised Acoustic Model Pretraining For Self-Attention Networks Xingcheng Song Guangsen Wang Zhiyong Wu Yiheng Huang Dan Su Dong Yu H. Meng SSL 15 49 0 23 Oct 2019
J Regularization Improves Imbalanced Multiclass Segmentation F. Guerrero-Peña Pedro Diamel Marrero Fernández Paul T. Tarr Ing Ren Tsang E. Meyerowitz Alexandre Cunha 18 30 0 22 Oct 2019
Theoretical Limits of Pipeline Parallel Optimization and Application to Distributed Deep Learning Igor Colin Ludovic Dos Santos Kevin Scaman 21 10 0 11 Oct 2019
PipeMare: Asynchronous Pipeline Parallel DNN Training Bowen Yang Jian Zhang Jonathan Li Christopher Ré Christopher R. Aberger Christopher De Sa 11 110 0 09 Oct 2019
Loss Landscape Sightseeing with Multi-Point Optimization Ivan Skorokhodov Mikhail Burtsev 3DPC 13 18 0 09 Oct 2019
GradVis: Visualization and Second Order Analysis of Optimization Surfaces during the Training of Deep Neural Networks Avraam Chatzimichailidis Franz-Josef Pfreundt N. Gauger J. Keuper 19 10 0 26 Sep 2019
Towards Understanding the Transferability of Deep Representations Hong Liu Mingsheng Long Jianmin Wang Michael I. Jordan 16 25 0 26 Sep 2019
Learning an Adaptive Learning Rate Schedule Zhen Xu Andrew M. Dai Jonas Kemp Luke Metz 14 61 0 20 Sep 2019
Understanding Architectures Learnt by Cell-based Neural Architecture Search Yao Shu Wei Wang Shaofeng Cai 14 87 0 20 Sep 2019
Ensemble Knowledge Distillation for Learning Improved and Efficient Networks Umar Asif Jianbin Tang S. Harrer FedML 11 74 0 17 Sep 2019
Visualizing Movement Control Optimization Landscapes Perttu Hämäläinen Juuso Toikka Amin Babadi Karen Liu 11 7 0 17 Sep 2019
Scene Compliant Trajectory Forecast with Agent-Centric Spatio-Temporal Grids Daniela A. Ridel Nachiket Deo D. Wolf Mohan M. Trivedi 22 69 0 16 Sep 2019
Towards Understanding the Importance of Shortcut Connections in Residual Networks Tianyi Liu Minshuo Chen Mo Zhou S. Du Enlu Zhou T. Zhao 4 43 0 10 Sep 2019
Port-Hamiltonian Approach to Neural Network Training Stefano Massaroli Michael Poli Federico Califano Angela Faragasso Jinkyoo Park Atsushi Yamashita Hajime Asama 10 14 0 06 Sep 2019
LCA: Loss Change Allocation for Neural Network Training Janice Lan Rosanne Liu Hattie Zhou J. Yosinski 8 24 0 03 Sep 2019
Deep Learning for Estimating Synaptic Health of Primary Neuronal Cell Culture Andrey Kormilitzin Xinyu Yang William H. Stone Caroline Woffindale Francesca Nicholls E. Ribe A. Nevado-Holgado N. Buckley 8 0 0 29 Aug 2019
Facial age estimation by deep residual decision making Shichao Li K. Cheng CVBM 14 6 0 28 Aug 2019
Neural Architecture Search by Estimation of Network Structure Distributions A. Muravev Jenni Raitoharju M. Gabbouj OOD 6 1 0 19 Aug 2019
Visualizing and Understanding the Effectiveness of BERT Y. Hao Li Dong Furu Wei Ke Xu 22 181 0 15 Aug 2019
Visualizing the PHATE of Neural Networks Scott A. Gigante Adam S. Charles Smita Krishnaswamy Gal Mishne 25 37 0 07 Aug 2019
Path Length Bounds for Gradient Descent and Flow Chirag Gupta Sivaraman Balakrishnan Aaditya Ramdas 79 15 0 02 Aug 2019
Calibrating the Adaptive Learning Rate to Improve Convergence of ADAM Qianqian Tong Guannan Liang J. Bi 36 7 0 02 Aug 2019
Momentum-Net: Fast and convergent iterative neural network for inverse problems Il Yong Chun Zhengyu Huang Hongki Lim Jeffrey A. Fessler 11 81 0 26 Jul 2019
Taming Momentum in a Distributed Asynchronous Environment Ido Hakimi Saar Barkai Moshe Gabel Assaf Schuster 11 23 0 26 Jul 2019
Higher-Order Function Networks for Learning Composable 3D Object Representations E. Mitchell Kazim Selim Engin Volkan Isler Daniel D. Lee AI4CE 3DPC 5 21 0 24 Jul 2019
Understanding Adversarial Robustness Through Loss Landscape Geometries Vinay Uday Prabhu Dian Ang Yap Joyce Xu John Whaley AAML 11 17 0 22 Jul 2019
Spectral Analysis of Latent Representations Justin Shenk Mats L. Richter Anders Arpteg Mikael Huss FAtt 8 6 0 19 Jul 2019
Subspace Inference for Bayesian Deep Learning Pavel Izmailov Wesley J. Maddox Polina Kirichenko T. Garipov Dmitry Vetrov A. Wilson UQCV BDL 17 141 0 17 Jul 2019
Towards Understanding Generalization in Gradient-Based Meta-Learning Simon Guiroy Vikas Verma C. Pal 7 21 0 16 Jul 2019
Positional Normalization Boyi Li Felix Wu Kilian Q. Weinberger Serge J. Belongie 17 91 0 09 Jul 2019
Are deep ResNets provably better than linear predictors? Chulhee Yun S. Sra Ali Jadbabaie 11 12 0 09 Jul 2019
Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape Johanni Brea Berfin Simsek Bernd Illing W. Gerstner 15 55 0 05 Jul 2019
Slim-CNN: A Light-Weight CNN for Face Attribute Prediction A. Sharma H. Foroosh CVBM 3DH 8 41 0 03 Jul 2019
Deep Gamblers: Learning to Abstain with Portfolio Theory Liu Ziyin Zhikang T. Wang Paul Pu Liang Ruslan Salakhutdinov Louis-Philippe Morency Masahito Ueda 21 110 0 29 Jun 2019
Neural ODEs as the Deep Limit of ResNets with constant weights B. Avelin K. Nystrom ODL 32 31 0 28 Jun 2019
Gradient Noise Convolution (GNC): Smoothing Loss Function for Distributed Large-Batch SGD Kosuke Haruki Taiji Suzuki Yohei Hamakawa Takeshi Toda Ryuji Sakai M. Ozawa Mitsuhiro Kimura ODL 6 17 0 26 Jun 2019
Exploring Model-based Planning with Policy Networks Tingwu Wang Jimmy Ba 23 147 0 20 Jun 2019
Learning to Forget for Meta-Learning Sungyong Baik Seokil Hong Kyoung Mu Lee CLL KELM 8 87 0 13 Jun 2019
Mask2Lesion: Mask-Constrained Adversarial Skin Lesion Image Synthesis Kumar Abhishek Ghassan Hamarneh GAN MedIm 15 40 0 13 Jun 2019
Generalization Guarantees for Neural Networks via Harnessing the Low-rank Structure of the Jacobian Samet Oymak Zalan Fabian Mingchen Li Mahdi Soltanolkotabi MLT 17 88 0 12 Jun 2019
A Closer Look at the Optimization Landscapes of Generative Adversarial Networks Hugo Berard Gauthier Gidel Amjad Almahairi Pascal Vincent Simon Lacoste-Julien GAN 15 64 0 11 Jun 2019
Large Scale Structure of Neural Network Loss Landscapes Stanislav Fort Stanislaw Jastrzebski 11 82 0 11 Jun 2019
Understanding Generalization through Visualizations W. R. Huang Z. Emam Micah Goldblum Liam H. Fowl J. K. Terry Furong Huang Tom Goldstein AI4CE 11 80 0 07 Jun 2019
The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks Ryo Karakida S. Akaho S. Amari 19 39 0 07 Jun 2019
AutoGrow: Automatic Layer Growing in Deep Convolutional Networks W. Wen Feng Yan Yiran Chen H. Li 10 38 0 07 Jun 2019
Stochasticity and Robustness in Spiking Neural Networks W. Olin-Ammentorp K. Beckmann Catherine D. Schuman J. Plank N. Cady 17 12 0 06 Jun 2019
A Tunable Loss Function for Robust Classification: Calibration, Landscape, and Generalization Tyler Sypherd Mario Díaz J. Cava Gautam Dasarathy Peter Kairouz Lalitha Sankar 13 27 0 05 Jun 2019
An Empirical Study on Hyperparameters and their Interdependence for RL Generalization Xingyou Song Yilun Du Jacob Jackson AI4CE 19 8 0 02 Jun 2019