Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Papers citing "Visualizing the Loss Landscape of Neural Nets"

50 / 1,039 papers shown

Title
Learning Neural Network Subspaces Mitchell Wortsman Maxwell Horton Carlos Guestrin Ali Farhadi Mohammad Rastegari UQCV 22 85 0 20 Feb 2021
Training Larger Networks for Deep Reinforcement Learning Keita Ota Devesh K. Jha Asako Kanezaki OffRL 12 39 0 16 Feb 2021
WGAN with an Infinitely Wide Generator Has No Spurious Stationary Points Albert No Taeho Yoon Sehyun Kwon Ernest K. Ryu GAN 19 2 0 15 Feb 2021
Eliminating Sharp Minima from SGD with Truncated Heavy-tailed Noise Xingyu Wang Sewoong Oh C. Rhee 13 13 0 08 Feb 2021
OPT-GAN: A Broad-Spectrum Global Optimizer for Black-box Problems by Learning Distribution Minfang Lu Shuai Ning Shuangrong Liu Fengyang Sun Bo Zhang Bo Yang Linshan Wang 28 4 0 07 Feb 2021
Understanding the Interaction of Adversarial Training with Noisy Labels Jianing Zhu Jingfeng Zhang Bo Han Tongliang Liu Gang Niu Hongxia Yang Mohan S. Kankanhalli Masashi Sugiyama AAML 14 27 0 06 Feb 2021
Adversarial Training Makes Weight Loss Landscape Sharper in Logistic Regression Masanori Yamada Sekitoshi Kanai Tomoharu Iwata Tomokatsu Takahashi Yuki Yamanaka Hiroshi Takahashi Atsutoshi Kumagai AAML 8 9 0 05 Feb 2021
ConvNets for Counting: Object Detection of Transient Phenomena in Steelpan Drums Scott H. Hawley Andrew C. Morrison 11 2 0 01 Feb 2021
Exploring the Geometry and Topology of Neural Network Loss Landscapes Stefan Horoi Je-chun Huang Bastian Alexander Rieck Guillaume Lajoie Guy Wolf Smita Krishnaswamy 13 13 0 31 Jan 2021
Visualization of Nonlinear Programming for Robot Motion Planning David Hägele Moataz Abdelaal Ozgur S. Oguz Marc Toussaint Daniel Weiskopf 20 3 0 28 Jan 2021
Old but Gold: Reconsidering the value of feedforward learners for software analytics Rahul Yedida Xueqi Yang Tim Menzies AI4TS 17 4 0 15 Jan 2021
Spending Your Winning Lottery Better After Drawing It Ajay Jaiswal Haoyu Ma Tianlong Chen Ying Ding Zhangyang Wang 20 6 0 08 Jan 2021
BN-invariant sharpness regularizes the training model to better generalization Mingyang Yi Huishuai Zhang Wei Chen Zhi-Ming Ma Tie-Yan Liu 22 3 0 08 Jan 2021
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 32 2 0 04 Jan 2021
Recoding latent sentence representations -- Dynamic gradient-based activation modification in RNNs Dennis Ulmer 23 0 0 03 Jan 2021
Topological obstructions in neural networks learning S. Barannikov Daria Voronkova I. Trofimov Alexander Korotin Grigorii Sotnikov Evgeny Burnaev 15 6 0 31 Dec 2020
BinaryBERT: Pushing the Limit of BERT Quantization Haoli Bai Wei Zhang Lu Hou Lifeng Shang Jing Jin Xin Jiang Qun Liu Michael Lyu Irwin King MQ 142 221 0 31 Dec 2020
Mathematical Models of Overparameterized Neural Networks Cong Fang Hanze Dong Tong Zhang 27 22 0 27 Dec 2020
Understanding Decoupled and Early Weight Decay Johan Bjorck Kilian Q. Weinberger Carla P. Gomes 6 26 0 27 Dec 2020
Data optimization for large batch distributed training of deep neural networks Shubhankar Gahlot Junqi Yin Mallikarjun Shankar 11 1 0 16 Dec 2020
Amata: An Annealing Mechanism for Adversarial Training Acceleration Nanyang Ye Qianxiao Li Xiao-Yun Zhou Zhanxing Zhu AAML 24 15 0 15 Dec 2020
Concept Generalization in Visual Representation Learning Mert Bulent Sariyildiz Yannis Kalantidis Diane Larlus Alahari Karteek SSL 26 50 0 10 Dec 2020
A Deeper Look at the Hessian Eigenspectrum of Deep Neural Networks and its Applications to Regularization Adepu Ravi Sankar Yash Khasbage Rahul Vigneswaran V. Balasubramanian 25 41 0 07 Dec 2020
Exploration-Exploitation in Multi-Agent Learning: Catastrophe Theory Meets Game Theory Stefanos Leonardos Georgios Piliouras 23 40 0 05 Dec 2020
Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning Daniel Grießhaber J. Maucher Ngoc Thang Vu 17 46 0 04 Dec 2020
DeepVideoMVS: Multi-View Stereo on Video with Recurrent Spatio-Temporal Fusion Arda Duzcceker S. Galliani Christoph Vogel Pablo Speciale Mihai Dusmanu Marc Pollefeys MDE 15 96 0 03 Dec 2020
Temporal Representation Learning on Monocular Videos for 3D Human Pose Estimation S. Honari Victor Constantin Helge Rhodin Mathieu Salzmann Pascal Fua 3DH 34 10 0 02 Dec 2020
Neural Teleportation M. Armenta Thierry Judge Nathan Painchaud Youssef Skandarani Carl Lemaire Gabriel Gibeau Sanchez Philippe Spino Pierre-Marc Jodoin 6 15 0 02 Dec 2020
To Boldly Show What No One Has Seen Before: A Dashboard for Visualizing Multi-objective Landscapes Lennart Schäpermeier C. Grimme P. Kerschke 19 11 0 29 Nov 2020
Is Support Set Diversity Necessary for Meta-Learning? Amrith Rajagopal Setlur Oscar Li Virginia Smith 18 16 0 28 Nov 2020
GENNI: Visualising the Geometry of Equivalences for Neural Network Identifiability Daniel Lengyel Janith C. Petangoda Isak Falk Kate Highnam Michalis Lazarou A. Kolbeinsson M. Deisenroth N. Jennings 7 4 0 14 Nov 2020
SALR: Sharpness-aware Learning Rate Scheduler for Improved Generalization Xubo Yue Maher Nouiehed Raed Al Kontar ODL 14 4 0 10 Nov 2020
Improving Neural Network Training in Low Dimensional Random Bases Frithjof Gressmann Zach Eaton-Rosen Carlo Luschi 22 28 0 09 Nov 2020
Matthews Correlation Coefficient Loss for Deep Convolutional Networks: Application to Skin Lesion Segmentation Kumar Abhishek Ghassan Hamarneh 16 31 0 26 Oct 2020
Deep Neural Mobile Networking Chaoyun Zhang 32 1 0 23 Oct 2020
Characterizing Deep Gaussian Processes via Nonlinear Recurrence Systems Anh Tong Jaesik Choi 21 2 0 19 Oct 2020
Towards Theoretically Understanding Why SGD Generalizes Better Than ADAM in Deep Learning Pan Zhou Jiashi Feng Chao Ma Caiming Xiong S. Hoi E. Weinan 25 227 0 12 Oct 2020
Towards Hardware-Agnostic Gaze-Trackers Jatin Sharma Jon Campbell P. Ansell Jay Beavers Christopher O'Dowd 12 2 0 11 Oct 2020
Regularizing Neural Networks via Adversarial Model Perturbation Yaowei Zheng Richong Zhang Yongyi Mao AAML 22 95 0 10 Oct 2020
Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate Zhiyuan Li Kaifeng Lyu Sanjeev Arora 18 74 0 06 Oct 2020
Deep kernel processes Laurence Aitchison Adam X. Yang Sebastian W. Ober BDL 16 41 0 04 Oct 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 57 1,276 0 03 Oct 2020
Unsupervised Point Cloud Pre-Training via Occlusion Completion Hanchen Wang Qi Liu Xiangyu Yue Joan Lasenby Matt J. Kusner 3DPC 13 243 0 02 Oct 2020
Accelerating Convergence of Replica Exchange Stochastic Gradient MCMC via Variance Reduction Wei Deng Qi Feng G. Karagiannis Guang Lin F. Liang 33 8 0 02 Oct 2020
Effective Regularization Through Loss-Function Metalearning Santiago Gonzalez Risto Miikkulainen 24 5 0 02 Oct 2020
Implicit Gradient Regularization David Barrett Benoit Dherin 14 146 0 23 Sep 2020
Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don't E. Weinan Chao Ma Stephan Wojtowytsch Lei Wu AI4CE 14 133 0 22 Sep 2020
Anomalous diffusion dynamics of learning in deep neural networks Guozhang Chen Chengqing Qu P. Gong 19 21 0 22 Sep 2020
Learning Task-Agnostic Action Spaces for Movement Optimization Amin Babadi M. van de Panne Caren Liu Perttu Hämäläinen 6 2 0 22 Sep 2020
Kernel-Based Smoothness Analysis of Residual Networks Tom Tirer Joan Bruna Raja Giryes 18 18 0 21 Sep 2020