v1v2 (latest)

The Goldilocks zone: Towards better understanding of neural network loss landscapes

6 July 2018

Papers citing "The Goldilocks zone: Towards better understanding of neural network loss landscapes"

20 / 20 papers shown

Title
Beginning with You: Perceptual-Initialization Improves Vision-Language Representation and Alignment Yang Hu Runchen Wang Stephen Chong Zhao Xuhui Zhan Do Hun Kim Mark Wallace David A. Tovar VLM 75 0 0 20 May 2025
High-entropy Advantage in Neural Networks' Generalizability Entao Yang Wei Wei Yue Shang Ge Zhang AI4CE 119 0 0 17 Mar 2025
Visualizing, Rethinking, and Mining the Loss Landscape of Deep Neural Networks Yichu Xu Xin-Chun Li Lan Li De-Chuan Zhan 87 2 0 21 May 2024
On the Overlooked Structure of Stochastic Gradients Zeke Xie Qian-Yuan Tang Mingming Sun P. Li 90 6 0 05 Dec 2022
Omnigrok: Grokking Beyond Algorithmic Data Ziming Liu Eric J. Michaud Max Tegmark 112 85 0 03 Oct 2022
FuNNscope: Visual microscope for interactively exploring the loss landscape of fully connected neural networks Aleksandar Doknic Torsten Moller 100 2 0 09 Apr 2022
A Local Convergence Theory for the Stochastic Gradient Descent Method in Non-Convex Optimization With Non-isolated Local Minima Tae-Eon Ko Xiantao Li 55 2 0 21 Mar 2022
Born-Infeld (BI) for AI: Energy-Conserving Descent (ECD) for Optimization G. Luca E. Silverstein 71 11 0 26 Jan 2022
Priors in Bayesian Deep Learning: A Review Vincent Fortuin UQCV BDL 137 133 0 14 May 2021
Analyzing Monotonic Linear Interpolation in Neural Network Loss Landscapes James Lucas Juhan Bae Michael Ruogu Zhang Stanislav Fort R. Zemel Roger C. Grosse MoMe 234 28 0 22 Apr 2021
Improving Neural Network Training in Low Dimensional Random Bases Frithjof Gressmann Zach Eaton-Rosen Carlo Luschi 78 28 0 09 Nov 2020
Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel Stanislav Fort Gintare Karolina Dziugaite Mansheej Paul Sepideh Kharaghani Daniel M. Roy Surya Ganguli 109 193 0 28 Oct 2020
Traces of Class/Cross-Class Structure Pervade Deep Learning Spectra Vardan Papyan 64 80 0 27 Aug 2020
The Break-Even Point on Optimization Trajectories of Deep Neural Networks Stanislaw Jastrzebski Maciej Szymczak Stanislav Fort Devansh Arpit Jacek Tabor Kyunghyun Cho Krzysztof J. Geras 88 164 0 21 Feb 2020
Deep Ensembles: A Loss Landscape Perspective Stanislav Fort Huiyi Hu Balaji Lakshminarayanan OOD UQCV 139 631 0 05 Dec 2019
Emergent properties of the local geometry of neural loss landscapes Stanislav Fort Surya Ganguli 120 51 0 14 Oct 2019
Large Scale Structure of Neural Network Loss Landscapes Stanislav Fort Stanislaw Jastrzebski 72 84 0 11 Jun 2019
An Investigation into Neural Net Optimization via Hessian Eigenvalue Density Behrooz Ghorbani Shankar Krishnan Ying Xiao ODL 101 326 0 29 Jan 2019
Stiffness: A New Perspective on Generalization in Neural Networks Stanislav Fort Pawel Krzysztof Nowak Stanislaw Jastrzebski S. Narayanan 131 94 0 28 Jan 2019
Understanding the impact of entropy on policy optimization Zafarali Ahmed Nicolas Le Roux Mohammad Norouzi Dale Schuurmans 81 238 0 27 Nov 2018