ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1906.04868
  4. Cited By
Semi-flat minima and saddle points by embedding neural networks to
  overparameterization
v1v2 (latest)

Semi-flat minima and saddle points by embedding neural networks to overparameterization

Neural Information Processing Systems (NeurIPS), 2019
12 June 2019
Kenji Fukumizu
Shoichiro Yamaguchi
Yoh-ichi Mototake
Mirai Tanaka
    3DPC
ArXiv (abs)PDFHTML

Papers citing "Semi-flat minima and saddle points by embedding neural networks to overparameterization"

22 / 22 papers shown
Flat Channels to Infinity in Neural Loss Landscapes
Flat Channels to Infinity in Neural Loss Landscapes
Flavio Martinelli
Alexander Van Meegen
Berfin Simsek
W. Gerstner
Johanni Brea
406
3
0
17 Jun 2025
Uncovering Critical Sets of Deep Neural Networks via Sample-Independent Critical Lifting
Uncovering Critical Sets of Deep Neural Networks via Sample-Independent Critical Lifting
Leyang Zhang
Yaoyu Zhang
Yaoyu Zhang
BDL
364
0
0
19 May 2025
An overview of condensation phenomenon in deep learning
An overview of condensation phenomenon in deep learning
Zhi-Qin John Xu
Yaoyu Zhang
Zhangchen Zhou
AI4CE
375
12
0
13 Apr 2025
Neural Network-based High-index Saddle Dynamics Method for Searching
  Saddle Points and Solution Landscape
Neural Network-based High-index Saddle Dynamics Method for Searching Saddle Points and Solution Landscape
Yuankai Liu
Lei Zhang
Jin Zhao
201
2
0
25 Nov 2024
Local Linear Recovery Guarantee of Deep Neural Networks at
  Overparameterization
Local Linear Recovery Guarantee of Deep Neural Networks at Overparameterization
Yaoyu Zhang
Leyang Zhang
Zhongwang Zhang
Zhiwei Bai
305
1
0
26 Jun 2024
Geometry of Critical Sets and Existence of Saddle Branches for Two-layer
  Neural Networks
Geometry of Critical Sets and Existence of Saddle Branches for Two-layer Neural Networks
Leyang Zhang
Yao Zhang
Yaoyu Zhang
292
0
0
26 May 2024
Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion
Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion
Zhiwei Bai
Jiajie Zhao
Yaoyu Zhang
AI4CE
438
3
0
22 May 2024
Exploring Neural Network Landscapes: Star-Shaped and Geodesic
  Connectivity
Exploring Neural Network Landscapes: Star-Shaped and Geodesic Connectivity
Zhanran Lin
Puheng Li
Lei Wu
519
9
0
09 Apr 2024
Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding
Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding
Zhengqing Wu
Berfin Simsek
Francois Ged
ODL
629
2
0
08 Feb 2024
Optimistic Estimate Uncovers the Potential of Nonlinear Models
Optimistic Estimate Uncovers the Potential of Nonlinear Models
Yaoyu Zhang
Zhongwang Zhang
Leyang Zhang
Zhiwei Bai
Yaoyu Zhang
Z. Xu
328
6
0
18 Jul 2023
Proximity to Losslessly Compressible Parameters
Proximity to Losslessly Compressible Parameters
Matthew Farrugia-Roberts
259
0
0
05 Jun 2023
Loss Spike in Training Neural Networks
Loss Spike in Training Neural NetworksJournal of Computational Mathematics (JCM), 2023
Zhongwang Zhang
Z. Xu
298
14
0
20 May 2023
Understanding the Initial Condensation of Convolutional Neural Networks
Understanding the Initial Condensation of Convolutional Neural NetworksCSIAM Transactions on Applied Mathematics (TCAM), 2023
Zhangchen Zhou
Hanxu Zhou
Yuqing Li
Zhi-Qin John Xu
MLTAI4CE
211
6
0
17 May 2023
Functional Equivalence and Path Connectivity of Reducible Hyperbolic
  Tangent Networks
Functional Equivalence and Path Connectivity of Reducible Hyperbolic Tangent NetworksNeural Information Processing Systems (NeurIPS), 2023
Matthew Farrugia-Roberts
298
6
0
08 May 2023
Linear Stability Hypothesis and Rank Stratification for Nonlinear Models
Linear Stability Hypothesis and Rank Stratification for Nonlinear Models
Yaoyu Zhang
Zhongwang Zhang
Leyang Zhang
Zhiwei Bai
Yaoyu Zhang
Z. Xu
177
9
0
21 Nov 2022
Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks
Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural NetworksCSIAM Transactions on Applied Mathematics (TCAM), 2022
Zhiwei Bai
Yaoyu Zhang
Z. Xu
Yaoyu Zhang
539
7
0
26 May 2022
Embedding Principle: a hierarchical structure of loss landscape of deep
  neural networks
Embedding Principle: a hierarchical structure of loss landscape of deep neural networks
Yaoyu Zhang
Yuqing Li
Zhongwang Zhang
Yaoyu Zhang
Z. Xu
245
26
0
30 Nov 2021
Embedding Principle of Loss Landscape of Deep Neural Networks
Embedding Principle of Loss Landscape of Deep Neural NetworksNeural Information Processing Systems (NeurIPS), 2021
Yaoyu Zhang
Zhongwang Zhang
Yaoyu Zhang
Z. Xu
290
44
0
30 May 2021
Geometry of the Loss Landscape in Overparameterized Neural Networks:
  Symmetries and Invariances
Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and InvariancesInternational Conference on Machine Learning (ICML), 2021
Berfin cSimcsek
François Ged
Arthur Jacot
Francesco Spadaro
Clément Hongler
W. Gerstner
Johanni Brea
AI4CE
365
132
0
25 May 2021
Towards Understanding the Condensation of Neural Networks at Initial
  Training
Towards Understanding the Condensation of Neural Networks at Initial TrainingNeural Information Processing Systems (NeurIPS), 2021
Hanxu Zhou
Qixuan Zhou
Yaoyu Zhang
Yaoyu Zhang
Z. Xu
MLTAI4CE
450
34
0
25 May 2021
When Are Solutions Connected in Deep Networks?
When Are Solutions Connected in Deep Networks?Neural Information Processing Systems (NeurIPS), 2021
Quynh N. Nguyen
Pierre Bréchet
Marco Mondelli
444
10
0
18 Feb 2021
Rethinking Parameter Counting in Deep Models: Effective Dimensionality
  Revisited
Rethinking Parameter Counting in Deep Models: Effective Dimensionality Revisited
Wesley J. Maddox
Gregory W. Benton
A. Wilson
369
66
0
04 Mar 2020
1
Page 1 of 1