Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales

Terms and Conditions

Twitter GitHub LinkedIn Bluesky Youtube

© 2026 ResearchTrend.AI, All rights reserved.

Home
Papers
1609.04836
Cited By

On Large-Batch Training for Deep Learning: Generalization Gap and Sharp
Minima

v1v2 (latest)

On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima

15 September 2016

Dheevatsa Mudigere

ArXiv (abs)PDF HTML

Papers citing "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima"

50 / 1,653 papers shown

Fast LLM Post-training via Decoupled and Fastest-of-N Speculation

Fast LLM Post-training via Decoupled and Fastest-of-N Speculation

...

436

0

0

24 Dec 2025

Data Curation Through the Lens of Spectral Dynamics: Static Limits, Dynamic Acceleration, and Practical Oracles

Data Curation Through the Lens of Spectral Dynamics: Static Limits, Dynamic Acceleration, and Practical Oracles

132

0

0

02 Dec 2025

Frequency-Adaptive Sharpness Regularization for Improving 3D Gaussian Splatting Generalization

Frequency-Adaptive Sharpness Regularization for Improving 3D Gaussian Splatting Generalization

144

0

0

22 Nov 2025

A Unified Stability Analysis of SAM vs SGD: Role of Data Coherence and Emergence of Simplicity Bias

A Unified Stability Analysis of SAM vs SGD: Role of Data Coherence and Emergence of Simplicity Bias

196

0

0

21 Nov 2025

Forecasting Thermospheric Density with Transformers for Multi-Satellite Orbit Management

Forecasting Thermospheric Density with Transformers for Multi-Satellite Orbit Management

Alessandro Bortotto

Mohamed Khalil Ben-Larbi

45

0

0

08 Nov 2025

Linear Mode Connectivity under Data Shifts for Deep Ensembles of Image Classifiers

Linear Mode Connectivity under Data Shifts for Deep Ensembles of Image Classifiers

175

0

0

06 Nov 2025

Sharp Minima Can Generalize: A Loss Landscape Perspective On Data

Sharp Minima Can Generalize: A Loss Landscape Perspective On Data

126

0

0

06 Nov 2025

Flat Minima and Generalization: Insights from Stochastic Convex Optimization

Flat Minima and Generalization: Insights from Stochastic Convex Optimization

Matan Schliserman

Shira Vansover-Hager

112

0

0

05 Nov 2025

The Curvature Rate λ: A Scalar Measure of Input-Space Sharpness in Neural Networks

The Curvature Rate λ: A Scalar Measure of Input-Space Sharpness in Neural Networks

173

0

0

03 Nov 2025

Bayesian Natural Gradient Fine-Tuning of CLIP Models via Kalman Filtering

Bayesian Natural Gradient Fine-Tuning of CLIP Models via Kalman Filtering

235

0

0

03 Nov 2025

A Framework Based on Graph Cellular Automata for Similarity Evaluation in Urban Spatial Networks

A Framework Based on Graph Cellular Automata for Similarity Evaluation in Urban Spatial Networks

124

0

0

02 Nov 2025

Information-Theoretic Greedy Layer-wise Training for Traffic Sign Recognition

Information-Theoretic Greedy Layer-wise Training for Traffic Sign Recognition

114

0

0

31 Oct 2025

DP-FedPGN: Finding Global Flat Minima for Differentially Private Federated Learning via Penalizing Gradient Norm

DP-FedPGN: Finding Global Flat Minima for Differentially Private Federated Learning via Penalizing Gradient Norm

275

2

0

31 Oct 2025

Gradient Descent as Loss Landscape Navigation: a Normative Framework for Deriving Learning Rules

Gradient Descent as Loss Landscape Navigation: a Normative Framework for Deriving Learning Rules

John J. Vastola

Samuel J. Gershman

124

1

0

30 Oct 2025

Gradient-Weight Alignment as a Train-Time Proxy for Generalization in Classification Tasks

Gradient-Weight Alignment as a Train-Time Proxy for Generalization in Classification Tasks

Florian A. Hölzl

Daniel Rueckert

Georgios Kaissis

142

0

0

29 Oct 2025

A Convexity-dependent Two-Phase Training Algorithm for Deep Neural Networks

A Convexity-dependent Two-Phase Training Algorithm for Deep Neural Networks

Bernhard Bermeitinger

Götz-Henrik Wiegand

Siegfried Handschuh

71

0

0

29 Oct 2025

From Memorization to Reasoning in the Spectrum of Loss Curvature

From Memorization to Reasoning in the Spectrum of Loss Curvature

Srihita Vatsavaya

210

1

0

28 Oct 2025

Modality-Aware SAM: Sharpness-Aware-Minimization Driven Gradient Modulation for Harmonized Multimodal Learning

Modality-Aware SAM: Sharpness-Aware-Minimization Driven Gradient Modulation for Harmonized Multimodal Learning

Hossein R. Nowdeh

139

0

0

28 Oct 2025

More Than Memory Savings: Zeroth-Order Optimization Mitigates Forgetting in Continual Learning

More Than Memory Savings: Zeroth-Order Optimization Mitigates Forgetting in Continual Learning

243

0

0

23 Oct 2025

Convergence Analysis of SGD under Expected Smoothness

Convergence Analysis of SGD under Expected Smoothness

148

0

0

23 Oct 2025

Position: Many generalization measures for deep learning are fragile

Position: Many generalization measures for deep learning are fragile

279

0

0

21 Oct 2025

A Unified Perspective on Optimization in Machine Learning and Neuroscience: From Gradient Descent to Neural Adaptation

A Unified Perspective on Optimization in Machine Learning and Neuroscience: From Gradient Descent to Neural Adaptation

Jesus Garcia Fernandez

Marcel van Gerven

259

0

0

21 Oct 2025

Stochastic Difference-of-Convex Optimization with Momentum

Stochastic Difference-of-Convex Optimization with Momentum

El Mahdi Chayti

119

0

0

20 Oct 2025

Seeing Through the Brain: New Insights from Decoding Visual Stimuli with fMRI

Seeing Through the Brain: New Insights from Decoding Visual Stimuli with fMRI

128

0

0

17 Oct 2025

When Flatness Does (Not) Guarantee Adversarial Robustness

When Flatness Does (Not) Guarantee Adversarial Robustness

Nils Philipp Walter

134

1

0

16 Oct 2025

DYNAMIX: RL-based Adaptive Batch Size Optimization in Distributed Machine Learning Systems

DYNAMIX: RL-based Adaptive Batch Size Optimization in Distributed Machine Learning Systems

123

0

0

09 Oct 2025

Unveiling the Power of Multiple Gossip Steps: A Stability-Based Generalization Analysis in Decentralized Training

Unveiling the Power of Multiple Gossip Steps: A Stability-Based Generalization Analysis in Decentralized Training

114

0

0

09 Oct 2025

LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution

LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution

199

0

0

09 Oct 2025

AppForge: From Assistant to Independent Developer - Are GPTs Ready for Software Development?

AppForge: From Assistant to Independent Developer - Are GPTs Ready for Software Development?

...

116

0

0

09 Oct 2025

Adjusting Initial Noise to Mitigate Memorization in Text-to-Image Diffusion Models

Adjusting Initial Noise to Mitigate Memorization in Text-to-Image Diffusion Models

186

1

0

08 Oct 2025

The Effect of Label Noise on the Information Content of Neural Representations

The Effect of Label Noise on the Information Content of Neural Representations

Ali Hussaini Umar

Franky Kevin Nando Tezoh

Santiago Acevedo

Alessandro Laio

230

0

0

07 Oct 2025

How does the optimizer implicitly bias the model merging loss landscape?

How does the optimizer implicitly bias the model merging loss landscape?

Chenxiang Zhang

Alexander Theus

Antonio Orvieto

189

1

0

06 Oct 2025

Categorical Invariants of Learning Dynamics

Categorical Invariants of Learning Dynamics

Abdulrahman Tamim

116

0

0

05 Oct 2025

Adaptively Sampling-Reusing-Mixing Decomposed Gradients to Speed Up Sharpness Aware Minimization

Adaptively Sampling-Reusing-Mixing Decomposed Gradients to Speed Up Sharpness Aware Minimization

164

0

0

04 Oct 2025

Optimal Scaling Needs Optimal Norm

Optimal Scaling Needs Optimal Norm

Stefan Kesselheim

166

2

0

04 Oct 2025

Flatness-Aware Stochastic Gradient Langevin Dynamics

Flatness-Aware Stochastic Gradient Langevin Dynamics

Sotirios Sabanis

176

0

0

02 Oct 2025

How Does Preconditioning Guide Feature Learning in Deep Neural Networks?

How Does Preconditioning Guide Feature Learning in Deep Neural Networks?

Atsushi Nitanda

243

0

0

30 Sep 2025

Hybrid Dual-Batch and Cyclic Progressive Learning for Efficient Distributed Training

Hybrid Dual-Batch and Cyclic Progressive Learning for Efficient Distributed Training

124

0

0

30 Sep 2025

Sharpness of Minima in Deep Matrix Factorization: Exact Expressions

Sharpness of Minima in Deep Matrix Factorization: Exact Expressions

350

0

0

30 Sep 2025

Reconcile Certified Robustness and Accuracy for DNN-based Smoothed Majority Vote Classifier

Reconcile Certified Robustness and Accuracy for DNN-based Smoothed Majority Vote Classifier

136

1

0

30 Sep 2025

Beyond Magic Words: Sharpness-Aware Prompt Evolving for Robust Large Language Models with TARE

Beyond Magic Words: Sharpness-Aware Prompt Evolving for Robust Large Language Models with TARE

...

155

0

0

28 Sep 2025

Dynamics of Learning: Generative Schedules from Latent ODEs

Dynamics of Learning: Generative Schedules from Latent ODEs

Matt L. Sampson

117

0

0

27 Sep 2025

Fine-tuning Done Right in Model Editing

Fine-tuning Done Right in Model Editing

180

0

0

26 Sep 2025

Sharpness-Aware Minimization Can Hallucinate Minimizers

Sharpness-Aware Minimization Can Hallucinate Minimizers

158

0

0

26 Sep 2025

TRUST: Test-Time Refinement using Uncertainty-Guided SSM Traverses

TRUST: Test-Time Refinement using Uncertainty-Guided SSM Traverses

Moslem Yazdanpanah

David Osowiechi

Ismail Ben Ayed

Christian Desrosiers

227

0

0

26 Sep 2025

A Unified Noise-Curvature View of Loss of Trainability

A Unified Noise-Curvature View of Loss of Trainability

Gunbir Singh Baveja

Alex Lewandowski

184

0

0

24 Sep 2025

Flatness is Necessary, Neural Collapse is Not: Rethinking Generalization via Grokking

Flatness is Necessary, Neural Collapse is Not: Rethinking Generalization via Grokking

244

1

0

22 Sep 2025

Neural Network Based Framework for Passive Intermodulation Cancellation in MIMO Systems

Neural Network Based Framework for Passive Intermodulation Cancellation in MIMO Systems

162

0

0

21 Sep 2025

DIVEBATCH: Accelerating Model Training Through Gradient-Diversity Aware Batch Size Adaptation

DIVEBATCH: Accelerating Model Training Through Gradient-Diversity Aware Batch Size Adaptation

106

0

0

19 Sep 2025

MEC-Quant: Maximum Entropy Coding for Extremely Low Bit Quantization-Aware Training

MEC-Quant: Maximum Entropy Coding for Extremely Low Bit Quantization-Aware Training

124

0

0

19 Sep 2025

1 2 3 4...32 33 34