ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1906.04267
  4. Cited By
Beyond Folklore: A Scaling Calculus for the Design and Initialization of
  ReLU Networks
v1v2v3 (latest)

Beyond Folklore: A Scaling Calculus for the Design and Initialization of ReLU Networks

10 June 2019
Aaron Defazio
Léon Bottou
ArXiv (abs)PDFHTML

Papers citing "Beyond Folklore: A Scaling Calculus for the Design and Initialization of ReLU Networks"

2 / 2 papers shown
Why Gradients Rapidly Increase Near the End of Training
Why Gradients Rapidly Increase Near the End of Training
Aaron Defazio
157
7
0
02 Jun 2025
Principled Architecture-aware Scaling of Hyperparameters
Principled Architecture-aware Scaling of Hyperparameters
Wuyang Chen
Junru Wu
Zhangyang Wang
Boris Hanin
AI4CE
306
2
0
27 Feb 2024
1
Page 1 of 1