CProp: Adaptive Learning Rate Scaling from Past Gradient Conformity

24 December 2019

Papers citing "CProp: Adaptive Learning Rate Scaling from Past Gradient Conformity"

2 / 2 papers shown

Title
A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay L. Smith 205 1,019 0 26 Mar 2018
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,888 0 15 Sep 2016