On the adequacy of untuned warmup for adaptive optimization

9 October 2019

Papers citing "On the adequacy of untuned warmup for adaptive optimization"

4 / 4 papers shown

Title
Sampling Foundational Transformer: A Theoretical Perspective Viet Anh Nguyen Minh Lenhat Khoa Nguyen Duong Duc Hieu Dao Huu Hung Truong Son-Hy 42 0 0 11 Aug 2024
Resource Efficient Perception for Vision Systems M. I. A V Subramanyam Niyati Singal Vinay K. Verma 25 0 0 12 May 2024
Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks Tim Whitaker Darrell Whitley 15 0 0 16 Jan 2024
Quasi-hyperbolic momentum and Adam for deep learning Jerry Ma Denis Yarats ODL 73 126 0 16 Oct 2018