Tune without Validation: Searching for Learning Rate and Weight Decay on Training Sets

8 March 2024

Papers citing "Tune without Validation: Searching for Learning Rate and Weight Decay on Training Sets"

7 / 7 papers shown

Title
Hyperparameter Optimization through Neural Network Partitioning Bruno Mlodozeniec M. Reisser Christos Louizos 29 6 0 28 Apr 2023
Omnigrok: Grokking Beyond Algorithmic Data Ziming Liu Eric J. Michaud Max Tegmark 54 76 0 03 Oct 2022
MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classification Jiancheng Yang Rui Shi D. Wei Zequan Liu Lin Zhao B. Ke Hanspeter Pfister Bingbing Ni VLM 161 645 0 27 Oct 2021
Bag of Tricks for Image Classification with Convolutional Neural Networks Tong He Zhi-Li Zhang Hang Zhang Zhongyue Zhang Junyuan Xie Mu Li 216 1,398 0 04 Dec 2018
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 268 10,214 0 16 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,886 0 15 Sep 2016
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 282 39,190 0 01 Sep 2014