Scaling Laws for Hyperparameter Optimization

1 February 2023

Papers citing "Scaling Laws for Hyperparameter Optimization"

9 / 9 papers shown

Title
Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Sebastian Pineda Arango Fabio Ferreira Arlind Kadra Frank Hutter Frank Hutter Josif Grabocka 21 15 0 06 Jun 2023
Deep Ranking Ensembles for Hyperparameter Optimization Abdus Salam Khazi Sebastian Pineda Arango Josif Grabocka BDL 21 7 0 27 Mar 2023
Optimizing Data Collection for Machine Learning Rafid Mahmood James Lucas J. Álvarez Sanja Fidler M. Law 38 18 0 03 Oct 2022
SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization Marius Lindauer Katharina Eggensperger Matthias Feurer André Biedenkapp Difan Deng C. Benjamins Tim Ruhopf René Sass Frank Hutter 83 323 0 20 Sep 2021
Provably Efficient Online Hyperparameter Optimization with Population-Based Bandits Jack Parker-Holder Vu Nguyen Stephen J. Roberts OffRL 62 82 0 06 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 220 4,424 0 23 Jan 2020
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 112 404 0 06 Mar 2017
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 268 5,635 0 05 Dec 2016
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 261 10,106 0 16 Nov 2016