HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO

14 September 2021

Katharina Eggensperger

Papers citing "HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO"

20 / 70 papers shown

Title
Batch Bayesian optimisation via density-ratio estimation with guarantees Rafael Oliveira Louis C. Tiao Fabio Ramos 18 7 0 22 Sep 2022
Task Selection for AutoML System Evaluation Jon Lorraine Nihesh Anderson Chansoo Lee Quentin de Laroussilhe Mehadi Hassen 26 4 0 26 Aug 2022
A Principled Method for the Creation of Synthetic Multi-fidelity Data Sets Clyde Fare Peter Fenner Edward O. Pyzer-Knapp 12 2 0 11 Aug 2022
AMLB: an AutoML Benchmark Pieter Gijsbers Marcos L. P. Bueno Stefan Coors E. LeDell Sébastien Poirier Janek Thomas B. Bischl Joaquin Vanschoren 17 52 0 25 Jul 2022
Asynchronous Decentralized Bayesian Optimization for Large Scale Hyperparameter Optimization Romain Egele Isabelle M Guyon V. Vishwanath Prasanna Balaprakash BDL 11 5 0 01 Jul 2022
Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview Florian Karl Tobias Pielok Julia Moosbauer Florian Pfisterer Stefan Coors ... Jakob Richter Michel Lang Eduardo C. Garrido-Merchán Juergen Branke B. Bischl AI4CE 11 55 0 15 Jun 2022
Joint Entropy Search for Maximally-Informed Bayesian Optimization Carl Hvarfner Frank Hutter Luigi Nardi 20 36 0 09 Jun 2022
FedHPO-B: A Benchmark Suite for Federated Hyperparameter Optimization Zhen Wang Weirui Kuang Ce Zhang Bolin Ding Yaliang Li FedML 16 13 0 08 Jun 2022
$π$ BO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimization Carl Hvarfner Daniel Stoll Artur L. F. Souza Marius Lindauer Frank Hutter Luigi Nardi 8 68 0 23 Apr 2022
General Cyclical Training of Neural Networks L. Smith 22 6 0 17 Feb 2022
B2EA: An Evolutionary Algorithm Assisted by Two Bayesian Optimization Modules for Neural Architecture Search Hyunghun Cho Jungwook Shin Wonjong Rhee 14 7 0 07 Feb 2022
NAS-Bench-Suite: NAS Evaluation is (Now) Surprisingly Easy Yash Mehta Colin White Arber Zela Arjun Krishnakumar Guri Zabergja Shakiba Moradian Mahmoud Safari Kaicheng Yu Frank Hutter 17 41 0 31 Jan 2022
Automated Deep Learning: Neural Architecture Search Is Not the End Xuanyi Dong D. Kedziora Katarzyna Musial Bogdan Gabrys 15 26 0 16 Dec 2021
Searching in the Forest for Local Bayesian Optimization Difan Deng Marius Lindauer 15 2 0 10 Nov 2021
LassoBench: A High-Dimensional Hyperparameter Optimization Benchmark Suite for Lasso Kenan Sehic Alexandre Gramfort Joseph Salmon Luigi Nardi 12 27 0 04 Nov 2021
SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization Marius Lindauer Katharina Eggensperger Matthias Feurer André Biedenkapp Difan Deng C. Benjamins Tim Ruhopf René Sass Frank Hutter 80 323 0 20 Sep 2021
YAHPO Gym -- An Efficient Multi-Objective Multi-Fidelity Benchmark for Hyperparameter Optimization Florian Pfisterer Lennart Schneider Julia Moosbauer Martin Binder B. Bischl 17 35 0 08 Sep 2021
Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challenges B. Bischl Martin Binder Michel Lang Tobias Pielok Jakob Richter ... Theresa Ullmann Marc Becker A. Boulesteix Difan Deng Marius Lindauer 74 268 0 13 Jul 2021
HPO-B: A Large-Scale Reproducible Benchmark for Black-Box HPO based on OpenML Sebastian Pineda Arango H. Jomaa Martin Wistuba Josif Grabocka 14 46 0 11 Jun 2021
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Arber Zela Julien N. Siems Frank Hutter 66 146 0 28 Jan 2020