Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020

20 April 2021

Papers citing "Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020"

50 / 72 papers shown

Title
LNUCB-TA: Linear-nonlinear Hybrid Bandit Learning with Temporal Attention H. Khosravi Mohammad Reza Shafie Ahmed Shoyeb Raihan Srinjoy Das I. Imtiaz Ahmed 29 0 0 01 Mar 2025
Posterior Inference with Diffusion Models for High-dimensional Black-box Optimization Taeyoung Yun Kiyoung Om Jaewoo Lee Sujin Yun Jinkyoo Park 48 1 0 24 Feb 2025
Covering Multiple Objectives with a Small Set of Solutions Using Bayesian Optimization N. Maus Kyurae Kim Yimeng Zeng Haydn Jones Fangping Wan Marcelo Der Torossian Torres Cesar de la Fuente-Nunez J. Gardner 80 0 0 31 Jan 2025
Unexpected Improvements to Expected Improvement for Bayesian Optimization Sebastian Ament Sam Daulton David Eriksson Maximilian Balandat E. Bakshy 49 69 0 08 Jan 2025
Safe Bayesian Optimization for the Control of High-Dimensional Embodied Systems Yunyue Wei Zeji Yi Hongda Li Saraswati Soedarmadji Yanan Sui 26 0 0 31 Dec 2024
Model Fusion through Bayesian Optimization in Language Model Fine-Tuning Chaeyun Jang Hyungi Lee Jungtaek Kim Juho Lee MoMe 39 0 0 11 Nov 2024
Building Trust in Black-box Optimization: A Comprehensive Framework for Explainability Nazanin Nezami Hadis Anahideh 16 0 0 18 Oct 2024
Neural Network Architecture Search Enabled Wide-Deep Learning (NAS-WD) for Spatially Heterogenous Property Awared Chicken Woody Breast Classification and Hardness Regression Chaitanya Pallerla Yihong Feng Casey M. Owens Ramesh Bahadur Bist Siavash Mahmoudi Pouya Sohrabipour Amirreza Davar Dongyi Wang 18 2 0 25 Sep 2024
Generating Synthetic Free-text Medical Records with Low Re-identification Risk using Masked Language Modeling Samuel Belkadi Libo Ren Nicolo Micheletti Lifeng Han Goran Nenadic SyDa MedIm 32 0 0 15 Sep 2024
Sample-Efficient Bayesian Optimization with Transfer Learning for Heterogeneous Search Spaces Aryan Deshwal Sait Cakmak Yuhou Xia David Eriksson 40 0 0 09 Sep 2024
Active Learning for Derivative-Based Global Sensitivity Analysis with Gaussian Processes Syrine Belakaria Benjamin Letham J. Doppa Barbara Engelhardt Stefano Ermon E. Bakshy GP 17 0 0 13 Jul 2024
Augmented Bayesian Policy Search Mahdi Kallel Debabrota Basu R. Akrour Carlo DÉramo 40 2 0 05 Jul 2024
FairJob: A Real-World Dataset for Fairness in Online Systems Mariia Vladimirova Federico Pavone Eustache Diemert 37 1 0 03 Jul 2024
Training Greedy Policy for Proposal Batch Selection in Expensive Multi-Objective Combinatorial Optimization Deokjae Lee Hyun Oh Song Kyunghyun Cho OffRL 38 0 0 21 Jun 2024
A survey and benchmark of high-dimensional Bayesian optimization of discrete sequences Miguel González Duque Richard Michael Simon Bartels Yevgen Zainchkovskyy Søren Hauberg Wouter Boomsma 42 4 0 07 Jun 2024
Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization Thomas Nagler Lennart Schneider B. Bischl Matthias Feurer 45 2 0 24 May 2024
Optimal Initialization of Batch Bayesian Optimization Jiuge Ren David Sweet 40 1 0 27 Apr 2024
Evolve Cost-aware Acquisition Functions Using Large Language Models Yiming Yao Fei Liu Ji Cheng Qingfu Zhang 43 7 0 25 Apr 2024
Hyperparameter Optimization Can Even be Harmful in Off-Policy Learning and How to Deal with It Yuta Saito Masahiro Nomura OffRL 30 2 0 23 Apr 2024
Lossless and Near-Lossless Compression for Foundation Models Moshik Hershcovitch Leshem Choshen Andrew Wood Ilias Enmouri Peter Chin S. Sundararaman Danny Harnik 49 6 0 05 Apr 2024
HyperPredict: Estimating Hyperparameter Effects for Instance-Specific Regularization in Deformable Image Registration Aisha L. Shuaibu Ivor J. A. Simpson 27 1 0 04 Mar 2024
LLaMoCo: Instruction Tuning of Large Language Models for Optimization Code Generation Zeyuan Ma Hongshu Guo Jiacheng Chen Guojun Peng Zhiguang Cao Yining Ma Yue-jiao Gong SyDa ALM 22 17 0 02 Mar 2024
Reinforced In-Context Black-Box Optimization Lei Song Chenxiao Gao Ke Xue Chenyang Wu Dong Li Jianye Hao Zongzhang Zhang Chao Qian 27 3 0 27 Feb 2024
High-dimensional Bayesian Optimization via Covariance Matrix Adaptation Strategy Lam Ngo Huong Ha Jeffrey Chan Vu-Linh Nguyen Hongyu Zhang 23 2 0 05 Feb 2024
Design & Implementation of Automatic Machine Condition Monitoring and Maintenance System in Limited Resource Situations A. H. M. Ripon Muhammad Ahsan Ullah Arindam Kumar Paul Md. Mortaza Morshed AI4CE 24 0 0 22 Jan 2024
Predicting the Skies: A Novel Model for Flight-Level Passenger Traffic Forecasting Sian Ehsani Elina Sergeeva Wendy Murdy Benjamin Fox 18 0 0 07 Jan 2024
Regret Optimality of GP-UCB Wenjia Wang Xiaowei Zhang Lu Zou 27 0 0 03 Dec 2023
Academic competitions H. J. Escalante Aleksandra Kruchinina AI4CE 24 0 0 01 Dec 2023
Automated discovery of trade-off between utility, privacy and fairness in machine learning models Bogdan Ficiu Neil D. Lawrence Andrei Paleyes 27 1 0 27 Nov 2023
Datasets and Benchmarks for Nanophotonic Structure and Parametric Design Simulations Jungtaek Kim Mingxuan Li Oliver Hinder Paul W. Leu 24 1 0 29 Oct 2023
On the Feasibility of Cross-Language Detection of Malicious Packages in npm and PyPI Piergiorgio Ladisa Serena Elisa Ponta Nicola Ronzoni Matias Martinez Olivier Barais 15 11 0 14 Oct 2023
Target Variable Engineering Jessica Clark 27 0 0 13 Oct 2023
MetaBox: A Benchmark Platform for Meta-Black-Box Optimization with Reinforcement Learning Zeyuan Ma Hongshu Guo Jiacheng Chen Zhenrui Li Guojun Peng Yue-jiao Gong Yining Ma Zhiguang Cao OffRL 22 25 0 12 Oct 2023
Ensemble-based Hybrid Optimization of Bayesian Neural Networks and Traditional Machine Learning Algorithms Peiwen Tan BDL 13 1 0 09 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models Zihao Lin Yan Sun Yifan Shi Xueqian Wang Lifu Huang Li Shen Dacheng Tao 34 11 0 04 Oct 2023
Deterministic Langevin Unconstrained Optimization with Normalizing Flows James M. Sullivan U. Seljak 24 0 0 01 Oct 2023
Optimizing with Low Budgets: a Comparison on the Black-box Optimization Benchmarking Suite and OpenAI Gym E. Raponi Nathanaël Carraz Rakotonirina Jérémy Rapin Carola Doerr O. Teytaud 35 5 0 29 Sep 2023
Transfer Learning for Bayesian Optimization on Heterogeneous Search Spaces Maria-Irina Nicolae Max Eisele Z. Wang 27 8 0 28 Sep 2023
CNN-based local features for navigation near an asteroid O. Knuuttila A. Kestilä E. Kallio 20 0 0 20 Sep 2023
SigOpt Mulch: An Intelligent System for AutoML of Gradient Boosted Trees Aleksei G. Sorokin Xinran Zhu E. Lee Bolong Cheng 30 2 0 10 Jul 2023
Hyperparameters in Reinforcement Learning and How To Tune Them Theresa Eimer Marius Lindauer Roberta Raileanu OffRL 27 34 0 02 Jun 2023
PFNs4BO: In-Context Learning for Bayesian Optimization Samuel G. Müller Matthias Feurer Noah Hollmann Frank Hutter 22 34 0 27 May 2023
Earning Extra Performance from Restrictive Feedbacks Jing Li Yuangang Pan Yueming Lyu Yinghua Yao Yulei Sui Ivor W. Tsang 20 3 0 28 Apr 2023
Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performance Shuhei Watanabe 19 119 0 21 Apr 2023
Self-Correcting Bayesian Optimization through Bayesian Active Learning Carl Hvarfner E. Hellsten Frank Hutter Luigi Nardi GP 35 14 0 21 Apr 2023
HyperTuner: A Cross-Layer Multi-Objective Hyperparameter Auto-Tuning Framework for Data Analytic Services Hui Dou Shanshan Zhu Yiwen Zhang Pengfei Chen Zibin Zheng 9 0 0 20 Apr 2023
FairPilot: An Explorative System for Hyperparameter Tuning through the Lens of Fairness Francesco Di Carlo Nazanin Nezami Hadis Anahideh Abolfazl Asudeh 17 1 0 10 Apr 2023
Active Learning and Bayesian Optimization: a Unified Perspective to Learn with a Goal Francesco Di Fiore Michela Nardelli L. Mainini 34 22 0 02 Mar 2023
Autotuning Symbolic Optimization Fabrics for Trajectory Generation Max Spahn Javier Alonso-Mora 10 2 0 14 Feb 2023
Contextual Causal Bayesian Optimisation Vahan Arsenyan Antoine Grosnit Haitham Bou-Ammar CML 27 2 0 29 Jan 2023