Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2007.03488
Cited By
v1
v2 (latest)
Benchmarking in Optimization: Best Practice and Open Issues
7 July 2020
Thomas Bartz-Beielstein
Carola Doerr
Daan van den Berg
Jakob Bossek
Sowmya Chandrasekaran
T. Eftimov
A. Fischbach
P. Kerschke
William La Cava
Manuel López-Ibánez
K. Malan
J. Moore
B. Naujoks
Patryk Orzechowski
Vanessa Volz
Markus Wagner
T. Weise
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Benchmarking in Optimization: Best Practice and Open Issues"
49 / 49 papers shown
Title
Benchmarking MOEAs for solving continuous multi-objective RL problems
Carlos Hernández
Roberto Santana
39
0
0
19 May 2025
A Standardized Benchmark Set of Clustering Problem Instances for Comparing Black-Box Optimizers
Diederick Vermetten
Catalin-Viorel Dinu
Marcus Gallagher
55
0
0
14 May 2025
Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows
Wenhao Li
Bo Jin
Mingyi Hong
Changhong Lu
Xiangfeng Wang
156
0
0
07 May 2025
BLADE: Benchmark suite for LLM-driven Automated Design and Evolution of iterative optimisation heuristics
Niki van Stein
Anna V. Kononova
Haoran Yin
Thomas Bäck
162
0
0
28 Apr 2025
Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation
Maria Eriksson
Erasmo Purificato
Arman Noroozian
Joao Vinagre
Guillaume Chaslot
Emilia Gomez
David Fernandez-Llorca
ELM
273
6
0
10 Feb 2025
Evolving Hard Maximum Cut Instances for Quantum Approximate Optimization Algorithms
Shuaiqun Pan
Yash J. Patel
Aneta Neumann
Frank Neumann
Thomas Bäck
Hao Wang
162
0
0
30 Jan 2025
MO-IOHinspector: Anytime Benchmarking of Multi-Objective Algorithms using IOHprofiler
Diederick Vermetten
Jeroen Rook
Oliver L. Preuß
Jacob De Nobel
Carola Doerr
Manuel López-Ibánez
Heike Trautmann
Thomas Bäck
122
2
0
10 Dec 2024
BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices
Anka Reuel
Amelia F. Hardy
Chandler Smith
Max Lamparth
Malcolm Hardy
Mykel J. Kochenderfer
ELM
193
23
0
20 Nov 2024
Deconstructing What Makes a Good Optimizer for Language Models
Rosie Zhao
Depen Morwani
David Brandfonbrener
Nikhil Vyas
Sham Kakade
144
25
0
10 Jul 2024
Generalizability of experimental studies
Federico Matteucci
Vadim Arzamasov
Jose Cribeiro-Ramallo
Marco Heyden
Konstantin Ntounas
Klemens Bohm
111
0
0
25 Jun 2024
A Novel Ranking Scheme for the Performance Analysis of Stochastic Optimization Algorithms using the Principles of Severity
Sowmya Chandrasekaran
Thomas Bartz-Beielstein
18
0
0
31 May 2024
Impact of Training Instance Selection on Automated Algorithm Selection Models for Numerical Black-box Optimization
Konstantin Dietrich
Diederick Vermetten
Carola Doerr
P. Kerschke
82
2
0
11 Apr 2024
Clustering in Dynamic Environments: A Framework for Benchmark Dataset Generation With Heterogeneous Changes
D. Yazdani
Juergen Branke
M. S. Khorshidi
M. Omidvar
Xiaodong Li
Amir H. Gandomi
Xin Yao
27
2
0
24 Feb 2024
Benchmarking multi-component signal processing methods in the time-frequency plane
J. M. Miramont
Rémi Bardenet
P. Chainais
François Auger
38
1
0
13 Feb 2024
Impact of spatial transformations on landscape features of CEC2022 basic benchmark problems
Haoran Yin
Diederick Vermetten
Furong Ye
Thomas H. W. Bäck
Anna V. Kononova
78
1
0
12 Feb 2024
Explainable Benchmarking for Iterative Optimization Heuristics
Niki van Stein
Diederick Vermetten
Anna V. Kononova
Thomas Bäck
113
13
0
31 Jan 2024
GNBG: A Generalized and Configurable Benchmark Generator for Continuous Numerical Optimization
D. Yazdani
M. Omidvar
Delaram Yazdani
Kalyanmoy Deb
Amir H. Gandomi
40
3
0
12 Dec 2023
Optimizing with Low Budgets: a Comparison on the Black-box Optimization Benchmarking Suite and OpenAI Gym
Elena Raponi
Nathanaël Carraz Rakotonirina
Jérémy Rapin
Carola Doerr
O. Teytaud
106
6
0
29 Sep 2023
Challenges of ELA-guided Function Evolution using Genetic Programming
Fu Xing Long
Diederick Vermetten
Anna V. Kononova
Roman Kalkreuth
Kaifeng Yang
Thomas Bäck
Niki van Stein
49
6
0
24 May 2023
PyTorch Hyperparameter Tuning - A Tutorial for spotPython
Thomas Bartz-Beielstein
BDL
GP
68
3
0
19 May 2023
When to be Discrete: Analyzing Algorithm Performance on Discretized Continuous Problems
André Thomaser
Jacob De Nobel
Diederick Vermetten
Furong Ye
Thomas Bäck
Anna V. Kononova
53
5
0
25 Apr 2023
Using Affine Combinations of BBOB Problems for Performance Assessment
Diederick Vermetten
Furong Ye
Carola Doerr
68
11
0
08 Mar 2023
Using Automated Algorithm Configuration for Parameter Control
D. Chen
M. Buzdalov
Carola Doerr
Nguyen Dang
92
4
0
23 Feb 2023
Tools for Landscape Analysis of Optimisation Problems in Procedural Content Generation for Games
Vanessa Volz
B. Naujoks
P. Kerschke
Tea Tušar
50
4
0
16 Feb 2023
Characterization of Constrained Continuous Multiobjective Optimization Problems: A Performance Space Perspective
Aljoša Vodopija
Tea Tušar
B. Filipič
43
2
0
04 Feb 2023
On the Algebraic Properties of Flame Graphs
G. Tornetta
16
0
0
21 Jan 2023
A Local Optima Network View of Real Function Fitness Landscapes
Marco Tomassini
53
5
0
20 Dec 2022
BBOB Instance Analysis: Landscape Properties and Algorithm Performance across Problem Instances
F. Long
Diederick Vermetten
Bas van Stein
Anna V. Kononova
72
21
0
29 Nov 2022
OPTION: OPTImization Algorithm Benchmarking ONtology
Ana Kostovska
Diederick Vermetten
Carola Doerr
Jannis Brugger
P. Panov
T. Eftimov
81
11
0
21 Nov 2022
Benchopt: Reproducible, efficient and collaborative optimization benchmarks
Thomas Moreau
Mathurin Massias
Alexandre Gramfort
Pierre Ablin
Pierre-Antoine Bannier Benjamin Charlier
...
Binh Duc Nguyen
A. Rakotomamonjy
Zaccharie Ramzi
Joseph Salmon
Samuel Vaiter
124
36
0
27 Jun 2022
A Survey on Learnable Evolutionary Algorithms for Scalable Multiobjective Optimization
Songbai Liu
Qiuzhen Lin
Jianqiang Li
Kay Chen Tan
94
56
0
23 Jun 2022
A Framework for Generating Informative Benchmark Instances
Nguyen Dang
Ozgur Akgun
Joan Espasa
Ian Miguel
Peter William Nightingale
21
6
0
29 May 2022
Analyzing the Impact of Undersampling on the Benchmarking and Configuration of Evolutionary Algorithms
Diederick Vermetten
Hongya Wang
Manuel López-Ibánez
Carola Doerr
Thomas Bäck
72
8
0
20 Apr 2022
The Importance of Landscape Features for Performance Prediction of Modular CMA-ES Variants
Ana Kostovska
Diederick Vermetten
Jannis Brugger
Carola Doerr
Peter Korošec
T. Eftimov
50
9
0
15 Apr 2022
An Instance Space Analysis of Constrained Multi-Objective Optimization Problems
Hanan Alsouly
M. Kirley
Mario Andrés Muñoz
36
6
0
02 Mar 2022
IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristics
Jacob De Nobel
Furong Ye
Diederick Vermetten
Hao Wang
Carola Doerr
Thomas Bäck
80
44
0
07 Nov 2021
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO
Katharina Eggensperger
Philip Muller
Neeratyoy Mallik
Matthias Feurer
René Sass
Aaron Klein
Noor H. Awad
Marius Lindauer
Frank Hutter
240
104
0
14 Sep 2021
A Continuous Optimisation Benchmark Suite from Neural Network Regression
K. Malan
C. Cleghorn
ODL
29
1
0
12 Sep 2021
Characterization of Constrained Continuous Multiobjective Optimization Problems: A Feature Space Perspective
Aljoša Vodopija
Tea Tušar
B. Filipič
75
18
0
09 Sep 2021
Surrogate Model Based Hyperparameter Tuning for Deep Learning with SPOT
Thomas Bartz-Beielstein
Frederik Rehbach
Amrita Sen
Martin Zaefferer
60
0
0
30 May 2021
Generating Instances with Performance Differences for More Than Just Two Algorithms
Jakob Bossek
Markus Wagner
77
5
0
29 Apr 2021
Towards Standardising Reinforcement Learning Approaches for Production Scheduling Problems
Alexandru Rinciog
Anne Meyer
OffRL
17
10
0
16 Apr 2021
On the Assessment of Benchmark Suites for Algorithm Comparison
D. I. Mattos
Lucas Ruud
J. Bosch
Helena Holmström Olsson
27
1
0
15 Apr 2021
Towards Large Scale Automated Algorithm Design by Integrating Modular Benchmarking Frameworks
Amine Aziz-Alaoui
Carola Doerr
Johann Dréo
58
12
0
12 Feb 2021
Reproducibility in Evolutionary Computation
Manuel López-Ibánez
Juergen Branke
L. Paquete
127
32
0
05 Feb 2021
Cognitive Capabilities for the CAAI in Cyber-Physical Production Systems
Jan Strohschein
A. Fischbach
Andreas Bunte
Heide Faeskorn-Woyke
N. Moriz
Thomas Bartz-Beielstein
36
3
0
03 Dec 2020
Metaheuristics "In the Large"
J. Swan
Steven Adriaensen
Alexander E. I. Brownlee
K. Hammond
Colin G. Johnson
...
Pablo García-Sánchez
K. Sorensen
S. Voß
Markus Wagner
D. White
AIFin
AI4CE
54
68
0
19 Nov 2020
Genetic Improvement @ ICSE 2020
W. Langdon
Westley Weimer
J. Petke
Erik M. Fredericks
Seongmin Lee
...
S. Yoo
Simos Gerasimou
Oliver Krauss
Yu Huang
Michael C. Gerten
18
4
0
31 Jul 2020
CAAI -- A Cognitive Architecture to Introduce Artificial Intelligence in Cyber-Physical Production Systems
A. Fischbach
Jan Strohschein
Andreas Bunte
Jörg Stork
Heide Faeskorn-Woyke
N. Moriz
Thomas Bartz-Beielstein
21
18
0
26 Feb 2020
1