ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2007.03488
  4. Cited By
Benchmarking in Optimization: Best Practice and Open Issues
v1v2 (latest)

Benchmarking in Optimization: Best Practice and Open Issues

7 July 2020
Thomas Bartz-Beielstein
Carola Doerr
Daan van den Berg
Jakob Bossek
Sowmya Chandrasekaran
T. Eftimov
A. Fischbach
P. Kerschke
William La Cava
Manuel López-Ibánez
K. Malan
J. Moore
B. Naujoks
Patryk Orzechowski
Vanessa Volz
Markus Wagner
T. Weise
ArXiv (abs)PDFHTML

Papers citing "Benchmarking in Optimization: Best Practice and Open Issues"

49 / 49 papers shown
Title
Benchmarking MOEAs for solving continuous multi-objective RL problems
Benchmarking MOEAs for solving continuous multi-objective RL problems
Carlos Hernández
Roberto Santana
39
0
0
19 May 2025
A Standardized Benchmark Set of Clustering Problem Instances for Comparing Black-Box Optimizers
A Standardized Benchmark Set of Clustering Problem Instances for Comparing Black-Box Optimizers
Diederick Vermetten
Catalin-Viorel Dinu
Marcus Gallagher
55
0
0
14 May 2025
Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows
Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows
Wenhao Li
Bo Jin
Mingyi Hong
Changhong Lu
Xiangfeng Wang
156
0
0
07 May 2025
BLADE: Benchmark suite for LLM-driven Automated Design and Evolution of iterative optimisation heuristics
BLADE: Benchmark suite for LLM-driven Automated Design and Evolution of iterative optimisation heuristics
Niki van Stein
Anna V. Kononova
Haoran Yin
Thomas Bäck
162
0
0
28 Apr 2025
Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation
Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation
Maria Eriksson
Erasmo Purificato
Arman Noroozian
Joao Vinagre
Guillaume Chaslot
Emilia Gomez
David Fernandez-Llorca
ELM
273
6
0
10 Feb 2025
Evolving Hard Maximum Cut Instances for Quantum Approximate Optimization Algorithms
Evolving Hard Maximum Cut Instances for Quantum Approximate Optimization Algorithms
Shuaiqun Pan
Yash J. Patel
Aneta Neumann
Frank Neumann
Thomas Bäck
Hao Wang
162
0
0
30 Jan 2025
MO-IOHinspector: Anytime Benchmarking of Multi-Objective Algorithms
  using IOHprofiler
MO-IOHinspector: Anytime Benchmarking of Multi-Objective Algorithms using IOHprofiler
Diederick Vermetten
Jeroen Rook
Oliver L. Preuß
Jacob De Nobel
Carola Doerr
Manuel López-Ibánez
Heike Trautmann
Thomas Bäck
122
2
0
10 Dec 2024
BetterBench: Assessing AI Benchmarks, Uncovering Issues, and
  Establishing Best Practices
BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices
Anka Reuel
Amelia F. Hardy
Chandler Smith
Max Lamparth
Malcolm Hardy
Mykel J. Kochenderfer
ELM
193
23
0
20 Nov 2024
Deconstructing What Makes a Good Optimizer for Language Models
Deconstructing What Makes a Good Optimizer for Language Models
Rosie Zhao
Depen Morwani
David Brandfonbrener
Nikhil Vyas
Sham Kakade
144
25
0
10 Jul 2024
Generalizability of experimental studies
Generalizability of experimental studies
Federico Matteucci
Vadim Arzamasov
Jose Cribeiro-Ramallo
Marco Heyden
Konstantin Ntounas
Klemens Bohm
111
0
0
25 Jun 2024
A Novel Ranking Scheme for the Performance Analysis of Stochastic
  Optimization Algorithms using the Principles of Severity
A Novel Ranking Scheme for the Performance Analysis of Stochastic Optimization Algorithms using the Principles of Severity
Sowmya Chandrasekaran
Thomas Bartz-Beielstein
18
0
0
31 May 2024
Impact of Training Instance Selection on Automated Algorithm Selection
  Models for Numerical Black-box Optimization
Impact of Training Instance Selection on Automated Algorithm Selection Models for Numerical Black-box Optimization
Konstantin Dietrich
Diederick Vermetten
Carola Doerr
P. Kerschke
82
2
0
11 Apr 2024
Clustering in Dynamic Environments: A Framework for Benchmark Dataset
  Generation With Heterogeneous Changes
Clustering in Dynamic Environments: A Framework for Benchmark Dataset Generation With Heterogeneous Changes
D. Yazdani
Juergen Branke
M. S. Khorshidi
M. Omidvar
Xiaodong Li
Amir H. Gandomi
Xin Yao
27
2
0
24 Feb 2024
Benchmarking multi-component signal processing methods in the
  time-frequency plane
Benchmarking multi-component signal processing methods in the time-frequency plane
J. M. Miramont
Rémi Bardenet
P. Chainais
François Auger
38
1
0
13 Feb 2024
Impact of spatial transformations on landscape features of CEC2022 basic
  benchmark problems
Impact of spatial transformations on landscape features of CEC2022 basic benchmark problems
Haoran Yin
Diederick Vermetten
Furong Ye
Thomas H. W. Bäck
Anna V. Kononova
78
1
0
12 Feb 2024
Explainable Benchmarking for Iterative Optimization Heuristics
Explainable Benchmarking for Iterative Optimization Heuristics
Niki van Stein
Diederick Vermetten
Anna V. Kononova
Thomas Bäck
113
13
0
31 Jan 2024
GNBG: A Generalized and Configurable Benchmark Generator for Continuous
  Numerical Optimization
GNBG: A Generalized and Configurable Benchmark Generator for Continuous Numerical Optimization
D. Yazdani
M. Omidvar
Delaram Yazdani
Kalyanmoy Deb
Amir H. Gandomi
40
3
0
12 Dec 2023
Optimizing with Low Budgets: a Comparison on the Black-box Optimization
  Benchmarking Suite and OpenAI Gym
Optimizing with Low Budgets: a Comparison on the Black-box Optimization Benchmarking Suite and OpenAI Gym
Elena Raponi
Nathanaël Carraz Rakotonirina
Jérémy Rapin
Carola Doerr
O. Teytaud
106
6
0
29 Sep 2023
Challenges of ELA-guided Function Evolution using Genetic Programming
Challenges of ELA-guided Function Evolution using Genetic Programming
Fu Xing Long
Diederick Vermetten
Anna V. Kononova
Roman Kalkreuth
Kaifeng Yang
Thomas Bäck
Niki van Stein
49
6
0
24 May 2023
PyTorch Hyperparameter Tuning - A Tutorial for spotPython
PyTorch Hyperparameter Tuning - A Tutorial for spotPython
Thomas Bartz-Beielstein
BDLGP
68
3
0
19 May 2023
When to be Discrete: Analyzing Algorithm Performance on Discretized
  Continuous Problems
When to be Discrete: Analyzing Algorithm Performance on Discretized Continuous Problems
André Thomaser
Jacob De Nobel
Diederick Vermetten
Furong Ye
Thomas Bäck
Anna V. Kononova
53
5
0
25 Apr 2023
Using Affine Combinations of BBOB Problems for Performance Assessment
Using Affine Combinations of BBOB Problems for Performance Assessment
Diederick Vermetten
Furong Ye
Carola Doerr
68
11
0
08 Mar 2023
Using Automated Algorithm Configuration for Parameter Control
Using Automated Algorithm Configuration for Parameter Control
D. Chen
M. Buzdalov
Carola Doerr
Nguyen Dang
92
4
0
23 Feb 2023
Tools for Landscape Analysis of Optimisation Problems in Procedural
  Content Generation for Games
Tools for Landscape Analysis of Optimisation Problems in Procedural Content Generation for Games
Vanessa Volz
B. Naujoks
P. Kerschke
Tea Tušar
50
4
0
16 Feb 2023
Characterization of Constrained Continuous Multiobjective Optimization
  Problems: A Performance Space Perspective
Characterization of Constrained Continuous Multiobjective Optimization Problems: A Performance Space Perspective
Aljoša Vodopija
Tea Tušar
B. Filipič
43
2
0
04 Feb 2023
On the Algebraic Properties of Flame Graphs
On the Algebraic Properties of Flame Graphs
G. Tornetta
16
0
0
21 Jan 2023
A Local Optima Network View of Real Function Fitness Landscapes
A Local Optima Network View of Real Function Fitness Landscapes
Marco Tomassini
53
5
0
20 Dec 2022
BBOB Instance Analysis: Landscape Properties and Algorithm Performance
  across Problem Instances
BBOB Instance Analysis: Landscape Properties and Algorithm Performance across Problem Instances
F. Long
Diederick Vermetten
Bas van Stein
Anna V. Kononova
72
21
0
29 Nov 2022
OPTION: OPTImization Algorithm Benchmarking ONtology
OPTION: OPTImization Algorithm Benchmarking ONtology
Ana Kostovska
Diederick Vermetten
Carola Doerr
Jannis Brugger
P. Panov
T. Eftimov
81
11
0
21 Nov 2022
Benchopt: Reproducible, efficient and collaborative optimization
  benchmarks
Benchopt: Reproducible, efficient and collaborative optimization benchmarks
Thomas Moreau
Mathurin Massias
Alexandre Gramfort
Pierre Ablin
Pierre-Antoine Bannier Benjamin Charlier
...
Binh Duc Nguyen
A. Rakotomamonjy
Zaccharie Ramzi
Joseph Salmon
Samuel Vaiter
124
36
0
27 Jun 2022
A Survey on Learnable Evolutionary Algorithms for Scalable
  Multiobjective Optimization
A Survey on Learnable Evolutionary Algorithms for Scalable Multiobjective Optimization
Songbai Liu
Qiuzhen Lin
Jianqiang Li
Kay Chen Tan
94
56
0
23 Jun 2022
A Framework for Generating Informative Benchmark Instances
A Framework for Generating Informative Benchmark Instances
Nguyen Dang
Ozgur Akgun
Joan Espasa
Ian Miguel
Peter William Nightingale
21
6
0
29 May 2022
Analyzing the Impact of Undersampling on the Benchmarking and
  Configuration of Evolutionary Algorithms
Analyzing the Impact of Undersampling on the Benchmarking and Configuration of Evolutionary Algorithms
Diederick Vermetten
Hongya Wang
Manuel López-Ibánez
Carola Doerr
Thomas Bäck
72
8
0
20 Apr 2022
The Importance of Landscape Features for Performance Prediction of
  Modular CMA-ES Variants
The Importance of Landscape Features for Performance Prediction of Modular CMA-ES Variants
Ana Kostovska
Diederick Vermetten
Jannis Brugger
Carola Doerr
Peter Korošec
T. Eftimov
50
9
0
15 Apr 2022
An Instance Space Analysis of Constrained Multi-Objective Optimization
  Problems
An Instance Space Analysis of Constrained Multi-Objective Optimization Problems
Hanan Alsouly
M. Kirley
Mario Andrés Muñoz
36
6
0
02 Mar 2022
IOHexperimenter: Benchmarking Platform for Iterative Optimization
  Heuristics
IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristics
Jacob De Nobel
Furong Ye
Diederick Vermetten
Hao Wang
Carola Doerr
Thomas Bäck
80
44
0
07 Nov 2021
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems
  for HPO
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO
Katharina Eggensperger
Philip Muller
Neeratyoy Mallik
Matthias Feurer
René Sass
Aaron Klein
Noor H. Awad
Marius Lindauer
Frank Hutter
240
104
0
14 Sep 2021
A Continuous Optimisation Benchmark Suite from Neural Network Regression
A Continuous Optimisation Benchmark Suite from Neural Network Regression
K. Malan
C. Cleghorn
ODL
29
1
0
12 Sep 2021
Characterization of Constrained Continuous Multiobjective Optimization
  Problems: A Feature Space Perspective
Characterization of Constrained Continuous Multiobjective Optimization Problems: A Feature Space Perspective
Aljoša Vodopija
Tea Tušar
B. Filipič
75
18
0
09 Sep 2021
Surrogate Model Based Hyperparameter Tuning for Deep Learning with SPOT
Surrogate Model Based Hyperparameter Tuning for Deep Learning with SPOT
Thomas Bartz-Beielstein
Frederik Rehbach
Amrita Sen
Martin Zaefferer
60
0
0
30 May 2021
Generating Instances with Performance Differences for More Than Just Two
  Algorithms
Generating Instances with Performance Differences for More Than Just Two Algorithms
Jakob Bossek
Markus Wagner
77
5
0
29 Apr 2021
Towards Standardising Reinforcement Learning Approaches for Production
  Scheduling Problems
Towards Standardising Reinforcement Learning Approaches for Production Scheduling Problems
Alexandru Rinciog
Anne Meyer
OffRL
17
10
0
16 Apr 2021
On the Assessment of Benchmark Suites for Algorithm Comparison
On the Assessment of Benchmark Suites for Algorithm Comparison
D. I. Mattos
Lucas Ruud
J. Bosch
Helena Holmström Olsson
27
1
0
15 Apr 2021
Towards Large Scale Automated Algorithm Design by Integrating Modular
  Benchmarking Frameworks
Towards Large Scale Automated Algorithm Design by Integrating Modular Benchmarking Frameworks
Amine Aziz-Alaoui
Carola Doerr
Johann Dréo
58
12
0
12 Feb 2021
Reproducibility in Evolutionary Computation
Reproducibility in Evolutionary Computation
Manuel López-Ibánez
Juergen Branke
L. Paquete
127
32
0
05 Feb 2021
Cognitive Capabilities for the CAAI in Cyber-Physical Production Systems
Cognitive Capabilities for the CAAI in Cyber-Physical Production Systems
Jan Strohschein
A. Fischbach
Andreas Bunte
Heide Faeskorn-Woyke
N. Moriz
Thomas Bartz-Beielstein
36
3
0
03 Dec 2020
Metaheuristics "In the Large"
Metaheuristics "In the Large"
J. Swan
Steven Adriaensen
Alexander E. I. Brownlee
K. Hammond
Colin G. Johnson
...
Pablo García-Sánchez
K. Sorensen
S. Voß
Markus Wagner
D. White
AIFinAI4CE
54
68
0
19 Nov 2020
Genetic Improvement @ ICSE 2020
Genetic Improvement @ ICSE 2020
W. Langdon
Westley Weimer
J. Petke
Erik M. Fredericks
Seongmin Lee
...
S. Yoo
Simos Gerasimou
Oliver Krauss
Yu Huang
Michael C. Gerten
18
4
0
31 Jul 2020
CAAI -- A Cognitive Architecture to Introduce Artificial Intelligence in
  Cyber-Physical Production Systems
CAAI -- A Cognitive Architecture to Introduce Artificial Intelligence in Cyber-Physical Production Systems
A. Fischbach
Jan Strohschein
Andreas Bunte
Jörg Stork
Heide Faeskorn-Woyke
N. Moriz
Thomas Bartz-Beielstein
21
18
0
26 Feb 2020
1