research-article

Benchmarking CMA-ES with Basic Integer Handling on a Mixed-Integer Test Problem Suite

Authors:

Nikolaus HansenAuthors Info & Claims

GECCO '23 Companion: Proceedings of the Companion Conference on Genetic and Evolutionary Computation

Pages 1628 - 1635

https://doi.org/10.1145/3583133.3596411

Published: 24 July 2023 Publication History

Get Access

Abstract

We compare the performances of one implementation of CMA-ES (pycma version 3.3.0) for optimizing functions with both continuous and integer variables. The implementation incorporates a lower bound on the variance along the integer coordinates to keep the optimization from stalling. This benchmark will serve as a baseline for further works on pycma. Results show substantial improvement since the last benchmarked version of pycma. Also this implementation is competitive with other mixed integer algorithms.

References

[1]

Y. Akimoto and N. Hansen. 2020. Diagonal Acceleration for Covariance Matrix Adaptation Evolution Strategies. Evolutionary Computation 28, 3 (09 2020), 405--435.

Digital Library

Google Scholar

[2]

A Auger and N. Hansen. 2005. A restart CMA evolution strategy with increasing population size. In 2005 IEEE Congress on Evolutionary Computation, Vol. 2. 1769--1776 Vol. 2.

Crossref

Google Scholar

[3]

Ryoki Hamano, Shota Saito, Masahiro Nomura, and Shinichi Shirakawa. 2022. Benchmarking CMA-ES with Margin on the Bbob-Mixint Testbed. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO '22). Association for Computing Machinery, New York, NY, USA, 1708--1716.

Digital Library

Google Scholar

[4]

Ryoki Hamano, Shota Saito, Masahiro Nomura, and Shinichi Shirakawa. 2022. CMA-ES with margin: lower-bounding marginal probability for mixed-integer black-box optimization. Proceedings of the Genetic and Evolutionary Computation Conference (2022).

Digital Library

Google Scholar

[5]

Nikolaus Hansen. 2011. A CMA-ES for Mixed-Integer Nonlinear Optimization. Research Report RR-7751. INRIA. https://hal.inria.fr/inria-00629689

Google Scholar

[6]

Nikolaus Hansen. 2022. CMA-ES/pycma 3.3.0. https://github.com/CMA-ES/pycma/tree/development. (2022). commit e762ac0.

Google Scholar

[7]

Nikolaus Hansen, Youhei Akimoto, and Petr Baudis. 2019. CMA-ES/pycma on Github. Zenodo, (Feb. 2019).

Crossref

Google Scholar

[8]

N. Hansen, A Auger, D. Brockhoff, D. Tušar, and T. Tušar. 2016. COCO: Performance Assessment. ArXiv e-prínts arXiv:1605.03560 (2016).

Google Scholar

[9]

N. Hansen, A. Auger, R. Ros, O. Mersmann, T. Tušar, and D. Brockhoff. 2021. COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting. Optimization Methods and Software 36 (2021), 114--144. Issue 1.

Crossref

Google Scholar

[10]

N. Hansen and A. Ostermeier. 1996. Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation. In Proceedings of IEEE International Conference on Evolutionary Computation. 312--317.

Crossref

Google Scholar

[11]

N. Hansen, T. Tušar, O. Mersmann, A. Auger, and D. Brockhoff. 2016. COCO: The Experimental Procedure. ArXiv e-prints arXiv:1603.08776 (2016).

Google Scholar

[12]

Kenneth Price. 1997. Differential evolution vs. the functions of the second ICEO. In Proceedings of the IEEE International Congress on Evolutionary Computation. IEEE, Piscataway, NJ, USA 153--157.

Crossref

Google Scholar

[13]

Tea Tušar, Dimo Brockhoff, and Nikolaus Hansen. 2019. Mixed-Integer Benchmark Problems for Single- and Bi-Objective Optimization. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '19). Association for Computing Machinery, New York, NY, USA, 718--726.

Digital Library

Google Scholar

Cited By

View all

Tanabe RLi XHandl J(2024)Benchmarking Parameter Control Methods in Differential Evolution for Mixed-Integer Black-Box OptimizationProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654019(712-721)Online publication date: 14-Jul-2024
https://dl.acm.org/doi/10.1145/3638529.3654019
Marty THansen NAuger ASemet YHéron S(2024)LB+IC-CMA-ES: Two Simple Modifications of CMA-ES to Handle Mixed-Integer ProblemsParallel Problem Solving from Nature – PPSN XVIII10.1007/978-3-031-70068-2_18(284-299)Online publication date: 7-Sep-2024
https://doi.org/10.1007/978-3-031-70068-2_18

Index Terms

Benchmarking CMA-ES with Basic Integer Handling on a Mixed-Integer Test Problem Suite
1. Computing methodologies
  1. Artificial intelligence
    1. Search methodologies
      1. Continuous space search

Recommendations

Comparison of cauchy EDA and BIPOP-CMA-ES algorithms on the BBOB noiseless testbed
GECCO '10: Proceedings of the 12th annual conference companion on Genetic and evolutionary computation

Estimation-of-distribution algorithm using Cauchy sampling distribution is compared with the bi-population CMA evolutionary strategy which was one of the best contenders in the black-box optimization benchmarking workshop in 2009. The results clearly ...
Black-box optimization benchmarking of NEWUOA compared to BIPOP-CMA-ES: on the BBOB noiseless testbed
GECCO '10: Proceedings of the 12th annual conference companion on Genetic and evolutionary computation

In this paper, the performances of the NEW Unconstrained Optimization Algorithm (NEWUOA) on some noiseless functions are compared to those of the BI-POPulation Covariance Matrix Adaptation-Evolution Strategy (BIPOP-CMA-ES). The two algorithms were ...
Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed
GECCO '12: Proceedings of the 14th annual conference companion on Genetic and evolutionary computation

In this paper, we study the performance of IPOP-saACM-ES and BIPOP-saACM-ES, recently proposed self-adaptive surrogate-assisted Covariance Matrix Adaptation Evolution Strategies. Both algorithms were tested using restarts till a total number of function ...

Comments

Information & Contributors

Information

Published In

GECCO '23 Companion: Proceedings of the Companion Conference on Genetic and Evolutionary Computation

July 2023

2519 pages

ISBN:9798400701207

DOI:10.1145/3583133

Chair:
Sara Silva,
Program Chair:
Luís Paquete

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

GECCO '23 Companion

Sponsor:

SIGEVO

GECCO '23 Companion: Companion Conference on Genetic and Evolutionary Computation

July 15 - 19, 2023

Lisbon, Portugal

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
74
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)2

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Tanabe RLi XHandl J(2024)Benchmarking Parameter Control Methods in Differential Evolution for Mixed-Integer Black-Box OptimizationProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654019(712-721)Online publication date: 14-Jul-2024
https://dl.acm.org/doi/10.1145/3638529.3654019
Marty THansen NAuger ASemet YHéron S(2024)LB+IC-CMA-ES: Two Simple Modifications of CMA-ES to Handle Mixed-Integer ProblemsParallel Problem Solving from Nature – PPSN XVIII10.1007/978-3-031-70068-2_18(284-299)Online publication date: 7-Sep-2024
https://doi.org/10.1007/978-3-031-70068-2_18

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Comparison of cauchy EDA and BIPOP-CMA-ES algorithms on the BBOB noiseless testbed

Black-box optimization benchmarking of NEWUOA compared to BIPOP-CMA-ES: on the BBOB noiseless testbed

Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Comparison of cauchy EDA and BIPOP-CMA-ES algorithms on the BBOB noiseless testbed

Black-box optimization benchmarking of NEWUOA compared to BIPOP-CMA-ES: on the BBOB noiseless testbed

Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations