Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1007/978-3-031-70071-2_19guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

A First Running Time Analysis of the Strength Pareto Evolutionary Algorithm 2 (SPEA2)

Published: 14 September 2024 Publication History

Abstract

Evolutionary algorithms (EAs) have emerged as a predominant approach for addressing multi-objective optimization problems. However, the theoretical foundation of multi-objective EAs (MOEAs), particularly the fundamental aspects like running time analysis, remains largely underexplored. Existing theoretical studies mainly focus on basic MOEAs, with little attention given to practical MOEAs. In this paper, we present a running time analysis of strength Pareto evolutionary algorithm 2 (SPEA2) for the first time. Specifically, we prove that the expected running time of SPEA2 for solving three commonly used multi-objective problems, i.e., mOneMinMax, mLeadingOnesTrailingZeroes, and m-OneJumpZeroJump, is O(μn·min{mlogn,n}), O(μn2), and O(μnk·min{mn,3m/2}), respectively. Here m denotes the number of objectives, and the population size μ is required to be at least (2n/m+1)m/2, (2n/m+1)m-1 and (2n/m-2k+3)m/2, respectively. The proofs are accomplished through general theorems which are also applicable for analyzing the expected running time of other MOEAs on these problems, and thus can be helpful for future theoretical analysis of MOEAs.

References

[1]
Bäck T Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms 1996 Oxford Oxford University Press
[2]
Beume N, Naujoks B, and Emmerich M SMS-EMOA: multiobjective selection based on dominated hypervolume Eur. J. Oper. Res. 2007 181 3 1653-1669
[3]
Bian, C., Qian, C.: Better running time of the non-dominated sorting genetic algorithm II (NSGA-II) by using stochastic tournament selection. In: Proceedings of the 17th International Conference on Parallel Problem Solving from Nature (PPSN 2022), Dortmund, Germany, pp. 428–441 (2022)
[4]
Bian, C., Qian, C., Tang, K.: A general approach to running time analysis of multi-objective evolutionary algorithms. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI 2018), Stockholm, Sweden, pp. 1405–1411 (2018)
[5]
Bian, C., Ren, S., Li, M.Q., Qian, C.: An archive can bring provable speed-ups in multi-objective evolutionary algorithms. In: Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI 2024), Jeju Island, South Korea (2024, to appear)
[6]
Bian, C., Zhou, Y., Li, M., Qian, C.: Stochastic population update can provably be helpful in multi-objective evolutionary algorithms. In: Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI 2023), Macao, SAR, China, pp. 2191–2197 (2023)
[7]
Brockhoff, D., Friedrich, T., Neumann, F.: Analyzing hypervolume indicator based algorithms. In: Proceedings of the 10th International Conference on Parallel Problem Solving from Nature (PPSN 2008), Dortmund, Germany, pp. 651–660 (2008)
[8]
Cerf, S., Doerr, B., Hebras, B., Kahane, Y., Wietheger, S.: The first proven performance guarantees for the non-dominated sorting genetic algorithm II (NSGA-II) on a combinatorial optimization problem. In: Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI 2023), Macao, SAR, China, pp. 5522–5530 (2023)
[9]
Coello CAC, Lamont GB, and Veldhuizen DAV Evolutionary Algorithms for Solving Multi-objective Problems 2007 New York Springer
[10]
Covantes Osuna E, Gao W, Neumann F, and Sudholt D Design and analysis of diversity-based parent selection schemes for speeding up evolutionary multi-objective optimisation Theoret. Comput. Sci. 2020 832 123-142
[11]
Dang, D.C., Opris, A., Salehi, B., Sudholt, D.: Analysing the robustness of NSGA-II under noise. In: Proceedings of the 25th ACM Conference on Genetic and Evolutionary Computation (GECCO 2023). Lisbon, Portugal, pp. 642–651 (2023)
[12]
Dang, D.C., Opris, A., Salehi, B., Sudholt, D.: A proof that using crossover can guarantee exponential speed-ups in evolutionary multi-objective optimisation. In: Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI 2023), Washington, DC, pp. 12390–12398 (2023)
[13]
Deb K Multi-objective Optimization using Evolutionary Algorithms 2001 Chichester Wiley
[14]
Deb K and Jain H An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints IEEE Trans. Evol. Comput. 2014 18 4 577-601
[15]
Deb K, Pratap A, Agarwal S, and Meyarivan T A fast and elitist multiobjective genetic algorithm: NSGA-II IEEE Trans. Evol. Comput. 2002 6 2 182-197
[16]
Doerr B Analyzing randomized search heuristics via stochastic domination Theoret. Comput. Sci. 2019 773 115-137
[17]
Doerr, B., Gao, W., Neumann, F.: Runtime analysis of evolutionary diversity maximization for OneMinMax. In: Proceedings of the 18th ACM Conference on Genetic and Evolutionary Computation (GECCO 2016), Denver, CO, pp. 557–564 (2016)
[18]
Doerr, B., Kodric, B., Voigt, M.: Lower bounds for the runtime of a global multi-objective evolutionary algorithm. In: Proceedings of the 2013 IEEE Congress on Evolutionary Computation (CEC 2013), pp. 432–439 (2013)
[19]
Doerr B and Qu Z A first runtime analysis of the NSGA-II on a multimodal problem IEEE Trans. Evol. Comput. 2023 27 1288-1297
[20]
Doerr, B., Qu, Z.: From understanding the population dynamics of the NSGA-II to the first proven lower bounds. In: Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI 2023), Washington, DC, pp. 12408–12416 (2023)
[21]
Doerr, B., Qu, Z.: Runtime analysis for the NSGA-II: provable speed-ups from crossover. In: Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI 2023), Washington, DC, pp. 12399–12407 (2023)
[22]
Doerr, B., Zheng, W.: Theoretical analyses of multi-objective evolutionary algorithms on multi-modal objectives. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI 2021), Virtual, pp. 12293–12301 (2021)
[23]
Eiben AE and Smith JE Introduction to Evolutionary Computing 2015 Berlin Springer
[24]
Friedrich T, Hebbinghaus N, and Neumann F Plateaus can be harder in multi-objective optimization Theoret. Comput. Sci. 2010 411 6 854-864
[25]
Friedrich T, Horoba C, and Neumann F Illustration of fairness in evolutionary multi-objective optimization Theoret. Comput. Sci. 2011 412 17 1546-1556
[26]
Giel, O.: Expected runtimes of a simple multi-objective evolutionary algorithm. In: Proceedings of the 2003 IEEE Congress on Evolutionary Computation (CEC 2003), vol. 3, pp. 1918–1925 (2003)
[27]
Giel, O., Lehre, P.K.: On the effect of populations in evolutionary multi-objective optimization. In: Proceedings of the 8th ACM Conference on Genetic and Evolutionary Computation (GECCO 2006), Seattle, WA, pp. 651–658 (2006)
[28]
Horoba, C.: Analysis of a simple evolutionary algorithm for the multiobjective shortest path problem. In: Proceedings of the tenth ACM SIGEVO workshop on Foundations of genetic algorithms (FOGA 2009), Orlando, FL, pp. 113–120 (2009)
[29]
Huang, Z., Zhou, Y., Luo, C., Lin, Q.: A runtime analysis of typical decomposition approaches in MOEA/D framework for many-objective optimization problems. In: Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI 2021), Virtual, pp. 1682–1688 (2021)
[30]
Laumanns M, Thiele L, and Zitzler E Running time analysis of multiobjective evolutionary algorithms on pseudo-Boolean functions IEEE Trans. Evol. Comput. 2004 8 2 170-182
[31]
Liang J et al. An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification SCIENCE CHINA Inf. Sci. 2024 67 2
[32]
Lu, T., Bian, C., Qian, C.: Towards running time analysis of interactive multi-objective evolutionary algorithms. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence (AAAI 2024), Vancouver, Canada (2024, in press)
[33]
Neumann F Expected runtimes of a simple evolutionary algorithm for the multi-objective minimum spanning tree problem Eur. J. Oper. Res. 2007 181 3 1620-1629
[34]
Neumann, F., Theile, M.: How crossover speeds up evolutionary algorithms for the multi-criteria all-pairs-shortest-path problem. In: Proceedings of the 11th International Conference on Parallel Problem Solving from Nature (PPSN 2010), Krakov, Poland, pp. 667–676 (2010)
[35]
Nguyen AQ, Sutton AM, and Neumann F Population size matters: rigorous runtime results for maximizing the hypervolume indicator Theoret. Comput. Sci. 2015 561 24-36
[36]
Opris., A., Dang., D.C., Sudholt, D.: Runtime analyses of NSGA-III on many-objective problems. CORR abs/2404.11433 (2024)
[37]
Qian, C., Tang, K., Zhou, Z.H.: Selection hyper-heuristics can provably be helpful in evolutionary multi-objective optimization. In: Proceedings of the 14th International Conference on Parallel Problem Solving from Nature (PPSN 2016), Edinburgh, Scotland, pp. 835–846 (2016)
[38]
Qian, C., Yu, Y., Zhou, Z.: An analysis on recombination in multi-objective evolutionary optimization. In: Proceedings of the 13th ACM Conference on Genetic and Evolutionary Computation (GECCO 2011), Dublin, Ireland, pp. 2051–2058 (2011)
[39]
Ren, S., Qiu, Z., Bian, C., Li, M.Q., Qian, C.: Maintaining diversity provably helps in evolutionary multimodal optimization. In: Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI 2024), Jeju Island, South Korea (2024, to appear)
[40]
Wietheger, S., Doerr, B.: A mathematical runtime analysis of the non-dominated sorting genetic algorithm III (NSGA-III). In: Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI 2023), Macao, SAR, China, pp. 5657–5665 (2023)
[41]
Wietheger, S., Doerr, B.: Near-tight runtime guarantees for many-objective evolutionary algorithms. CORR abs/2404.12746 (2024)
[42]
Witt C Fitness levels with tail bounds for the analysis of randomized search heuristics Inf. Process. Lett. 2014 114 1–2 38-41
[43]
Yang, P., Zhang, L., Liu, H., Li, G.: Reducing idleness in financial cloud via multi-objective evolutionary reinforcement learning based load balancer. Sci. China Inf. Sci. 67(2), 120102– (2024)
[44]
Zhang Q and Li H MOEA/D: a multiobjective evolutionary algorithm based on decomposition IEEE Trans. Evol. Comput. 2007 11 6 712-731
[45]
Zheng, W., Doerr, B.: Better approximation guarantees for the NSGA-II by using the current crowding distance. In: Proceedings of the 24th ACM Conference on Genetic and Evolutionary Computation (GECCO 2022), Boston, MA, pp. 611–619 (2022)
[46]
Zheng W and Doerr B Mathematical runtime analysis for the non-dominated sorting genetic algorithm II (NSGA-II) Artif. Intell. 2023 325
[47]
Zheng, W., Doerr, B.: Runtime analysis for the NSGA-II: proving, quantifying, and explaining the inefficiency for many objectives. IEEE Trans. Evol. Comput. (2023, in press)
[48]
Zheng, W., Doerr, B.: Runtime analysis of the SMS-EMOA for many-objective optimization. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence (AAAI 2024), Vancouver, Canada, pp. 20874–20882 (2024)
[49]
Zhou ZH, Yu Y, and Qian C Evolutionary Learning: Advances in Theories and Algorithms 2019 Singapore Springer
[50]
Zitzler, E., Laumanns, M., Thiele, L.: SPEA2: improving the strength pareto evolutionary algorithm. TIK report 103 (2001)

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings
Parallel Problem Solving from Nature – PPSN XVIII: 18th International Conference, PPSN 2024, Hagenberg, Austria, September 14–18, 2024, Proceedings, Part III
Sep 2024
435 pages
ISBN:978-3-031-70070-5
DOI:10.1007/978-3-031-70071-2

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 14 September 2024

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media