Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Free access
Just Accepted

Evolutionary Optimization with Simplified Helper Task for High-dimensional Expensive Multiobjective Problems

Online AM: 11 January 2024 Publication History

Abstract

In recent years, surrogate-assisted evolutionary algorithms (SAEAs) have been sufficiently studied for tackling computationally expensive multiobjective optimization problems (EMOPs), as they can quickly estimate the qualities of solutions by using surrogate models to substitute for expensive evaluations. However, most existing SAEAs only show promising performance for solving EMOPs with no more than 10 dimensions, and become less efficient for tackling EMOPs with higher dimensionality. Thus, this article proposes a new SAEA with a simplified helper task for tackling high-dimensional EMOPs. In each generation, one simplified task will be generated artificially by using random dimension reduction on the target task (i.e., the target EMOPs). Then, two surrogate models are trained for the helper task and the target task, respectively. Based on the trained surrogate models, evolutionary multitasking optimization is run to solve these two tasks, so that the experiences of solving the helper task can be transferred to speed up the convergence of tackling the target task. Moreover, an effective model management strategy is designed to select new promising samples for training the surrogate models. When compared to five competitive SAEAs on four well-known benchmark suites, the experiments validate the advantages of the proposed algorithm on most test cases.

References

[1]
George De Ath, Richard M Everson, Alma AM Rahat, and Jonathan E Fieldsend. 2021. Greed is good: Exploration and exploitation trade-offs in Bayesian optimization. ACM Transactions on Evolutionary Learning and Optimization. 1, 1 (2021), 1–22.
[2]
Mickael Binois and Nathan Wycoff. 2022. A survey on high-dimensional Gaussian process modeling with application to Bayesian optimization. ACM Transactions on Evolutionary Learning and Optimization. 2, 2 (2022), 1–26.
[3]
Nicola Beume, Boris Naujoks, and Michael Emmerich. 2007. SMS-EMOA: Multiobjective selection based on dominated hypervolume. European Journal of Operational Research. 181, 3 (2007), 1653–1669.
[4]
Ke Chen, Bing Xue, Mengjie Zhang, and Fengyu Zhou. 2021. Evolutionary Multitasking for Feature Selection in High-Dimensional Classification via Particle Swarm Optimization. IEEE Transactions on Evolutionary Computation. 26, 3 (2021), 446–460.
[5]
Ran Cheng, Yaochu Jin, Markus Olhofer, and Bernhard Sendhoff. 2016. A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Transactions on Evolutionary Computation. 20, 5 (2016), 773–791.
[6]
Ran Cheng, Miqing Li, Ye Tian, Xingyi Zhang, Shengxiang Yang, Yaochu Jin, and Xin Yao. 2017. A benchmark test suite for evolutionary many-objective optimization. Complex & Intelligent Systems. 3 (2017), 67–81.
[7]
Tinkle Chugh, Nirupam Chakraborti, Karthik Sindhya, and Yaochu Jin. 2017. A data-driven surrogate-assisted evolutionary algorithm applied to a many-objective blast furnace optimization problem. Materials and Manufacturing Processes. 32, 10 (2017), 1172–1178.
[8]
Tinkle Chugh, Yaochu Jin, Kaisa Miettinen, Jussi Hakanen, and Karthik Sindhya. 2018. A Surrogate-Assisted Reference Vector Guided Evolutionary Algorithm for Computationally Expensive Many-Objective Optimization. IEEE Transactions on Evolutionary Computation. 22, 1 (2018), 129–142.
[9]
Tinkle Chugh, Karthik Sindhya, Jussi Hakanen, and Kaisa Miettinen. 2019. A survey on handling computationally expensive multiobjective optimization problems with evolutionary algorithms. Soft Computation. 23, 9 (2019), 3137–3166.
[10]
Carlos A. Coello Coello and Margarita Reyes Sierra. 2004. A study of the parallelization of a coevolutionary multiobjective evolutionary algorithm. in Artificial Intelligence: Third Mexican International Conference on Artificial Intelligence. (2004), 688–697.
[11]
Kalyanmoy Deb and Ram Bhushan Agrawal. 1995. Simulated binary crossover for continuous search space. Complex Systems. 9, 2 (1995), 115–148.
[12]
Kalyanmoy Deb and Mayank Goyal. 1996. A combined genetic adaptive search (GeneAS) for engineering design. Computer Science and informatics. 26, 4 (1996), 30–45.
[13]
Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and TAMT Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation. 6, 2 (2002), 182–197.
[14]
Kalyanmoy Deb, Lothar Thiele, Marco Laumanns, and Eckart Zitzler. 2002. Scalable multiobjective optimization test problems. in Proceedings of the 2002 Congress on Evolutionary Computation. 1 (2002), 825–830.
[15]
Dawei Ding, Jing Xia, Lixia Yang, and Xiaodong Ding. 2018. Multiobjective Optimization Design for Electrically Large Coverage: Fragment-Type NearField\/Far-Field UHF RFID Reader Antenna Design. IEEE Antennas and Propagation Magazine. 60, 1 (2018), 27–37.
[16]
Michael Emmerich, Nicola Beume, and Boris Naujoks. 2005. An EMO algorithm using the hypervolume measure as selection criterion. in International Conference on Evolutionary Multi-Criterion Optimization. (2005), 62–76.
[17]
Michael Emmerich, Kyriakos C. Giannakoglou, and Boris Naujoks. 2006. Single-and multiobjective evolutionary optimization assisted by Gaussian random field metamodels. IEEE Transactions on Evolutionary Computation. 10, 4 (2006), 421–439.
[18]
Michael Emmerich, Alexios Giotis, Mutlu ¨Ozdemir, Thomas B¨ack, and Kyriakos Giannakoglou. 2002. Metamodel-Assisted evolution strategies. in International Conference on Parallel Problem Solving from Nature. (2002), 361–370.
[19]
Yinglan Feng, Liang Feng, Yaqing Hou, Kay Chen Tan, and Sam Kwong. 2021. EMT-ReMO: Evolutionary Multitasking for High-Dimensional Multi-Objective Optimization via Random Embedding. in 2021 IEEE Congress on Evolutionary Computation (CEC). (2021), 1672-1679.
[20]
Dan Guo, Tianyou Chai, Jinliang Ding, and Yaochu Jin. 2016. Small data driven evolutionary multiobjective optimization of fused magnesium furnaces. in 2016 IEEE Symposium Series on Computational Intelligence (SSCI). (2016), 1–8.
[21]
Dan Guo, Yaochu Jin, Jinliang Ding, and Tianyou Chai. 2019. Heterogeneous ensemble-based infill criterion for evolutionary multiobjective optimization of expensive problems. IEEE Transactions on Cybernetics. 49, 3 (2019), 1012–1025.
[22]
Dan Guo, Xilu Wang, Kailai Gao, Yaochu Jin, Jinliang Ding, and Tianyou Chai. 2022. Evolutionary optimization of high-dimensional multiobjective and many-objective expensive problems assisted by a dropout neural network. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 52, 4 (2022), 2084-2097.
[23]
Daofu Guo, Zhigang Ren, Yongsheng Liang, and An Chen. 2000. Scaling up radial basis function for high-dimensional expensive optimization using random projection. in 2020 IEEE Congress on Evolutionary Computation (CEC). (2000), 1-8.
[24]
Abhishek Gupta, Yew-Soon Ong, and Liang Feng. 2015. Multifactorial evolution: toward evolutionary multitasking. IEEE Transactions on Evolutionary Computation. 20, 3 (2015), 343–357.
[25]
Abhishek Gupta, Yew-Soon Ong, Liang Feng, and Kay Chen Tan. 2016. Multiobjective multifactorial optimization in evolutionary multitasking. IEEE Transactions on Cybernetics. 47, 7 (2016), 1652–1665.
[26]
Ahsanul Habib, Hemant Kumar Singh, Tinkle Chugh, Tapabrata Ray, and Kaisa Miettinen. 2019. A multiple surrogate assisted decomposition-based evolutionary algorithm for expensive multi/many-objective optimization. IEEE Transactions on Evolutionary Computation. 23, 6 (2019), 1000–1014.
[27]
Manuel Herrera, Aurore Guglielmetti, Manyu Xiao, and Rajan Filomeno Coelho. 2014. Metamodelassisted optimization based on multiple kernel regression for mixed variables. Structural and multidisciplinary optimization. 49, 6 (2014), 979–991.
[28]
Simon Huband, Philip Hingston, Luigi Barone, and Lyndon While. 2006. A review of multiobjective test problems and a scalable test problem toolkit. IEEE Transactions on Evolutionary Computation. 10, 5 (2006), 477–506.
[29]
Yaochu Jin. 2011. Surrogate-assisted evolutionary computation: Recent advances and future challenges. Swarm and Evolutionary Computation. 1, 2 (2011), 61–70.
[30]
Yaochu Jin and Bernhard Sendhoff. 2004. Reducing Fitness Evaluations Using Clustering Techniques and Neural Network Ensembles. in Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO). (2004), 688–699.
[31]
Yaochu Jin, Handing Wang, Tinkle Chugh, Dan Guo, and Kaisa Miettinen. 2018. Data-driven evolutionary optimization: an overview and case studies. IEEE Transactions on Evolutionary Computation, 23, 3 (2018), 442–458.
[32]
Hao Jiang, Yuhang Wang, Ye Tian, Xingyi Zhang, and Jianhua Xiao. 2021. Feature construction for meta-heuristic algorithm recommendation of capacitated vehicle routing problems. ACM Transactions on Evolutionary Learning and Optimization. 1, 1 (2021), 1–28.
[33]
Donald R Jones, Matthias Schonlau, and William J. Welch. 1998. Efficient global optimization of expensive black-box functions. Journal of Global Optimization. 13, 4 (1998), 455–492.
[34]
Nicolas Jozefowiez, Frédéric Semet, and El-Ghazali Talbi. 2021. Multiobjective vehicle routing problems. European Journal of Operational Research. 189, 2 (2008), 293–309.
[35]
Joshua Knowles. 2006. ParEGO: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Transactions on Evolutionary Computation. 10, 1 (2006), 50–66.
[36]
Weijian Kong, Tianyou Chai, Shengxiang Yang, and Jinliang Ding. 2013. A hybrid evolutionary multiobjective optimization strategy for the dynamic power supply problem in magnesia grain manufacturing. Applied Soft Computing. 13, 5 (2013), 2960–2969.
[37]
Ke Li, Qingfu Zhang, Sam Kwong, Miqing Li, and Ran Wang. 2014. Stable matching-based selection in evolutionary multiobjective optimization. IEEE Transactions on Evolutionary Computation. 18, 6 (2014), 909–923.
[38]
Jianqing Lin, Cheng He, and Ran Cheng. 2022. Adaptive dropout for high-dimensional expensive multiobjective optimization. Complex & Intelligent Systems. 8, 1 (2022), 271–285.
[39]
Qiuzhen Lin, Xunfeng Wu, Lijia Ma, Jianqiang Li, Maoguo Gong, and Carlos A. Coello Coello. 2021. An ensemble surrogate-based framework for expensive multiobjective evolutionary optimization. IEEE Transactions on Evolutionary Computation. 26, 4 (2021), 631–645.
[40]
Hai-Lin Liu, Fangqing Gu, and Qingfu Zhang. 2014. Decomposition of a multiobjective optimization problem into a number of simple multiobjective subproblems. IEEE Transactions on Evolutionary Computation. 18, 3 (2014), 450–455.
[41]
Ilya Loshchilov, Marc Schoenauer, and Michele Sebag. 2010. Dominance-based Paretosurrogate for multiobjective optimization. in Simulated Evolution and Learning: 8th International Conference. (2010), 230–239.
[42]
Zhichao Lu, Ian Whalen, Vishnu Boddeti, Yashesh Dhebar, Kalyanmoy Deb, Erik Goodman, and Wolfgang Banzhaf. 2019. NSGA-Net: Neural architecture search using multiobjective genetic algorithm. in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO). (2019), 419–427.
[43]
James MacQueen. 1967. Some methods for classification and analysis of multivariate observations. in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. 1, 14 (1967), 281–297.
[44]
Helena Mala-Jetmarova, Nargiz Sultanova, and Dragan Savic. 2017. Lost in optimization of water distribution systems? a literature review of system operation. Environmental Modelling and Software. 93 (2017), 209–254.
[45]
Michael D. Mckay, Richard J. Beckman, and William J. Conover. 2000. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics. 42, 1 (2000), 55–61.
[46]
Yew-Soon Ong and Abhishek Gupta. 2016. Evolutionary multitasking: A computer science view of cognitive multitasking. Cognitive Computation. 8, 2 (2016), 125–142.
[47]
Linqiang Pan, Cheng He, Ye Tian, Handing Wang, Xingyi Zhang, and Yaochu Jin. 2019. A classification-based surrogate-assisted evolutionary algorithm for expensive manyobjective optimization. IEEE Transactions on Evolutionary Computation. 23, 1 (2019), 74–88.
[48]
Wolfgang Ponweiser, Tobias wagner, Dirk Biermann, and Markus Vincze. 2008. Multiobjective optimization on a limited budget of evaluations using model-assisted s-metric selection. in International Conference on Parallel Problem Solving from Nature. (2008), 784–794.
[49]
Kangjia Qiao, Kunjie Yu, Boyang Qu, Jing Liang, Hui Song, Caitong Yue, Hongyu Lin, and Kay Chen Tan. 2022. Dynamic Auxiliary Task-Based Evolutionary Multitasking for Constrained Multiobjective Optimization. IEEE Transactions on Evolutionary Computation. 27, 3 (2022), 642-656.
[50]
Alma AM Rahat, Richard M. Everson, and Jonathan E. Fieldsend. 2017. Alternative infill strategies for expensive multiobjective optimization. in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO). (2017), 873–880.
[51]
R. Saravanan, S. Ramabalan, N. Godwin Raja Ebenezer, and C. Dharmaraja. 2009. Evolutionary multi criteria design optimization of robot grippers. Applied Soft Computing. 9, 1 (2009), 159–172.
[52]
Takum Sonoda and Masaya Nakata. 2022. Multiple Classifiers-Assisted Evolutionary Algorithm Based on Decomposition for High-Dimensional Multiobjective Problems. IEEE Transactions on Evolutionary Computation. 26, 6 (2022), 1581-1595.
[53]
Zhenshou Song, Handing Wang, Cheng He, and Yaochu Jin. 2021. A kriging-assisted two-archive evolutionary algorithm for expensive many-objective optimization. IEEE Transactions on Evolutionary Computation. 25, 6 (2021), 1013–1027.
[54]
Yanan Sun, Handing Wang, Bing Xue, Yaochu Jin, Gary G Yen, and Mengjie Zhang. 2020. Surrogate-assisted evolutionary deep learning using an end-to-end random forestbased performance predictor. IEEE Transactions on Evolutionary Computation. 24, 2 (2020), 350–364.
[55]
Chaoli Sun, Yaochu Jin, Ran Cheng, Jinliang Ding, and Jianchao Zeng. 2017. Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems. IEEE Transactions on Evolutionary Computation. 21, 4 (2017), 644–660.
[56]
Mohammad Tabatabaei, Markus Hartikainen, Karthik Sindhya, Jussi Hakanen, and Kaisa Miettinen. 2019. An interactive surrogate-based method for computationally expensive multiobjective optimization. Journal of the Operational Research Society. 70, 6 (2019), 898–914.
[57]
Ye Tian, Ran Cheng, Xingyi Zhang, Fan Cheng, and Yaochu Jin. 2018. An indicator based multi-objective evolutionary algorithm with reference point adaptation for better versatility. IEEE Transactions on Evolutionary Computation. 22, 4 (2018), 609–622.
[58]
Virginia Torczon and Michael Trosset. 1998. Using approximations to accelerate engineering design optimization. in 7th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization. (1998), 4800.
[59]
Cuie Yang, Jinliang Ding, Yaochu Jin, and Tianyou Chai. 2019. Offline data-driven multiobjective optimization: Knowledge transfer between surrogates and generation of final solutions. IEEE Transactions on Evolutionary Computation, 24, 3 (2019), 409–423.
[60]
Dawei Zhan and Huanlai Xing. 2021. A fast Kriging-assisted evolutionary algorithm based on incremental learning. IEEE Transactions on Evolutionary Computation. 25, 5 (2021), 941–955.
[61]
Qingfu Zhang and Hui Li. 2007. MOEA/D: A multiobjective evolutionary algorithm based on decomposition. IEEE Transactions on Evolutionary Computation. 11, 6 (2007), 712–731.
[62]
Qingfu Zhang, Wudong Liu, Edward Tsang, and Botond Virginas. 2010. Expensive multiobjective optimization by MOEA/D with Gaussian process model. IEEE Transactions on Evolutionary Computation. 14, 3 (2010), 456–474.
[63]
Qingfu Zhang, Aimin Zhou, Shizheng Zhao, Ponnuthurai Nagaratnam Suganthan, Wudong Liu, and Santosh Tiwari. 2008. Multiobjective optimization test instances for the CEC 2009 special session and competition. University of Essex, Colchester, UK and Nanyang Technological University, Singapore, Special Session on Performance Assessment of Multi-objective Optimization Algorithms, Technical Report. (2008), 1–30.
[64]
Zongzhao Zhou, Yew Soon Ong, My Hanh Nguyen, and Dudy Lim. 2005. A study on polynomial regression and Gaussian process global surrogate model in hierarchical surrogate-assisted evolutionary algorithm. in 2005 IEEE Congress on Evolutionary Computation. 3 (2005), 2832–2839.
[65]
Eckart Zitzler and Simon Künzli. 2004. Indicator-based selection in multiobjective search. in PPSN. 4 (2004), 832–842.
[66]
Eckart Zitzler, Marco Laumanns, and Lothar Thiele. 2001. SPEA2: Improving the strength Pareto evolutionary algorithm. TIK-report. 103 (2001).

Cited By

View all

Index Terms

  1. Evolutionary Optimization with Simplified Helper Task for High-dimensional Expensive Multiobjective Problems
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Transactions on Evolutionary Learning and Optimization
          ACM Transactions on Evolutionary Learning and Optimization Just Accepted
          EISSN:2688-3007
          Table of Contents
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Online AM: 11 January 2024
          Accepted: 21 November 2023
          Revised: 03 October 2023
          Received: 17 February 2023

          Check for updates

          Author Tags

          1. Surrogate-assisted evolutionary algorithm
          2. expensive multiobjective optimization problem
          3. evolutionary multitasking
          4. model management

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • 0
            Total Citations
          • 306
            Total Downloads
          • Downloads (Last 12 months)306
          • Downloads (Last 6 weeks)49
          Reflects downloads up to 30 Aug 2024

          Other Metrics

          Citations

          Cited By

          View all

          View Options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Get Access

          Login options

          Full Access

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media