Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Learning Regularity for Evolutionary Multiobjective Search: A Generative Model-Based Approach

Published: 18 October 2023 Publication History

Abstract

The prior domain knowledge, i.e., the regularity property of continuous multiobjective optimization problems (MOPs), could be learned to guide the search for evolutionary multiobjective optimization. This paper proposes a learning-to-guide strategy (LGS) for assisting the search for multiobjective optimization algorithms in dealing with MOPs. The main idea behind LGS is to capture the regularity via learning techniques to guide the evolutionary search to generate promising offspring solutions. To achieve this, a generative model called the generative topographic mapping (GTM) is adopted to capture the manifold distribution of a population. A set of regular grid points in the latent space are mapped into the decision space within some manifold structures to guide the search for mating with some parents for offspring generation. Following this idea, three alternative LGS-based generation operators are developed and investigated, which combine the local and global information in the offspring generation. To learn the regularity more efficiently in an algorithm, the proposed LGS is embedded in an efficient evolutionary algorithm (called LGSEA). The LGSEA includes an incremental training procedure aimed at reducing the computational cost of GTM training by reusing the built GTM model. The developed algorithm is compared with some newly developed or classical learning-based algorithms on several benchmark problems. The results demonstrate the advantages of LGSEA over other approaches, showcasing its potential for solving complex MOPs.

References

[1]
K. Miettinen, Nonlinear Multiobjective Optimization, vol. 12. Berlin, Germany: Springer, 2012.
[2]
K. Deb, “Multi-objective optimisation using evolutionary algorithms: An introduction,” in Multi-Objective Evolutionary Optimisation for Product Design and Manufacturing. Berlin, Germany: Springer, 2011, pp. 3–34.
[3]
A. Zhou, B.-Y. Qu, H. Li, S.-Z. Zhao, P. N. Suganthan, and Q. Zhang, “Multiobjective evolutionary algorithms: A survey of the state of the art,” Swarm Evol. Comput., vol. 1, no. 1, pp. 32–49, 2011.
[4]
K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, “A fast and elitist multiobjective genetic algorithm: NSGA-II,” IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182–197, Apr. 2002.
[5]
E. Zitzler, M. Laumanns, and L. Thiele, “SPEA2: Improving the strength pareto evolutionary algorithm,” Comput. Eng. Netw. Lab., ETH Zurich, Zurich, Switzerland, TIK-report 103, 2001.
[6]
D. W. Corne, N. R. Jerram, J. D. Knowles, and M. J. Oates, “PESA-II: Region-based selection in evolutionary multiobjective optimization,” in Proc. 3rd Annu. Conf. Genet. Evol. Comput., 2001, pp. 283–290.
[7]
N. Beume, B. Naujoks, and M. Emmerich, “SMS-EMOA: Multiobjective selection based on dominated hypervolume,” Eur. J. Oper. Res., vol. 181, no. 3, pp. 1653–1669, 2007.
[8]
J. Bader and E. Zitzler, “Hype: An algorithm for fast hypervolume-based many-objective optimization,” Evol. Comput., vol. 19, no. 1, pp. 45–76, 2011.
[9]
Q. Zhang and H. Li, “MOEA/D: A multiobjective evolutionary algorithm based on decomposition,” IEEE Trans. Evol. Comput., vol. 11, no. 6, pp. 712–731, Dec. 2007.
[10]
H. Li and Q. Zhang, “Multiobjective optimization problems with complicated pareto sets, MOEA/D and NSGA-II,” IEEE Trans. Evol. Comput., vol. 13, no. 2, pp. 284–302, Apr. 2009.
[11]
L. Chen, K. Deb, and H.-L. Liu, “Explicit control of implicit parallelism in decomposition-based evolutionary many-objective optimization algorithms [research frontier],” IEEE Comput. Intell. Mag., vol. 14, no. 4, pp. 52–64, Nov. 2019.
[12]
C. Hillermeier et al., Nonlinear Multiobjective Optimization: A Generalized Homotopy Approach, vol. 135. Berlin, Germany: Springer, 2001.
[13]
Y. Jin and B. Sendhoff, “Connectedness, regularity and the success of local search in evolutionary multi-objective optimization,” in Proc. IEEE Congr. Evol. Comput., 2003, pp. 1910–1917.
[14]
Q. Zhang, A. Zhou, and Y. Jin, “RM-MEDA: A regularity model-based multiobjective estimation of distribution algorithm,” IEEE Trans. Evol. Comput., vol. 12, no. 1, pp. 41–63, Feb. 2008.
[15]
N. Kambhatla and T. K. Leen, “Dimension reduction by local principal component analysis,” Neural Comput., vol. 9, no. 7, pp. 1493–1516, 1997.
[16]
Y. Jin and B. Sendhoff, “A systems approach to evolutionary multiobjective structural optimization and beyond,” IEEE Comput. Intell. Mag., vol. 4, no. 3, pp. 62–76, Aug. 2009.
[17]
H. Wang, Q. Zhang, L. Jiao, and X. Yao, “Regularity model for noisy multiobjective optimization,” IEEE Trans. Cybern., vol. 46, no. 9, pp. 1997–2009, Sep. 2016.
[18]
S. Wang, B. Li, and A. Zhou, “A regularity augmented evolutionary algorithm with dual-space search for multiobjective optimization,” Swarm Evol. Comput., vol. 78, 2023, Art. no.
[19]
K. Li and S. Kwong, “A general framework for evolutionary multiobjective optimization via manifold learning,” Neurocomputing, vol. 146, pp. 65–74, 2014.
[20]
T. Hastie and W. Stuetzle, “Principal curves,” J. Amer. Stat. Assoc., vol. 84, no. 406, pp. 502–516, 1989.
[21]
U. Ozertem and D. Erdogmus, “Locally defined principal curves and surfaces,” J. Mach. Learn. Res., vol. 12, pp. 1249–1286, 2011.
[22]
M. Belkin and P. Niyogi, “Laplacian eigenmaps for dimensionality reduction and data representation,” Neural Comput., vol. 15, no. 6, pp. 1373–1396, 2003.
[23]
A. K. Jain, “Data clustering: 50 years beyond K-means,” Pattern Recognit. Lett., vol. 31, no. 8, pp. 651–666, 2010.
[24]
T. Kohonen, “The self-organizing map,” Proc. IEEE, vol. 78, no. 9, pp. 1464–1480, Sep. 1990.
[25]
H. Zhang, A. Zhou, S. Song, Q. Zhang, X.-Z. Gao, and J. Zhang, “A self-organizing multiobjective evolutionary algorithm,” IEEE Trans. Evol. Comput., vol. 20, no. 5, pp. 792–806, Oct. 2016.
[26]
J. Sun, H. Zhang, A. Zhou, Q. Zhang, and K. Zhang, “A new learning-based adaptive multi-objective evolutionary algorithm,” Swarm Evol. Comput., vol. 44, pp. 304–319, 2019.
[27]
L. Pan, L. Li, R. Cheng, C. He, and K. C. Tan, “Manifold learning-inspired mating restriction for evolutionary multiobjective optimization with complicated pareto sets,” IEEE Trans. Cybern., vol. 51, no. 6, pp. 3325–3337, Jun. 2021.
[28]
W. Zhang, N. Zhang, W. Zhang, G. G. Yen, and G. Li, “A cluster-based immune-inspired algorithm using manifold learning for multimodal multi-objective optimization,” Inf. Sci., vol. 581, pp. 304–326, 2021.
[29]
I. D. Guedalia, M. London, and M. Werman, “An on-line agglomerative clustering method for nonstationary data,” Neural Comput., vol. 11, no. 2, pp. 521–540, 1999.
[30]
S. Calinon and A. Billard, “Incremental learning of gestures by imitation in a humanoid robot,” in Proc. 2nd ACM/IEEE Int. Conf. Hum.-Robot Interact., 2007, pp. 255–262.
[31]
K. Li and R. Chen, “Batched data-driven evolutionary multi-objective optimization based on manifold interpolation,” IEEE Trans. Evol. Comput., vol. 27, no. 1, pp. 126–140, Feb. 2023.
[32]
C. M. Bishop, M. Svensén, and C. K. Williams, “GTM: The generative topographic mapping,” Neural Comput., vol. 10, no. 1, pp. 215–234, 1998.
[33]
C. M. Bishop, M. Svensén, and C. K. Williams, “Developments of the generative topographic mapping,” Neurocomputing, vol. 21, no. 1–3, pp. 203–224, 1998.
[34]
P. Larrañaga and J. A. Lozano, Estimation of Distribution Algorithms: A New Tool for Evolutionary Comput., vol. 2. Berlin, Germany: Springer, 2001.
[35]
Y. Wang, J. Xiang, and Z. Cai, “A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator,” Appl. Soft Comput., vol. 12, no. 11, pp. 3526–3538, 2012.
[36]
Y. Li, X. Xu, P. Li, and L. Jiao, “Improved RM-MEDA with local learning,” Soft Comput., vol. 18, no. 7, pp. 1383–1397, 2014.
[37]
M. Shi, Z. He, Z. Chen, and X. Liu, “A full variate Gaussian model-based RM-MEDA without clustering process,” Int. J. Mach. Learn. Cybern., vol. 9, no. 10, pp. 1591–1608, 2018.
[38]
Y. Jin, A. Zhou, Q. Zhang, B. Sendhoff, and E. Tsang, “Modeling regularity to improve scalability of model-based multiobjective optimization algorithms,” in Multiobjective Problem Solving From Nature. Berlin, Germany: Springer, 2008, pp. 331–355.
[39]
A. Zhou, Q. Zhang, and G. Zhang, “A multiobjective evolutionary algorithm based on decomposition and probability model,” in Proc. IEEE Congr. Evol. Comput., 2012, pp. 1–8.
[40]
A. Zhou, Q. Zhang, and Y. Jin, “Approximating the set of pareto-optimal solutions in both the decision and objective spaces by an estimation of distribution algorithm,” IEEE Trans. Evol. Comput., vol. 13, no. 5, pp. 1167–1189, Oct. 2009.
[41]
Y. Tian, X. Zhang, R. Cheng, C. He, and Y. Jin, “Guiding evolutionary multiobjective optimization with generic front modeling,” IEEE Trans. Cybern., vol. 50, no. 3, pp. 1106–1119, Mar. 2020.
[42]
Y. Tian, L. Si, X. Zhang, K. C. Tan, and Y. Jin, “Local model-based pareto front estimation for multiobjective optimization,” IEEE Trans. Syst., Man, Cybern. Syst., vol. 53, no. 1, pp. 623–634, Jan. 2023.
[43]
R. Cheng, Y. Jin, K. Narukawa, and B. Sendhoff, “A multiobjective evolutionary algorithm using Gaussian process-based inverse modeling,” IEEE Trans. Evol. Comput., vol. 19, no. 6, pp. 838–856, Dec. 2015.
[44]
C. He, S. Huang, R. Cheng, K. C. Tan, and Y. Jin, “Evolutionary multiobjective optimization driven by generative adversarial networks (GANs),” IEEE Trans. Cybern., vol. 51, no. 6, pp. 3129–3142, Jun. 2020.
[45]
Z. Wang, H. Hong, K. Ye, G.-E. Zhang, M. Jiang, and K. C. Tan, “Manifold interpolation for large-scale multiobjective optimization via generative adversarial networks,” IEEE Trans. Neural Netw. Learn. Syst., vol. 34, no. 8, pp. 4631–4645, Aug. 2023.
[46]
A. Zhou, Q. Zhang, Y. Jin, B. Sendhoff, and E. Tsang, “Modelling the population distribution in multi-objective optimization by generative topographic mapping,” in Proc. Int. Conf. Parallel Prob. Solving Nature, 2006, pp. 443–452.
[47]
W. Zhang, S. Wang, A. Zhou, and H. Zhang, “A practical regularity model based evolutionary algorithm for multiobjective optimization,” Appl. Soft Comput., vol. 129, 2022, Art. no.
[48]
F. Gu, H.-L. Liu, and K. C. Tan, “A multiobjective evolutionary algorithm using dynamic weight design method,” Int. J. Innov. Comput., Inf. Control, vol. 8, no. 5(B), pp. 3677–3688, 2012.
[49]
S. Huband, L. Barone, L. While, and P. Hingston, “A scalable multi-objective test problem toolkit,” in Proc. 3rd Int. Conf. Evol. Multi-Criterion Optim., 2005, pp. 280–295.
[50]
E. Zitzler, K. Deb, and L. Thiele, “Comparison of multiobjective evolutionary algorithms: Empirical results,” Evol. Comput., vol. 8, no. 2, pp. 173–195, 2000.
[51]
Y. Tian, R. Cheng, X. Zhang, and Y. Jin, “PlatEMO: A MATLAB platform for evolutionary multi-objective optimization [educational forum],” IEEE Comput. Intell. Mag., vol. 12, no. 4, pp. 73–87, Nov. 2017.
[52]
R. Tanabe and H. Ishibuchi, “An easy-to-use real-world multi-objective optimization problem suite,” Appl. Soft Comput., vol. 89, 2020, Art. no.

Cited By

View all
  • (2024)Evolutionary Retrosynthetic Route Planning [Research Frontier]IEEE Computational Intelligence Magazine10.1109/MCI.2024.340136919:3(58-72)Online publication date: 1-Aug-2024
  • (2024)Diffusion Model-Based Multiobjective Optimization for Gasoline Blending SchedulingIEEE Computational Intelligence Magazine10.1109/MCI.2024.336398019:2(61-76)Online publication date: 8-Apr-2024

Index Terms

  1. Learning Regularity for Evolutionary Multiobjective Search: A Generative Model-Based Approach
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image IEEE Computational Intelligence Magazine
          IEEE Computational Intelligence Magazine  Volume 18, Issue 4
          Nov. 2023
          73 pages

          Publisher

          IEEE Press

          Publication History

          Published: 18 October 2023

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 30 Aug 2024

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Evolutionary Retrosynthetic Route Planning [Research Frontier]IEEE Computational Intelligence Magazine10.1109/MCI.2024.340136919:3(58-72)Online publication date: 1-Aug-2024
          • (2024)Diffusion Model-Based Multiobjective Optimization for Gasoline Blending SchedulingIEEE Computational Intelligence Magazine10.1109/MCI.2024.336398019:2(61-76)Online publication date: 8-Apr-2024

          View Options

          View options

          Get Access

          Login options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media