Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2739480.2754666acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Extended Differential Grouping for Large Scale Global Optimization with Direct and Indirect Variable Interactions

Published: 11 July 2015 Publication History

Abstract

Cooperative co-evolution is a framework that can be used to effectively solve large scale optimization problems. This approach employs a divide and conquer strategy, which decomposes the problem into sub-components that are optimized separately. However, solution quality relies heavily on the decomposition method used. Ideally, the interacting decision variables should be assigned to the same sub-component and the interdependency between sub-components should be kept to a minimum. Differential grouping, a recently proposed method, has high decomposition accuracy across a suite of benchmark functions. However, we show that differential grouping can only identify decision variables that interact directly. Subsequently, we propose an extension of differential grouping that is able to correctly identify decision variables that also interact indirectly. Empirical studies show that our extended differential grouping method achieves perfect decomposition on all of the benchmark functions investigated. Significantly, when our decomposition method is embedded in the cooperative co-evolution framework, it achieves comparable or better solution quality than the differential grouping method.

References

[1]
W. Chen, T. Weise, Z. Yang, and K. Tang. Large-scale global optimization using cooperative coevolution with variable interaction learning. In Lecture Notes in Computer Science, pages 300--309, 2010.
[2]
Y. Davidor. Epistasis variance: Suitability of a representation to genetic algorithms. Complex Systems, 4:369--383, 1990.
[3]
D. Goldberg, B. Korb, and K. Deb. Messy genetic algorithms: Motivation, analysis, and first results. Complex systems, 3:493--530, 1989.
[4]
D. E. Goldberg. Genetic Algorithms in Search, Optimization, and Machine Learning, volume Addison-We. 1989.
[5]
D. E. Goldberg, K. Deb, H. Kargupta, and G. Harik. Rapid Accurate Optimization of Difficult Problems Using Fast Messy Genetic Algorithms. Proceedings of the Fifth International Conference on Genetic Algorithms,(Urbana, USA), pages 56--64, 1993.
[6]
N. Hansen. Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evolutionary computation, 11(1):1--18, 2003.
[7]
H. Kargupta. The performance of the gene expression messy genetic algorithm on real test functions. Proceedings of IEEE International Conference on Evolutionary Computation, 1996.
[8]
Y. Liu, X. Yao, Q. Zhao, and T. Higuchi. Scaling up fast evolutionary programming with cooperative coevolution. Proceedings of the 2001 Congress on Evolutionary Computation, 2, 2001.
[9]
H. Mühlenbein, J. Bendisch, and H. M. Voigt. From recombination of genes to the estimation of distributions II. Continuous parameters. Parallel Problem Solving from Nature - PPSN IV. Springer Berlin Heidelberg, pages 188--197, 1996.
[10]
M. Munetomo and D. Goldberg. A genetic algorithm using linkage identification by nonlinearity check. IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics, 1, 1999.
[11]
M. Munetomo and D. E. Goldberg. Linkage identification by non-monotonicity detection for overlapping functions. Evolutionary computation, 7:377--398, 1999.
[12]
M. Omidvar, X. Li, Y. Mei, and X. Yao. Cooperative co-evolution with differential grouping for large scale optimization. IEEE Transcations on Evolutionary Computation, 18(3):378--393, 2014.
[13]
M. N. Omidvar, X. Li, Z. Yang, and X. Yao. Cooperative co-evolution for large scale optimization through more frequent random grouping. In IEEE Congress on Evolutionary Computation, 2010.
[14]
M. N. Omidvar, X. Li, and X. Yao. Cooperative co-evolution with delta grouping for large scale non-separable function optimization. In IEEE Congress on Evolutionary Computation, 2010.
[15]
M. N. Omidvar, Y. Mei, and X. Li. Optimal Decomposition of Large-Scale Separable Continuous Functions for Cooperative Co-evolutionary Algorithms. IEEE Congress on Evolutionary Computation, 2014.
[16]
M. Potter and K. D. Jong. A cooperative coevolutionary approach to function optimization. Parallel Problem Solving from Nature - PPSN III, pages 249 -- 257, 1994.
[17]
S. Rochet, G. Venturini, M. Slimane, and E. E. Kharoubi. A critical and empirical study of epistasis measures for predicting GA performances: a summary. Artificial evolution, 1998.
[18]
D.-I. Seo and B.-R. Moon. An information-theoretic analysis on the interactions of variables in combinatorial optimization problems. Evolutionary computation, 15:169--198, 2007.
[19]
Y.-j. Shi, H.-f. Teng, and Z.-q. Li. Cooperative Co-evolutionary Differential Evolution for Function Optimization. In Advances in Natural Computation, pages 1080--1088. 2005.
[20]
K. Tang, X. Yáo, and P. Suganthan. Benchmark functions for the CEC'2010 special session and competition on large scale global optimization. Rapport technique, USTC, Nature Inspired Computation and Applications Laboratory, (1):1--23, 2010.
[21]
F. VandenBergh and A. Engelbrecht. A Cooperative Approach to Particle Swarm Optimization. Evolutionary Computation, IEEE Transactions on, 8:225--239, 2004.
[22]
T. Weise, R. Chiong, and K. Tang. Evolutionary Optimization: Pitfalls and Booby Traps. Journal of Computer Science and Technology, 27(5):907--936, Nov. 2012.
[23]
Z. Yang, K. Tang, and X. Yao. Large scale evolutionary optimization using cooperative coevolution. Information Sciences, 178(15):2985--2999, Aug. 2008.
[24]
Z. Yang, K. Tang, and X. Yao. Self-adaptive differential evolution with neighborhood search. In 2008 IEEE Congress on Evolutionary Computation, CEC 2008, pages 1110--1116, 2008.

Cited By

View all
  • (2024)Transfer-Based Particle Swarm Optimization for Large-Scale Dynamic Optimization With Changing Variable InteractionsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2023.332632728:6(1633-1643)Online publication date: Dec-2024
  • (2024)Random Contrastive Interaction for Particle Swarm Optimization in High-Dimensional EnvironmentIEEE Transactions on Evolutionary Computation10.1109/TEVC.2023.327750128:4(933-949)Online publication date: Aug-2024
  • (2024)An Efficient Differential Grouping Algorithm for Large-Scale Global OptimizationIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.323007028:1(32-46)Online publication date: Feb-2024
  • Show More Cited By

Index Terms

  1. Extended Differential Grouping for Large Scale Global Optimization with Direct and Indirect Variable Interactions

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      GECCO '15: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation
      July 2015
      1496 pages
      ISBN:9781450334723
      DOI:10.1145/2739480
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 11 July 2015

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. cooperative co-evolution
      2. large scale global optimization
      3. problem decomposition
      4. variable interaction

      Qualifiers

      • Research-article

      Conference

      GECCO '15
      Sponsor:

      Acceptance Rates

      GECCO '15 Paper Acceptance Rate 182 of 505 submissions, 36%;
      Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)19
      • Downloads (Last 6 weeks)4
      Reflects downloads up to 07 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Transfer-Based Particle Swarm Optimization for Large-Scale Dynamic Optimization With Changing Variable InteractionsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2023.332632728:6(1633-1643)Online publication date: Dec-2024
      • (2024)Random Contrastive Interaction for Particle Swarm Optimization in High-Dimensional EnvironmentIEEE Transactions on Evolutionary Computation10.1109/TEVC.2023.327750128:4(933-949)Online publication date: Aug-2024
      • (2024)An Efficient Differential Grouping Algorithm for Large-Scale Global OptimizationIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.323007028:1(32-46)Online publication date: Feb-2024
      • (2024)Large-Scale Multiobjective Optimization via Reformulated Decision Variable AnalysisIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.321300628:1(47-61)Online publication date: Feb-2024
      • (2024)A Composite Decomposition Method for Large-Scale Global OptimizationIEEE Transactions on Artificial Intelligence10.1109/TAI.2024.33733915:12(6304-6319)Online publication date: Dec-2024
      • (2024)Large-scale evolutionary optimization: A review and comparative studySwarm and Evolutionary Computation10.1016/j.swevo.2023.101466(101466)Online publication date: Jan-2024
      • (2024)A decomposition framework based on memorized binary search for large-scale optimization problemsInformation Sciences: an International Journal10.1016/j.ins.2024.121063679:COnline publication date: 1-Sep-2024
      • (2024)Objective contribution decomposition method and multi-population optimization strategy for large-scale multi-objective optimization problemsInformation Sciences: an International Journal10.1016/j.ins.2024.120950678:COnline publication date: 1-Sep-2024
      • (2024)Cooperative coevolutionary differential evolution with adjacent intensity matrix with linkage identification for large-scale optimization problems in noisy environmentsEvolutionary Intelligence10.1007/s12065-024-00941-817:5-6(3483-3503)Online publication date: 10-May-2024
      • (2024)Evolutionary dynamic grouping based cooperative co-evolution algorithm for large-scale optimizationApplied Intelligence10.1007/s10489-024-05390-554:6(4585-4601)Online publication date: 1-Mar-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media