Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3377929.3398123acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

A modular hybridization of particle swarm optimization and differential evolution

Published: 08 July 2020 Publication History

Abstract

In swarm intelligence, Particle Swarm Optimization (PSO) and Differential Evolution (DE) have been successfully applied in many optimization tasks, and a large number of variants, where novel algorithm operators or components are implemented, has been introduced to boost the empirical performance. In this paper, we first propose to combine the variants of PSO or DE by modularizing each algorithm and incorporating the variants thereof as different options of the corresponding modules. Then, considering the similarity between the inner workings of PSO and DE, we hybridize the algorithms by creating two populations with variation operators of PSO and DE respectively, and selecting individuals from those two populations. The resulting novel hybridization, called PSODE, encompasses most up-to-date variants from both sides, and more importantly gives rise to an enormous number of unseen swarm algorithms via different instantiations of the modules therein.
In detail, we consider 16 different variation operators originating from existing PSO- and DE algorithms, which, combined with 4 different selection operators, allow the hybridization framework to generate 800 novel algorithms. The resulting set of hybrid algorithms, along with the combined 30 PSO- and DE algorithms that can be generated with the considered operators, is tested on the 24 problems from the well-known COCO/BBOB benchmark suite, across multiple function groups and dimensionalities.

References

[1]
Rick Boks, Hao Wang, and Thomas Bäck. 2020. Experimental Results for the study "A Modular Hybridization of Particle Swarm Optimization and Differential Evolution". (May 2020).
[2]
Cheng-Wen Chiang, Wei-Ping Lee, and Jia-Sheng Heh. 2010. A 2-Opt based differential evolution for global optimization. Applied Soft Computing 10, 4 (2010), 1200 -- 1207. Optimisation Methods & Applications in Decision-Making Processes.
[3]
M. Clerc and J. Kennedy. 2002. The particle swarm - explosion, stability, and convergence in a multidimensional complex space. IEEE Transactions on Evolutionary Computation 6, 1 (Feb 2002), 58--73.
[4]
Carola Doerr, Furong Ye, Naama Horesh, Hao Wang, Ofer M Shir, and Thomas Bäck. 2019. Benchmarking discrete optimization heuristics with IOHprofiler. Applied Soft Computing (2019), 106027.
[5]
R. Eberhart and J. Kennedy. 1995. A New Optimizer Using Particle Swarm Theory. Proceedings of the sixth international symposium on micro machine and human science (1995), 39--43.
[6]
A. Engelbrecht. 2012. Particle swarm optimization: Velocity initialization. In 2012 IEEE Congress on Evolutionary Computation. 1--8.
[7]
N. Hansen, A. Auger, O. Mersmann, T. Tušar, and D. Brockhoff. 2016. COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting. ArXiv e-prints arXiv:1603.08785 (2016).
[8]
Tim Hendtlass. 2001. A Combined Swarm Differential Evolution Algorithm for Optimization Problems. In Proceedings of the 14th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems: Engineering of Intelligent Systems (IEA/AIE '01). Springer-Verlag, Berlin, Heidelberg, 11--18.
[9]
Mahmud Iwan, R. Akmeliawati, Tarig Faisal, and Hayder M.A.A. Al-Assadi. 2012. Performance Comparison of Differential Evolution and Particle Swarm Optimization in Constrained Optimization. Procedia Engineering 41 (2012), 1323 -- 1328. International Symposium on Robotics and Intelligent Sensors 2012 (IRIS 2012).
[10]
Jingqiao Zhang and A. C. Sanderson. 2007. JADE: Self-adaptive differential evolution with fast and reliable convergence performance. In 2007 IEEE Congress on Evolutionary Computation. 2251--2258.
[11]
J. Kennedy. 2003. Bare bones particle swarms. In Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706). 80--87.
[12]
J. Kennedy and R. Mendes. 2002. Population structure and particle swarm performance. In Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600), Vol. 2. 1671--1676 vol.2.
[13]
J. J. Liang and P. N. Suganthan. 2005. Dynamic multi-swarm particle swarm optimizer. In Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005. 124--129.
[14]
R. Mendes, J. Kennedy, and J. Neves. 2004. The fully informed particle swarm: simpler, maybe better. IEEE Transactions on Evolutionary Computation 8, 3 (June 2004), 204--210.
[15]
M. G. H. Omran, A. P. Engelbrecht, and A. Salman. 2007. Differential Evolution Based Particle Swarm Optimization. In 2007 IEEE Swarm Intelligence Symposium. 112--119.
[16]
M. Pant, R. Thangaraj, C. Grosan, and A. Abraham. 2008. Hybrid Differential Evolution - Particle Swarm Optimization Algorithm for Solving Global Optimization Problems. In 2008 Third International Conference on Digital Information Management. 18--24.
[17]
K. V. Price. 1997. Differential evolution vs. the functions of the 2/sup nd/ ICEO. In Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97). 153--157.
[18]
Y. Shi and R. Eberhart. 1998. A modified particle swarm optimizer. In 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360). 69--73.
[19]
Rainer Storn and Kenneth Price. 1995. Differential Evolution: A Simple and Efficient Adaptive Scheme for Global Optimization Over Continuous Spaces. Journal of Global Optimization 23 (01 1995).
[20]
P. N. Suganthan. 1999. Particle swarm optimiser with neighbourhood operator. In Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406), Vol. 3. 1958--1962 Vol. 3.
[21]
Chris Thornton, Frank Hutter, Holger H. Hoos, and Kevin Leyton-Brown. 2013. Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '13). Association for Computing Machinery, New York, NY, USA, 847--855.
[22]
S. van Rijn, H. Wang, M. van Leeuwen, and T. Bäck. 2016. Evolving the structure of Evolution Strategies. In 2016 IEEE Symposium Series on Computational Intelligence (SSCI). 1--8.
[23]
Sander van Rijn, Hao Wang, Bas van Stein, and Thomas Bäck. 2017. Algorithm Configuration Data Mining for CMA Evolution Strategies. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '17). ACM, New York, NY, USA, 737--744.
[24]
J. Vesterstrom and R. Thomsen. 2004. A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems. In Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753), Vol. 2. 1980--1987 Vol.2.
[25]
Wen-Jun Zhang and Xiao-Feng Xie. 2003. DEPSO: hybrid particle swarm with differential evolution operator. In SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483), Vol. 4. 3816--3821 vol.4.

Cited By

View all
  • (2023)Designing New Metaheuristics: Manual Versus Automatic ApproachesIntelligent Computing10.34133/icomputing.00482Online publication date: 4-Dec-2023
  • (2023)Parameters Identification of a Permanent Magnet DC Motor: A ReviewElectronics10.3390/electronics1212255912:12(2559)Online publication date: 6-Jun-2023
  • (2023)Automated Design of Metaheuristics Using Reinforcement Learning Within a Novel General Search FrameworkIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.319729827:4(1072-1084)Online publication date: Aug-2023
  • Show More Cited By

Index Terms

  1. A modular hybridization of particle swarm optimization and differential evolution

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    GECCO '20: Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion
    July 2020
    1982 pages
    ISBN:9781450371278
    DOI:10.1145/3377929
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 July 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. differential evolution
    2. hybridization
    3. metaheuristics
    4. particle swarm optimization
    5. swarm intelligence

    Qualifiers

    • Research-article

    Conference

    GECCO '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)9
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 25 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Designing New Metaheuristics: Manual Versus Automatic ApproachesIntelligent Computing10.34133/icomputing.00482Online publication date: 4-Dec-2023
    • (2023)Parameters Identification of a Permanent Magnet DC Motor: A ReviewElectronics10.3390/electronics1212255912:12(2559)Online publication date: 6-Jun-2023
    • (2023)Automated Design of Metaheuristics Using Reinforcement Learning Within a Novel General Search FrameworkIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.319729827:4(1072-1084)Online publication date: Aug-2023
    • (2022)Energy-Efficient Resource Allocation for Downlink Non-Orthogonal Multiple Access SystemsApplied Sciences10.3390/app1219974012:19(9740)Online publication date: 27-Sep-2022
    • (2022)The importance of landscape features for performance prediction of modular CMA-ES variantsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3512290.3528832(648-656)Online publication date: 8-Jul-2022
    • (2021)Quantifying the impact of boundary constraint handling methods on differential evolutionProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3449726.3463214(1199-1207)Online publication date: 7-Jul-2021
    • (2021)A Phase Memory Controller for Isolated Intersection Traffic SignalsIntelligent Systems Design and Applications10.1007/978-3-030-71187-0_28(302-311)Online publication date: 3-Jun-2021

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media