Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

The Impact of a Sparse Migration Topology on the Runtime of Island Models in Dynamic Optimization

Published: 01 May 2018 Publication History

Abstract

Island models denote a distributed system of evolutionary algorithms which operate independently, but occasionally share their solutions with each other along the so-called migration topology. We investigate the impact of the migration topology by introducing a simplified island model with behavior similar to $$\lambda $$ź islands optimizing the so-called Maze fitness function (Kötzing and Molter in Proceedings of parallel problem solving from nature (PPSN XII), Springer, Berlin, pp 113---122, 2012). Previous work has shown that when a complete migration topology is used, migration must not occur too frequently, nor too soon before the optimum changes, to track the optimum of the Maze function. We show that using a sparse migration topology alleviates these restrictions. More specifically, we prove that there exist choices of model parameters for which using a unidirectional ring of logarithmic diameter as the migration topology allows the model to track the oscillating optimum through n Maze-like phases with high probability, while using any graph of diameter less than $$c\ln n$$clnn for some sufficiently small constant $$c>0$$c>0 results in the island model losing track of the optimum with overwhelming probability. Experimentally, we show that very frequent migration on a ring topology is not an effective diversity mechanism, while a lower migration rate allows the ring topology to track the optimum for a wider range of oscillation patterns. When migration occurs only rarely, we prove that dense migration topologies of small diameter may be advantageous. Combined, our results show that the sparse migration topology is able to track the optimum through a wider range of oscillation patterns, and cope with a wider range of migration frequencies.

References

[1]
Alba, E., Nakib, A., Siarry, P.: Metaheuristics for Dynamic Optimization. Studies in Computational Intelligence. Springer, Berlin (2013)
[2]
Alba, E., Troya, J.M.: A survey of parallel distributed genetic algorithms. Complexity 4(4), 31---52 (1999)
[3]
Dang, D.C., Jansen, T., Lehre, P.K.: Populations can be essential in dynamic optimisation. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '15), pp. 1407---1414 (2015)
[4]
Doerr, B.: Analyzing randomized search heuristics: tools from probability theory. In: Auger, A., Doerr, B. (eds.) Theory of Randomized Search Heuristics. World Scientific, Singapore (2011)
[5]
Droste, S.: Analysis of the (1+1) EA for a dynamically bitwise changing OneMax. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '03), pp. 909---921. Springer, Berlin (2003)
[6]
Feller, W.: An Introduction to Probability Theory and Its Applications, 3rd edn. Wiley, New York (1968)
[7]
He, J., Yao, X.: Drift analysis and average time complexity of evolutionary algorithms. Artif. Intell. 127, 57---85 (2001). Erratum in Artif. Intell. 140(1/2), 245---248 (2002)
[8]
Jansen, T., Schellbach, U.: Theoretical analysis of a mutation-based evolutionary algorithm for a tracking problem in the lattice. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '05), pp. 841---848. ACM Press, New York (2005)
[9]
Jansen, T., Zarges, C.: Evolutionary algorithms and artificial immune systems on a bi-stable dynamic optimisation problem. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '14), pp. 975---982. ACM Press, New York (2014)
[10]
Kötzing, T., Lissovoi, A., Witt, C.: (1+1) EA on generalized dynamic OneMax. In: Proceedings of Foundations of Genetic Algorithms Workshop (FOGA '15), pp. 40---51. ACM Press, New York (2015)
[11]
Kötzing, T., Molter, H.: ACO beats EA on a dynamic pseudo-boolean function. In: Proceedings of Parallel Problem Solving from Nature (PPSN XII), pp. 113---122. Springer, Berlin (2012)
[12]
Lässig, J., Sudholt, D.: Design and analysis of migration in parallel evolutionary algorithms. Soft Comput. 17(7), 1121---1144 (2013)
[13]
Lehre, P.K., Witt, C.: Concentrated hitting times of randomized search heuristics with variable drift. In: Proceedings of the 25th International Symposium on Algorithms and Computation (ISAAC'14), Lecture Notes in Computer Science, vol. 8889, pp. 686---697. Springer, Berlin (2014). Extended version at arXiv:1307.2559
[14]
Levin, D.A., Peres, Y., Wilmer, E.L.: Markov Chains and Mixing Times. American Mathematical Society, Providence (2008)
[15]
Lissovoi, A., Witt, C.: MMAS versus population-based EA on a family of dynamic fitness functions. Algorithmica 75(3), 554---576 (2015)
[16]
Lissovoi, A., Witt, C.: The impact of migration topology on the runtime of island models in dynamic optimization. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '16), pp. 1155---1162 (2016)
[17]
Lissovoi, A., Witt, C.: A runtime analysis of parallel evolutionary algorithms in dynamic optimization. Algorithmica 78(2), 641---659 (2017)
[18]
Mambrini, A., Sudholt, D.: Design and analysis of adaptive migration intervals in parallel evolutionary algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '14), pp. 1047---1054 (2014)
[19]
Nguyen, T.T., Yang, S., Branke, J.: Evolutionary dynamic optimization: a survey of the state of the art. Swarm Evol. Comput. 6, 1---24 (2012)
[20]
Rohlfshagen, P., Lehre, P.K., Yao, X.: Dynamic evolutionary optimisation: an analysis of frequency and magnitude of change. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '09), pp. 1713---1720. ACM Press, New York (2009)
[21]
Ruciński, M., Izzo, D., Biscani, F.: On the impact of the migration topology on the island model. Parallel Comput. 36(10---11), 555---571 (2010)

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Algorithmica
Algorithmica  Volume 80, Issue 5
May 2018
358 pages

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 May 2018

Author Tags

  1. Dynamic problems
  2. Evolutionary algorithms
  3. Island models
  4. Populations
  5. Runtime analysis

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Runtime Analysis of the -EA on the Dynamic BinVal FunctionSN Computer Science10.1007/s42979-022-01203-z3:4Online publication date: 11-Jun-2022
  • (2021)A Survey on Recent Progress in the Theory of Evolutionary Algorithms for Discrete OptimizationACM Transactions on Evolutionary Learning and Optimization10.1145/34723041:4(1-43)Online publication date: 13-Oct-2021
  • (2021)Runtime Analysis of the -EA on the Dynamic BinVal FunctionEvolutionary Computation in Combinatorial Optimization10.1007/978-3-030-72904-2_6(84-99)Online publication date: 7-Apr-2021
  • (2020)MI-LFGOA: multi-island levy-flight based grasshopper optimization for spatial image steganalysisMultimedia Tools and Applications10.1007/s11042-020-09328-079:39-40(29723-29750)Online publication date: 12-Aug-2020

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media