Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1830483.1830620acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Generalized crowding for genetic algorithms

Published: 07 July 2010 Publication History

Abstract

Crowding is a technique used in genetic algorithms to preserve diversity in the population and to prevent premature convergence to local optima. It consists of pairing each offspring with a similar individual in the current population (pairing phase) and deciding which of the two will remain in the population (replacement phase). The present work focuses on the replacement phase of crowding, which usually has been carried out by one of the following three approaches: Deterministic, Probabilistic, and Simulated Annealing. These approaches present some limitations regarding the way replacement is conducted. On the one hand, the first two apply the same selective pressure regardless of the problem being solved or the stage of the genetic algorithm. On the other hand, the third does not apply a uniform selective pressure over all the individuals in the population, which makes the control of selective pressure over the generations somewhat difficult. This work presents a Generalized Crowding approach that allows selective pressure to be controlled in a simple way in the replacement phase of crowding, thus overcoming limitations of the other approaches. Furthermore, the understanding of existing approaches is greatly improved, since both Deterministic and Probabilistic Crowding turn out to be special cases of Generalized Crowding. In addition, the temperature parameter used in Simulated Annealing is replaced by a parameter called scaling factor that controls the selective pressure applied. Theoretical analysis using Markov chains and empirical evaluation using Bayesian networks demonstrate the potential of this novel Generalized Crowding approach.

References

[1]
D. H. Ackley, G. E. Hinton, and T. J. Sejnowski. A learning algorithm for Boltzmann machines. Cognitive Science, 9:147--169, 1985.
[2]
K. A. de Jong. An Analysis of the Behavior of a Class of Genetic Adaptive Systems. PhD thesis, Department of Computer and Communication Sciences, University of Michigan, Ann Arbor, MI, 1975.
[3]
S. F. Galán and O. J. Mengshoel. Constraint handling using tournament selection: Abductive inference in partly deterministic Bayesian networks. Evolutionary Computation, 17(1):55--88, 2009.
[4]
D. E. Goldberg. Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading, MA, 1989.
[5]
D. E. Goldberg. A note on Boltzmann tournament selection for genetic algorithms and population-oriented simulated annealing. Complex Systems, 4:445--460, 1990.
[6]
J. H. Holland. Adaptation in Natural and Arti?cial Systems. The University of Michigan Press, Ann Arbor, MI, 1975. Second Edition, The MIT Press, Boston, MA, 1992.
[7]
S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi. Optimization by simulated annealing. Science, 220(4598):671--680, 1983.
[8]
S. W. Mahfoud. Crowding and preselection revisited. In R. Männer and B. Manderick, editors, Proceedings of the 2nd International Conference on Parallel Problem Solving from Nature (PPSN II), pages 27--36, Brussels, Belgium, 1992. Elsevier, Amsterdam, The Netherlands.
[9]
S. W. Mahfoud. Niching Methods for Genetic Algorithms. PhD thesis, Department of General Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, 1995.
[10]
S. W. Mahfoud and D. E. Goldberg. Parallel recombinative simulated annealing: A genetic algorithm. Parallel Computing, 21:1--28, 1995.
[11]
O. J. Mengshoel. E¢ cient Bayesian Network Inference: Genetic Algorithms, Stochastic Local Search, and Abstraction. PhD thesis, Department of Computer Science, University of Illinois at Urbana-Champaign, Urbana, IL, 1999.
[12]
O. J. Mengshoel and D. E. Goldberg. Probabilistic crowding: Deterministic crowding with probabilistic replacement. In W. Banzhaf, J. M. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. J. Jakiela, and R. E. Smith, editors, Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-1999), pages 409--416, Orlando, FL, 1999. Morgan Kaufmann, San Francisco, CA.
[13]
O. J. Mengshoel and D. E. Goldberg. The crowding approach to niching in genetic algorithms. Evolutionary Computation, 16(3):315--354, 2008.
[14]
N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller. Equation of state calculations by fast computing machines. Journal of Chemical Physics, 21(6):1087--1092, 1953.

Cited By

View all
  • (2024)Theory and Practice of Population Diversity in Evolutionary ComputationProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3638530.3648430(1391-1409)Online publication date: 14-Jul-2024
  • (2023)Theory and Practice of Population Diversity in Evolutionary ComputationProceedings of the Companion Conference on Genetic and Evolutionary Computation10.1145/3583133.3595053(1361-1378)Online publication date: 15-Jul-2023
  • (2022)Theory and practice of population diversity in evolutionary computationProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3533642(1469-1486)Online publication date: 9-Jul-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '10: Proceedings of the 12th annual conference on Genetic and evolutionary computation
July 2010
1520 pages
ISBN:9781450300728
DOI:10.1145/1830483
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. bayesian networks
  2. deterministic crowding
  3. experiments
  4. genetic algorithms
  5. markov chain analysis
  6. niching
  7. probabilistic crowding

Qualifiers

  • Research-article

Conference

GECCO '10
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)24
  • Downloads (Last 6 weeks)1
Reflects downloads up to 02 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Theory and Practice of Population Diversity in Evolutionary ComputationProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3638530.3648430(1391-1409)Online publication date: 14-Jul-2024
  • (2023)Theory and Practice of Population Diversity in Evolutionary ComputationProceedings of the Companion Conference on Genetic and Evolutionary Computation10.1145/3583133.3595053(1361-1378)Online publication date: 15-Jul-2023
  • (2022)Theory and practice of population diversity in evolutionary computationProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3533642(1469-1486)Online publication date: 9-Jul-2022
  • (2021)Runtime Analysis of Restricted Tournament Selection for Bimodal OptimisationEvolutionary Computation10.1162/evco_a_00292(1-26)Online publication date: 4-Oct-2021
  • (2020)Theory and practice of population diversity in evolutionary computationProceedings of the 2020 Genetic and Evolutionary Computation Conference Companion10.1145/3377929.3389892(975-992)Online publication date: 8-Jul-2020
  • (2020)Runtime Analysis of Crowding Mechanisms for Multimodal OptimizationIEEE Transactions on Evolutionary Computation10.1109/TEVC.2019.291460624:3(581-592)Online publication date: Jun-2020
  • (2018)Runtime analysis of probabilistic crowding and restricted tournament selection for bimodal optimisationProceedings of the Genetic and Evolutionary Computation Conference10.1145/3205455.3205591(929-936)Online publication date: 2-Jul-2018
  • (2017)Self-adaptation for Individual Self-aware Computing SystemsSelf-Aware Computing Systems10.1007/978-3-319-47474-8_12(375-399)Online publication date: 24-Jan-2017
  • (2017)Deterministic crowding introducing the distribution of population for template matchingIEEJ Transactions on Electrical and Electronic Engineering10.1002/tee.2259113:3(480-488)Online publication date: 28-Dec-2017
  • (2016)A crowding multi-objective genetic algorithm for image parsingNeural Computing and Applications10.1007/s00521-015-2000-227:8(2217-2227)Online publication date: 1-Nov-2016
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media