Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

Self-adaptation of mutation operator and probability for permutation representations in genetic algorithms

Published: 01 September 2010 Publication History

Abstract

The choice of mutation rate is a vital factor in the success of any genetic algorithm (GA), and for permutation representations this is compounded by the availability of several alternative mutation operators. It is now well understood that there is no one “"optimal choice”"; rather, the situation changes per problem instance and during evolution. This paper examines whether this choice can be left to the processes of evolution via self-adaptation, thus removing this nontrivial task from the GA user and reducing the risk of poor performance arising from (inadvertent) inappropriate decisions. Self-adaptation has been proven successful for mutation step sizes in the continuous domain, and for the probability of applying bitwise mutation to binary encodings; here we examine whether this can translate to the choice and parameterisation of mutation operators for permutation encodings.
We examine one method for adapting the choice of operator during runtime, and several different methods for adapting the rate at which the chosen operator is applied. In order to evaluate these algorithms, we have used a range of benchmark TSP problems. Of course this paper is not intended to present a state of the art in TSP solvers; rather, we use this well known problem as typical of many that require a permutation encoding, where our results indicate that self-adaptation can prove beneficial. The results show that GAs using appropriate methods to self-adapt their mutation operator and mutation rate find solutions of comparable or lower cost than algorithms with “"static”" operators, even when the latter have been extensively pretuned. Although the adaptive GAs tend to need longer to run, we show that is a price well worth paying as the time spent finding the optimal mutation operator and rate for the nonadaptive versions can be considerable. Finally, we evaluate the sensitivity of the self-adaptive methods to changes in the implementation, and to the choice of other genetic operators and population models. The results show that the methods presented are robust, in the sense that the performance benefits can be obtained in a wide range of host algorithms.

References

[1]
Abbass, H. (2002). The self-adaptive Pareto differential evolution algorithm. In Proceedings of the 2002 Congress on Evolutionary Computation (CEC'2002), Vol. 1, pp. 831-836.
[2]
Applegate, D. L., Bixby, R. E., Chvátal, V., and Cook, W. (1996). Concorde TSP solver: http:// www.tsp.gatech.edu/concorde.html.
[3]
Bäck, T. (1992). Self adaptation in genetic algorithms. In F. Varela and P. Bourgine (Eds.), Toward a Practice of Autonomous Systems: Proceedings of the 1st European Conference on Artificial Life, pp. 263-271.
[4]
Bäck, T., Eiben, A. E., and van der Vaart, N. A. L. (2000). An empirical study on GAs without parameters. In M. Schoenauer, K. Deb, G. Rudolph, X. Yao, E. Lutton, J. J. Merelo, and H.-P. Schwefel (Eds.), Proceedings of the 6th Conference on Parallel Problem Solving from Nature, Vol. 1917 of LNCS, pp. 315-324.
[5]
Beyer, H.-G. (2001). The theory of evolution strategies. Berlin: Springer.
[6]
Castillo, O., and Trujillo, L. (2005). Multiple objective optimization genetic algorithms for path planning in autonomous mobile robots. International Journal of Computers, Systems and Signals, 6(1), 48-63.
[7]
Cobb, H., and Grefenstette, J. (1993). Genetic algorithms for tracking changing environments. In S. Forrest (Ed.), Proceedings of the 5th International Conference on Genetic Algorithms, pp. 523-530.
[8]
Cowling, P., Kendall, G., and Soubeiga, E. (2001). A hyperheuristic approach to scheduling a sales summit. Lecture Notes in Computer Science, 2079:176-195.
[9]
Eiben, A., Michalewicz, Z., Schoenauer, M., and Smith, J. (2007). Parameter control in evolutionary algorithms. In F. G. Lobo, C. F. Lima, and Z. Michalewicz (Eds.), Parameter Setting in Evolutionary Algorithms, Vol. 54 of Studies in Computational Intelligence (pp. 19-46). Berlin: Springer Verlag.
[10]
Eiben, A. E., Schut, M. C., and de Wilde, A. R. (2006). Is self-adaptation of selection pressure and population size possible? A case study. In T. P. Runarsson et al. (Eds.) Proceedings of the 9th Annual Conference on Parallel Problem Solving from Nature, Vol. 4193 of LNCS, pp. 900-909.
[11]
Eiben, A., and Smith, J. (2003). Introduction to evolutionary computation. Berlin: Springer.
[12]
Friesleben, B., and Merz, P. (1996). A genetic local search algorithm for solving the symmetric and assymetric travelling salesman problem. In ICEC-96, pp. 616-621.
[13]
Glickman, M., and Sycara, K. (1999). Comparing mechanisms for evolving evolvability. In A. Wu (Ed.), Proceedings of the 1999 Genetic and Evolutionary Computation Conference Workshop Program.
[14]
Glickman, M., and Sycara, K. (2000). Reasons for premature convergence of self-adaptating mutation rates. In 2000 Congress on Evolutionary Computation (CEC'2000), pp. 62-69.
[15]
Hansen, P., and Mladenovic, N. (1998). An introduction to variable neighborhood search. In S. Voß, S. Martello, I. Osman, and C. Roucairol (Eds.), Meta-Heuristics: Advances and Trends in Local Search Paradigms for Optimization. Proceedings of MIC 97 Conference. Dordrecht, The Netherlands: Kluwer Academic Publishers.
[16]
Hart, W., Krasnogor, N., and Smith, J. (2004). Editorial introduction, special issue on memetic algorithms. Evolutionary Computation, 12(3):v-vi.
[17]
Julstrom, B. (1997). Adaptive operator probabilities in a genetic algorithm that applies three operators. In Proceedings of the 1997 ACM Symposium on Applied Computing, pp. 233-238.
[18]
Krasnogor, N., Blackburne, B., Burke, E., and Hirst, J. (2002). Multimeme algorithms for protein structure prediction. In J.M. Guervos, P. Adamidis, H.-G. Beyer, J.-L. Fernandez-Villacanas, and H.-P. Schwefel (Eds.), Proceedings of the 7th Conference on Parallel Problem Solving from Nature, Vol. 2439 in Lecture Notes in Computer Science, pp. 769-778.
[19]
Krasnogor, N., and Gustafson, S. (2004). A study on the use of "self-generation" in memetic algorithms. Natural Computing, 3(1):53-76.
[20]
Merz, P., and Freisleben, B. (1997). Genetic local search for the TSP: New results. In IEEE Conference on Evolutionary Computation, pp. 159-164.
[21]
Meyer-Nieberg, S., and Beyer, H.-G. (2007). Self adaptation in evolutionary algorithms. In F. G. Lobo, C. F. Lima, and Z. Michalewicz (Eds.), Parameter Setting in Evolutionary Algorithms, pp. 47-76. Berlin: Springer.
[22]
Oltean, M. (2005). Evolving evolutionary algorithms using linear genetic programming. Evolutionary Computation, 13(3):387-410.
[23]
Ong, Y., Lim, M., Zhu, N., and Wong, K. (2006). Classification of adaptive memetic algorithms: A comparative study. IEEE Transactions on Systems, Man and Cybernetics Part B, 36(1):141-152.
[24]
Preuss, M., and Bartz-Beielstein, T. (2007). Sequential parameter optimisation applied to self-adaptation for binary-coded evolutionary algorithms. In F. G. Lobo, C. F. Lima, and Z. Michalewicz (Eds.), Parameter Setting in Evolutionary Algorithms, pages 91-120. Berlin: Springer.
[25]
Reeves, C. (1999). Landscapes, operators and heuristic search. Annals of Operations Research, 86:473-490.
[26]
Reinelt, G. (1991). Tsplib: http://www.iwr.uni-heidelberg.de/groups/comopt/software/ tsplib95/.
[27]
Rudolph, G. (2001). Self-adaptive mutations may lead to premature convergence. IEEE Transactions on Evolutionary Computation, 5:410-414.
[28]
Schaffer, J., and Morishima, A. (1987). An adaptive crossover distribution mechanism for genetic algorithms. In J. Grefenstette (Ed.), Proceedings of the 2nd International Conference on Genetic Algorithms and Their Applications, pp. 36-40.
[29]
Schiavinotto, T., and Stutzle, T. (2007). A review of metrics on permutations for search landscape analysis. Computers and Operations Research, 34(10):3143-3153.
[30]
Schwefel, H.-P. (1981). Numerical optimization of computer models. New York: Wiley.
[31]
Smith, J. (2001). Modelling GAs with self-adaptive mutation rates. In L. Spector, E. Goodman, A. Wu, W. Langdon, H.-M. Voigt, M. Gen, S. Sen, M. Dorigo, S. Pezeshk, M. Garzon, and E. Burke (Eds.), Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2001), pp. 599-606.
[32]
Smith, J. (2002). On appropriate adaptation levels for the learning of gene linkage. Journal of Genetic Programming and Evolvable Machines, 3(2):129-155.
[33]
Smith, J. (2003). Parameter perturbation mechanisms in binary coded GAs with self-adaptive mutation. In K. De Jong, R. Poli, and J. Rowe (Eds.), Foundations of Genetic Algorithms 7, pages 329-346. Morgan Kauffman.
[34]
Smith, J. (2007a). Co-evolving memetic algorithms: A review and progress report. IEEE Transactions in Systems, Man and Cybernetics, Part B, 37(1):6-17.
[35]
Smith, J. (2007b). On replacement strategies in steady state evolutionary algorithms. Evolutionary Computation, 15(1):29-59.
[36]
Smith, J., and Fogarty, T. (1995). An adaptive poly-parental recombination strategy. In T. Fogarty (Ed.), Evolutionary Computing 2 (pp. 48-61). Berlin: Springer.
[37]
Smith, J., and Fogarty, T. (1996). Self adaptation of mutation rates in a steady state genetic algorithm. In ICEC-96, pp. 318-323.
[38]
Spears, W., and Anand, V. (1991). A study of crossover operators in genetic programming. In Proceedings of the 6th International Symposium on Methodologies for Intelligent Systems, pp. 409-418.
[39]
Stephens, C. R., Garcia Olmedo, I., Moro Vargas, J., and Waelbroeck, H. (1998). Artificial Life, 4:183-201.
[40]
Stone, C., and Smith, J. (2002). Strategy parameter variety in self-adaption. In W. Langdon, E. Cantú-Paz, K. Mathias, R. Roy, D. Davis, R. Poli, K. Balakrishnan, V. Honavar, G. Rudolph, J. Wegener, L. Bull, M. Potter, A. Schultz, J. Miller, E. Burke, and N. Jonoska (Eds.), Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2002), pp. 586-593.
[41]
Thierens, D. (2005). An adaptive pursuit strategy for allocating operator probabilities. In Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, pp. 1539-1546.

Cited By

View all
  • (2023)Single and Multi-objective Test Cases Prioritization for Self-driving Cars in Virtual EnvironmentsACM Transactions on Software Engineering and Methodology10.1145/353381832:2(1-30)Online publication date: 4-Apr-2023
  • (2022)Genetic algorithm using probabilistic-based natural selections and dynamic mutation ranges in optimizing precast beamsComputers and Structures10.1016/j.compstruc.2021.106681258:COnline publication date: 1-Jan-2022
  • (2019)Evolutionary $n$ -Level Hypergraph Partitioning With Adaptive CoarseningIEEE Transactions on Evolutionary Computation10.1109/TEVC.2019.289695123:6(962-971)Online publication date: 1-Dec-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Evolutionary Computation
Evolutionary Computation  Volume 18, Issue 3
Fall 2010
179 pages
ISSN:1063-6560
EISSN:1530-9304
Issue’s Table of Contents

Publisher

MIT Press

Cambridge, MA, United States

Publication History

Published: 01 September 2010
Published in EVOL Volume 18, Issue 3

Author Tags

  1. Genetic algorithms
  2. mutation
  3. permutation encodings
  4. self-adaptation

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Single and Multi-objective Test Cases Prioritization for Self-driving Cars in Virtual EnvironmentsACM Transactions on Software Engineering and Methodology10.1145/353381832:2(1-30)Online publication date: 4-Apr-2023
  • (2022)Genetic algorithm using probabilistic-based natural selections and dynamic mutation ranges in optimizing precast beamsComputers and Structures10.1016/j.compstruc.2021.106681258:COnline publication date: 1-Jan-2022
  • (2019)Evolutionary $n$ -Level Hypergraph Partitioning With Adaptive CoarseningIEEE Transactions on Evolutionary Computation10.1109/TEVC.2019.289695123:6(962-971)Online publication date: 1-Dec-2019
  • (2016)Genetic Algorithm Parameter Control: Application to Scheduling with Sequence-Dependent SetupsProceedings of the 9th EAI International Conference on Bio-inspired Information and Communications Technologies (formerly BIONETICS)10.4108/eai.3-12-2015.2262346(136-143)Online publication date: 24-May-2016
  • (2016)The Permutation in a Haystack Problem and the Calculus of Search LandscapesIEEE Transactions on Evolutionary Computation10.1109/TEVC.2015.247728420:3(434-446)Online publication date: 26-May-2016
  • (2016)Bolstering efficient SSGAs based on an ensemble of probabilistic variable-wise crossover strategiesSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-015-1630-820:6(2149-2176)Online publication date: 1-Jun-2016
  • (2015)The influence of search components and problem characteristics in early life cycle class modellingJournal of Systems and Software10.1016/j.jss.2014.11.034103:C(440-451)Online publication date: 1-May-2015
  • (2015)Improving the modeling capacity of Volterra model using evolutionary computing methods based on Kalman smoother adaptive filterApplied Soft Computing10.1016/j.asoc.2015.05.04635:C(695-707)Online publication date: 1-Oct-2015
  • (2014)On the effects of window-limits on the distance profiles of permutation neighborhood operatorsProceedings of the 8th International Conference on Bioinspired Information and Communications Technologies10.4108/icst.bict.2014.257872(28-35)Online publication date: 1-Dec-2014
  • (2014)Evolutionary algorithms and other metaheuristics in water resourcesEnvironmental Modelling & Software10.1016/j.envsoft.2014.09.01362:C(271-299)Online publication date: 1-Dec-2014
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media