Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2739480.2754691acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Predicting Heuristic Search Performance with PageRank Centrality in Local Optima Networks

Published: 11 July 2015 Publication History

Abstract

Previous studies have used statistical analysis of fitness landscapes such as ruggedness and deceptiveness in order to predict the expected quality of heuristic search methods. Novel approaches for predicting the performance of heuristic search are based on the analysis of local optima networks (LONs). A LON is a compressed stochastic model of a fitness landscape's basin transitions. Recent literature has suggested using various LON network measurements as predictors for local search performance.
In this study, we suggest PageRank centrality as a new measure for predicting the performance of heuristic search methods using local search. PageRank centrality is a variant of Eigenvector centrality and reflects the probability that a node in a network is visited by a random walk. Since the centrality of high-quality solutions in LONs determines the search difficulty of the underlying fitness landscape and since the big valley property suggests that local optima are not randomly distributed in the search space but rather clustered and close to one another, PageRank centrality can serve as a good predictor for local search performance. In our experiments for NK-models and the traveling salesman problem, we found that the PageRank centrality is a very good predictor for the performance of first-improvement local search as well as simulated annealing, since it explains more than 90% of the variance of search performance. Furthermore, we found that PageRank centrality is a better predictor of search performance than traditional approaches such as ruggedness, deceptiveness, and the length of the shortest path to the optimum.

References

[1]
K. D. Boese, A. B. Kahng, and S. Muddu. A new adaptive multi-start technique for combinatorial global optimizations. Operations Research Letters, 16(2):101--113, 1994.
[2]
S. P. Borgatti. Centrality and network flow. Social Networks, 27(1):55--71, Jan. 2005.
[3]
S. Brin and L. Page. The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems, 30(1--7):107--117, Apr. 1998.
[4]
S. Choi and B. Moon. Normalization for Genetic Algorithms With Nonsynonymously Redundant Encodings. IEEE Transactions on Evolutionary Computation, 12(5):604--616, 2008.
[5]
F. Daolio, S. Verel, G. Ochoa, and M. Tomassini. Local optima networks and the performance of iterated local search. Proceedings of the fourteenth international conference on Genetic and evolutionary computation conference - GECCO '12, page 369, Oct. 2012.
[6]
M. Franceschet. PageRank: standing on the shoulders of giants. Communications of the ACM, 54(6):92, June 2011.
[7]
L. C. Freeman. The Development of Social Network Analysis. Createspace, 2004.
[8]
G. Frobenius. Über Matrizen aus nicht negativen Elementen. Sitzungsberichte Preussische Akademie der Wissenschaft, Berlin, pages 456--477, 1912.
[9]
F. Glover. Future paths for integer programming and links to artificial intelligence. Computers & Operations Research, 13(5):533--549, Jan. 1986.
[10]
J. He, C. Reeves, C. Witt, and X. Yao. A note on problem difficulty measures in black-box optimization: classification, realizations and predictability. IEEE Transactions on Evolutionary Computation, 15(4):435--43, Jan. 2007.
[11]
T. Jones and S. Forrest. Fitness Distance Correlation as a Measure of Problem Difficulty for Genetic Algorithms. Proceedings of the Sixth International Conference on Genetic Algorithms, 1995.
[12]
L. Kallel, B. Naudts, and C. R. Reeves. Properties of Fitness Functions and Search Landscapes. In L. Kallel, B. Naudts, and A. Rogers, editors, Theoretical Aspects of Evolutionary Computing, Natural Computing Series, pages 175--206. Springer Berlin Heidelberg, 2001.
[13]
S. Kauffman and S. Levin. Towards a General Theory of Adaptive Walks on Rugged Landscapes. Journal of theoretical Biology, pages 11--45, 1987.
[14]
S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi. Optimization by simulated annealing. Science (N.Y.), 220(4598):671--80, May 1983.
[15]
P. J. M. Laarhoven and E. H. L. Aarts. Simulated Annealing: Theory and Applications. Kluwer Academic Publishers, Norwell, MA, USA, 1988.
[16]
D. H. Lehmer. Teaching combinatorial tricks to a computer. In Proceedings of the Symposium on Applied Mathematics and Combinatorial Analysis., 1960.
[17]
J. K. Lenstra and a.H. Rinnooy Kan. Complexity of Vehicle Routing and Scheduling Problems. Networks, 11:221--227, 1981.
[18]
K. M. Malan and A. P. Engelbrecht. Fitness Landscape Analysis for Metaheuristic Performance Prediction. In H. Richter and A. Engelbrecht, editors, Recent Advances in the Theory and Application of Fitness Landscapes, pages 103--129. Springer, 2014.
[19]
G. Ochoa, M. Tomassini, S. Vérel, and C. Darabos. A study of NK landscapes' basins and local optima networks. In Proceedings of the 10th annual conference on Genetic and evolutionary computation - GECCO '08, page 555, New York, 2008. ACM Press.
[20]
G. Ochoa, S. Verel, and M. Tomassini. First-improvement vs. best-improvement local optima networks of nk landscapes. PPSN'10 Proceedings of the 11th international conference on Parallel problem solving from nature, I:104--113, 2010.
[21]
O. Perron. Zur Theorie der Matrices. Mathematische Annalen1, 64(1):248--263, 1907.
[22]
E. Pitzer and M. Affenzeller. A Comprehensive Survey on Fitness Landscape Analysis. In J. Fodor, R. Klempous, and C. P. Suárez Araujo, editors, Recent Advances in Intelligent Engineering Systems, volume 378 of Studies in Computational Intelligence, pages 161--191. Springer, Berlin and Heidelberg, 2012.
[23]
C. M. Reidys and P. F. Stadler. Combinatorial Landscapes. SIAM Review, 44(1):3--54, Jan. 2002.
[24]
F. Rothlauf. Design of modern heuristics: Principles and application. Springer, Berlin and Heidelberg, 2011.
[25]
P. F. Stadler. Landscapes and their correlation functions. Journal of Mathematical Chemistry, 20(1):1--45, 1996.
[26]
F. H. Stillinger. A topographic view of supercooled liquids and glass formation. Science (N.Y.), 267(5206):1935--9, Mar. 1995.
[27]
E. Weinberger. Correlated and Uncorrelated Fitness Landscapes and How to Tell the Difference. Biological cybernetics, 336:325--336, 1990.
[28]
S. Wright. The roles of mutation, inbreeding, crossbreeding, and selection in evolution. In Proceedings of the 6th International Congress of Genetics, pages 356--366, 1932.

Cited By

View all
  • (2024)Information Flow and Laplacian Dynamics on Local Optima Networks2024 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC60901.2024.10612156(01-08)Online publication date: 30-Jun-2024
  • (2023)Benchmarking Optimization Algorithms for Auto-Tuning GPU KernelsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.321065427:3(550-564)Online publication date: Jun-2023
  • (2021)Attraction Basins in Metaheuristics: A Systematic Mapping StudyMathematics10.3390/math92330369:23(3036)Online publication date: 26-Nov-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '15: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation
July 2015
1496 pages
ISBN:9781450334723
DOI:10.1145/2739480
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. NK-landscapes
  2. fitness landscape analysis
  3. local optima networks
  4. pagerank centrality
  5. search difficulty
  6. traveling salesman problem

Qualifiers

  • Research-article

Conference

GECCO '15
Sponsor:

Acceptance Rates

GECCO '15 Paper Acceptance Rate 182 of 505 submissions, 36%;
Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 21 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Information Flow and Laplacian Dynamics on Local Optima Networks2024 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC60901.2024.10612156(01-08)Online publication date: 30-Jun-2024
  • (2023)Benchmarking Optimization Algorithms for Auto-Tuning GPU KernelsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.321065427:3(550-564)Online publication date: Jun-2023
  • (2021)Attraction Basins in Metaheuristics: A Systematic Mapping StudyMathematics10.3390/math92330369:23(3036)Online publication date: 26-Nov-2021
  • (2021)A Survey of Advances in Landscape Analysis for OptimisationAlgorithms10.3390/a1402004014:2(40)Online publication date: 28-Jan-2021
  • (2020)Modelling parameter configuration spaces with local optima networksProceedings of the 2020 Genetic and Evolutionary Computation Conference10.1145/3377930.3390199(751-759)Online publication date: 25-Jun-2020
  • (2020)Using pagerank to uncover patterns in search behavior induced by the bit flip operatorProceedings of the 2020 Genetic and Evolutionary Computation Conference Companion10.1145/3377929.3398140(1866-1871)Online publication date: 8-Jul-2020
  • (2018)PageRank centrality for performance predictionJournal of Heuristics10.1007/s10732-017-9333-124:3(243-264)Online publication date: 1-Jun-2018
  • (2017)Shaping communities of local optima by perturbation strengthProceedings of the Genetic and Evolutionary Computation Conference10.1145/3071178.3071243(266-273)Online publication date: 1-Jul-2017
  • (2017)Fitness landscape characterisation of optimisation problemsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3067695.3067720(435-449)Online publication date: 15-Jul-2017
  • (2016)Communities of Local Optima as Funnels in Fitness LandscapesProceedings of the Genetic and Evolutionary Computation Conference 201610.1145/2908812.2908818(325-331)Online publication date: 20-Jul-2016

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media