Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Multilevel Refinement for Combinatorial Optimisation: Boosting Metaheuristic Performance

  • Chapter
Hybrid Metaheuristics

Part of the book series: Studies in Computational Intelligence ((SCI,volume 114))

The multilevel paradigm as applied to combinatorial optimisation problems is a simple one, which at its most basic involves recursive coarsening to create a hierarchy of approximations to the original problem. An initial solution is found, usually at the coarsest level, and then iteratively refined at each level, coarsest to finest, typically by using some kind of heuristic optimisation algorithm (either a problem-specific local search scheme or a metaheuristic). Solution extension (or projection) operators can transfer the solution from one level to another. As a general solution strategy, the multilevel paradigm has been in use for many years and has been applied to many problem areas (for example multigrid techniques can be viewed as a prime example of the paradigm). Overview papers such as [39] attest to its efficacy. However, with the exception of the graph partitioning problem, multilevel techniques have not been widely applied to combinatorial problems and in this chapter we discuss recent developments. In this chapter we survey the use of multilevel combinatorial techniques and consider their ability to boost the performance of (meta)heuristic optimisation algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. A. Abou-Rjeili and G. Karypis. Multilevel algorithms for partitioning power-law graphs. In Proc. 20th Intl Parallel & Distributed Processing Symp., 2006, page 10 pp. IEEE, 2006.

    Google Scholar 

  2. S. T. Barnard and H. D. Simon. A Fast Multilevel Implementation of Recursive Spectral Bisection for Partitioning Unstructured Problems. Concurrency: Practice & Experience, 6(2):101–117, 1994.

    Article  Google Scholar 

  3. R. Battiti, A. Bertossi, and A. Cappelletti. Multilevel Reactive Tabu Search for Graph Partitioning. Preprint UTM 554, Dip. Mat., Univ. Trento, Italy, 1999.

    Google Scholar 

  4. C. Blum and A. Roli. Metaheuristics in combinatorial optimization: Overview and conceptual comparison. ACM Computing Surveys, 35(3):268–308, 2003.

    Article  Google Scholar 

  5. C. Blum and M. Yábar. Multi-level ant colony optimization for DNA sequencing by hybridization. In F. Almeida et al., editors, Proc. 3rd Intl Workshop on Hybrid Metaheuristics, volume 4030 of LNCS, pages 94–109. Springer-Verlag, Berlin, Germany, 2006.

    Chapter  Google Scholar 

  6. C. Blum, M. Yábar-Vallès, and M. J. Blesa. An ant colony optimization algorithm for DNA sequencing by hybridization. Computers & Operations Research, 2007. (in press).

    Google Scholar 

  7. E. G. Boman and B. Hendrickson. A Multilevel Algorithm for Reducing the Envelope of Sparse Matrices. Tech. Rep. 96-14, SCCM, Stanford Univ., CA, 1996.

    Google Scholar 

  8. N. Bouhmala. Combining local search and genetic algorithms with the multilevel paradigm for the traveling salesman problem. In C. Blum et al., editors, Proc. 1st Intl Workshop on Hybrid Metaheuristics, 2004. ISBN 3-00-015331-4.

    Google Scholar 

  9. A. Brandt. Multiscale Scientific Computation: Review 2000. In T. J. Barth, T. Chan, and R. Haimes, editors, Multiscale and Multiresolution Methods, pages 3–95. Springer-Verlag, Berlin, Germany, 2001.

    Google Scholar 

  10. T. N. Bui and C. Jones. A Heuristic for Reducing Fill-In in Sparse Matrix Factorization. In R. F. Sincovec et al., editors, Parallel Processing for Scientific Computing, pages 445–452. SIAM, Philadelphia, 1993.

    Google Scholar 

  11. J. Cong and J. Shinnerl, editors. Multilevel Optimization in VLSICAD. Kluwer, Boston, 2003.

    MATH  Google Scholar 

  12. T. G. Crainic, Y. Li, and M. Toulouse. A First Multilevel Cooperative Algorithm for Capacitated Multicommodity Network Design. Computers & Operations Research, 33(9):2602–2622, 2006.

    Article  MATH  Google Scholar 

  13. C. Dai, P. C. Li, and M. Toulouse. A Multilevel Cooperative Tabu Search Algorithm for the Covering Design Problem. Dept Computer Science, Univ. Manitoba, 2006.

    Google Scholar 

  14. C. M. Fiduccia and R. M. Mattheyses. A Linear Time Heuristic for Improving Network Partitions. In Proc. 19th IEEE Design Automation Conf., pages 175–181. IEEE, Piscataway, NJ, 1982.

    Google Scholar 

  15. J. E. Gallardo, C. Cotta, and A. J. Fernández. A Multi-level Memetic/Exact Hybrid Algorithm for the Still Life Problem. In T. P. Runarsson et al., editors, Parallel Problem Solving from Nature – PPSN IX, volume 4193 of LNCS, pages 212–221. Springer-Verlag, Berlin, 2006.

    Chapter  Google Scholar 

  16. J. Gu and X. Huang. Efficient Local Search With Search Space Smoothing: A Case Study of the Traveling Salesman Problem (TSP). IEEE Transactions on Systems, Man & Cybernetics, 24(5):728–735, 1994.

    Article  Google Scholar 

  17. A. Gupta. Fast and effective algorithms for graph partitioning and sparse matrix reordering. IBM Journal of Research & Development, 41(1/2):171–183, 1996.

    Google Scholar 

  18. D. Harel and Y. Koren. A Fast Multi-Scale Algorithm for Drawing Large Graphs. Journal of Graph Algorithms & Applications, 6(3):179–202, 2002.

    MATH  MathSciNet  Google Scholar 

  19. B. Hendrickson and R. Leland. A Multilevel Algorithm for Partitioning Graphs. In S. Karin, editor, Proc. Supercomputing ’95, San Diego (CD-ROM). ACM Press, New York, 1995.

    Google Scholar 

  20. Y. F. Hu and J. A. Scott. Multilevel Algorithms for Wavefront Reduction. RAL-TR-2000-031, Comput. Sci. & Engrg. Dept., Rutherford Appleton Lab., Didcot, UK, 2000.

    Google Scholar 

  21. G. Karypis and V. Kumar. A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs. SIAM Journal on Scientific Computing, 20(1):359–392, 1998.

    Article  MathSciNet  Google Scholar 

  22. G. Karypis and V. Kumar. Multilevel Algorithms for Multi-Constraint Graph Partitioning. In D. Duke, editor, Proc. Supercomputing ’98, Orlando. ACM SIGARCH & IEEE Comput. Soc., 1998. (CD-ROM).

    Google Scholar 

  23. G. Karypis and V. Kumar. Multilevel k-way Partitioning Scheme for Irregular Graphs. Journal of Parallel & Distributed Computing, 48(1):96–129, 1998.

    Article  MathSciNet  Google Scholar 

  24. G. Karypis and V. Kumar. Multilevel k-way Hypergraph Partitioning. VLSI Design, 11(3):285–300, 2000.

    Article  Google Scholar 

  25. A. Kaveh and H. A. Rahimi-Bondarabady. A Hybrid Graph-Genetic Method for Domain Decomposition. In B. H. V. Topping, editor, Computational Engineering using Metaphors from Nature, pages 127–134. Civil-Comp Press, Edinburgh, 2000. (Proc. Engrg. Comput. Technology, Leuven, Belgium, 2000).

    Chapter  Google Scholar 

  26. B. W. Kernighan and S. Lin. An Efficient Heuristic for Partitioning Graphs. Bell Systems Technical Journal, 49:291–308, 1970.

    Google Scholar 

  27. P. Korošec, J. Šilc, and B. Robič. Solving the mesh-partitioning problem with an ant-colony algorithm. Parallel Computing, 30:785–801, 2004.

    Article  Google Scholar 

  28. A. E. Langham and P. W. Grant. A Multilevel k-way Partitioning Algorithm for Finite Element Meshes using Competing Ant Colonies. In W. Banzhaf et al., editors, Proc. Genetic & Evolutionary Comput. Conf. (GECCO-1999), pages 1602–1608. Morgan Kaufmann, San Francisco, 1999.

    Google Scholar 

  29. I. O. Oduntan. A Multilevel Search Algorithm for Feature Selection in Biomedical Data. Master’s thesis, Dept. Computer Science, Univ. Manitoba, 2005.

    Google Scholar 

  30. D. Rodney, A. Soper, and C. Walshaw. The Application of Multilevel Refinement to the Vehicle Routing Problem. In D. Fogel et al., editors, Proc. CISChed 2007, IEEE Symposium on Computational Intelligence in Scheduling, pages 212–219. IEEE, Piscataway, NJ, 2007.

    Chapter  Google Scholar 

  31. D. F. Rogers, R. D. Plante, R. T. Wong, and J. R. Evans. Aggregation and Disaggregation Techniques and Methodology in Optimization. Operations Research, 39(4):553–582, 1991.

    Article  MATH  MathSciNet  Google Scholar 

  32. Y. Romem, L. Rudolph, and J. Stein. Adapting Multilevel Simulated Annealing for Mapping Dynamic Irregular Problems. In S. Ranka, editor, Proc. Intl Parallel Processing Symp., pages 65–72, 1995.

    Google Scholar 

  33. Camilo Rostoker and Chris Dabrowski. Multilevel Stochastic Local Search for SAT. Dept Computer Science, Univ. British Columbia, 2005.

    Google Scholar 

  34. Y. Saab. Combinatorial Optimization by Dynamic Contraction. Journal of Heuristics, 3(3):207–224, 1997.

    Article  MATH  Google Scholar 

  35. I. Safro, D. Ron, and A. Brandt. Graph minimum linear arrangement by multilevel weighted edge contractions. Journal of Algorithms, 60(1):24–41, 2006.

    Article  MATH  MathSciNet  Google Scholar 

  36. K. Schloegel, G. Karypis, and V. Kumar. Multilevel Diffusion Schemes for Repartitioning of Adaptive Meshes. Journal of Parallel & Distributed Computing, 47(2):109–124, 1997.

    Article  Google Scholar 

  37. K. Schloegel, G. Karypis, and V. Kumar. A New Algorithm for Multi-objective Graph Partitioning. In P. Amestoy et al., editors, Proc. Euro-Par ’99 Parallel Processing, volume 1685 of LNCS, pages 322–331. Springer-Verlag, Heidelberg, Germany, 1999.

    Google Scholar 

  38. A. J. Soper, C. Walshaw, and M. Cross. A Combined Evolutionary Search and Multilevel Optimisation Approach to Graph Partitioning. Journal of Global Optimization, 29(2):225–241, 2004.

    Article  MATH  MathSciNet  Google Scholar 

  39. S.-H. Teng. Coarsening, Sampling, and Smoothing: Elements of the Multilevel Method. In M. T. Heath et al., editors, Algorithms for Parallel Processing, volume 105 of IMA Volumes in Mathematics and its Applications, pages 247–276. Springer-Verlag, New York, 1999.

    Google Scholar 

  40. M. Toulouse, K. Thulasiraman, and F. Glover. Multi-level Cooperative Search: A New Paradigm for Combinatorial Optimization and an Application to Graph Partitioning. In P. Amestoy et al., editors, Proc. Euro-Par ’99 Parallel Processing, volume 1685 of LNCS, pages 533–542. Springer-Verlag, Berlin, 1999.

    Google Scholar 

  41. D. Vanderstraeten, C. Farhat, P. S. Chen, R. Keunings, and O. Zone. A Retrofit Based Methodology for the Fast Generation and Optimization of Large-Scale Mesh Partitions: Beyond the Minimum Interface Size Criterion. Computer Methods in Applied Mechanics & Engineering, 133:25–45, 1996.

    Article  MATH  Google Scholar 

  42. C. Walshaw. A Multilevel Approach to the Travelling Salesman Problem. Operations Research, 50(5):862–877, 2002.

    Article  MATH  MathSciNet  Google Scholar 

  43. C. Walshaw. A Multilevel Algorithm for Force-Directed Graph Drawing. Journal of Graph Algorithms & Applications, 7(3):253–285, 2003.

    MATH  MathSciNet  Google Scholar 

  44. C. Walshaw. Multilevel Refinement for Combinatorial Optimisation Problems. Annals of Operations Research, 131:325–372, 2004.

    Article  MATH  MathSciNet  Google Scholar 

  45. C. Walshaw. Variable partition inertia: graph repartitioning and load-balancing for adaptive meshes. In S. Chandra M. Parashar and X. Li, editors, Advanced Computational Infrastructures for Parallel and Distributed Adaptive Applications. Wiley, New York. (Invited chapter – to appear in 2008).

    Google Scholar 

  46. C. Walshaw and M. Cross. Mesh Partitioning: a Multilevel Balancing and Refinement Algorithm. SIAM Journal on Scientific Computing, 22(1):63–80, 2000.

    Article  MATH  MathSciNet  Google Scholar 

  47. C. Walshaw and M. Cross. Multilevel Mesh Partitioning for Heterogeneous Communication Networks. Future Generation Computer Systems, 17(5):601–623, 2001.

    Article  Google Scholar 

  48. C. Walshaw, M. Cross, R. Diekmann, and F. Schlimbach. Multilevel Mesh Partitioning for Optimising Domain Shape. International Journal of High Performance Computing Applications, 13(4):334–353, 1999.

    Article  Google Scholar 

  49. C. Walshaw and M. G. Everett. Multilevel Landscapes in Combinatorial Optimisation. Tech. Rep. 02/IM/93, Comp. Math. Sci., Univ. Greenwich, London SE10 9LS, UK, April 2002.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Walshaw, C. (2008). Multilevel Refinement for Combinatorial Optimisation: Boosting Metaheuristic Performance. In: Blum, C., Aguilera, M.J.B., Roli, A., Sampels, M. (eds) Hybrid Metaheuristics. Studies in Computational Intelligence, vol 114. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78295-7_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-78295-7_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-78294-0

  • Online ISBN: 978-3-540-78295-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics