The multilevel paradigm as applied to combinatorial optimisation problems is a simple one, which at its most basic involves recursive coarsening to create a hierarchy of approximations to the original problem. An initial solution is found, usually at the coarsest level, and then iteratively refined at each level, coarsest to finest, typically by using some kind of heuristic optimisation algorithm (either a problem-specific local search scheme or a metaheuristic). Solution extension (or projection) operators can transfer the solution from one level to another. As a general solution strategy, the multilevel paradigm has been in use for many years and has been applied to many problem areas (for example multigrid techniques can be viewed as a prime example of the paradigm). Overview papers such as [39] attest to its efficacy. However, with the exception of the graph partitioning problem, multilevel techniques have not been widely applied to combinatorial problems and in this chapter we discuss recent developments. In this chapter we survey the use of multilevel combinatorial techniques and consider their ability to boost the performance of (meta)heuristic optimisation algorithms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
A. Abou-Rjeili and G. Karypis. Multilevel algorithms for partitioning power-law graphs. In Proc. 20th Intl Parallel & Distributed Processing Symp., 2006, page 10 pp. IEEE, 2006.
S. T. Barnard and H. D. Simon. A Fast Multilevel Implementation of Recursive Spectral Bisection for Partitioning Unstructured Problems. Concurrency: Practice & Experience, 6(2):101–117, 1994.
R. Battiti, A. Bertossi, and A. Cappelletti. Multilevel Reactive Tabu Search for Graph Partitioning. Preprint UTM 554, Dip. Mat., Univ. Trento, Italy, 1999.
C. Blum and A. Roli. Metaheuristics in combinatorial optimization: Overview and conceptual comparison. ACM Computing Surveys, 35(3):268–308, 2003.
C. Blum and M. Yábar. Multi-level ant colony optimization for DNA sequencing by hybridization. In F. Almeida et al., editors, Proc. 3rd Intl Workshop on Hybrid Metaheuristics, volume 4030 of LNCS, pages 94–109. Springer-Verlag, Berlin, Germany, 2006.
C. Blum, M. Yábar-Vallès, and M. J. Blesa. An ant colony optimization algorithm for DNA sequencing by hybridization. Computers & Operations Research, 2007. (in press).
E. G. Boman and B. Hendrickson. A Multilevel Algorithm for Reducing the Envelope of Sparse Matrices. Tech. Rep. 96-14, SCCM, Stanford Univ., CA, 1996.
N. Bouhmala. Combining local search and genetic algorithms with the multilevel paradigm for the traveling salesman problem. In C. Blum et al., editors, Proc. 1st Intl Workshop on Hybrid Metaheuristics, 2004. ISBN 3-00-015331-4.
A. Brandt. Multiscale Scientific Computation: Review 2000. In T. J. Barth, T. Chan, and R. Haimes, editors, Multiscale and Multiresolution Methods, pages 3–95. Springer-Verlag, Berlin, Germany, 2001.
T. N. Bui and C. Jones. A Heuristic for Reducing Fill-In in Sparse Matrix Factorization. In R. F. Sincovec et al., editors, Parallel Processing for Scientific Computing, pages 445–452. SIAM, Philadelphia, 1993.
J. Cong and J. Shinnerl, editors. Multilevel Optimization in VLSICAD. Kluwer, Boston, 2003.
T. G. Crainic, Y. Li, and M. Toulouse. A First Multilevel Cooperative Algorithm for Capacitated Multicommodity Network Design. Computers & Operations Research, 33(9):2602–2622, 2006.
C. Dai, P. C. Li, and M. Toulouse. A Multilevel Cooperative Tabu Search Algorithm for the Covering Design Problem. Dept Computer Science, Univ. Manitoba, 2006.
C. M. Fiduccia and R. M. Mattheyses. A Linear Time Heuristic for Improving Network Partitions. In Proc. 19th IEEE Design Automation Conf., pages 175–181. IEEE, Piscataway, NJ, 1982.
J. E. Gallardo, C. Cotta, and A. J. Fernández. A Multi-level Memetic/Exact Hybrid Algorithm for the Still Life Problem. In T. P. Runarsson et al., editors, Parallel Problem Solving from Nature – PPSN IX, volume 4193 of LNCS, pages 212–221. Springer-Verlag, Berlin, 2006.
J. Gu and X. Huang. Efficient Local Search With Search Space Smoothing: A Case Study of the Traveling Salesman Problem (TSP). IEEE Transactions on Systems, Man & Cybernetics, 24(5):728–735, 1994.
A. Gupta. Fast and effective algorithms for graph partitioning and sparse matrix reordering. IBM Journal of Research & Development, 41(1/2):171–183, 1996.
D. Harel and Y. Koren. A Fast Multi-Scale Algorithm for Drawing Large Graphs. Journal of Graph Algorithms & Applications, 6(3):179–202, 2002.
B. Hendrickson and R. Leland. A Multilevel Algorithm for Partitioning Graphs. In S. Karin, editor, Proc. Supercomputing ’95, San Diego (CD-ROM). ACM Press, New York, 1995.
Y. F. Hu and J. A. Scott. Multilevel Algorithms for Wavefront Reduction. RAL-TR-2000-031, Comput. Sci. & Engrg. Dept., Rutherford Appleton Lab., Didcot, UK, 2000.
G. Karypis and V. Kumar. A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs. SIAM Journal on Scientific Computing, 20(1):359–392, 1998.
G. Karypis and V. Kumar. Multilevel Algorithms for Multi-Constraint Graph Partitioning. In D. Duke, editor, Proc. Supercomputing ’98, Orlando. ACM SIGARCH & IEEE Comput. Soc., 1998. (CD-ROM).
G. Karypis and V. Kumar. Multilevel k-way Partitioning Scheme for Irregular Graphs. Journal of Parallel & Distributed Computing, 48(1):96–129, 1998.
G. Karypis and V. Kumar. Multilevel k-way Hypergraph Partitioning. VLSI Design, 11(3):285–300, 2000.
A. Kaveh and H. A. Rahimi-Bondarabady. A Hybrid Graph-Genetic Method for Domain Decomposition. In B. H. V. Topping, editor, Computational Engineering using Metaphors from Nature, pages 127–134. Civil-Comp Press, Edinburgh, 2000. (Proc. Engrg. Comput. Technology, Leuven, Belgium, 2000).
B. W. Kernighan and S. Lin. An Efficient Heuristic for Partitioning Graphs. Bell Systems Technical Journal, 49:291–308, 1970.
P. Korošec, J. Šilc, and B. Robič. Solving the mesh-partitioning problem with an ant-colony algorithm. Parallel Computing, 30:785–801, 2004.
A. E. Langham and P. W. Grant. A Multilevel k-way Partitioning Algorithm for Finite Element Meshes using Competing Ant Colonies. In W. Banzhaf et al., editors, Proc. Genetic & Evolutionary Comput. Conf. (GECCO-1999), pages 1602–1608. Morgan Kaufmann, San Francisco, 1999.
I. O. Oduntan. A Multilevel Search Algorithm for Feature Selection in Biomedical Data. Master’s thesis, Dept. Computer Science, Univ. Manitoba, 2005.
D. Rodney, A. Soper, and C. Walshaw. The Application of Multilevel Refinement to the Vehicle Routing Problem. In D. Fogel et al., editors, Proc. CISChed 2007, IEEE Symposium on Computational Intelligence in Scheduling, pages 212–219. IEEE, Piscataway, NJ, 2007.
D. F. Rogers, R. D. Plante, R. T. Wong, and J. R. Evans. Aggregation and Disaggregation Techniques and Methodology in Optimization. Operations Research, 39(4):553–582, 1991.
Y. Romem, L. Rudolph, and J. Stein. Adapting Multilevel Simulated Annealing for Mapping Dynamic Irregular Problems. In S. Ranka, editor, Proc. Intl Parallel Processing Symp., pages 65–72, 1995.
Camilo Rostoker and Chris Dabrowski. Multilevel Stochastic Local Search for SAT. Dept Computer Science, Univ. British Columbia, 2005.
Y. Saab. Combinatorial Optimization by Dynamic Contraction. Journal of Heuristics, 3(3):207–224, 1997.
I. Safro, D. Ron, and A. Brandt. Graph minimum linear arrangement by multilevel weighted edge contractions. Journal of Algorithms, 60(1):24–41, 2006.
K. Schloegel, G. Karypis, and V. Kumar. Multilevel Diffusion Schemes for Repartitioning of Adaptive Meshes. Journal of Parallel & Distributed Computing, 47(2):109–124, 1997.
K. Schloegel, G. Karypis, and V. Kumar. A New Algorithm for Multi-objective Graph Partitioning. In P. Amestoy et al., editors, Proc. Euro-Par ’99 Parallel Processing, volume 1685 of LNCS, pages 322–331. Springer-Verlag, Heidelberg, Germany, 1999.
A. J. Soper, C. Walshaw, and M. Cross. A Combined Evolutionary Search and Multilevel Optimisation Approach to Graph Partitioning. Journal of Global Optimization, 29(2):225–241, 2004.
S.-H. Teng. Coarsening, Sampling, and Smoothing: Elements of the Multilevel Method. In M. T. Heath et al., editors, Algorithms for Parallel Processing, volume 105 of IMA Volumes in Mathematics and its Applications, pages 247–276. Springer-Verlag, New York, 1999.
M. Toulouse, K. Thulasiraman, and F. Glover. Multi-level Cooperative Search: A New Paradigm for Combinatorial Optimization and an Application to Graph Partitioning. In P. Amestoy et al., editors, Proc. Euro-Par ’99 Parallel Processing, volume 1685 of LNCS, pages 533–542. Springer-Verlag, Berlin, 1999.
D. Vanderstraeten, C. Farhat, P. S. Chen, R. Keunings, and O. Zone. A Retrofit Based Methodology for the Fast Generation and Optimization of Large-Scale Mesh Partitions: Beyond the Minimum Interface Size Criterion. Computer Methods in Applied Mechanics & Engineering, 133:25–45, 1996.
C. Walshaw. A Multilevel Approach to the Travelling Salesman Problem. Operations Research, 50(5):862–877, 2002.
C. Walshaw. A Multilevel Algorithm for Force-Directed Graph Drawing. Journal of Graph Algorithms & Applications, 7(3):253–285, 2003.
C. Walshaw. Multilevel Refinement for Combinatorial Optimisation Problems. Annals of Operations Research, 131:325–372, 2004.
C. Walshaw. Variable partition inertia: graph repartitioning and load-balancing for adaptive meshes. In S. Chandra M. Parashar and X. Li, editors, Advanced Computational Infrastructures for Parallel and Distributed Adaptive Applications. Wiley, New York. (Invited chapter – to appear in 2008).
C. Walshaw and M. Cross. Mesh Partitioning: a Multilevel Balancing and Refinement Algorithm. SIAM Journal on Scientific Computing, 22(1):63–80, 2000.
C. Walshaw and M. Cross. Multilevel Mesh Partitioning for Heterogeneous Communication Networks. Future Generation Computer Systems, 17(5):601–623, 2001.
C. Walshaw, M. Cross, R. Diekmann, and F. Schlimbach. Multilevel Mesh Partitioning for Optimising Domain Shape. International Journal of High Performance Computing Applications, 13(4):334–353, 1999.
C. Walshaw and M. G. Everett. Multilevel Landscapes in Combinatorial Optimisation. Tech. Rep. 02/IM/93, Comp. Math. Sci., Univ. Greenwich, London SE10 9LS, UK, April 2002.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Walshaw, C. (2008). Multilevel Refinement for Combinatorial Optimisation: Boosting Metaheuristic Performance. In: Blum, C., Aguilera, M.J.B., Roli, A., Sampels, M. (eds) Hybrid Metaheuristics. Studies in Computational Intelligence, vol 114. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78295-7_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-78295-7_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78294-0
Online ISBN: 978-3-540-78295-7
eBook Packages: EngineeringEngineering (R0)