Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1007/978-3-319-43659-3_11guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Penalized Graph Partitioning for Static and Dynamic Load Balancing

Published: 24 August 2016 Publication History

Abstract

With ubiquitous parallel architectures, the importance of optimally distributed and thereby balanced work is unprecedented. To tackle this challenge, graph partitioning algorithms have been successfully applied in various application areas. However, there is a mismatch between solutions found by classic graph partitioning and the behavior of many real hardware systems. Graph partitioning assumes that individual vertex weights add upï źto partition weights here, referred to as linear graph partitioning. This implies that performance scales linearly with the number of tasks. In reality, performance does usually not scale linearly with the amount of work due to contention on various resources. We address this mismatch with our novel penalized graph partitioning approach in this paper. Furthermore, we experimentally evaluate the applicability and scalability of our method.

References

[1]
Amazon. Amazon Relational Database Service 2015
[2]
Bichot, C.-E., Siarry, P. eds.: Graph Partitioning. Wiley, Hoboken 2011
[3]
Blagodurov, S., Zhuravlev, S., Fedorova, A.: Contention-aware scheduling on multicore systems. ACM Trans. Comput. Syst. 284, 8 2010
[4]
Buluç, A., Meyerhenke, H., Safro, I., Sanders, P., Schulz, C.: Recent Advances in Graph Partitioning. preprint: Computing Research Repository 2013
[5]
Catalyurek, U.V., et al.: Hypergraph-based dynamic load balancing for adaptive scientific computations. In: IPDPS 2007
[6]
Curino, C., Jones, E.P.C., Zhang, Y., Madden, S.: Schism: a workload-driven approach to database replication and partitioning. In: VLDB 2010
[7]
Devine, K.D., Boman, E.G., Heaphy, R.T., Hendrickson, B.A.: New challenges in dynamic load balancing. Appl. Numer. Math. 52, 133---152 2005
[8]
Fiduccia, C.M., Mattheyses, R.M.: A linear-time heuristic for improving network partitions. In: DAC 1982
[9]
Golab, L., Hadjieleftheriou, M., Karloff, H., Saha, B.: Distributed data placement to minimize communication costs via graph partitioning. In: SSDBM 2014
[10]
Hendrickson, B., Kolda, T.G.: Graph partitioning models for parallel computing. Parallel Comput. 2612, 1519---1534 2000
[11]
Hendrickson, B., Leland, R., Van Driessche, R.: Enhancing data locality by using terminal propagation. In: HICSS 1996
[12]
Hyafil, L., Rivest, R.L.: Graph Partitioning and Constructing Optimal Decision Trees are Polynomial Complete Problems. Technical report, IRIA 1973
[13]
Karypis, G., Kumar, V.: Analysis of multilevel graph partitioning. In: SC 1995
[14]
Karypis, G., Kumar, V.: Multilevel Algorithms for Multi-Constraint Graph Partitioning. Technical report, University of Minnesota 1998
[15]
Karypis, G., Kumar, V.: Multilevel k-way partitioning scheme for irregular graphs. J. Parallel Distrib. Comput. 481, 71---95 1998
[16]
Kernighan, B.W., Lin, S.: An efficient heuristic procedure for partitioning graphs. Bell Syst. Tech. J. 492, 291---307 1970
[17]
Kissinger, T., et al.: ERIS: a NUMA-aware in-memory storage engine for analytical workloads. In: ADMS 2014
[18]
Li, C., Ding, C., Shen, K.: Quantifying the cost of context switch. In: ExpCS 2007
[19]
Microsoft. Microsoft Windows Azure 2015
[20]
Pandis, I., Johnson, R., Hardavellas, N., Ailamaki, A.: Data-oriented transaction execution. In: VLDB 2010
[21]
Pellegrini, F.: Static mapping by dual recursive bipartitioning of process and architecture graphs. In: SHPCC 1994
[22]
Pothen, A.: Graph Partitioning Algorithms with Applications to Scientific Computing. Technical report, Old Dominion University 1997
[23]
Quamar, A., Kumar, K.A., Deshpande, A.: SWORD: scalable workload-aware data placement for transactional workloads. In: EDBT 2013
[24]
Schaffner, J., et al.: RTP: Robust tenant placement for elastic in-memory database clusters. In: SIGMOD 2013
[25]
Schloegel, K., Karypis, G., Kumar, V.: Graph partitioning for dynamic. adaptive and multi-phase scientific simulations. In: CLUSTER 2001
[26]
Soper, A.J., Walshaw, C., Cross, M.: A combined evolutionary search and multilevel optimisation approach to graph-partitioning. J. Global Optim. 292, 225---241 2004

Cited By

View all
  • (2022)More Recent Advances in (Hyper)Graph PartitioningACM Computing Surveys10.1145/357180855:12(1-38)Online publication date: 23-Nov-2022
  • (2022)Recent Advances in Fully Dynamic Graph Algorithms – A Quick Reference GuideACM Journal of Experimental Algorithmics10.1145/355580627(1-45)Online publication date: 12-Aug-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings
Proceedings of the 22nd International Conference on Euro-Par 2016: Parallel Processing - Volume 9833
August 2016
666 pages
ISBN:9783319436586

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 24 August 2016

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2022)More Recent Advances in (Hyper)Graph PartitioningACM Computing Surveys10.1145/357180855:12(1-38)Online publication date: 23-Nov-2022
  • (2022)Recent Advances in Fully Dynamic Graph Algorithms – A Quick Reference GuideACM Journal of Experimental Algorithmics10.1145/355580627(1-45)Online publication date: 12-Aug-2022

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media