Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Efficient Parallel Simulation over Large-scale Social Contact Networks

Published: 18 April 2019 Publication History

Abstract

Social contact network (SCN) models the daily contacts between people in real life. It consists of agents and locations. When agents visit a location at the same time, the social interactions can be established among them. Simulations over SCN have been employed to study social dynamics such as disease spread among population. Because of the scale of SCN and the execution time requirement, the simulations are usually run in parallel. However, a challenge to the parallel simulation is that the structure of SCN is naturally skewed with a few hub locations that have far more visitors than others. These hub locations can cause load imbalance and heavy communication between partitions, which therefore impact the simulation performance. This article proposes a comprehensive solution to address this challenge. First, the hub locations are decomposed into small locations, so that SCN can be divided into partitions with better balanced workloads. Second, the agents are decomposed to exploit data locality, so that the overall communication across partitions can be greatly reduced. Third, two enhanced execution mechanisms are designed for locations and agents, respectively, to improve simulation parallelism. To evaluate the efficiency of the proposed solution, an epidemic simulation was developed and extensive experiments were conducted on two computer clusters using three SCN datasets with different scales. The results demonstrate that our approach can significantly improve the execution performance of the simulation.

References

[1]
Amine Abou-Rjeili and George Karypis. 2006. Multilevel algorithms for partitioning power-law graphs. In Proceedings of the 20th IEEE International Parallel 8 Distributed Processing Symposium. IEEE, 124--124.
[2]
Aj Alt and Philip A. Wilsey. 2014. Profile driven partitioning of parallel simulation models. In Proceedings of the 2014 Winter Simulation Conference. IEEE, 2750--2761.
[3]
Andrea Apolloni, Karthik Channakeshava, Lisa Durbeck, Maleq Khan, Chris Kuhlman, Bryan Lewis, and Samarth Swarup. 2009. A study of information diffusion over a realistic social network model. In Proceedings of the International Conference on Computational Science and Engineering (CSE’09), Vol. 4. IEEE, 675--682.
[4]
Albert-László Barabási and Réka Albert. 1999. Emergence of scaling in random networks. science 286, 5439 (1999), 509--512.
[5]
Albert László Barabási, Réka Albert, and Hawoong Jeong. 2000. Scale-free characteristics of random networks: The topology of the world-wide web. Physica A 281, 1 (2000), 69--77.
[6]
Christopher L. Barrett, Keith R. Bisset, Stephen G. Eubank, Xizhou Feng, and Madhav V. Marathe. 2008. EpiSimdemics: An efficient algorithm for simulating the spread of infectious disease over large realistic social networks. In Proceedings of the 2008 ACM/IEEE Conference on Supercomputing. ACM, Article 37.
[7]
Chris L. Barrett, Stephen G. Eubank, and James P. Smith. 2005. If smallpox strikes portland… Sci. Am. 292, 3 (2005), 54--61.
[8]
Abhinav Bhatele, Jae-Seung Yeom, Nikhil Jain, Chris J. Kuhlman, Yarden Livnat, Keith R. Bisset, Laxmikant V. Kale, and Madhav V. Marathe. 2017. Massively parallel simulations of spread of infectious diseases over realistic social networks. In Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing. IEEE, 689--694.
[9]
K. Bisset, K. Atkins, C. L. Barrett, R. Beckman, S. Eubank, A. Marathe, M. Marathe, H. S. Mortveit, P. Stretz, and V. A. Kumar. 2006. Synthetic Data Products for Societal Infrastructures and Proto-populations: Data Set 1.0. Technical Report. NDSSL Technical Report.
[10]
Keith Bisset, Jiangzhuo Chen, Chris J. Kuhlman, V. S. Kumar, and Madhav V. Marathe. 2011. Interaction-based HPC modeling of social, biological, and economic contagions over large networks. In Proceedings of the 2011 Winter Simulation Conference. IEEE, 2938--2952.
[11]
Keith R. Bisset, Jiangzhuo Chen, Suruchi Deodhar, Xizhou Feng, Yifei Ma, and Madhav V. Marathe. 2014. Indemics: An interactive high-performance computing framework for data-intensive epidemic modeling. ACM Trans. Model. Comput. Simul. 24, 1 (2014), Article 4.
[12]
Keith R. Bisset, Jiangzhuo Chen, Xizhou Feng, V. S. Kumar, and Madhav V. Marathe. 2009. EpiFast: A fast algorithm for large scale realistic epidemic simulations on distributed memory systems. In Proceedings of the 23rd International Conference on Supercomputing. ACM, 430--439.
[13]
Stephen P. Borgatti, Ajay Mehra, Daniel J. Brass, and Giuseppe Labianca. 2009. Network analysis in the social sciences. Science 323, 5916 (2009), 892--895.
[14]
Nicholson Collier and Michael North. 2013. Parallel agent-based simulation with repast for high performance computing. Simulation 89, 10 (2013), 1215--1235.
[15]
Gabriele D’Angelo and Stefano Ferretti. 2009. Simulation of scale-free networks. In Proceedings of the 2nd International Conference on Simulation Tools and Techniques. Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, Article 20.
[16]
Stephen Eubank. 2005. Network based models of infectious disease spread. Jpn. J. Infect. Dis. 58, 6 (2005), S.
[17]
Stephen Eubank, Hasan Guclu, V. S. Anil Kumar, Madhav V. Marathe, Aravind Srinivasan, Zoltan Toroczkai, and Nan Wang. 2004. Modelling disease outbreaks in realistic urban social networks. Nature 429, 6988 (2004), 180--184.
[18]
Richard M. Fujimoto. 2016. Research challenges in parallel and distributed simulation. ACM Trans. Model. Comput. Simul. 26, 4 (2016), Article 22.
[19]
Shannon Gallagher, Lee Richardson, Samuel L. Ventura, and William F. Eddy. 2017. SPEW: Synthetic populations and ecosystems of the world. Arxiv preprint Arxiv:1701.02383 (2017).
[20]
Yuanzheng Ge, Rongqing Meng, Zhidong Cao, Xiaogang Qiu, and Kedi Huang. 2014. Virtual city: An individual-based digital environment for human mobility and interactive behavior. Simulation 90, 8 (2014), 917--935.
[21]
Joseph E. Gonzalez, Yucheng Low, Haijie Gu, Danny Bickson, and Carlos Guestrin. 2012. PowerGraph: Distributed graph-parallel computation on natural graphs. In Proceedings of the 10th USENIX Conference on Operating Systems Design and Implementation (OSDI’12). USENIX Association, 17--30.
[22]
John J. Grefenstette, Shawn T. Brown, Roni Rosenfeld, Jay DePasse, Nathan T. B. Stone, Phillip C. Cooley, William D. Wheaton, Alona Fyshe, David D. Galloway, Anuroop Sriram, et al. 2013. FRED (A framework for reconstructing epidemic dynamics): an open-source software system for modeling infectious diseases and control strategies using census-based populations. BMC Publ. Health 13:940, 1 (2013), 1--14.
[23]
Diansheng Guo. 2007. Visual analytics of spatial interaction patterns for pandemic decision support. Int. J. Geogr. Inf. Sci. 21, 8 (2007), 859--877.
[24]
Bonan Hou and Yiping Yao. 2010. Commpar: A community-based model partitioning approach for large-scale networked social dynamics simulation. In Proceedings of the 2010 IEEE/ACM 14th International Symposium on Distributed Simulation and Real Time Applications (DS-RT’10). IEEE, 7--13.
[25]
Jiangming Jin, Stephen John Turner, Bu-Sung Lee, Jianlong Zhong, and Bingsheng He. 2012. HPC simulations of information propagation over social networks. Proc. Comput. Sci. 9 (2012), 292--301.
[26]
Yu A. Kuznetsov and C. Piccardi. 1994. Bifurcation analysis of periodic SEIR and SIR epidemic models. J. Math. Biol. 32, 2 (1994), 109--121.
[27]
B. Lewis, S. Swarup, K. Bisset, S. Eubank, M. Marathe, and C. Barrett. 2013. A simulation environment for the dynamic evaluation of disaster preparedness policies and interventions. J. Publ. Health Manage. Pract. 19, 2 (2013), S42.
[28]
Il-Chul Moon and Kathleen M. Carley. 2007. Modeling and simulating terrorist networks in social and geospatial dimensions. IEEE Intell. Syst. 22, 5 (2007), 40--49.
[29]
Vy Thuy Nguyen and Richard Fujimoto. 2016. Link partitioning in parallel simulation of scale-free networks. In Proceedings of the 2016 IEEE/ACM 20th International Symposium on Distributed Simulation and Real Time Applications (DS-RT). IEEE, 77--84.
[30]
Roger Pearce, Maya Gokhale, and Nancy M. Amato. 2013. Scaling techniques for massive scale-free graphs in distributed (external) memory. In Proceedings of the 2013 IEEE 27th International Symposium on Parallel 8 Distributed Processing (IPDPS’13). IEEE, 825--836.
[31]
A. Petkova, C. Hughes, N. Deo, and M. Dimitrov. 2016. Accelerating the distributed simulations of agent-based models using community detection. In Proceedings of the IEEE International Conference on Computing Communication Technologies, Research, Innovation, and Vision for the Future (RIVF’16). IEEE, 25--30.
[32]
Robert S. Pienta and Richard M. Fujimoto. 2013. On the parallel simulation of scale-free networks. In Proceedings of the 1st ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. ACM, 179--188.
[33]
Natasa Pržulj, Derek G. Corneil, and Igor Jurisica. 2004. Modeling interactome: Scale-free or geometric? Bioinformatics 20, 18 (2004), 3508--3515. Arxiv preprint ArXiv:q-bio/0404017 (2004).
[34]
Samarth Swarup, Stephen G. Eubank, and Madhav V. Marathe. 2014. Computational epidemiology as a challenge domain for multiagent systems. In Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 1173--1176.
[35]
Youzhong Wang, Daniel Zeng, Zhidong Cao, Yong Wang, Hongbin Song, and Xiaolong Zheng. 2011. The impact of community structure of social contact network on epidemic outbreak and effectiveness of non-pharmaceutical interventions. In Proceedings of the Pacific-Asia Workshop on Intelligence and Security Informatics. Springer, 108--120.
[36]
Yulin Wu, Xiangting Hou, Wen Jun Tan, Zengxiang Li, and Wentong Cai. 2017. Efficient parallel simulation over social contact network with skewed degree distribution. In Proceedings of the 2017 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. ACM, 65--75.
[37]
Huadong Xia, Kalyani Nagaraj, Jiangzhuo Chen, and Madhav V Marathe. 2015. Synthesis of a high resolution social contact network for delhi with application to pandemic planning. Artif. Intell. Med. 65, 2 (2015), 113--130.
[38]
Yadong Xu, Wentong Cai, Heiko Aydt, and Michael Lees. 2014. Efficient graph-based dynamic load-balancing for parallel large-scale agent-based traffic simulation. In Proceedings of the 2014 Winter Simulation Conference. IEEE, 3483--3494.
[39]
Jae-Seung Yeom, Abhinav Bhatele, Keith Bisset, Eric Bohm, Abhishek Gupta, Laxmikant V. Kale, Madhav Marathe, Dimitrios S. Nikolopoulos, Martin Schulz, and Lukasz Wesolowski. 2014. Overcoming the scalability challenges of epidemic simulations on blue waters. In Proceedings of the 2014 IEEE 28th International Parallel and Distributed Processing Symposium. IEEE, 755--764.
[40]
Haifeng Zhang, Jie Zhang, Changsong Zhou, Michael Small, and Binghong Wang. 2010. Hub nodes inhibit the outbreak of epidemic under voluntary vaccination. New J. Phys. 12, 2 (2010), 023015.
[41]
Mingxin Zhang, Rongqing Meng, and Alexander Verbraeck. 2015b. Including public transportation into a large-scale agent-based model for epidemic prediction and control. In Proceedings of the Conference on Summer Computer Simulation. Society for Computer Simulation International, 1--8.
[42]
Yu Zhang, Xiaofei Liao, Hai Jin, and Geyong Min. 2015a. Resisting skew-accumulation for time-stepped applications in the cloud via exploiting parallelism. IEEE Trans. Cloud Comput. 3, 1 (2015), 54--65.
[43]
Zhaoyang Zhang, Honggang Wang, Chonggang Wang, and Hua Fang. 2015c. Modeling epidemics spreading on social contact networks. IEEE Trans. Emerg. Top. Comput. 3, 3 (2015), 410--419.
[44]
Tao Zou, Guozhang Wang, Marcos Vaz Salles, David Bindel, Alan Demers, Johannes Gehrke, and Walker White. 2011. Making time-stepped applications tick in the cloud. In Proceedings of the 2nd ACM Symposium on Cloud Computing. ACM, Article 20.

Cited By

View all
  • (2024)Large-Scale Parallelization of Human Migration SimulationIEEE Transactions on Computational Social Systems10.1109/TCSS.2023.329293211:2(2135-2146)Online publication date: Apr-2024
  • (2023)Comprehensive Methodology of Contact Tracing Techniques to Reduce Pandemic Infectious Diseases SpreadNature-Inspired Methods for Smart Healthcare Systems and Medical Data10.1007/978-3-031-45952-8_5(89-119)Online publication date: 2-Dec-2023
  • (2022)A New Application of Machine LearningProceedings of the Winter Simulation Conference10.5555/3586210.3586264(653-664)Online publication date: 11-Dec-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Modeling and Computer Simulation
ACM Transactions on Modeling and Computer Simulation  Volume 29, Issue 2
Special Issue on PADS 2017
April 2019
105 pages
ISSN:1049-3301
EISSN:1558-1195
DOI:10.1145/3320014
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2019
Accepted: 01 August 2018
Revised: 01 April 2018
Received: 01 November 2017
Published in TOMACS Volume 29, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Social network
  2. graph partitioning
  3. load balancing
  4. parallel and distributed simulation
  5. skewed degree distribution

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • Singapore National Research Foundation under its Campus for Research Excellence And Technological Enterprise (CREATE) program

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)1
Reflects downloads up to 02 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Large-Scale Parallelization of Human Migration SimulationIEEE Transactions on Computational Social Systems10.1109/TCSS.2023.329293211:2(2135-2146)Online publication date: Apr-2024
  • (2023)Comprehensive Methodology of Contact Tracing Techniques to Reduce Pandemic Infectious Diseases SpreadNature-Inspired Methods for Smart Healthcare Systems and Medical Data10.1007/978-3-031-45952-8_5(89-119)Online publication date: 2-Dec-2023
  • (2022)A New Application of Machine LearningProceedings of the Winter Simulation Conference10.5555/3586210.3586264(653-664)Online publication date: 11-Dec-2022
  • (2022)A New Application of Machine Learning: Detecting Errors in Network Simulations2022 Winter Simulation Conference (WSC)10.1109/WSC57314.2022.10015484(653-664)Online publication date: 11-Dec-2022
  • (2021)P-Flee: An Efficient Parallel Algorithm for Simulating Human Migration2021 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)10.1109/IPDPSW52791.2021.00159(1008-1011)Online publication date: Jun-2021

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media