Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3274895.3274948acmconferencesArticle/Chapter ViewAbstractPublication PagesgisConference Proceedingsconference-collections
poster

FUTURES-DPE: towards dynamic provisioning and execution of geosimulations in HPC environments

Published: 06 November 2018 Publication History

Abstract

Geosimulations using computer simulation models provideGI scientists an effective way to study complex geographic phenomena and predict future outcomes. Typically, geosimulations are developed to execute in an HPC environment with parallel and distributed execution capabilities. However, traditional HPC environments limit these simulations to a static runtime environment, where resources for execution must be decided before execution. Traditional simulation approaches such as a data parallel approach assigns fixed computing resources on every unit of data (e.g., a tile or a county). However, in many practical situations, a user may want to assign additional computing resources to speedup or perform more computation in a specific region. For example, in an urban growth model (UGM) simulation, to explore the outcomes of changes due to urban policy in a tile or a group of tiles at a given time-step, an urban geographer may want to assign more computing resources to those group of tiles to quickly determine impacts of policy on urbanization. In the absence of a dynamic resource allocation mechanism, the utility of a geosimulation to explore what-if scenarios on-the-fly is limited to pre-allocated computing resources. Thus, to effectively leverage existing resources, we first design a co-scheduling approach for geosimulations in a resource constrained HPC environment. We then present a second design for a geosimulation which allows dynamic provisioning of resources in an HPC environment based on run-time users' demands. Finally, to demonstrate the utility of the two approaches we modify the FUTURES geosimulation to support computationally expensive high-resolution simulation in regions of interest (ROIs) as specified by a user using the FUTURES-DPE framework.

References

[1]
Pavan Balaji, Darius Buntinas, David Goodell, William Gropp, Jayesh Krishna, Ewing Lusk, and Rajeev Thakur. 2010. PMI: A scalable parallel process-management interface for extreme-scale systems. In European MPI Users' Group Meeting. Springer, 31--41.
[2]
Adam Beguelin, Jack Dongarra, Al Geist, Robert Manchek, and Vaidy Sunderam. 1991. A User's Guide to PVM Parallel Virtual Machine. Technical Report. Knoxville, TN, USA.
[3]
Itzhak Benenson, Paul M Torrens, and Paul Torrens. 2004. Geosimulation: Automata-based modeling of urban phenomena. John Wiley & Sons.
[4]
Marsha J Berger and Joseph Oliger. 1984. Adaptive mesh refinement for hyperbolic partial differential equations. Journal of computational Physics 53, 3 (1984), 484--512.
[5]
Ralph M Butler and Ewing L Lusk. 1994. Monitors, messages, and clusters: The p4 parallel programming system. Parallel Comput. 20, 4 (1994), 547--564.
[6]
Adaptive Computing Enterprises Inc. {n. d.}. Torque Resource Manager Administrator Guide 6.1.2, February 2018.
[7]
Anshu Dubey et al. 2014. A survey of high level frameworks in block-structured adaptive mesh refinement packages. J. Parallel and Distrib. Comput. 74, 12 (2014), 3217 -- 3227. Domain-Specific Languages and High-Level Frameworks for High-Performance Computing.
[8]
William Gropp, Ewing Lusk, Nathan Doss, and Anthony Skjellum. 1996. A high-performance, portable implementation of the MPI message passing interface standard. Parallel computing 22, 6 (1996), 789--828.
[9]
Preeti Malakar, Vijay Natarajan, and Sathish S. Vadhiyar. 2011. InSt: An Integrated Steering Framework for Critical Weather Applications. Procedia Computer Science 4 (2011), 116 -- 125.
[10]
Ross K Meentemeyer, Wenwu Tang, Monica A Dorning, John B Vogler, Nik J Cunniffe, and Douglas A Shoemaker. 2013. FUTURES: Multilevel Simulations of Emerging Urban-Rural Landscape Structure Using a Stochastic Patch-Growing Algorithm. Annals of the Association of American Geographers 103, 4 (2013), 785--807.
[11]
John G Michalakes. 2000. RSL: A parallel runtime system library for regional atmospheric models with nesting. IMA Volumes in Mathematics and Its Applications 117 (2000), 59--74.
[12]
Tomasz Plewa, Timur Linde, and V Gregory Weirs. 2005. Adaptive mesh refinement-theory and applications. Lecture notes in computational science and engineering 41 (2005), 3--5.
[13]
Ashwin Shashidharan, Derek B van Berkel, Ranga Raju Vatsavai, and Ross K Meentemeyer. 2016. pFUTURES: A Parallel Framework for Cellular Automaton Based Urban Growth Models. In International Conference on Geographic Information Science. Springer, 163--177.
[14]
Ashwin Shashidharan, Ranga Raju Vatsavai, Abhinav Ashish, and Ross K. Meentemeyer. 2017. tFUTURES: Computational Steering for Geosimulations. In Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL'17). ACM, New York, NY, USA, Article 27, 10 pages.
[15]
Ashwin Shashidharan, Ranga Raju Vatsavai, Derek B. Van Berkel, and Ross K. Meentemeyer. 2018. FUTURES-AMR: Towards an Adaptive Mesh Refinement Framework for Geosimulations. In 10th International Conference on Geographic Information Science (GIScience 2018) (Leibniz International Proceedings in Informatics (LIPIcs)), Stephan Winter, Amy Griffin, and Monika Sester (Eds.), Vol. 114. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany, 16:1--16:15.
[16]
Jeffrey S Vetter and Daniel A Reed. 2000. Real-time performance monitoring, adaptive control, and interactive steering of computational grids. The International Journal of High Performance Computing Applications 14, 4 (2000), 357--366.
[17]
Jeffrey Scott Vetter and Karsten Schwan. 1995. Progress: A toolkit for interactive program steering. Technical Report. Georgia Institute of Technology.
[18]
Andy B Yoo, Morris A Jette, and Mark Grondona. 2003. Slurm: Simple linux utility for resource management. In Workshop on Job Scheduling Strategies for Parallel Processing. Springer, 44--60.
[19]
Matei Zaharia, Reynold S. Xin, Patrick Wendell, Tathagata Das, Michael Armbrust, Ankur Dave, Xiangrui Meng, Josh Rosen, Shivaram Venkataraman, Michael J. Franklin, Ali Ghodsi, Joseph Gonzalez, Scott Shenker, and Ion Stoica. 2016. Apache Spark: A Unified Engine for Big Data Processing. Commun. ACM 59, 11 (Oct. 2016), 56--65.
[20]
Songnian Zhou. 1992. Lsf: Load sharing in large heterogeneous distributed systems. In I Workshop on Cluster Computing, Vol. 136.

Cited By

View all
  • (2023)Adaptive elasticity policies for staging-based in situ visualizationFuture Generation Computer Systems10.1016/j.future.2022.12.010142(75-89)Online publication date: May-2023
  • (2021)Adaptive Placement of Data Analysis Tasks For Staging Based In-Situ Processing2021 IEEE 28th International Conference on High Performance Computing, Data, and Analytics (HiPC)10.1109/HiPC53243.2021.00038(242-251)Online publication date: Dec-2021
  • (2019)Projecting Urbanization and Landscape Change at Large Scale Using the FUTURES ModelLand10.3390/land81001448:10(144)Online publication date: 24-Sep-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGSPATIAL '18: Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems
November 2018
655 pages
ISBN:9781450358897
DOI:10.1145/3274895
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2018

Check for updates

Author Tags

  1. computational steering
  2. distributed computing
  3. geosimulation

Qualifiers

  • Poster

Conference

SIGSPATIAL '18
Sponsor:

Acceptance Rates

SIGSPATIAL '18 Paper Acceptance Rate 30 of 150 submissions, 20%;
Overall Acceptance Rate 220 of 1,116 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)1
Reflects downloads up to 09 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Adaptive elasticity policies for staging-based in situ visualizationFuture Generation Computer Systems10.1016/j.future.2022.12.010142(75-89)Online publication date: May-2023
  • (2021)Adaptive Placement of Data Analysis Tasks For Staging Based In-Situ Processing2021 IEEE 28th International Conference on High Performance Computing, Data, and Analytics (HiPC)10.1109/HiPC53243.2021.00038(242-251)Online publication date: Dec-2021
  • (2019)Projecting Urbanization and Landscape Change at Large Scale Using the FUTURES ModelLand10.3390/land81001448:10(144)Online publication date: 24-Sep-2019

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media