Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Automatic Reuse, Adaption, and Execution of Simulation Experiments via Provenance Patterns

Published: 28 February 2023 Publication History

Abstract

Simulation experiments are typically conducted repeatedly during the model development process, for example, to revalidate if a behavioral property still holds after several model changes. Approaches for automatically reusing and generating simulation experiments can support modelers in conducting simulation studies in a more systematic and effective manner. They rely on explicit experiment specifications and, so far, on user interaction for initiating the reuse. Thereby, they are constrained to support the reuse of simulation experiments in a specific setting. Our approach now goes one step further by automatically identifying and adapting the experiments to be reused for a variety of scenarios. To achieve this, we exploit provenance graphs of simulation studies, which provide valuable information about the previous modeling and experimenting activities, and contain meta-information about the different entities that were used or produced during the simulation study. We define provenance patterns and associate them with a semantics, which allows us to interpret the different activities and construct transformation rules for provenance graphs. Our approach is implemented in a Reuse and Adapt framework for Simulation Experiments (RASE), which can interface with various modeling and simulation tools. In the case studies, we demonstrate the utility of our framework for (1) the repeated sensitivity analysis of an agent-based model of migration routes and (2) the cross-validation of two models of a cell signaling pathway.

References

[1]
Gul Agha and Karl Palmskog. 2018. A survey of statistical model checking. ACM Trans. Model. Comput. Simul. 28, 1, Article 6 (2018), 39 pages.
[2]
M. David Allen, Len Seligman, Barbara Blaustein, and Adriane Chapman. 2010. Provenance Capture and Use: A Practical Guide. Technical Report. Mitre Corp., McLean, VA.
[3]
Robert Axtell, Robert Axelrod, Joshua M. Epstein, and Michael D. Cohen. 1996. Aligning simulation models: A case study and results. Computational & Mathematical Organization Theory 1, 2 (1996), 123–141.
[4]
Daniel Ayllón, Steven F. Railsback, Cara Gallagher, Jacqueline Augusiak, Hans Baveco, Uta Berger, Sandrine Charles, Romina Martin, Andreas Focks, Nika Galic, Chun Liu, E. Emiel van Loon, Jacob Nabe-Nielsen, Cyril Piou, J. Gareth Polhill, Thomas G. Preuss, Viktoriia Radchuk, Amelie Schmolke, Julita Stadnicka-Michalak, Pernille Thorbek, and Volker Grimm. 2021. Keeping modelling notebooks with TRACE: Good for you and good for environmental research and management support. Environmental Modelling & Software 136 (2021), 104932.
[5]
Osman Balci. 2012. A life cycle for modeling and simulation. Simulation 88, 7 (2012), 870–883.
[6]
Khalid Belhajjame, Reza B’Far, James Cheney, Sam Coppens, Stephen Cresswell, Yolanda Gil, Paul Groth, Graham Klyne, Timothy Lebo, Jim McCusker, et al. 2013. PROV-DM: The PROV data model. W3C Recommendation (2013). https://www.w3.org/TR/2013/REC-prov-dm-20130430/.
[7]
Frank T. Bergmann, Richard Adams, Stuart Moodie, Jonathan Cooper, Mihai Glont, Martin Golebiewski, Michael Hucka, Camille Laibe, Andrew K. Miller, David P. Nickerson, et al. 2014. COMBINE archive and OMEX format: One file to share all information to reproduce a modeling project. BMC Bioinformatics 15, 1 (2014), 1–9.
[8]
Jeff Bezanson, Alan Edelman, Stefan Karpinski, and Viral B. Shah. 2017. Julia: A fresh approach to numerical computing. SIAM Rev. 59, 1 (2017), 65–98.
[9]
Benjamin J. Bornstein, Sarah M. Keating, Akiya Jouraku, and Michael Hucka. 2008. LibSBML: An API library for SBML. Bioinformatics 24, 6 (2008), 880–881.
[10]
Kai Budde, Jacob Smith, Pia Wilsdorf, Fiete Haack, and Adelinde M. Uhrmacher. 2021. Relating simulation studies by provenance–Developing a family of Wnt signaling models. PLOS Computational Biology 17, 8 (2021), 1–27.
[11]
Hans Clevers and Roel Nusse. 2012. Wnt/ß-catenin signaling and disease. Cell 149, 6 (June2012), 1192–1205.
[12]
The UniProt Consortium. 2018. UniProt: A worldwide hub of protein knowledge. Nucleic Acids Research 47, D1 (112018), D506–D515.
[13]
Jonathan Cooper, Martin Scharm, and Gary R. Mirams. 2016. The cardiac electrophysiology web lab. Biophysical Journal 110, 2 (2016), 292–300.
[14]
Mélanie Courtot, Nick Juty, Christian Knüpfer, Dagmar Waltemath, Anna Zhukova, Andreas Dräger, Michel Dumontier, Andrew Finney, Martin Golebiewski, Janna Hastings, et al. 2011. Controlled vocabularies and semantics in systems biology. Molecular Systems Biology 7, 1 (2011), 543.
[15]
Peter V. Coveney, Derek Groen, and Alfons G. Hoekstra. 2021. Reliability and reproducibility in computational science: Implementing validation, verification and uncertainty quantification in silico. Philosophical Transactions of the Royal Society A 379 (2021), 20200409.
[16]
Orçun Dayıbaş, Halit Oǧuztüzün, and Levent Yılmaz. 2019. On the use of model-driven engineering principles for the management of simulation experiments. Journal of Simulation 13, 2 (2019), 83–95.
[17]
Roland Ewald and Adelinde M. Uhrmacher. 2014. SESSL: A domain-specific language for simulation experiments. ACM Trans. Model. Comput. Simul. 24, 2, Article 11 (2014), 25 pages.
[18]
Niclas Feldkamp, Soeren Bergmann, and Steffen Strassburger. 2020. Knowledge discovery in simulation data. ACM Trans. Model. Comput. Simul. 30, 4, Article 24 (2020), 25 pages.
[19]
Mingbin Feng and Jeremy Staum. 2017. Green simulation: Reusing the output of repeated experiments. ACM Trans. Model. Comput. Simul. 27, 4, Article 23 (2017), 28 pages.
[20]
Nadime Francis, Alastair Green, Paolo Guagliardo, Leonid Libkin, Tobias Lindaaker, Victor Marsault, Stefan Plantikow, Mats Rydberg, Petra Selmer, and Andrés Taylor. 2018. Cypher: An evolving query language for property graphs. In Proceedings of the 2018 International Conference on Management of Data (SIGMOD’18). 1433–1445.
[21]
Cláudio Gomes, Casper Thule, David Broman, Peter Gorm Larsen, and Hans Vangheluwe. 2018. Co-simulation: A survey. ACM Comput. Surv. 51, 3, Article 49 (2018), 33 pages.
[22]
Volker Grimm, Jacqueline Augusiak, Andreas Focks, Béatrice M. Frank, Faten Gabsi, Alice S. A. Johnston, Chun Liu, Benjamin T. Martin, Mattia Meli, Viktoriia Radchuk, Pernille Thorbek, and Steven F. Railsback. 2014. Towards better modelling and decision support: Documenting model development, testing, and analysis using TRACE. Ecological Modelling 280 (2014), 129–139.
[23]
Volker Grimm, Steven F. Railsback, Christian E. Vincenot, Uta Berger, Cara Gallagher, Donald L. DeAngelis, Bruce Edmonds, Jiaqi Ge, Jarl Giske, Juergen Groeneveld, et al. 2020. The ODD protocol for describing agent-based and other simulation models: A second update to improve clarity, replication, and structural realism. Journal of Artificial Societies and Social Simulation 23, 2 (2020), 7.
[24]
Fiete Haack, Heiko Lemcke, Roland Ewald, Tareck Rharass, and Adelinde M. Uhrmacher. 2015. Spatio-temporal model of endogenous ROS and raft-dependent WNT/beta-catenin signaling driving cell fate commitment in human neural progenitor cells. PLOS Computational Biology 11, 3 (2015), 1–28.
[25]
David Hales, Juliette Rouchier, and Bruce Edmonds. 2003. Model-to-model analysis. Journal of Artificial Societies and Social Simulation 6, 4 (2003), 1–5.
[26]
Tobias Helms, Tom Warnke, Carsten Maus, and Adelinde M. Uhrmacher. 2017. Semantics and efficient simulation algorithms of an expressive multilevel modeling language. ACM Trans. Model. Comput. Simul. 27, 2, Article 8 (2017), 25 pages.
[27]
Martin Hinsch and Jakub Bijak. 2019. Rumours lead to self-organized migration routes. In 2019 International Workshop on Agent-based Modelling of Human Behaviour (ABMHuB’19), Artificial Life Conference, ALife. http://abmhub.cs.ucl.ac.uk/2019/papers/Hinsch_Bijak.pdf.
[28]
Martin Hinsch and Jakub Bijak. 2022. Towards more realistic models. In Towards Bayesian Model-based Demography: Agency, Complexity and Uncertainty in Migration Studies. Methodos Series, Vol. 17. Springer, Dordecht, Chapter 8.
[29]
Alexandre Hocquet and Frédéric Wieber. 2021. Epistemic issues in computational reproducibility: Software as the elephant in the room. European Journal for Philosophy of Science 11, 2 (2021), 1–20.
[30]
Stefan Hoops, Sven Sahle, Ralph Gauges, Christine Lee, Jürgen Pahle, Natalia Simus, Mudita Singhal, Liang Xu, Pedro Mendes, and Ursula Kummer. 2006. COPASI-a complex pathway simulator. Bioinformatics 22, 24 (2006), 3067–3074.
[31]
M. Hucka, A. Finney, H. M. Sauro, H. Bolouri, J. C. Doyle, H. Kitano, A. P. Arkin, B. J. Bornstein, D. Bray, A. Cornish-Bowden, et al. 2003. The systems biology markup language (SBML): A medium for representation and exchange of biochemical network models. Bioinformatics 19, 4 (2003), 524–531.
[32]
Marco A. Janssen, Lilian Na’ia Alessa, Michael Barton, Sean Bergin, and Allen Lee. 2008. Towards a community framework for agent-based modelling. Journal of Artificial Societies and Social Simulation 11, 2 (2008), 6.
[33]
JSON. 2017. ECMA-404 The JSON Data Interchange Standard, 2nd Edition. Retrieved August 5, 2021, from https://www.json.org/.
[34]
JSON Schema. 2018. JSON Schema Draft-07 Release Notes. Retrieved August 5, 2021, from https://json-schema.org/draft-07/json-schema-release-notes.html.
[35]
Thomas Kluyver, Benjamin Ragan-Kelley, Fernando Pérez, Brian Granger, Matthias Bussonnier, Jonathan Frederic, Kyle Kelley, Jessica Hamrick, Jason Grout, Sylvain Corlay, Paul Ivanov, Damián Avila, Safia Abdalla, Carol Willing, and Jupyter Development Team. 2016. Jupyter notebooks - A publishing format for reproducible computational workflows. In Positioning and Power in Academic Publishing: Players, Agents and Agendas. IOS Press, 87–90. https://eprints.soton.ac.uk/403913/.
[36]
Frank Krüger and David Schindler. 2020. A literature review on methods for the extraction of usage statements of software and data. Computing in Science Engineering 22, 1 (2020), 26–38.
[37]
Ethan Lee, Adrian Salic, Roland Krüger, Reinhart Heinrich, and Marc W. Kirschner. 2003. The roles of APC and Axin derived from experimental and theoretical analysis of the Wnt pathway. PLOS Biology 1, 1 (2003), e10.
[38]
Junxue Liang, Zhaowen Lin, and Yan Ma. 2012. OF-NEDL: An openflow networking experiment description language based on XML. In International Conference on Web Information Systems and Mining. Springer, 686–697.
[39]
Fabian Lorig. 2019. Hypothesis-driven Simulation Studies: Assistance for the Systematic Design and Conducting of Computer Simulation Experiments. Springer.
[40]
Oded Maler and Dejan Nickovic. 2004. Monitoring temporal properties of continuous signals. In Formal Techniques, Modelling and Analysis of Timed and Fault-Tolerant Systems, Yassine Lakhnech and Sergio Yovine (Eds.). Springer, Berlin, 152–166.
[41]
Rahuman S. Malik-Sheriff, Mihai Glont, Tung V. N. Nguyen, Krishna Tiwari, Matthew G. Roberts, Ashley Xavier, Manh T. Vu, Jinghao Men, Matthieu Maire, Sarubini Kananathan. 2020. BioModels – 15 years of sharing computational models in life science. Nucleic Acids Research 48, D1 (2020), D407–D415.
[42]
Justin J. Miller. 2013. Graph database applications and concepts with Neo4j. In Proceedings of the Southern Association for Information Systems Conference, Vol. 2324.
[43]
Paolo Missier, Bertram Ludäscher, Shawn Bowers, Saumen Dey, Anandarup Sarkar, Biva Shrestha, Ilkay Altintas, Manish Kumar Anand, and Carole Goble. 2010. Linking multiple workflow provenance traces for interoperable collaborative science. In The 5th Workshop on Workflows in Support of Large-scale Science. 1–8.
[44]
Thomas Monks, Christine S. M. Currie, Bhakti Stephan Onggo, Stewart Robinson, Martin Kunc, and Simon J. E. Taylor. 2019. Strengthening the reporting of empirical simulation studies: Introducing the STRESS guidelines. Journal of Simulation 13, 1 (2019), 55–67.
[45]
Luc Moreau and Paul Groth. 2013. Provenance: An introduction to PROV. Synthesis Lectures on the Semantic Web: Theory and Technology 3, 4 (2013), 1–129.
[46]
Leonardo Murta, Vanessa Braganholo, Fernando Chirigati, David Koop, and Juliana Freire. 2015. noWorkflow: Capturing and analyzing provenance of scripts. In Provenance and Annotation of Data and Processes. Springer International Publishing, Cham, 71–83.
[47]
Tanzeem Bin Noor and Hadi Hemmati. 2015. A similarity-based approach for test case prioritization using historical failure data. In 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE’15). 58–68.
[48]
Roel Nusse. 2008. Wnt signaling and stem cell control. Cell Research 18, 5 (2008), 523–527.
[49]
Cyrus Omar, Jonathan Aldrich, and Richard C. Gerkin. 2014. Collaborative infrastructure for test-driven scientific model validation. In Companion Proceedings of the 36th International Conference on Software Engineering (ICSE Companion’14). 524–527.
[50]
K. Pawlikowski, H.-D. J. Jeong, and J.-S. R. Lee. 2002. On credibility of simulation studies of telecommunication networks. IEEE Communications Magazine 40, 1 (2002), 132–139.
[51]
Danhua Peng, Tom Warnke, Fiete Haack, and Adelinde M. Uhrmacher. 2017. Reusing simulation experiment specifications in developing models by successive composition – A case study of the Wnt/\(\beta\)-catenin signaling pathway. Simulation 93, 8 (2017), 659–677.
[52]
R Core Team. 2019. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/.
[53]
Ranjit Randhawa, Cliff Shaffer, and John Tyson. 2010. Model composition for macromolecular regulatory networks. IEEE/ACM Transactions on Computational Biology and Bioinformatics 7, 2 (2010), 278–287.
[54]
Oliver Reinhardt, Tom Warnke, Andreas Ruscheinski, and Adelinde M. Uhrmacher. 2019. Valid and Reproducible Simulation Studies—Making It Explicit. Springer International Publishing, Cham, 607–672.
[55]
Oliver Reinhardt, Tom Warnke, and Adelinde M. Uhrmacher. 2022. Agent-based modelling and simulation with domain-specific languages. In Towards Bayesian Model-based Demography: Agency, Complexity and Uncertainty in Migration Studies. Methodos Series, Vol. 17. Springer, Dordecht, Chapter 7.
[56]
Stewart Robinson, Gilbert Arbez, Louis G. Birta, Andreas Tolk, and Gerd Wagner. 2015. Conceptual modeling: Definition, purpose and benefits. In 2015 Winter Simulation Conference (WSC’15). 2812–2826.
[57]
Andreas Ruscheinski and Adelinde M. Uhrmacher. 2017. Provenance in modeling and simulation studies — Bridging gaps. In 2017 Winter Simulation Conference (WSC’17). 872–883.
[58]
Andreas Ruscheinski, Tom Warnke, and Adelinde M. Uhrmacher. 2019. Artifact-based workflows for supporting simulation studies. IEEE Transactions on Knowledge and Data Engineering 32, 6 (2019), 1064–1078.
[59]
Andreas Ruscheinski, Pia Wilsdorf, Marcus Dombrowsky, and Adelinde M. Uhrmacher. 2019. Capturing and reporting provenance information of simulation studies based on an artifact-Based workflow approach. In Proceedings of the 2019 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation (SIGSIM-PADS’19). 185–196.
[60]
Susan M. Sanchez, Paul J. Sanchez, and Hong Wan. 2020. Work smarter, not harder: a tutorial on designing and conducting simulation experiments. In 2020 Winter Simulation Conference (WSC’20). 1128–1142.
[61]
R. G. Sargent. 2013. Verification and validation of simulation models. Journal of Simulation 7, 1 (2013), 12–24.
[62]
Martin Scharm, Olaf Wolkenhauer, and Dagmar Waltemath. 2015. An algorithm to detect and communicate the differences in computational models describing biological systems. Bioinformatics 32, 4 (2015), 563–570.
[63]
Falk Schreiber, Björn Sommer, Tobias Czauderna, Martin Golebiewski, Thomas E. Gorochowski, Michael Hucka, Sarah M. Keating, Matthias König, Chris Myers, David Nickerson, and Dagmar Waltemath. 2020. Specifications of standards in systems and synthetic biology: status and developments in 2020. Journal of Integrative Bioinformatics 17, 2–3 (2020), 20200022.
[64]
Max Schröder, Susanne Stählke, J. Barbara Nebe, and Frank Krüger. 2020. Towards in-situ knowledge acquisition for research data provenance from electronic lab notebooks. In 1st Workshop on Data and Research Objects Management for Linked Open Science (DaMaLOS’20), Co-located at the International Semantic Web Conference (ISWC’20), Virtual Conference. 1–12.
[65]
Gregory A. Silver, John A. Miller, Maria Hybinette, Gregory Baramidze, and William S. York. 2011. DeMO: An ontology for discrete-event modeling and simulation. Simulation 87, 9 (2011), 747–773.
[66]
Alejandro Teran-Somohano, Alice E. Smith, Joseph Ledet, Levent Yilmaz, and Halit Oǧuztüzün. 2015. A model-driven engineering approach to simulation experiment design and execution. In 2015 Winter Simulation Conference (WSC’15). 2632–2643.
[67]
The Gene Ontology Consortium. 2018. The gene ontology resource: 20 years and still GOing strong. Nucleic Acids Research 47, D1 (2018), D330–D338.
[68]
Krishna Tiwari, Sarubini Kananathan, Matthew G. Roberts, Johannes P. Meyer, Mohammad Umer Sharif Shohan, Ashley Xavier, Matthieu Maire, Ahmad Zyoud, Jinghao Men, Szeyi Ng, et al. 2021. Reproducibility in systems biology modelling. Molecular Systems Biology 17, 2 (2021), e9982.
[69]
Dai Hai Ton That, Gabriel Fils, Zhihao Yuan, and Tanu Malik. 2017. Sciunits: Reusable research objects. In 2017 IEEE 13th International Conference on e-Science (e-Science’17). 374–383.
[70]
T. G. Trucano, L. P. Swiler, T. Igusa, W. L. Oberkampf, and M. Pilch. 2006. Calibration, validation, and sensitivity analysis: What’s what. Reliability Engineering & System Safety 91, 10 (2006), 1331–1357.
[71]
Dagmar Waltemath, Richard Adams, Daniel A. Beard, Frank T. Bergmann, Upinder S. Bhalla, Randall Britten, Vijayalakshmi Chelliah, Michael T. Cooling, Jonathan Cooper, Edmund J. Crampin, et al. 2011. Minimum information about a simulation experiment (MIASE). PLOS Computational Biology 7, 4 (2011), 1–4.
[72]
Dagmar Waltemath, Richard Adams, Frank T. Bergmann, Michael Hucka, Fedor Kolpakov, Andrew K. Miller, Ion I. Moraru, David Nickerson, Sven Sahle, Jacky L. Snoep, et al. 2011. Reproducible computational biology experiments with SED-ML-the simulation experiment description markup language. BMC Systems Biology 5, 1 (2011), 198.
[73]
Mark D. Wilkinson, Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, Niklas Blomberg, Jan-Willem Boiten, Luiz Bonino da Silva Santos, Philip E. Bourne, et al. 2016. The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data 3, 1 (2016), 160018.
[74]
Pia Wilsdorf, Jakob Heller, Kai Budde, Julius Zimmermann, Tom Warnke, Christian Haubelt, Dirk Timmermann, Ursula van Rienen, and Adelinde M. Uhrmacher. 2022. A model-driven approach for conducting simulation experiments. Applied Sciences 12, 16, Article 7977 (2022). DOI:
[75]
Levent Yilmaz, Sritika Chakladar, and Kyle Doud. 2016. The goal-hypothesis-experiment framework: A generative cognitive domain architecture for simulation experiment management. In 2016 Winter Simulation Conference (WSC’16). 1001–1012.
[76]
S. Yoo and M. Harman. 2012. Regression testing minimization, selection and prioritization: a survey. Software Testing, Verification and Reliability 22, 2 (2012), 67–120.

Cited By

View all
  • (2024)Context, Composition, Automation, and Communication: The C2AC Roadmap for Modeling and SimulationACM Transactions on Modeling and Computer Simulation10.1145/367322634:4(1-51)Online publication date: 13-Aug-2024
  • (2024)Towards an Integrated Provenance Framework: A Scenario for Marine Data2024 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW)10.1109/EuroSPW61312.2024.00071(597-601)Online publication date: 8-Jul-2024
  • (2023)Replication of Computational Results Report for “Automatic Reuse, Adaption, and Execution of Simulation Experiments via Provenance Patterns”ACM Transactions on Modeling and Computer Simulation10.1145/357700733:1-2(1-3)Online publication date: 28-Feb-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Modeling and Computer Simulation
ACM Transactions on Modeling and Computer Simulation  Volume 33, Issue 1-2
April 2023
159 pages
ISSN:1049-3301
EISSN:1558-1195
DOI:10.1145/3572857
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 February 2023
Online AM: 27 September 2022
Accepted: 05 September 2022
Revised: 04 July 2022
Received: 20 August 2021
Published in TOMACS Volume 33, Issue 1-2

Permissions

Request permissions for this article.

Check for updates

Badges

Author Tags

  1. Simulation experiment
  2. simulation study
  3. reuse
  4. provenance
  5. graph patterns

Qualifiers

  • Research-article

Funding Sources

  • German Research Foundation (DFG)
  • European Research Council (ERC)

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)220
  • Downloads (Last 6 weeks)19
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Context, Composition, Automation, and Communication: The C2AC Roadmap for Modeling and SimulationACM Transactions on Modeling and Computer Simulation10.1145/367322634:4(1-51)Online publication date: 13-Aug-2024
  • (2024)Towards an Integrated Provenance Framework: A Scenario for Marine Data2024 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW)10.1109/EuroSPW61312.2024.00071(597-601)Online publication date: 8-Jul-2024
  • (2023)Replication of Computational Results Report for “Automatic Reuse, Adaption, and Execution of Simulation Experiments via Provenance Patterns”ACM Transactions on Modeling and Computer Simulation10.1145/357700733:1-2(1-3)Online publication date: 28-Feb-2023
  • (2023)NBSIMGEN: Jupyter Notebook Extension for Generating Simulation Experiments2023 Winter Simulation Conference (WSC)10.1109/WSC60868.2023.10408537(2884-2895)Online publication date: 10-Dec-2023
  • (2022)Validity in (Co-) SimulationSoftware Engineering and Formal Methods. SEFM 2022 Collocated Workshops10.1007/978-3-031-26236-4_17(193-199)Online publication date: 26-Sep-2022

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media