research-article

Enabling Model Testing of Cyber-Physical Systems

Authors:

Carlos A. González,

Mojtaba Varmazyar,

Lionel C. Briand,

Yago IsasiAuthors Info & Claims

MODELS '18: Proceedings of the 21th ACM/IEEE International Conference on Model Driven Engineering Languages and Systems

Pages 176 - 186

https://doi.org/10.1145/3239372.3239409

Published: 14 October 2018 Publication History

Abstract

Applying traditional testing techniques to Cyber-Physical Systems (CPS) is challenging due to the deep intertwining of software and hardware, and the complex, continuous interactions between the system and its environment. To alleviate these challenges we propose to conduct testing at early stages and over executable models of the system and its environment. Model testing of CPSs is however not without difficulties. The complexity and heterogeneity of CPSs renders necessary the combination of different modeling formalisms to build faithful models of their different components. The execution of CPS models thus requires an execution framework supporting the cosimulation of different types of models, including models of the software (e.g., SysML), hardware (e.g., SysML or Simulink), and physical environment (e.g., Simulink). Furthermore, to enable testing in realistic conditions, the cosimulation process must be (1) fast, so that thousands of simulations can be conducted in practical time, (2) controllable, to precisely emulate the expected runtime behavior of the system and, (3) observable, by producing simulation data enabling the detection of failures. To tackle these challenges, we propose a SysML-based modeling methodology for model testing of CPSs, and an efficient SysML-Simulink cosimulation framework. Our approach was validated on a case study from the satellite domain.

References

[1]

An-jelo Gian C. Abad, Lady Mari Faeda G. Guerrero, Jasper Kendall M. Ignacio, Dianne C. Magtibay, Mark Angelo C. Purio, and Evelyn Q. Raguindin. 2015. A simulation of a power surge monitoring and suppression system using LabVIEW and multisim cosimulation tool. In Proceedings of the 8th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management, HNICEM 2015. 1--3.

[2]

Ahmad T. Al-Hammouri. 2012. A Comprehensive Co-simulation Platform for Cyber-physical Systems. Computer Communications 36, 1 (December 2012), 8--19.

Digital Library

[3]

Daniele Antonioli and Nils Ole Tippenhauer. 2015. MiniCPS: A Toolkit for Security Research on CPS Networks. In Proceedings of the 1st ACM Workshop on Cyber-Physical Systems-Security and/or PrivaCy, CPS-SPC 2015. 91--100.

Digital Library

[4]

D. Bian, M. Kuzlu, M. Pipattanasomporn, S. Rahman, and Y. Wu. 2015. Realtime co-simulation platform using OPAL-RT and OPNET for analyzing smart grid performance. In Proceedings of the IEEE Power & Energy Society General Meeting 2015. 1--5.

[5]

Mary Bone and Robert Cloutier. 2009. The current state of model based systems engineering: Results from the OMG SysML request for information 2009. In Proceedings of the 8th Conference on Systems Engineering Research. 225--232.

[6]

T. Brezina, Z. Hadas, and J. Vetiska. 2011. Using of Co-simulation ADAMS-SIMULINK for development of mechatronic systems. In Proceedings of the 14th International Conference Mechatronika. 59--64.

[7]

Lionel C. Briand, Shiva Nejati, Mehrdad Sabetzadeh, and Domenico Bianculli. 2016. Testing the untestable: model testing of complex software-intensive systems. In Proceedings of the 38th International Conference on Software Engineering, ICSE 2016. 789--792.

Digital Library

[8]

Christopher Brooks, Edward A. Lee, David Lorenzetti, Thierry S. Nouidui, and Michael Wetter. 2015. CyPhySim: A Cyber-physical Systems Simulator. In Proceedings of the 18th International Conference on Hybrid Systems: Computation and Control, HSCC 2015. 301--302.

Digital Library

[9]

W. Stuart Dols, Steven J. Emmerich, and Brian J. Polidoro. 2016. Coupling the multizone airflow and contaminant transport software CONTAM with EnergyPlus using co-simulation. Building Simulation 9, 4 (August 2016), 469--479.

[10]

J. Eker, J. W. Janneck, E. A. Lee, Jie Liu, Xiaojun Liu, J. Ludvig, S. Neuendorffer, S. Sachs, and Yuhong Xiong. 2003. Taming heterogeneity - the Ptolemy approach. Proc. IEEE 91, 1 (January 2003), 127--144.

[11]

Peter H. Feiler and David P. Gluch. 2012. Model-Based Engineering with AADL: An Introduction to the SAE Architecture Analysis & Design Language. Addison-Wesley Professional.

Digital Library

[12]

J. Fitzgerald, C. Gamble, P. G. Larsen, K. Pierce, and J. Woodcock. 2015. Cyber-Physical Systems Design: Formal Foundations, Methods and Integrated Tool Chains. In Proceedings of the 3rd FME Workshop on Formal Methods in Software Engineering, FormaliSE 2015. 40--46.

Digital Library

[13]

Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides. 1995. Design Patterns: Elements of Reusable Object-oriented Software. Addison-Wesley Longman Publishing Co., Inc.

Digital Library

[14]

H. Georg, S. C. Müller, C. Rehtanz, and C. Wietfeld. 2014. Analyzing Cyber-Physical Energy Systems:The INSPIRE Cosimulation of Power and ICT Systems Using HLA. IEEE Transactions on Industrial Informatics 10, 4 (November 2014), 2364--2373.

[15]

Cláudio Gomes, Casper Thule, David Broman, Peter Gorm Larsen, and Hans Vangheluwe. 2017. Co-simulation: State of the art. CoRR abs/1702.00686 (February 2017). arXiv:1702.00686

[16]

Carlos A. González, Mojtaba Varmazyar, Shiva Nejati, Lionel C. Briand, and Yago Isasi. 2018. A SysML-Based Approach for Model Testing of Cyber-Physical Systems. Tech. Rep. TR-SNT-2018--2. SnT Centre - University of Luxembourg.

[17]

Siddhartha Kumar Khaitan and James D. McCalley. 2015. Design Techniques and Applications of Cyberphysical Systems: A Survey. IEEE Systems Journal 9, 2 (June 2015), 350--365.

[18]

X. Koutsoukos, G. Karsai, A. Laszka, H. Neema, B. Potteiger, P. Volgyesi, Y. Vorobeychik, and J. Sztipanovits. 2018. SURE: A Modeling and Simulation Integration Platform for Evaluation of Secure and Resilient Cyber-Physical Systems. Proc. IEEE 106, 1 (January 2018), 93--112.

[19]

P. G. Larsen, J. Fitzgerald, J. Woodcock, P. Fritzson, J. Brauer, C. Kleijn, T. Lecomte, M. Pfeil, O. Green, S. Basagiannis, and A. Sadovykh. 2016. Integrated tool chain for model-based design of Cyber-Physical Systems: The INTO-CPS project. In Proceedings of the 2nd International Workshop on Modelling, Analysis, and Control of Complex CPS, CPS Data 2016. 1--6.

[20]

Peter Gorm Larsen, Kenneth Lausdahl, Nick Battle, John Fitzgerald, Sune Wolff, Shin Sahara, Marcel Verhoef, Peter W. V. Tran-Jørgensen, Tomohiro Oda, and Paul Chisholm. 2018. VDM-10 Language Manual.

[21]

E. Lee and S. Neuendorffer. 2004. Classes and subclasses in actor-oriented design. In Proceedings of the 2nd ACM and IEEE International Conference on Formal Methods and Models for Co-Design, MEMOCODE 2004. 161--168.

Digital Library

[22]

E. A. Lee, M. Niknami, T. S. Nouidui, and M. Wetter. 2015. Modeling and simulating cyber-physical systems using CyPhySim. In Proceedings of the 12th International Conference on Embedded Software, EMSOFT 2015. 115--124.

Digital Library

[23]

Edward Ashford Lee and Sanjit Arunkumar Seshia. 2017. Introduction to Embedded Systems: A Cyber-Physical Systems Approach, 2nd Edition. MIT Press.

[24]

Jane W. S. Liu. 2000. Real-Time Systems. Prentice Hall.

[25]

Phil McMinn. 2004. Search-based Software Test Data Generation: A Survey: Research Articles. Software Testing, Verification & Reliability 14, 2 (June 2004), 105--156.

Digital Library

[26]

Modelica Association. 2014. Functional Mock-up Interface for Model Exchange and Co-Simulation Version 2.0. https://svn.modelica.org/fmi/branches/public/specifications/v2.0/FMI_for_ModelExchange_and_CoSimulation_v2.0.pdf

[27]

OMG. 2017. Semantics of a Foundational Subset for Executable UML Models (fUML) 1.3 Specification. http://www.omg.org/spec/SysML/1.5/

[28]

OMG. 2017. Systems Modeling Language Specification (SysML). Version 1.5. http://www.omg.org/spec/SysML/1.5/

[29]

Ioannis Papaefstathiou, Gregory Chrysos, and Lambros Sarakis. 2015. COSSIM: A Novel, Comprehensible, Ultra-Fast, Security-Aware CPS Simulator. In 11th International Symposium on Applied Reconfigurable Computing, ARC 2015 (Lecture Notes in Computer Science), Vol. 9040. Springer, 542--553.

[30]

Maxime Perrotin, Eric Conquet, Julien Delange, André Schiele, and Thanassis Tsiodras. 2011. TASTE: A Real-Time Software Engineering Tool-Chain Overview, Status, and Future. In 15th International SDL Forum: Integrating System and Software Modeling, SDL 2011 (Lecture Notes in Computer Science), Vol. 7083. Springer Berlin Heidelberg, 26--37.

Digital Library

[31]

Claudius Ptolemaeus (Ed.). 2014. System Design, Modeling, and Simulation using Ptolemy II. Ptolemy.org. http://ptolemy.org/books/Systems

[32]

Ragunathan Rajkumar, Insup Lee, Lui Sha, and John A. Stankovic. 2010. Cyberphysical systems: the next computing revolution. In Proceedings of the 47th Design Automation Conference, DAC 2010. 731--736.

Digital Library

[33]

F. Schloegl, S. Rohjans, S. Lehnhoff, J. Velasquez, C. Steinbrink, and P. Palensky. 2015. Towards a classification scheme for co-simulation approaches in energy systems. In Proceedings of the 2015 International Symposium on Smart Electric Distribution Systems and Technologies, EDST 2015. 516--521.

[34]

Hesham Shokry and Mike Hinchey. 2009. Model-Based Verification of Embedded Software. IEEE Computer 42, 4 (April 2009), 53--59.

Digital Library

[35]

Janos Sztipanovits, Ted Bapty, Sandeep Neema, Larry Howard, and Ethan Jackson. 2014. OpenMETA: A Model- and Component-Based Design Tool Chain for Cyber-Physical Systems. In From Programs to Systems. The Systems perspective in Computing. ETAPS 2014 (Lecture Notes in Computer Science), Vol. 8415. Springer Berlin Heidelberg, 235--248.

[36]

ITU-T: Telecommunication and Standardization Sector of the International Telecommunication Union. 1999. Specification and Description Language (SDL): Reference Manual. https://www.itu.int/ITU-T/studygroups/com10/languages/Z.100_1199.pdf

[37]

ITU-T: Telecommunication and Standardization Sector of the International Telecommunication Union. 2002. Abstract Syntax Notation One (ASN.1): Specification of basic notation. https://www.itu.int/ITU-T/studygroups/com17/languages/X.680-0207.pdf

[38]

ITU-T: Telecommunication and Standardization Sector of the International Telecommunication Union. 2011. Message Sequence Chart (MSC): Recommendation ITU-T Z.120. https://www.itu.int/rec/T-REC-Z.120-201102-I

[39]

Casper Thule. 2016. Verifying the Co-Simulation Orchestration Engine for INTO-CPS. CEUR Workshop Proceedings 1744 (November 2016).

[40]

B. Wang and J. S. Baras. 2013. HybridSim: A Modeling and Co-simulation Toolchain for Cyber-physical Systems. In Proceedings of the 17th IEEE/ACM International Symposium on Distributed Simulation and Real Time Applications, DS-RT 2013. 33--40.

Digital Library

Cited By

Prochazka JProchazkova D(2024)Present Development of Software for Railway SafetyDESIGN, CONSTRUCTION, MAINTENANCE10.37394/232022.2024.4.34(19-28)Online publication date: 25-Jun-2024
https://doi.org/10.37394/232022.2024.4.3
Cederbladh JCicchetti ASuryadevara J(2024)Early Validation and Verification of System Behaviour in Model-based Systems Engineering: A Systematic Literature ReviewACM Transactions on Software Engineering and Methodology10.1145/363197633:3(1-67)Online publication date: 15-Mar-2024
https://dl.acm.org/doi/10.1145/3631976
Li JNejati SSabetzadeh M(2023)Using Genetic Programming to Build Self-Adaptivity into Software-Defined NetworksACM Transactions on Autonomous and Adaptive Systems10.1145/3616496Online publication date: 17-Aug-2023
https://dl.acm.org/doi/10.1145/3616496
Show More Cited By

Index Terms

Enabling Model Testing of Cyber-Physical Systems
1. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Model verification and validation
      2. Modeling methodologies

Recommendations

Towards Independent In-Cloud Evolution of Cyber-Physical Systems
CPSNA '14: Proceedings of the 2014 IEEE International Conference on Cyber-Physical Systems, Networks, and Applications

The capabilities of Cyber-Physical Systems (CPSs) are increasingly being extended towards new composite services deployed across a range of smart sensing and controlling devices. These services enable the emergence of multiple end-to-end cyber-physical ...
Towards a Unified Framework for Cyber-Physical Systems (CPS)
CDEE '10: Proceedings of the 2010 First ACIS International Symposium on Cryptography, and Network Security, Data Mining and Knowledge Discovery, E-Commerce and Its Applications, and Embedded Systems

Cyber-Physical Systems (CPS) integrate computation with physical processes. By merging computing and communication with physical processes CPS allows computer systems to monitor and interact with the physical world. However, today's computing and ...
DEECo: an ecosystem for cyber-physical systems
ICSE Companion 2014: Companion Proceedings of the 36th International Conference on Software Engineering

In this work we tackle the problem of designing and developing software-intensive cyber-physical systems (CPS), which are large distributed systems of collaborating elements that closely interact with the physical world, such as intelligent ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MODELS '18: Proceedings of the 21th ACM/IEEE International Conference on Model Driven Engineering Languages and Systems

October 2018

478 pages

ISBN:9781450349499

DOI:10.1145/3239372

Conference Chair:
Andrzej Wąsowski,
Program Chairs:
Richard Paige,
Øystein Haugen

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Industry Paper

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MODELS '18

Sponsor:

SIGSOFT

MODELS '18: ACM/IEEE 21th International Conference on Model Driven Engineering Languages and Systems

October 14 - 19, 2018

Copenhagen, Denmark

Acceptance Rates

MODELS '18 Paper Acceptance Rate 29 of 101 submissions, 29%;

Overall Acceptance Rate 144 of 506 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
468
Total Downloads

Downloads (Last 12 months)56
Downloads (Last 6 weeks)2

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Prochazka JProchazkova D(2024)Present Development of Software for Railway SafetyDESIGN, CONSTRUCTION, MAINTENANCE10.37394/232022.2024.4.34(19-28)Online publication date: 25-Jun-2024
https://doi.org/10.37394/232022.2024.4.3
Cederbladh JCicchetti ASuryadevara J(2024)Early Validation and Verification of System Behaviour in Model-based Systems Engineering: A Systematic Literature ReviewACM Transactions on Software Engineering and Methodology10.1145/363197633:3(1-67)Online publication date: 15-Mar-2024
https://dl.acm.org/doi/10.1145/3631976
Li JNejati SSabetzadeh M(2023)Using Genetic Programming to Build Self-Adaptivity into Software-Defined NetworksACM Transactions on Autonomous and Adaptive Systems10.1145/3616496Online publication date: 17-Aug-2023
https://dl.acm.org/doi/10.1145/3616496
Birchler CKhatiri SDerakhshanfar PPanichella SPanichella A(2023)Single and Multi-objective Test Cases Prioritization for Self-driving Cars in Virtual EnvironmentsACM Transactions on Software Engineering and Methodology10.1145/353381832:2(1-30)Online publication date: 4-Apr-2023
https://dl.acm.org/doi/10.1145/3533818
Ling XMenzies T(2023)What Not to Test (For Cyber-Physical Systems)IEEE Transactions on Software Engineering10.1109/TSE.2023.327230949:7(3811-3826)Online publication date: Jul-2023
https://doi.org/10.1109/TSE.2023.3272309
Jodat BNejati SSabetzadeh MSaavedra P(2023)Learning Non-robustness using Simulation-based Testing: a Network Traffic-shaping Case Study2023 IEEE Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST57152.2023.00043(386-397)Online publication date: Apr-2023
https://doi.org/10.1109/ICST57152.2023.00043
Zahid MBucaioni AFlammini F(2023)Trustworthiness-Related Risks in Autonomous Cyber-Physical Production Systems - A Survey2023 IEEE International Conference on Cyber Security and Resilience (CSR)10.1109/CSR57506.2023.10224955(440-445)Online publication date: 31-Jul-2023
https://doi.org/10.1109/CSR57506.2023.10224955
Birchler CKhatiri SBosshard BGambi APanichella S(2023)Machine learning-based test selection for simulation-based testing of self-driving cars softwareEmpirical Software Engineering10.1007/s10664-023-10286-y28:3Online publication date: 26-Apr-2023
https://dl.acm.org/doi/10.1007/s10664-023-10286-y
Mandrioli CMaggio M(2022)Testing Self-Adaptive Software With Probabilistic Guarantees on Performance Metrics: Extended and Comparative ResultsIEEE Transactions on Software Engineering10.1109/TSE.2021.310113048:9(3554-3572)Online publication date: 1-Sep-2022
https://doi.org/10.1109/TSE.2021.3101130
Munaro TMuntean I(2022)Early Assessment of System-Level Safety Mechanisms through Co-Simulation-based Fault Injection2022 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV51971.2022.9827327(1703-1708)Online publication date: 5-Jun-2022
https://doi.org/10.1109/IV51971.2022.9827327
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents