research-article

Public Access

Non-Intrusive In-Situ Requirements Monitoring of Embedded System

Authors:

Roman LyseckyAuthors Info & Claims

ACM Transactions on Design Automation of Electronic Systems (TODAES), Volume 23, Issue 5

Article No.: 58, Pages 1 - 27

https://doi.org/10.1145/3206213

Published: 20 August 2018 Publication History

Abstract

Accounting for all operating conditions of a system at the design stage is typically infeasible for complex systems. Monitoring and verifying system requirements at runtime enable a system to continuously and introspectively ensure the system is operating correctly in the presence of dynamic execution scenarios. In this article, we present a requirements-driven methodology enabling efficient runtime monitoring of embedded systems. The proposed approach extracts a runtime monitoring graph from system requirements specified using UML sequence diagrams. Non-intrusive, on-chip hardware dynamically monitors the system execution, verifies the execution adheres to the requirements model, and in the event of a failure provides detailed information that can be analyzed to determine the root cause. Using case studies of an autonomous vehicle and pacemaker prototypes, we analyze the relationship between event coverage, detection rate, and hardware requirements

References

[1]

Altera Verification Tool. 2006. SignalTap II Embedded Logic Analyzer. Retrieved from http://www.altera.com/products/software/products/quartus2/verification/signaltap2/sig-index.html.

[2]

Rajeev Alur. 1999. Timed automata. In Computer Aided Verification. Springer, Berlin, 8--22.

Digital Library

[3]

Rico Backasch, Christian Hochberger, Alexander Weiss, Martin Leucker, and Richard Lasslop. 2013. Runtime verification for multicore soc with high-quality trace data. ACM Trans. Des. Autom. Electron. Syst. 18, 2 (March 2013), 1--26.

Digital Library

[4]

Tiller Beauchamp and David Weston. 2008. Dtrace: The Reverse Engineer's Unexpected Swiss Army Knife. Retrieved from http://www.poppopret.org/DTrace-Beauchamp-Weston.pdf.

[5]

Borzoo Bonakdarpour, Samaneh Navabpour, and Sebastian Fischmeister. 2011. Sampling-based runtime verification. In International Symposium on Formal Methods. Springer, 88--102.

Digital Library

[6]

Matthias Brill, Werner Damm, Jochen Klose, Bernd Westphal, and Hartmut Wittke. 2004. Live sequence charts. In Springer, Berlin, 374--399.

[7]

Powell Douglass Bruce. 1999. Real-Time UML: Developing Efficient Objects for Embedded Systems (2nd. ed.). Addison-Wesley.

[8]

Ming Chai and Bernd-Holger Schlingloff. 2014. Monitoring systems with extended live sequence charts. In Proceedings of the International Conference on Runtime Verification. Springer, 48--63.

[9]

Alexandre David. 2003. Hierarchical Modeling and Analysis of Timed Systems. Ph.D. Dissertation. Uppsala University.

[10]

N. Delgado, A. Q. Gates, and S. Roach. 2004. A taxonomy and catalog of runtime software-fault monitoring tools. IEEE Trans. Softw. Eng. 30, 12 (Dec. 2004), 859--872.

Digital Library

[11]

Bruce Powel Douglass. 2014. Real-time UML Workshop for Embedded Systems. Newnes.

Digital Library

[12]

Thomas Firley, Michaela Huhn, Karsten Diethers, Thomas Gehrke, and Ursula Goltz. 1999. Timed sequence diagrams and tool-based analysis—a case study. In Proceedings of the International Conference on the Unified Modeling Language. Springer, 645--660.

Digital Library

[13]

Richard Fryer. 2005. FPGA based CPU instrumentation for hard real-time embedded system testing. ACM SIGBED Rev. 2, 2 (2005), 39--42.

Digital Library

[14]

Sébastien Gérard and Bran Selic. 2008. The UML--MARTE Standardized profile. IFAC Proc. 41, 2 (2008), 6909--6913.

[15]

Brent Hailpern and Padmanabhan Santhanam. 2002. Software debugging, testing, and verification. IBM Syst. J. 41, 1 (2002), 4--12.

Digital Library

[16]

Richard Hofmann, Rainer Klar, Bernd Mohr, Andreas Quick, and Markus Siegle. 1994. Distributed performance monitoring: methods, tools, and applications. IEEE Trans. Parallel Distrib. Syst. 5, 6 (1994), 585--598.

Digital Library

[17]

Mike Jones. 1997. What really happened on mars rover pathfinder. Risks Dig. 19, 49 (1997), 1--2.

[18]

Aaron Kane, Omar Chowdhury, Anupam Datta, and Philip Koopman. 2015. A case study on runtime monitoring of an autonomous research vehicle (ARV) system. In Proceedings of the International Conference on Runtime Verification. Springer, 102--117.

[19]

Jong Chul Lee and Roman Lysecky. 2015. System-level observation framework for non-intrusive runtime monitoring of embedded systems. ACM Trans. Des. Autom. Electron. Syst. 20, 3 (Jun. 2015), 1--27.

Digital Library

[20]

Nancy G. Leveson and Clark S. Turner. 1993. An investigation of the Therac-25 accidents. Computer 26, 7 (1993), 18--41.

Digital Library

[21]

Hong Lu. 2007. The design and implementation of P2V, an architecture for zero-overhead online verification of software programs. Microsoft Research.

[22]

Shan Lu, Joseph Tucek, Feng Qin, and Yuanyuan Zhou. 2007. AVIO: Detecting atomicity violations via access-interleaving invariants. IEEE Micro 27, 1 (2007), 26--35.

Digital Library

[23]

Kerryn Macaulay. 1992. ATSB preliminary factual report, in-flight upset, Qantas Airbus A330, 154 Km West of Learmonth, WA, 7 October 2008. Australian Transport Safety Bureau Media Release, November 14 2008. (1992).

[24]

R. Mijat. 2010. Better trace for better software: Introducing the new arm coresight system trace macrocell and trace memory controller. ARM, White Paper (2010).

[25]

Niall Murphy and Michael Barr. 2001. Watchdog timers. Embed. Syst. Program. 14, 11 (2001), 79--80.

[26]

Ajay Nair and Roman Lysecky. 2008. Non-intrusive dynamic application profiler for detailed loop execution characterization. In Proceedings of the 2008 International Conference on Compilers, Architectures and Synthesis for Embedded Systems. ACM, 23--30.

Digital Library

[27]

Ajay Nair, Karthik Shankar, and Roman Lysecky. 2011. Efficient hardware-based nonintrusive dynamic application profiling. ACM Trans. Embed. Comput. Syst. 10, 3 (2011), 32.

Digital Library

[28]

Ahmed Nassar, Fadi J. Kurdahi, and Wael Elsharkasy. 2015. NUVA: Architectural support for runtime verification of parametric specifications over multicores. In Proceedings of the 2015 International Conference on Compilers, Architecture, and Synthesis for Embedded Systems (CASES’15), 137--146.

Digital Library

[29]

Samaneh Navabpour, Borzoo Bonakdarpour, and Sebastian Fischmeister. 2015. Time-triggered runtime verification of component-based multi-core systems. In Proceedings of the International Conference on Runtime Verification. Springer, 153--168.

[30]

Lee Pike, Sebastian Niller, and Nis Wegmann. 2011. Runtime verification for ultra-critical systems. In Proceedings of the International Conference on Runtime Verification. Springer, 310--324.

Digital Library

[31]

Amir Pnueli. 1977. The temporal logic of programs. In Proceedings of the 18th Annual Symposium on Foundations of Computer Science (SFCS’77). IEEE, 46--57.

Digital Library

[32]

Thomas Reinbacher, Matthias Függer, and Jörg Brauer. 2012. Real-time runtime verification on chip. In Proceedings of the International Conference on Runtime Verification. Springer, 110--125.

[33]

James Rumbaugh, Ivar Jacobson, and Grady Booch. 2005. The Unified Modeling Language Reference Manual. Addison-Wesley.

Digital Library

[34]

Mohammed El Shobaki. 2002. On-chip monitoring of single-and multiprocessor hardware real-time operating systems. In Proceedings of the 8th International Conference on Real-time Computing Systems and Applications (RTCSA’02).

[35]

Robert Skeel. 1992. Roundoff error and the patriot missile. SIAM News 25, 4 (1992), 11.

[36]

Neal Stollon. 2011. On-Chip Instrumentation. Springer, Boston, MA.

[37]

Michael Whalen, Darren Cofer, Steven Miller, Bruce H. Krogh, and Walter Storm. 2007. Integration of formal analysis into a model-based software development process. In Formal Methods for Industrial Critical Systems. Springer, Berlin, 68--84.

Digital Library

[38]

Xilinx Verification Tool. 2006. ChipScope Pro. Retrieved from http://www.xilinx.com/ise/optional_prod/cspro.htm.

[39]

Pin Zhou, Radu Teodorescu, and Yuanyuan Zhou. 2007. HARD: Hardware-assisted lockset-based race detection. In Proceedings of the International Symposium on High-Performance Computing Architecture. 121--132.

Digital Library

Cited By

de Melo CAshrafiamiri MSeo MKurdahi FDutt N(2024)SAFER: Safety Assurances for Emergent BehaviorIEEE Design & Test10.1109/MDAT.2023.332488741:4(17-25)Online publication date: Aug-2024
https://doi.org/10.1109/MDAT.2023.3324887
Amer WRakka MKarami RSeo MSaghir MKanj RKurdahi F(2023)Hardware Implementation and Evaluation of an Information Processing Factory2023 IFIP/IEEE 31st International Conference on Very Large Scale Integration (VLSI-SoC)10.1109/VLSI-SoC57769.2023.10321939(1-6)Online publication date: 16-Oct-2023
https://doi.org/10.1109/VLSI-SoC57769.2023.10321939
Georgsen RKøien G(2022)Serious Games with SysML: Gamifying Threat Modelling in a Small Business SettingINCOSE International Symposium10.1002/iis2.1290232:S2(119-132)Online publication date: 13-Sep-2022
https://doi.org/10.1002/iis2.12902
Show More Cited By

Index Terms

Non-Intrusive In-Situ Requirements Monitoring of Embedded System
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Embedded systems

Recommendations

Runtime monitoring and resolution of probabilistic obstacles to system goals
SEAMS '17: Proceedings of the 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

Software systems are deployed in environments that keep changing over time. They should therefore adapt to changing conditions in order to meet their requirements. The satisfaction rate of these requirements depends on the rate at which adverse ...
Runtime Monitoring and Resolution of Probabilistic Obstacles to System Goals

Software systems are deployed in environments that keep changing over time. They should therefore adapt to changing conditions to meet their requirements. The satisfaction rate of these requirements depends on the rate at which adverse conditions ...
A Lightweight Dynamic Performance Monitoring Framework for Embedded Systems
ICESS '09: Proceedings of the 2009 International Conference on Embedded Software and Systems

Traditional monitoring techniques are not suitable for embedded systems because they could incur significant overhead. This paper proposes a lightweight dynamic performance monitoring framework for embedded systems focusing on reducing the dynamic ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Design Automation of Electronic Systems

ACM Transactions on Design Automation of Electronic Systems Volume 23, Issue 5

September 2018

310 pages

ISSN:1084-4309

EISSN:1557-7309

DOI:10.1145/3268934

Editor:
Naehyuck Chang
Korea Advanced Institute of Science and Technology, Korea

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 20 August 2018

Accepted: 01 May 2018

Revised: 01 February 2018

Received: 01 October 2017

Published in TODAES Volume 23, Issue 5

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
453
Total Downloads

Downloads (Last 12 months)87
Downloads (Last 6 weeks)27

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

de Melo CAshrafiamiri MSeo MKurdahi FDutt N(2024)SAFER: Safety Assurances for Emergent BehaviorIEEE Design & Test10.1109/MDAT.2023.332488741:4(17-25)Online publication date: Aug-2024
https://doi.org/10.1109/MDAT.2023.3324887
Amer WRakka MKarami RSeo MSaghir MKanj RKurdahi F(2023)Hardware Implementation and Evaluation of an Information Processing Factory2023 IFIP/IEEE 31st International Conference on Very Large Scale Integration (VLSI-SoC)10.1109/VLSI-SoC57769.2023.10321939(1-6)Online publication date: 16-Oct-2023
https://doi.org/10.1109/VLSI-SoC57769.2023.10321939
Georgsen RKøien G(2022)Serious Games with SysML: Gamifying Threat Modelling in a Small Business SettingINCOSE International Symposium10.1002/iis2.1290232:S2(119-132)Online publication date: 13-Sep-2022
https://doi.org/10.1002/iis2.12902
Valente GFanni TSau CMascio TPomante LPalumbo F(2021)A Composable Monitoring System for Heterogeneous Embedded PlatformsACM Transactions on Embedded Computing Systems10.1145/346164720:5(1-34)Online publication date: 9-Jul-2021
https://dl.acm.org/doi/10.1145/3461647
Mettler MMueller-Gritschneder DSchlichtmann U(2020)A Distributed Hardware Monitoring System for Runtime Verification on Multi-Tile MPSoCsACM Transactions on Architecture and Code Optimization10.1145/343069918:1(1-25)Online publication date: 30-Dec-2020
https://dl.acm.org/doi/10.1145/3430699
Mettler MMueller-Gritschneder DSchlichtmann U(2020)Runtime Monitoring of Inter- and Intra-Thread Requirements on Embedded MPSoCs2020 33rd International Conference on VLSI Design and 2020 19th International Conference on Embedded Systems (VLSID)10.1109/VLSID49098.2020.00026(49-54)Online publication date: Jan-2020
https://doi.org/10.1109/VLSID49098.2020.00026
Muttillo VValente GPomante LPosadas HMerino JVillar E(2020)Run-time Monitoring and Trace Analysis Methodology for Component-based Embedded Systems Design Flow2020 23rd Euromicro Conference on Digital System Design (DSD)10.1109/DSD51259.2020.00029(117-125)Online publication date: Aug-2020
https://doi.org/10.1109/DSD51259.2020.00029
Valente GFanni TSau CDi Battista F(2020)Layering the monitoring action for improved flexibility and overhead control: work-in-progress2020 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS)10.1109/CODESISSS51650.2020.9244018(18-20)Online publication date: 20-Sep-2020
https://doi.org/10.1109/CODESISSS51650.2020.9244018
Seo MKurdahi F(2019)Efficient Tracing Methodology Using Automata ProcessorACM Transactions on Embedded Computing Systems10.1145/335820018:5s(1-18)Online publication date: 8-Oct-2019
https://dl.acm.org/doi/10.1145/3358200
Rambo EKadeed TErnst RSeo MKurdahi FDonyanavard Bde Melo CMaity BMoazzemi KStewart KYi SRahmani ADutt NMaurer FDoan NSurhonne AWild THerkersdorf A(2019)The information processing factoryProceedings of the International Conference on Hardware/Software Codesign and System Synthesis Companion10.1145/3349567.3357391(1-2)Online publication date: 13-Oct-2019
https://dl.acm.org/doi/10.1145/3349567.3357391

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents