research-article

Evaluation and Improvements of Runtime Monitoring Methods for Real-Time Event Streams

Authors:

Alois KnollAuthors Info & Claims

ACM Transactions on Embedded Computing Systems (TECS), Volume 15, Issue 3

Article No.: 56, Pages 1 - 26

https://doi.org/10.1145/2890503

Published: 23 May 2016 Publication History

Abstract

Runtime monitoring is of great importance as a safeguard to guarantee the correctness of system runtime behaviors. Two state-of-the-art methods, dynamic counters and l-repetitive function, were recently developed to tackle the runtime monitoring for real-time systems. While both are reported to be efficient in monitoring arbitrary events, the monitoring performance between them has not yet been evaluated. This article evaluates both methods in depth, to identify their strengths and weaknesses. New methods are proposed to efficiently monitor the many-to-one connections that are abstracted as AND and OR components on multiple inputs. Representative scenarios are used as our case studies to quantitatively demonstrate the evaluations. Both methods are implemented in hardware Fpga. The timing overhead and resource usages of implementing the two methods are evaluated.

References

[1]

B. Bonakdarpour, S. Navabpour, and S. Fischmeister. 2011. Sampling-based runtime verification. In FM 2011: Formal Methods. Springer, 88--102.

Digital Library

[2]

B. Bonakdarpour, S. Navabpour, and S. Fischmeister. 2013. Time-triggered runtime verification. Formal Methods in System Design 43, 1 (2013), 29--60.

[3]

W. Haid and L. Thiele. 2007. Complex task activation schemes in system level performance analysis. In Hardware/Software Codesign and System Synthesis (CODES+ ISSS’07). IEEE, 173--178.

Digital Library

[4]

R. Henia, A. Hamann, M. Jersak, R. Racu, K. Richter, and R. Ernst. 2005. System level performance analysis - the SymTA/S approach. In Computers and Digital Techniques. IEEE, 148--166.

[5]

K. Huang, G. Chen, C. Buckl, and A. Knoll. 2012. Conforming the runtime inputs for hard real-time embedded systems. In Design Automation Conference (DAC’12). ACM, 430--436.

Digital Library

[6]

M. Jersak. 2005. Compositional Performance Analysis for Complex Embedded Applications. Ph.D. Dissertation. University of Braunschweig-Institute of Technology.

[7]

M. Jersak and R. Ernst. 2003. Enabling scheduling analysis of heterogeneous systems with multi-rate data dependencies and rate intervals. In Design Automation Conference (DAC’03). ACM, 454--459.

Digital Library

[8]

K. Lampka, K. Huang, and J.-J. Chen. 2011. Dynamic counters and the efficient and effective online power management of embedded real-time systems. In Hardware/Software Codesign and System Synthesis (CODES+ ISSS’11). ACM, 267--276.

Digital Library

[9]

K. Lampka, S. Perathoner, and L. Thiele. 2009. Analytic real-time analysis and timed automata: A hybrid method for analyzing embedded real-time systems. In ACM International Conference on Embedded Software (EMSOFT’09). ACM, 107--116.

Digital Library

[10]

K. Lampka, S. Perathoner, and L. Thiele. 2010. Analytic real-time analysis and timed automata: A hybrid methodology for the performance analysis of embedded real-time systems. Design Automation for Embedded Systems 14, 3 (2010), 193--227.

Digital Library

[11]

J.-Y. Le Boudec and P. Thiran. 2001. Network Calculus: A Theory of Deterministic Queuing Systems for the Internet. Vol. 2050. Springer.

Digital Library

[12]

R. Medhat, B. Bonakdarpour, D. Kumar, and S. Fischmeister. 2015. Runtime monitoring of cyber-physical systems under timing and memory constraints. ACM Transactions on Embedded Computing Systems (TECS) 14, 4 (2015), 79.

Digital Library

[13]

R. Medhat, D. Kumar, B. Bonakdarpour, and S. Fischmeister. 2014. Sacrificing a little space can significantly improve monitoring of time-sensitive cyber-physical systems. In Cyber-Physical Systems (ICCPS’14). IEEE, 115--126.

Digital Library

[14]

M. Neukirchner, P. Axer, T. Michaels, and R. Ernst. 2013a. Monitoring of workload arrival functions for mixed-criticality systems. In Real-Time Systems Symposium (RTSS’13). IEEE, 88--96.

Digital Library

[15]

M. Neukirchner, T. Michaels, P. Axer, S. Quinton, and R. Ernst. 2012. Monitoring arbitrary activation patterns in real-time systems. In Real-Time Systems Symposium (RTSS’12). IEEE, 293--302.

Digital Library

[16]

M. Neukirchner, S. Quinton, R. Ernst, and K. Lampka. 2013b. Multi-mode monitoring for mixed-criticality real-time systems. In Hardware/Software Codesign and System Synthesis (CODES-ISSS’13). ACM, 1--10.

Digital Library

[17]

S. Perathoner, E. Wandeler, L. Thiele, A. Hamann, S. Schliecker, R. Henia, R. Racu, R. Ernst, and M. G. Harbour. 2009. Influence of different abstractions on the performance analysis of distributed hard real-time systems. Design Automation for Embedded Systems 13, 1--2 (2009), 27--49.

Digital Library

[18]

L. T. X. Phan and I. Lee. 2013. Improving schedulability of fixed-priority real-time systems using shapers. In Real-Time and Embedded Technology and Applications Symposium (RTAS’13). IEEE, 217--226.

Digital Library

[19]

K. Richter, M. Jersak, and R. Ernst. 2003a. A formal approach to MpSoC performance verification. Computer 36, 4 (2003), 60--67.

Digital Library

[20]

K. Richter, R. Racu, and R. Ernst. 2003b. Scheduling analysis integration for heterogeneous multiprocessor SoC. In Real-Time Systems Symposium (RTSS’03). IEEE, 236--245.

Digital Library

[21]

L. Thiele, S. Chakraborty, and M. Naedele. 2000. Real-time calculus for scheduling hard real-time systems. In International Symposium on Circuits and Systems. IEEE, 101--104.

[22]

K. W. Tindell, A. Burns, and A. J. Wellings. 1994. An extendible approach for analyzing fixed priority hard real-time tasks. Real-Time Systems 6, 2 (1994), 133--151.

Digital Library

[23]

E. Wandeler. 2006. Modular Performance Analysis and Interface-Based Design for Embedded Real-Time Systems. Ph.D. Dissertation. ETH Zurich, Swiss.

[24]

E. Wandeler, A. Maxiaguine, and L. Thiele. 2012. On the use of greedy shapers in real-time embedded systems. ACM Transactions on Embedded Computing Systems (TECS) 11, 1 (2012), 1.

Digital Library

Cited By

Zhou MCheng LDell’Antonio MWang XBing ZNasseri MHuang KKnoll A(2018)Peak Temperature Minimization for Hard Real-Time Systems Using DVS and DPMJournal of Circuits, Systems and Computers10.1142/S0218126619501020(1950102)Online publication date: 19-Jul-2018
https://doi.org/10.1142/S0218126619501020
Hu BHuang KChen GCheng LKnoll A(2017)Online workload monitoring with the feedback of actual execution time for real-time systemsProceedings of the Conference on Design, Automation & Test in Europe10.5555/3130379.3130564(764-769)Online publication date: 27-Mar-2017
https://dl.acm.org/doi/10.5555/3130379.3130564
Hu BHuang KChen GCheng LKnoll A(2017)Online workload monitoring with the feedback of actual execution time for real-time systemsDesign, Automation & Test in Europe Conference & Exhibition (DATE), 201710.23919/DATE.2017.7927092(764-769)Online publication date: Mar-2017
https://doi.org/10.23919/DATE.2017.7927092
Show More Cited By

Index Terms

Evaluation and Improvements of Runtime Monitoring Methods for Real-Time Event Streams
1. Computer systems organization
  1. Embedded and cyber-physical systems
  2. Real-time systems

Recommendations

Runtime verification of real-time embedded systems
EMSOFT '12: Proceedings of the tenth ACM international conference on Embedded software

Time-triggered runtime verification aims at tackling two defects associated with runtime overhead: unboundedness and unpredictability. In this approach, a monitor runs in parallel with the program under inspection and periodically samples the program ...
Partially Evaluating Finite-State Runtime Monitors Ahead of Time

Finite-state properties account for an important class of program properties, typically related to the order of operations invoked on objects. Many library implementations therefore include manually written finite-state monitors to detect violations of ...
A Runtime-Monitoring-Based Dependable Software Construction Method
ICYCS '08: Proceedings of the 2008 The 9th International Conference for Young Computer Scientists

Software runtime monitoring mechanisms can be used to increase the dependability of software systems. However, it is a complex and burdensome job for developers to rebuild existing software systems by adding software runtime monitoring mechanism. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Embedded Computing Systems

ACM Transactions on Embedded Computing Systems Volume 15, Issue 3

July 2016

520 pages

ISSN:1539-9087

EISSN:1558-3465

DOI:10.1145/2899033

Editor:
Sandeep K. Shukla
Indian Institute of Technology, India

Issue’s Table of Contents

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 23 May 2016

Accepted: 01 February 2016

Revised: 01 January 2016

Received: 01 April 2015

Published in TECS Volume 15, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

China Scholarship Council, German BMBF project ECU
China SYSU “the Fundamental Research Funds for the Central Universities”

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
158
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou MCheng LDell’Antonio MWang XBing ZNasseri MHuang KKnoll A(2018)Peak Temperature Minimization for Hard Real-Time Systems Using DVS and DPMJournal of Circuits, Systems and Computers10.1142/S0218126619501020(1950102)Online publication date: 19-Jul-2018
https://doi.org/10.1142/S0218126619501020
Hu BHuang KChen GCheng LKnoll A(2017)Online workload monitoring with the feedback of actual execution time for real-time systemsProceedings of the Conference on Design, Automation & Test in Europe10.5555/3130379.3130564(764-769)Online publication date: 27-Mar-2017
https://dl.acm.org/doi/10.5555/3130379.3130564
Hu BHuang KChen GCheng LKnoll A(2017)Online workload monitoring with the feedback of actual execution time for real-time systemsDesign, Automation & Test in Europe Conference & Exhibition (DATE), 201710.23919/DATE.2017.7927092(764-769)Online publication date: Mar-2017
https://doi.org/10.23919/DATE.2017.7927092
Hu BHuang KHuang PThiele LKnoll A(2016)On-the-fly fast overrun budgeting for mixed-criticality systemsProceedings of the 13th International Conference on Embedded Software10.1145/2968478.2968491(1-10)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1145/2968478.2968491
Hu BHuang KChen GCheng LKnoll A(2016)Adaptive Workload Management in Mixed-Criticality SystemsACM Transactions on Embedded Computing Systems10.1145/295005816:1(1-27)Online publication date: 13-Oct-2016
https://dl.acm.org/doi/10.1145/2950058

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents