End-to-End Schedulability of Virtualized Distributed Time-Triggered Systems
Pages 242 - 254
Abstract
In most distributed safety-critical applications, real-time tasks executing on multi-core multi-SoC platforms communicate critical messages over a deterministic communication backbone. Virtualization is increasingly used in such systems to enhance scalability and enforce spatial isolation while still maintaining the timing properties of critical tasks. Using time-triggered (TT) scheduling on the computation, the communication, and the virtualization layer enables strict end-to-end timing guarantees with tight latency and jitter bounds. In this paper, we introduce for the first time a formal system and scheduling model to harmonize these different layers of the global scheduling problem for virtualized distributed TT real-time systems. We also describe two offline algorithms to generate TT schedules for all layers that guarantee end-to-end latency requirements. The two schedulers offer trade-offs between schedule synthesis runtime and virtualization overhead. We derive synthetic benchmarks from real-world system properties to show the scalability and schedulability of our approaches.
References
[1]
Luca Abeni and Giorgio C. Buttazzo. 2004. Resource Reservation in Dynamic Real-Time Systems. Real Time Syst. 27, 2 (2004), 123–167.
[2]
Hamidreza Ahmadian, Roman Obermaisser, and Jon Perez. 2018. Distributed Real-Time Architecture for Mixed-Criticality Systems. CRC Press.
[3]
Benny Akesson, Mitra Nasri, Geoffrey Nelissen, Sebastian Altmeyer, and Robert I. Davis. 2022. A comprehensive survey of industry practice in real-time systems. Real Time Syst. 58, 3 (2022), 358–398.
[4]
Clark W. Barrett, Roberto Sebastiani, Sanjit A. Seshia, and Cesare Tinelli. 2009. Satisfiability Modulo Theories. In Handbook of Satisfiability, Armin Biere, Marijn Heule, Hans van Maaren, and Toby Walsh (Eds.). Frontiers in Artificial Intelligence and Applications, Vol. 185. IOS Press, 825–885.
[5]
Sanjoy K. Baruah and Gerhard Fohler. 2011. Certification-Cognizant Time-Triggered Scheduling of Mixed-Criticality Systems. In Proceedings of the 32nd IEEE Real-Time Systems Symposium, RTSS 2011, Vienna, Austria, November 29 - December 2, 2011. IEEE Computer Society, 3–12.
[6]
Mohammadreza Barzegaran and Paul Pop. 2023. The FORA European Training Network on Fog Computing for Robotics and Industrial Automation. In Design, Automation & Test in Europe Conference & Exhibition, DATE 2023, Antwerp, Belgium, April 17-19, 2023. IEEE, 1–6.
[7]
Matthias Becker, Dakshina Dasari, Saad Mubeen, Moris Behnam, and Thomas Nolte. 2016. Synthesizing Job-Level Dependencies for Automotive Multi-rate Effect Chains. In 22nd IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2016, Daegu, South Korea, August 17-19, 2016. IEEE Computer Society, 159–169.
[8]
Matthias Becker, Dakshina Dasari, Saad Mubeen, Moris Behnam, and Thomas Nolte. 2017. End-to-end timing analysis of cause-effect chains in automotive embedded systems. J. Syst. Archit. 80 (2017), 104–113.
[9]
Timothy Broomhead, Laurence Cremean, Julien Ridoux, and Darryl Veitch. 2010. Virtualize Everything but Time. In 9th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2010, October 4-6, 2010, Vancouver, BC, Canada, Proceedings, Remzi H. Arpaci-Dusseau and Brad Chen (Eds.). USENIX Association, 451–464. http://www.usenix.org/events/osdi10/tech/full_papers/Broomhead.pdf
[10]
Zhuo Cheng, Jinyun Xue, Haitao Zhang, Zhen You, Qimin Hu, and Yuto Lim. 2020. Scheduling Heterogeneous Multiprocessor Real-Time Systems with Mixed Sets of Task. In 14th IEEE International Conference on Service Oriented Systems Engineering, SOSE 2020, Oxford, UK, August 3-6, 2020. IEEE, 72–81.
[11]
Silviu S. Craciunas and Ramon Serna Oliver. 2016. Combined task- and network-level scheduling for distributed time-triggered systems. Real Time Systems 52, 2 (2016), 161–200.
[12]
Silviu S. Craciunas and Ramon Serna Oliver. 2021. Out-of-sync Schedule Robustness for Time-sensitive Networks. In 17th IEEE International Conference on Factory Communication Systems, WFCS 2021, Linz, Austria, June 9-11, 2021. IEEE, 75–82.
[13]
Silviu S. Craciunas, Ramon Serna Oliver, Martin Chmelík, and Wilfried Steiner. 2016. Scheduling Real-Time Communication in IEEE 802.1Qbv Time Sensitive Networks. In Proceedings of the 24th International Conference on Real-Time Networks and Systems, RTNS 2016, Brest, France, October 19-21, 2016, Alain Plantec, Frank Singhoff, Sébastien Faucou, and Luís Miguel Pinho (Eds.). ACM, 183–192.
[14]
Silviu S. Craciunas, Ramon Serna Oliver, and Valentin Ecker. 2014. Optimal static scheduling of real-time tasks on distributed time-triggered networked systems. In Proceedings of the 2014 IEEE Emerging Technology and Factory Automation, ETFA 2014, Barcelona, Spain, September 16-19, 2014, Antoni Grau and Herminio Martínez (Eds.). IEEE, 1–8.
[15]
Silviu S. Craciunas and Ramon Serna Oliver. 2017. An Overview of Scheduling Mechanisms for Time-sensitive Networks. Technical report, Real-time summer school L’École d’Été Temps Réel (ETR).
[16]
Alfons Crespo, Ismael Ripoll, and Miguel Masmano. 2010. Partitioned Embedded Architecture Based on Hypervisor: The XtratuM Approach. In Eighth European Dependable Computing Conference, EDCC-8 2010, Valencia, Spain, 28-30 April 2010. IEEE Computer Society, 67–72.
[17]
Leonardo Mendonça de Moura and Nikolaj S. Bjørner. 2011. Satisfiability modulo theories: introduction and applications. Commun. ACM 54, 9 (2011), 69–77.
[18]
Paul Emberson. [n. d.]. TaskGen v1.0. https://github.com/jlelli/taskgen.
[19]
Paul Emberson, Roger Stafford, and Robert I Davis. 2010. Techniques for the synthesis of multiprocessor tasksets. In Proceedings of the 1st International Workshop on Analysis Tools and Methodologies for Embedded and Real-time Systems (WATERS 2010). 6–11.
[20]
Rolf Ernst, Stefan Kuntz, Sophie Quinton, and Martin Simons. 2018. The Logical Execution Time Paradigm: New Perspectives for Multicore Systems (Dagstuhl Seminar 18092). Dagstuhl Reports 8, 2 (2018), 122–149.
[21]
Xiang Feng and A.K. Mok. 2002. A model of hierarchical real-time virtual resources. In 23rd IEEE Real-Time Systems Symposium, 2002. RTSS 2002.26–35.
[22]
Anaïs Finzi, Silviu S. Craciunas, and Marc Boyer. 2024. Integrating Sporadic Events in Time-triggered Systems via Affine Envelope Approximations. In 2024 IEEE 30th Real-Time and Embedded Technology and Applications Symposium (RTAS). 15–28.
[23]
Tom Fleming, Sanjoy K. Baruah, and Alan Burns. 2016. Improving the Schedulability of Mixed Criticality Cyclic Executives via Limited Task Splitting. In Proceedings of the 24th International Conference on Real-Time Networks and Systems, RTNS 2016, Brest, France, October 19-21, 2016, Alain Plantec, Frank Singhoff, Sébastien Faucou, and Luís Miguel Pinho (Eds.). ACM, 277–286.
[24]
Robert Kaiser Rudolf Fuchsen. 2005. Method for distributing computing time in a computer system. Patent No. 20090210879A1, Filed November 11st., 2005, Issued Aug. 20th., 2009.
[25]
Gautam Gala, Javier Castillo Rivera, and Gerhard Fohler. 2021. Work-in-Progress: Cloud Computing for Time-Triggered Safety-Critical Systems. In 42nd IEEE Real-Time Systems Symposium, RTSS 2021, Dortmund, Germany, December 7-10, 2021. IEEE, 516–519.
[26]
Gernot Heiser and Ben Leslie. 2010. The OKL4 microvisor: convergence point of microkernels and hypervisors. In Proceedings of the 1st ACM SIGCOMM Asia-Pacific Workshop on Systems, ApSys 2010, New Delhi, India, August 30, 2010, Chandramohan A. Thekkath, Ramakrishna Kotla, and Lidong Zhou (Eds.). ACM, 19–24.
[27]
IEEE. 2016. 802.1Qbv - Enhancements for Scheduled Traffic. https://standards.ieee.org/standard/802_1Qbv-2015.html. Accessed: 21.05.2024.
[28]
IEEE. 2016. Official Website of the 802.1 Time-Sensitive Networking Task Group. http://www.ieee802.org/1/pages/tsn.html. Accessed: 21.05.2024.
[29]
IEEE. 2020. IEEE Std 802.1AS-2020. https://standards.ieee.org/standard/802_1AS-2020.html. Accessed: 21.05.2024.
[30]
Haris Isakovic and Radu Grosu. 2016. A heterogeneous time-triggered architecture on a hybrid system-on-a-chip platform. In 25th IEEE International Symposium on Industrial Electronics, ISIE 2016, Santa Clara, CA, USA, June 8-10, 2016. IEEE, 244–253.
[31]
Damir Isovic and Gerhard Fohler. 2009. Handling mixed sets of tasks in combined offline and online scheduled real-time systems. Real Time Syst. 43, 3 (2009), 296–325.
[32]
Jan Jatzkowski, Marcio Kreutz, and Achim Rettberg. 2017. Hierarchical Multicore-Scheduling for Virtualization of Dependent Real-Time Systems. In System Level Design from HW/SW to Memory for Embedded Systems, Marcelo Götz, Gunar Schirner, Marco Aurélio Wehrmeister, Mohammad Abdullah Al Faruque, and Achim Rettberg (Eds.). Springer International Publishing, Cham, 103–115.
[33]
Robert Kaiser. 2008. Alternatives for scheduling virtual machines in real-time embedded systems. In Proceedings of the 1st Workshop on Isolation and Integration in Embedded Systems, IIES ’08, Glasgow, Scotland, April 1, 2008, Michael Engel and Olaf Spinczyk (Eds.). ACM, 5–10.
[34]
Timo Kerstan, Daniel Baldin, and Stefan Groesbrink. 2010. Full virtualization of real-time systems by temporal partitioning. In International Workshop on Operating Systems Platforms for Embedded Real-Time Applications. 24.
[35]
Hermann Kopetz. 1992. Sparse Time versus Dense Time in Distributed Real-Time Systems. In Proceedings of the 12th International Conference on Distributed Computing Systems, Yokohama, Japan, June 9-12, 1992. IEEE Computer Society, 460–467.
[36]
Hermann Kopetz and Günter Grünsteidl. 1993. TTP - A Time-Triggered Protocol for Fault-Tolerant Real-Time Systems. In Digest of Papers: FTCS-23, The Twenty-Third Annual International Symposium on Fault-Tolerant Computing, Toulouse, France, June 22-24, 1993. IEEE Computer Society, 524–533.
[37]
Hermann Kopetz and Wilfried Steiner. 2022. Real-Time Systems - Design Principles for Distributed Embedded Applications, Third Edition. Springer.
[38]
Simon Kramer, Dirk Ziegenbein, and Arne Hamann. 2015. Real world automotive benchmarks for free. In 6th International Workshop on Analysis Tools and Methodologies for Embedded and Real-time Systems (WATERS), Vol. 130.
[39]
Jaewoo Lee, Sisu Xi, Sanjian Chen, Linh T.X. Phan, Chris Gill, Insup Lee, Chenyang Lu, and Oleg Sokolsky. 2012. Realizing Compositional Scheduling through Virtualization. In 2012 IEEE 18th Real Time and Embedded Technology and Applications Symposium. 13–22.
[40]
Giuseppe Lipari and Enrico Bini. 2005. A methodology for designing hierarchical scheduling systems. J. Embedded Comput. 1, 2 (apr 2005), 257–269.
[41]
Martin Lukasiewycz, Reinhard Schneider, Dip Goswami, and Samarjit Chakraborty. 2012. Modular scheduling of distributed heterogeneous time-triggered automotive systems. In Proceedings of the 17th Asia and South Pacific Design Automation Conference, ASP-DAC 2012, Sydney, Australia, January 30 - February 2, 2012. IEEE, 665–670.
[42]
Martin Lukasiewycz, Reinhard Schneider, Dip Goswami, and Samarjit Chakraborty. 2012. Modular scheduling of distributed heterogeneous time-triggered automotive systems. In Proceedings of the 17th Asia and South Pacific Design Automation Conference, ASP-DAC 2012, Sydney, Australia, January 30 - February 2, 2012. IEEE, 665–670.
[43]
S.P. Marimuthu and S.C. Chakraborty. 2006. A Framework for Compositional and Hierarchical Real-Time Scheduling. In 12th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA’06). 91–96.
[44]
Shane D. McLean, Emil A. Juul Hansen, Paul Pop, and Silviu S. Craciunas. 2022. Configuring ADAS Platforms for Automotive Applications Using Metaheuristics. Frontiers in Robotics and AI 8 (2022), 353.
[45]
Ayhan Mehmed, Wilfried Steiner, and Maximilian Rosenblattl. 2017. A Time-Triggered Middleware for Safety-Critical Automotive Applications. In Ada-Europe.
[46]
Carlo Meroni, Silviu S. Craciunas, Anaïs Finzi, and Paul Pop. 2023. Mapping and Integration of Event- and Time-triggered Real-time Tasks on Partitioned Multi-core Systems. In 28th IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2023, Sinaia, Romania, September 12-15, 2023. IEEE, 1–8.
[47]
Anna Minaeva and Zdenek Hanzálek. 2022. Survey on Periodic Scheduling for Time-triggered Hard Real-time Systems. ACM Comput. Surv. 54, 1 (2022), 23:1–23:32.
[48]
Aloysius K. Mok, Alex Xiang Feng, and Deji Chen. 2001. Resource Partition for Real-Time Systems. In Proceedings of the 7th IEEE Real-Time Technology and Applications Symposium (RTAS 2001), 30 May - 1 June 2001, Taipei, Taiwan. IEEE Computer Society, 75–84.
[49]
Andreas Motzkus and Mehmet Oezer. 2016. PikeOS Safe Real-Time Scheduling: Adaptive Time-Partitioning Scheduler for EN 50128 certified Multi-Core Platforms. Technical Report. SYSGO. 6 pages. https://www.sysgo.com/whitepapers
[50]
Roman Obermaisser. 2009. Time-Triggered Communication. In Networked Embedded Systems - Volume 2 of the Embedded Systems Handbook, Richard Zurawski (Ed.). CRC Press, 14.
[51]
Ramon Serna Oliver and Silviu S. Craciunas. 2016. Hierarchical scheduling over off- and on-chip deterministic networks. SIGBED Rev. 13, 4 (2016), 14–19.
[52]
Ramon Serna Oliver, Silviu S. Craciunas, and Wilfried Steiner. 2018. IEEE 802.1Qbv Gate Control List Synthesis Using Array Theory Encoding. In IEEE Real-Time and Embedded Technology and Applications Symposium, RTAS 2018, 11-13 April 2018, Porto, Portugal, Rodolfo Pellizzoni (Ed.). IEEE Computer Society, 13–24.
[53]
Traian Pop, Petru Eles, and Zebo Peng. 2002. Holistic scheduling and analysis of mixed time/event-triggered distributed embedded systems. In Proceedings of the Tenth International Symposium on Hardware/Software Codesign, CODES 2002, Estes Park, Colorado, USA, May 6-8, 2002, Jörg Henkel, Xiaobo Sharon Hu, Rajesh Gupta, and Sri Parameswaran (Eds.). ACM, 187–192.
[54]
Traian Pop, Petru Eles, and Zebo Peng. 2003. Schedulability Analysis for Distributed Heterogeneous Time/Event Triggered Real-Time Systems. In 15th Euromicro Conference on Real-Time Systems (ECRTS 2003), 2-4 July 2003, Porto, Portugal, Proceedings. IEEE Computer Society, 257–266.
[55]
Traian Pop, Paul Pop, Petru Eles, Zebo Peng, and Alexandru Andrei. 2006. Timing Analysis of the FlexRay Communication Protocol. In 18th Euromicro Conference on Real-Time Systems, ECRTS’06, 5-7 July 2006, Dresden, Germany, Proceedings. IEEE Computer Society, 203–216.
[56]
Jan Ruh, Wilfried Steiner, and Gerhard Fohler. 2021. Clock Synchronization in Virtualized Distributed Real-Time Systems Using IEEE 802.1AS and ACRN. IEEE Access 9 (2021), 126075–126094.
[57]
Jan Ruh, Wilfried Steiner, and Gerhard Fohler. 2023. IEEE 802.1AS Multi-Domain Aggregation for Virtualized Distributed Real-Time Systems. In 53rd Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2023 - Supplemental Volume, Porto, Portugal, June 27-30, 2023. IEEE, 70–76.
[58]
Florian Sagstetter, Sidharta Andalam, Peter Waszecki, Martin Lukasiewycz, Hauke Stähle, Samarjit Chakraborty, and Alois C. Knoll. 2014. Schedule Integration Framework for Time-Triggered Automotive Architectures. In The 51st Annual Design Automation Conference 2014, DAC ’14, San Francisco, CA, USA, June 1-5, 2014. ACM, 20:1–20:6.
[59]
Insik Shin and Insup Lee. 2003. Periodic resource model for compositional real-time guarantees. In RTSS 2003. 24th IEEE Real-Time Systems Symposium, 2003. 2–13.
[60]
Insik Shin and Insup Lee. 2004. Compositional real-time scheduling framework. In 25th IEEE International Real-Time Systems Symposium. 57–67.
[61]
Wilfried Steiner. 2010. An Evaluation of SMT-Based Schedule Synthesis for Time-Triggered Multi-hop Networks. In Proceedings of the 31st IEEE Real-Time Systems Symposium, RTSS 2010, San Diego, California, USA, November 30 - December 3, 2010. IEEE Computer Society, 375–384.
[62]
Wilfried Steiner, Günther Bauer, Brendan Hall, and Michael Paulitsch. 2011. TTEthernet: Time-Triggered Ethernet. In Time-Triggered Comm.CRC Press.
[63]
Henrik Theiling. 2013. PikeOS and Time-Triggering. Technical Report. SYSGO. 6 pages. https://www.sysgo.com/whitepapers
[64]
Jia Xu and David Lorge Parnas. 2000. Priority Scheduling Versus Pre-Run-Time Scheduling. Real Time Syst. 18, 1 (2000), 7–23.
[65]
Jungwoo Yang, Hyungseok Kim, Sangwon Park, Changki Hong, and Insik Shin. 2011. Implementation of compositional scheduling framework on virtualization. SIGBED Rev. 8, 1 (mar 2011), 30–37.
[66]
Licong Zhang, Dip Goswami, Reinhard Schneider, and Samarjit Chakraborty. 2014. Task- and network-level schedule co-synthesis of Ethernet-based time-triggered systems. In 19th Asia and South Pacific Design Automation Conference, ASP-DAC 2014, Singapore, January 20-23, 2014. IEEE, 119–124.
Index Terms
- End-to-End Schedulability of Virtualized Distributed Time-Triggered Systems
Recommendations
An Evaluation of Time-triggered Scheduling in the Linux Kernel
RTNS '23: Proceedings of the 31st International Conference on Real-Time Networks and SystemsThe GNU/Linux operating system (OS) is becoming more commonly used in real-time systems and has been modified with specific updates to provide faster and bounded response times as well as with fixed- and dynamic-priority real-time scheduling ...
Combining Time-Triggered Plans with Priority Scheduled Task Sets
Proceedings of the 21st Ada-Europe International Conference on Reliable Software Technologies --- Ada-Europe 2016 - Volume 9695Time-triggered and concurrent priority-based scheduling are the two major approaches in use for real-time and embedded systems. Both approaches have their own advantages and drawbacks. On the one hand, priority-based systems facilitate separation of ...
Real-time scheduling in cloud-based virtualized software systems
NordiCloud '13: Proceedings of the Second Nordic Symposium on Cloud Computing & Internet TechnologiesThe number of applications that use virtualized cloud-based systems is growing, and one would like to use this kind of systems also for real-time applications with hard deadlines. There is scheduling on two levels in real-time applications executing in ...
Comments
Information & Contributors
Information
Published In
November 2024
326 pages
ISBN:9798400717246
DOI:10.1145/3696355
Copyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 03 January 2025
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
RTNS 2024
RTNS 2024: The 32nd International Conference on Real-Time Networks and Systems
November 6 - 8, 2024
Porto, Portugal
Acceptance Rates
Overall Acceptance Rate 119 of 255 submissions, 47%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 28Total Downloads
- Downloads (Last 12 months)28
- Downloads (Last 6 weeks)12
Reflects downloads up to 25 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in