research-article

Powertrain control verification benchmark

Authors:

Jyotirmoy V. Deshmukh,

James Kapinski,

Ken ButtsAuthors Info & Claims

HSCC '14: Proceedings of the 17th international conference on Hybrid systems: computation and control

Pages 253 - 262

https://doi.org/10.1145/2562059.2562140

Published: 15 April 2014 Publication History

Abstract

Industrial control systems are often hybrid systems that are required to satisfy strict performance requirements. Verifying designs against requirements is a difficult task, and there is a lack of suitable open benchmark models to assess, evaluate, and compare tools and techniques. Benchmark models can be valuable for the hybrid systems research community, as they can communicate the nature and complexity of the problems facing industrial practitioners. We present a collection of benchmark problems from the automotive powertrain control domain that are focused on verification for hybrid systems; the problems are intended to challenge the research community while maintaining a manageable scale. We present three models of a fuel control system, each with a unique level of complexity, along with representative requirements in signal temporal logic (STL). We provide results obtained by applying a state of the art analysis tool to these models, and finally, we discuss challenge problems for the research community.

References

[1]

A. Agrawal, G. Simon, and G. Karsai. Semantic translation of simulink/stateflow models to hybrid automata using graph transformations. Electronic Notes in Theoretical Computer Science, 109:43--56, 2004.

Digital Library

[2]

M. Althoff. Reachability analysis of nonlinear systems using conservative polynomialization and non-convex sets. In Proc. of Hybrid Systems: Computation and Control, pages 173--182, 2013.

Digital Library

[3]

M. Althoff, O. Stursberg, and M. Buss. Computing reachable sets of hybrid systems using a combination of zonotopes and polytopes. Nonlinear Analysis: Hybrid Systems, 4(2):233--249, 2010.

[4]

R. Alur, T. Feder, and T. A. Henzinger. The benefits of relaxing punctuality. Journal of the ACM, 43(1):116--146, 1996.

Digital Library

[5]

R. Alur, T. Henzinger, and P.-H. Ho. Automatic symbolic verifcation of embedded systems. IEEE Transactions on Software Engineering, 22(3):181--201, March 1996.

Digital Library

[6]

Y. Annapureddy, C. Liu, G. Fainekos, and S. Sankaranarayanan. S-TaLiRo: A tool for temporal logic falsification for hybrid systems. In Proc. of Tools and Algorithms for the Construction and Analysis of Systems, pages 254--257, 2011.

Digital Library

[7]

G. Behrmann, R. David, and K. G. Larsen. A tutorial on UPPAAL. In Formal Methods for the Design of Real-time Systems, pages 200--236, 2004.

[8]

P. Caspi and A. Benveniste. Toward an approximation theory for computerised control. In Proc. of 2nd International Workshop on Embedded Software, 2002.

Digital Library

[9]

X. Chen, E. Abraham, and S. Sankaranarayanan. Flow*: An analyzer for non-linear hybrid systems. In Proc. of Computer Aided Verification, 2013.

Digital Library

[10]

J. A. Cook, J. Sun, J. H. Buckland, I. V. Kolmanovsky, H. Peng, and J. W. Grizzle. Automotive powertrain control - a survey. Asian Journal of Control, 8:237--260, 2006.

[11]

P. R. Crossley and J. A. Cook. A nonlinear engine model for drivetrain system development. In International Conference on Control, volume 2, pages 921--925, 1991.

[12]

A. Donzé and O. Maler. Robust satisfaction of temporal logic over real-valued signals. In Proc. of Formal modeling and analysis of timed systems, pages 92--106, 2010.

Digital Library

[13]

A. Donzé, O. Maler, E. Bartocci, D. Nickovic, R. Grosu, and S. A. Smolka. On temporal logic and signal processing. In Proc. of Automated Technology for Verification and Analysis, pages 92--106, 2012.

Digital Library

[14]

A. Eggers, N. Ramdani, N. Nedialkov, and M. Fränzle. Improving SAT modulo ODE for hybrid systems analysis by combining different enclosure methods. In Proc. of Software Engineering and Formal Methods, pages 172--187, 2011.

Digital Library

[15]

A. Fehnker and F. Ivancic. Benchmarks for hybrid systems verification. In Proc. of Hybrid Systems: Computation and Control, pages 326--341, 2004.

[16]

G. Frehse. PHAVer: algorithmic verification of hybrid systems past HyTech. International journal on Software Tools for Technology Transfer, 10(3):263--279, 2008.

Digital Library

[17]

G. Frehse, Z. Han, and B. Krogh. Assume-guarantee reasoning for hybrid i/o-automata by over-approximation of continuous interaction. In Proc. of IEEE Conf. on Decision and Control, volume 1, 2004.

[18]

G. Frehse, C. Le Guernic, A. Donzé, S. Cotton, R. Ray, O. Lebeltel, R. Ripado, A. Girard, T. Dang, and O. Maler. Spaceex: Scalable verification of hybrid systems. In Proc. of Computer Aided Verification, 2011.

Digital Library

[19]

A. Girard and G. J. Pappas. Approximate bisimulation: A bridge between computer science and control theory. European Journal of Control, 17(5-6):568--578, 2011.

[20]

L. Guzzella and C. Onder. Introduction to Modeling and Control of Internal Combustion Engine Systems. Springer-Verlag, 2nd edition edition, 2010.

[21]

T. A. Henzinger, P. W. Kopke, A. Puri, and P. Varaiya. What's Decidable about Hybrid Automata? Proc. of the ACM Symposium on Theory of Computing, 57(1):94--124, 1998.

Digital Library

[22]

H. Khalil. Nonlinear Systems. Prentice Hall PTR, 2002.

[23]

R. Koymans. Specifying real-time properties with metric temporal logic. Real-Time Systems, 2(4):255--299, 1990.

Digital Library

[24]

N. Lynch, R. Segala, and F. Vaandrager. Hybrid I/O automata. Information and Computation, 185(1):105--157, 2003.

Digital Library

[25]

K. Manamcheri, S. Mitra, S. Bak, and M. Caccamo. A step towards verification and synthesis from Simulink/Stateflow models. In Hybrid Systems: Computation and Control, 2011. 317--318, 2011.

Digital Library

[26]

Mathworks Automotive Advisory Board. Control Algorithm Modeling Guidelines Using MATLAB, Simulink, and Stateflow, 2012.

[27]

P. Prabhakar, G. E. Dullerud, and M. Viswanathan. Pre-orders for reasoning about stability. In Proc. of Hybrid Systems: Computation and Control, pages 197--206, 2012.

Digital Library

[28]

S. Sankaranarayanan and G. E. Fainekos. Falsification of temporal properties of hybrid systems using the cross-entropy method. In Proc. of Hybrid Systems: Computation and Control, pages 125--134, 2012.

Digital Library

[29]

A. A. Stotsky. Automotive Engines: Control, Estimation, Statistical Detection. Springer, 2009.

[30]

The MathWorks, Inc. Simulink User's Guide. Natick, MA, 2012.

Cited By

Kundu AGon SRay R(2024)Data-Driven Falsification of Cyber-Physical SystemsProceedings of the 17th Innovations in Software Engineering Conference10.1145/3641399.3641401(1-5)Online publication date: 22-Feb-2024
https://dl.acm.org/doi/10.1145/3641399.3641401
Lyu DZhang ZArcaini PIshikawa FLaurent TZhao JLi XHandl J(2024)Search-Based Repair of DNN Controllers of AI-Enabled Cyber-Physical Systems Guided by System-Level SpecificationsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654078(1435-1444)Online publication date: 14-Jul-2024
https://dl.acm.org/doi/10.1145/3638529.3654078
Formica FFan TRajhans APantelic VLawford MMenghi C(2024)Simulation-Based Testing of Simulink Models With Test Sequence and Test Assessment BlocksIEEE Transactions on Software Engineering10.1109/TSE.2023.334375350:2(239-257)Online publication date: Feb-2024
https://doi.org/10.1109/TSE.2023.3343753
Show More Cited By

Index Terms

Powertrain control verification benchmark

Recommendations

Automated verification of practical garbage collectors
POPL '09

Garbage collectors are notoriously hard to verify, due to their low-level interaction with the underlying system and the general difficulty in reasoning about reachability in graphs. Several papers have presented verified collectors, but either the ...
Automated verification of practical garbage collectors
POPL '09: Proceedings of the 36th annual ACM SIGPLAN-SIGACT symposium on Principles of programming languages

Garbage collectors are notoriously hard to verify, due to their low-level interaction with the underlying system and the general difficulty in reasoning about reachability in graphs. Several papers have presented verified collectors, but either the ...
Statistical Verification of the Toyota Powertrain Control Verification Benchmark
HSCC '17: Proceedings of the 20th International Conference on Hybrid Systems: Computation and Control

The Toyota Powertrain Control Verification Benchmark has been recently proposed as challenge problems that capture features of realistic automotive designs. In this paper we statistically verify the most complicated of the powertrain control models ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HSCC '14: Proceedings of the 17th international conference on Hybrid systems: computation and control

April 2014

328 pages

ISBN:9781450327329

DOI:10.1145/2562059

Program Chairs:
Martin Fráänzle
Carl von Ossietziky Universität Oldenburg, Germany
,
John Lygeros
ETH Zurich, Switzerland

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGBED: ACM Special Interest Group on Embedded Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HSCC'14

Sponsor:

SIGBED

HSCC'14: 17th International Conference on Hybrid Systems: Computation and Control

April 15 - 17, 2014

Berlin, Germany

Acceptance Rates

HSCC '14 Paper Acceptance Rate 29 of 69 submissions, 42%;

Overall Acceptance Rate 153 of 373 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

124
Total Citations
View Citations
581
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)5

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kundu AGon SRay R(2024)Data-Driven Falsification of Cyber-Physical SystemsProceedings of the 17th Innovations in Software Engineering Conference10.1145/3641399.3641401(1-5)Online publication date: 22-Feb-2024
https://dl.acm.org/doi/10.1145/3641399.3641401
Lyu DZhang ZArcaini PIshikawa FLaurent TZhao JLi XHandl J(2024)Search-Based Repair of DNN Controllers of AI-Enabled Cyber-Physical Systems Guided by System-Level SpecificationsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654078(1435-1444)Online publication date: 14-Jul-2024
https://dl.acm.org/doi/10.1145/3638529.3654078
Formica FFan TRajhans APantelic VLawford MMenghi C(2024)Simulation-Based Testing of Simulink Models With Test Sequence and Test Assessment BlocksIEEE Transactions on Software Engineering10.1109/TSE.2023.334375350:2(239-257)Online publication date: Feb-2024
https://doi.org/10.1109/TSE.2023.3343753
Yancosek JBaheri A(2024)BEACON: A Bayesian Evolutionary Approach for Counterexample Generation of Control SystemsIEEE Access10.1109/ACCESS.2024.343651512(106455-106465)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3436515
Formica FFan TMenghi C(2023)Search-Based Software Testing Driven by Automatically Generated and Manually Defined Fitness FunctionsACM Transactions on Software Engineering and Methodology10.1145/362474533:2(1-37)Online publication date: 23-Dec-2023
https://dl.acm.org/doi/10.1145/3624745
Song JXie XMa L(2023)SIEGE: A Semantics-Guided Safety Enhancement Framework for AI-enabled Cyber-Physical SystemsIEEE Transactions on Software Engineering10.1109/TSE.2023.3282981(1-23)Online publication date: 2023
https://doi.org/10.1109/TSE.2023.3282981
Boufaied CMenghi CBianculli DBriand L(2023)Trace Diagnostics for Signal-Based Temporal PropertiesIEEE Transactions on Software Engineering10.1109/TSE.2023.324258849:5(3131-3154)Online publication date: 1-May-2023
https://doi.org/10.1109/TSE.2023.3242588
Zhang ZLyu DArcaini PMa LHasuo IZhao J(2023)FalsifAI: Falsification of AI-Enabled Hybrid Control Systems Guided by Time-Aware Coverage CriteriaIEEE Transactions on Software Engineering10.1109/TSE.2022.319464049:4(1842-1859)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TSE.2022.3194640
Ghorbel BPrabhu V(2023)Quantitative Robustness for Signal Temporal Logic With Time-Freeze QuantifiersIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2023.328329642:12(4436-4449)Online publication date: Dec-2023
https://doi.org/10.1109/TCAD.2023.3283296
Takisaka TZhang ZArcaini PHasuo I(2023)A Robustness-Based Confidence Measure for Hybrid System FalsificationIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2022.320115742:5(1718-1731)Online publication date: May-2023
https://doi.org/10.1109/TCAD.2022.3201157
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents