Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1109/MEMCOD.2014.6961854acmconferencesArticle/Chapter ViewAbstractPublication PagesmemocodeConference Proceedingsconference-collections
Article

Formal property verification in a conformance testing framework

Published: 01 October 2014 Publication History

Abstract

In model-based design of cyber-physical systems, such as switched mixed-signal circuits or software-controlled physical systems, it is common to develop a sequence of system models of different fidelity and complexity, each appropriate for a particular design or verification task. In such a sequence, one model is often derived from the other by a process of simplification or implementation. E.g. a Simulink model might be implemented on an embedded processor via automatic code generation. Three questions naturally present themselves: how do we quantify closeness between the two systems? How can we measure such closeness? If the original system satisfies some formal property, can we automatically infer what properties are then satisfied by the derived model? This paper addresses all three questions: we quantify the closeness between original and derived model via a distance measure between their outputs. We then propose two computational methods for approximating this closeness measure. Finally, we derive syntactical re-writing rules which, when applied to a Metric Temporal Logic specification satisfied by the original model, produce a formula satisfied by the derived model. We demonstrate the soundness of the theory with several experiments.

References

[1]
A. Abate and M. Prandini. Approximate abstractions of stochastic systems: A randomized method. In Decision and Control and European Control Conference (CDC-ECC), 2011 50th IEEE Conference on, pages 4861-4866, 2011.
[2]
H. Abbas, B. Hoxha, G. Fainekos, J. V. Deshmukh, J. Kapinski, and K. Ueda. Conformance testing as falsification for cyber-physical systems. Technical Report arXiv:1401.5200, January 2014.
[3]
H. Abbas, B. Hoxha, G. Fainekos, J. V. Deshmukh, J. Kapinski, and K. Ueda. Work in progress: Conformance testing as falsification for cyber-physical systems. In Cyber-Physical Systems, 2014 IEEE Intl. Conference on, April 2014.
[4]
H. Abbas, H. Mittelmann, and G. Fainekos. Formal property verification in a conformance testing framework. [Online at: http://www.public.asu.edu/~hyabbas/techreports/MEMOCODE14TechRpt.pdf], 2014.
[5]
M. Anand, S. Fischmeister, Y. Hur, J. Kim, and I. Lee. Generating reliable code from hybrid-systems models. Computers, IEEE Transactions on, 59(9):1281-1294, Sept 2010.
[6]
Y. S. R. Annapureddy, C. Liu, G. E. Fainekos, and S. Sankaranarayanan. S-taliro: A tool for temporal logic falsification for hybrid systems. In Tools and algorithms for the construction and analysis of systems, volume 6605 of LNCS, pages 254-257. Springer, 2011.
[7]
S. Bensalem, A. Legay, and M. Bozga. Rigorous embedded design: challenges and perspectives. STTT, 15(3):149-154, 2013.
[8]
N. Bombieri, F. Fummi, G. Pravadelli, and J. Marques-Silva. Towards equivalence checking between TLM and RTL models. In Proceedings of the 5th IEEE/ACM MEMOCODE, pages 113-122, Washington, DC, USA, 2007.
[9]
H. Brandl, M. Weiglhofer, and B. K. Aichernig. Automated conformance verification of hybrid systems. In Quality Software (QSIC), 10th International Conference on, pages 3-12. IEEE, 2010.
[10]
S. Burden, H. Gonzales, R. Vasudevan, R. Bajcsy, and S. S. Sastry. Metrization and simulation of controlled hybrid systems. Technical Report arXiv:1302.4402, February 2013.
[11]
K. Butts. Presentation: Toyota's direction. [Online at: http://cmacs.cs.cmu.edu/presentations/verif_csystems/06_KenButts.pdf], 2010.
[12]
P. Caspi and A. Benveniste. Toward an approximation theory for computerized control. In Embedded Software, volume 2491 of LNCS, pages 294-304. Springer, 2002.
[13]
H. Choset, K. M. Lynch, S. Hutchinson, G. A. Kantor, W. Burgard, L. E. Kavraki, and S. Thrun. Principles of Robot Motion: Theory, Algorithms, and Implementation. MIT Press, 2005.
[14]
T. Dang and T. Nahhal. Coverage-guided test generation for continuous and hybrid systems. Formal Methods in System Design, 34(2):183-213, 2009.
[15]
J. Davoren. Epsilon-tubes and generalized skorokhod metrics for hybrid paths spaces. In R. Majumdar and P. Tabuada, editors, Hybrid Systems: Computation and Control, volume 5469 of Lecture Notes in Computer Science, pages 135-149. Springer Berlin Heidelberg, 2009.
[16]
G. Di Guglielmo, M. Fujita, F. Fummi, G. Pravadelli, and S. Soffia. EFSM-based model-driven approach to concolic testing of system-level design. In 9th IEEE/ACM MEMOCODE, pages 201-209, July 2011.
[17]
G. Frehse, C. L. Guernic, A. Donz, S. Cotton, R. Ray, O. Lebeltel, R. Ripado, A. Girard, T. Dang, and O. Maler. Spaceex: Scalable verification of hybrid systems. In Proceedings of the 23d CAV, 2011.
[18]
G. Funchal and M. Moy. Modeling of time in discrete-event simulation of systems-on-chip. In 9th IEEE/ACM MEMOCODE, pages 171-180, July 2011.
[19]
A. Girard, A. Julius, and G. Pappas. Approximate simulation relations for hybrid systems. Discrete Event Dynamic Systems, 18(2):163-179, 2008.
[20]
A. Girard and G. J. Pappas. Approximate bisimulations for nonlinear dynamical systems. In Proceedings of 44th IEEE Conference on Decision and Control and European Control Conference, pages 684-689, 2005.
[21]
R. Goebel, R. G. SanFelice, and A. R. Teel. Hybrid Dynamical Systems: modeling, stability and robustness. Princeton University Press, 2012.
[22]
R. Goebel and A. Teel. Solutions to hybrid inclusions via set and graphical convergence with stability theory applications. Automatica, 42(4):573-587, 2006.
[23]
R. J. Hanson and D. C. Sorensen. Model reduction of dynamical systems for real time control. [Online at: http://www.caam.rice.edu/~modelreduction/mission.html].
[24]
J. Huang, J. Voeten, and M. Geilen. Real-time property preservation in approximations of timed systems. In Formal Methods and Models for Co-Design, 2003. MEMOCODE '03. Proceedings. First ACM and IEEE International Conference on, pages 163-171, June 2003.
[25]
K. H. Johansson, J. Lygeros, S. Sastry, and M. Egerstedt. Simulation of hybrid zeno automata. In Conference on Decision and Control, volume 4, pages 3538-3543, December 1999.
[26]
A. Julius and G. Pappas. Approximate equivalence and approximate synchronization of metric transition systems. In Decision and Control, 2006 45th IEEE Conference on, pages 905-910, Dec 2006.
[27]
A. A. Julius, G. Fainekos, M. Anand, I. Lee, and G. Pappas. Robust test generation and coverage for hybrid systems. In Hybrid Systems: Computation and Control, volume 4416 of LNCS, pages 329-342. Springer-Verlag Berlin Heidelberg, 2007.
[28]
S. Karaman and E. Frazzoli. Sampling-based algorithms for optimal motion planning. I. J. Robotic Res., 30(7):846-894, 2011.
[29]
R. Koymans. Specifying real-time properties with metric temporal logic. Real-Time Systems, 2(4):255-299, 1990.
[30]
R. Majumdar, I. Saha, K. Ueda, and H. Yazarel. Compositional equivalence checking for models and code of control systems. In Decision and Control (CDC), 2013 IEEE 52nd Annual Conference on, pages 1564-1571, Dec 2013.
[31]
R. Majumdar, I. Saha, and Z. Wang. Systematic testing for control applications. In 8th IEEE/ACM MEMOCODE, pages 1-10, July 2010.
[32]
L. V. Nguyen and T. J. Johnson. Benchmark: DC-to-DC switched-mode power converters (buck converters, boost converters and buckboost converters). In ARCH 2014. 2014.
[33]
M. Osch. Hybrid input-output conformance and test generation. In K. Havelund, M. Nez, G. Rou, and B. Wolff, editors, Formal Approaches to Software Testing and Runtime Verification, volume 4262 of Lecture Notes in Computer Science, pages 70-84. Springer Berlin Heidelberg, 2006.
[34]
A. Platzer and J.-D. Quesel. KeYmaera: A hybrid theorem prover for hybrid systems. In A. Armando, P. Baumgartner, and G. Dowek, editors, International Joint Conference on Automated Reasoning, volume 5195 of LNCS, pages 171-178. Springer, 2008.
[35]
J.-D. Quesel. Similarity, Logic, and Games: Bridging Modeling Layers of Hybrid Systems. PhD thesis, Carl Von Ossietzky Universitat Oldenburg, July 2013.
[36]
A. Saadat. Defect information report. [Online at: http://www-odi.nhtsa.dot.gov/acms/cs/jaxrs/download/doc/UCM450071/RCDNN-14V053-0945.PDF], 2014.
[37]
R. G. Sanfelice. Interconnections of hybrid systems: Some challenges and recent results. Journal of Nonlinear Systems and Applications, 2(1-2):111-121, 2011.
[38]
J.-P. Talpin, P. Guernic, S. Shukla, and R. Gupta. A compositional behavioral modeling framework for embedded system design and conformance checking. International Journal of Parallel Programming, 33(6):613-643, 2005.
[39]
J. Tretmans. Testing concurrent systems: A formal approach. In CONCUR 1999 Concurrency Theory, pages 46-65. Springer, 1999.
[40]
Y. Watanabe and S. Swan. Clearing the clutter: Unified modeling and verification methodology for system level hardware design. In 10th IEEE/ACM MEMOCODE, pages 21-23, July 2012.
[41]
M. Woehrle, K. Lampka, and L. Thiele. Conformance testing for cyberphysical systems. ACM Trans. Embed. Comput. Syst., 11(4):84:1-84:23, Jan. 2013.
[42]
J. Zhang, K. Johansson, J. Lygeros, and S. Sastry. Dynamical systems revisited: Hybrid systems with zeno executions. In N. Lynch and B. Krogh, editors, HSCC, volume 1790 of Lecture Notes in Computer Science, pages 451-464. Springer Berlin Heidelberg, 2000.
[43]
Ziena. KNITRO. [Online at: http://www.ziena.com].

Cited By

View all
  • (2024)FaMoS– Fast Model Learning for Hybrid Cyber-Physical Systems using Decision TreesProceedings of the 27th ACM International Conference on Hybrid Systems: Computation and Control10.1145/3641513.3650131(1-10)Online publication date: 14-May-2024
  • (2022)Temporal Robustness of Temporal Logic Specifications: Analysis and Control DesignACM Transactions on Embedded Computing Systems10.1145/355007222:1(1-44)Online publication date: 29-Oct-2022
  • (2022)Discovering IoT Physical Channel VulnerabilitiesProceedings of the 2022 ACM SIGSAC Conference on Computer and Communications Security10.1145/3548606.3560644(2415-2428)Online publication date: 7-Nov-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MEMOCODE '14: Proceedings of the Twelfth ACM/IEEE Conference on Formal Methods and Models for Codesign
October 2014
231 pages
ISBN:9781479953387

Sponsors

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 October 2014

Check for updates

Qualifiers

  • Article

Acceptance Rates

Overall Acceptance Rate 34 of 82 submissions, 41%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)FaMoS– Fast Model Learning for Hybrid Cyber-Physical Systems using Decision TreesProceedings of the 27th ACM International Conference on Hybrid Systems: Computation and Control10.1145/3641513.3650131(1-10)Online publication date: 14-May-2024
  • (2022)Temporal Robustness of Temporal Logic Specifications: Analysis and Control DesignACM Transactions on Embedded Computing Systems10.1145/355007222:1(1-44)Online publication date: 29-Oct-2022
  • (2022)Discovering IoT Physical Channel VulnerabilitiesProceedings of the 2022 ACM SIGSAC Conference on Computer and Communications Security10.1145/3548606.3560644(2415-2428)Online publication date: 7-Nov-2022
  • (2022)Temporal Robustness of Stochastic SignalsProceedings of the 25th ACM International Conference on Hybrid Systems: Computation and Control10.1145/3501710.3519504(1-11)Online publication date: 4-May-2022
  • (2022)A Framework for Identification and Validation of Affine Hybrid Automata from Input-Output TracesACM Transactions on Cyber-Physical Systems10.1145/34704556:2(1-24)Online publication date: 11-Apr-2022
  • (2021)Probabilistic conformance for cyber-physical systemsProceedings of the ACM/IEEE 12th International Conference on Cyber-Physical Systems10.1145/3450267.3450534(55-66)Online publication date: 19-May-2021
  • (2019)Model Conformance for Cyber-Physical SystemsACM Transactions on Cyber-Physical Systems10.1145/33061573:3(1-26)Online publication date: 20-Aug-2019
  • (2018)Quantitative monitoring of STL with edit distanceFormal Methods in System Design10.1007/s10703-018-0319-x53:1(83-112)Online publication date: 1-Aug-2018
  • (2017)Hyperproperties of real-valued signalsProceedings of the 15th ACM-IEEE International Conference on Formal Methods and Models for System Design10.1145/3127041.3127058(104-113)Online publication date: 29-Sep-2017
  • (2016)Computing Distances between Reach FlowpipesProceedings of the 19th International Conference on Hybrid Systems: Computation and Control10.1145/2883817.2883850(267-276)Online publication date: 11-Apr-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media