Abstract
Today, embedded systems across industrial domains (e.g., avionics, automotive) are representatives of software-intensive systems with increasing reliance on software and growing complexity. It has become critically important to verify software in a time, resource and cost effective manner. Furthermore, industrial domains are striving to comply with the requirements of relevant safety standards. This paper proposes a novel workflow along with tool support to evaluate robustness of software in model-based development environment, assuming different abstraction levels of representing software. We then show the effectiveness of our technique, on a brake-by-wire application, by performing back-to-back fault injection testing between two different abstraction levels using MODIFI for the Simulink model and GOOFI-2 for the generated code running on the target microcontroller. Our proposed method and tool support facilitates not only verifying software during early phases of the development lifecycle but also fulfilling back-to-back testing requirements of ISO 26262 [1] when using model-based development.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
ISO 26262:2011, Road vehicles — Functional safety
ISO 26262-6:2011, Road vehicles — Functional safety — Part 6: Product development at the software level
The Mathworks, Inc. http://www.mathworks.se/products/simulink/. Accessed March 2015
dSPACE. http://www.dspace.com/en/pub/home/products/sw/pcgs/targetli.cfm. Accessed March 2015
Conrad, M.: Testing-based translation validation of generated code in the context of IEC 61508. Formal Methods Syst. Des. 35(3), 389–401 (2009)
Conrad, M.: Verification and Validation According to ISO 26262: A Workflow to Facilitate the Development of High-Integrity Software (2012)
Beine, M.: A model-based reference workflow for the development of safety-critical software. In: Embedded Real Time Software and Systems (2010)
The Mathworks, Inc. http://www.mathworks.se/products/embedded-coder/. Accessed March 2015
Vouk, M.A.: Back-to-back testing. Inf. Softw. Technol. 32(1), 34–45 (1990)
Iyer, R.K.: Experimental evaluation. In: Special Issue of Proceedings Twenty-Fifth International Symposium on Fault-Tolerant Computing (1995)
Jenn, E., Arlat, J., Rimen, M., Ohlsson, J., Karlsson, J.: Fault injection into VHDL models: the MEFISTO tool. In: Proceedings of the 24th International Symposium on Fault Tolerant Computing, pp. 66–75 (1994)
Certitude Functional Qualification Tool from Synopsys. https://www.synopsys.com/TOOLS/VERIFICATION/FUNCTIONALVERIFICATION/Pages/certitude-ds.aspx. Accessed March 2015
Vinter, J., Bromander, L., Raistrick, P., Edler, H.: FISCADE - a fault injection tool for SCADE models. In: Proceedings of the 3rd IET Conference on Automotive Electronics, pp. 1–9 (2007)
Svenningsson, R., Vinter, J., Eriksson, H., Törngren, M.: MODIFI: a MODel-implemented fault injection tool. In: Schoitsch, E. (ed.) SAFECOMP 2010. LNCS, vol. 6351, pp. 210–222. Springer, Heidelberg (2010)
Esterel Technologies. http://www.estereltechnologies.com/products/scade-suite/. Accessed June 2015
Bhatt, D., Madl, G., Oglesby, D., Schloegl, K.: Towards scalable verification of commercial avionics software. In: AIAA Infotech@Aerospace, April 2010
RTCA: DO-178B: Software Considerations in Airborne Systems and Equipment Certification. Radio Technical Commission for Aeronautics, RTCA Inc., Washington, D.C. (1992)
Madeira, H., Rela, M.Z., Moreira, F., Silva, J.G.: RIFLE: a general purpose pin-level fault injector. In: Proceedings of the 1st European Dependable Computing Conference, pp. 199–216 (1994)
Arlat, J., Crouzet, Y., Karlsson, J., Folkesson, P., Fuchs, E., Leber, G.: Comparison of physical and software implemented fault injection techniques. IEEE Trans. Comput. 52(8), 115–1133 (2003)
Karlsson, J., Liden, P., Dahlgren, P., Johansson, R., Gunneflo, U.: Using heavy-ion radiation to validate fault-handling mechanisms. IEEE Micro 14(1), 8–23 (1994)
Skarin, D., Barbosa, R., Karlsson, J.: GOOFI-2: a tool for experimental dependability assessment. In: 40th International Conference on Dependable Systems and Networks (2010)
Rebaudengo, M., Reorda, M.: Evaluating the fault tolerance capabilities of embedded systems via BDM. In: Proceedings of the 17th IEEE VLSI Test Symposium, pp. 452–457 (1999)
Costa, D., Madeira, H., Carreira, J., Silva, J.: Xception: software fault injection and monitoring in processor functional units. In: Benso, A., Prinetto, P. (eds.) Fault Injection Techniques and Tools for Embedded Systems Reliability Evaluation. Frontiers in Electronic Testing, vol. 23, pp. 125–139 (2003)
Han, S., Shin, K.G., Rosenberg, H.A.: DOCTOR: an integrated software fault injection environment for distributed real-time systems. In: Proceedings of 1995 IEEE International Computer Performance and Dependability Symposium, pp. 204–213 (1995)
Svenningsson, R., Eriksson, H., Vinter, J., Törngren, M.: Model-implemented fault injection for hardware fault simulation. Paper presented at MoDeVVa 2010, Oslo, Norway, 3 October 2010
Barbosa, R., Vinter, J., Folkesson, P., Karlsson, J.M.: Assembly-level pre-injection analysis for improving fault injection efficiency. In: Dal Cin, M., Kaâniche, M., Pataricza, A. (eds.) EDCC 2005. LNCS, vol. 3463, pp. 246–262. Springer, Heidelberg (2005)
Nexus 5001â„¢ Forum, IEEE-ISTO (1999). http://www.nexus5001.org/. Accessed March 2015
winIDEA – iSystem’s Integrated Development Environment. http://www.isystem.com/products/software/winidea. Accessed March 2015
iC3000 debugger. http://www.isystem.com/products/11-products/89-ic3000-activeemulator. Accessed March 2015
Ayatolahi, F., Sangchoolie, B., Johansson, R., Karlsson, J.: A study of the impact of single bit-flip and double bit-flip errors on program execution. In: Bitsch, F., Guiochet, J., Kaâniche, M. (eds.) SAFECOMP. LNCS, vol. 8153, pp. 265–276. Springer, Heidelberg (2013)
Acknowledgements
We would like to thank Daniel Skarin for valuable input to the proposed workflow and for his work with the implementation of the BBW application for GOOFI-2. We would also like to thank Fredrik Bernin and Johan Haraldsson from Volvo AB for their support with the BBW application model and code generation. This work was partly funded by the ARTEMIS Joint Undertaking research project VeTeSS under grant agreement no. 295311 and the national research project BeSafe funded by Vinnova (Swedish Governmental Agency for Innovation Systems) within the Vehicle Development Program (Diary number: 2010-02114).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Folkesson, P., Ayatolahi, F., Sangchoolie, B., Vinter, J., Islam, M., Karlsson, J. (2015). Back-to-Back Fault Injection Testing in Model-Based Development. In: Koornneef, F., van Gulijk, C. (eds) Computer Safety, Reliability, and Security. SAFECOMP 2014. Lecture Notes in Computer Science(), vol 9337. Springer, Cham. https://doi.org/10.1007/978-3-319-24255-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-24255-2_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24254-5
Online ISBN: 978-3-319-24255-2
eBook Packages: Computer ScienceComputer Science (R0)