Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.5555/2557696.2557724acmotherconferencesArticle/Chapter ViewAbstractPublication PagesscscConference Proceedingsconference-collections
research-article

Improving scenario selection for simulations by run-time control-flow analysis

Published: 07 July 2013 Publication History

Abstract

Cyber-physical systems like active safety systems in recent vehicles are significantly driven by software and rely predominantly on data that is perceived by cameras, laser scanners, and the like from the system's environment. For example, these sensor-based systems realize pedestrian protection function-alities, which cannot be tested under simplified conditions on proving grounds only or by arbitrary test-runs on public roads anymore. Instead, simulative environments are used nowadays, which provide the virtual surroundings for such a system where its real input sources are replaced with simplified sensor models. Thus, interactive and hazard-free system tests and automated system evaluations can be carried out easily. However, the simple strategy to run all available modeled traffic scenarios in the simulation on any change of the implementation would consume too much computation time to provide effective and fast feedback for developers. In this article, an improved strategy for selecting scenarios that shall be run in a simulation based on run-time control-flow analysis is proposed, which resulted from the in-depth analysis of the revision history of the source code and their accompanying simulations for two self-driving vehicles. The outlined strategy is evaluated on a self-driving miniature vehicle.

References

[1]
X. Bai, B. Chen, B. Ma, and Y. Gong. Design of Intelligent Agents for Collaborative Testing of Service-Based Systems. In Proceeding of the 6th International Workshop on Automation of Software Test, pages 22--28, New York, New York, USA, May 2011. ACM Press.
[2]
K. Beck. Test-Driven Development. Addison-Wesley, 2003.
[3]
B. Beizer. Software Testing Techniques. Van Nost. Reinhold, U.S., 1990.
[4]
C. Berger. Automating Acceptance Tests for Sensor- and Actuator-based Systems on the Example of Autonomous Vehicles. Shaker Verlag, Aachener Informatik-Berichte, Software Engineering Band 6, Aachen, Germany, 2010.
[5]
C. Berger. From Autonomous Vehicles to Safer Cars: Selected Challenges for the Software Engineering. In F. Ortmeier and P. Daniel, editors, Proceedings of the SAFECOMP 2012 Workshops, LNCS 7613, pages 180--189, Magdeburg, Germany, Sept. 2012. Springer-Verlag Berlin Heidelberg.
[6]
C. Berger, M. Chaudron, R. Heldal, O. Landsiedel, and E. M. Schiller. Model-based, Composable Simulation for the Development of Autonomous Miniature Vehicles. In Proceedings of the SCS/IEEE Symposium on Theory of Modeling and Simulation, San Diego, CA, USA, Apr. 2013.
[7]
C. Berger and B. Rumpe. Autonomous Driving - 5 Years after the Urban Challenge: The Anticipatory Vehicle as a Cyber-Physical System. In U. Goltz, M. Magnor, H.-J. Appelrath, H. K. Matthies, W.-T. Balke, and L. Wolf, editors, Proceedings of the INFORMATIK 2012, pages 789--798, Braunschweig, Germany, Sept. 2012.
[8]
C. Berger and B. Rumpe. Engineering Autonomous Driving Software. In C. Rouff and M. Hinchey, editors, Experience from the DARPA Urban Challenge, pages 243--271. Springer-Verlag, London, UK, 2012.
[9]
E. Engström, P. Runeson, and M. Skoglund. A systematic review on regression test selection techniques. Information and Software Technology, 52(1):14--30, Jan. 2010.
[10]
P. Godefroid, P. de Halleux, A. V. Nori, S. K. Rajamani, W. Schulte, and N. Tillmann. Automating Software Testing Using Program Analysis. IEEE Software, 25(5):30--37, Sept. 2008.
[11]
S. Hangal and M. S. Lam. Tracking Down Software Bugs Using Automatic Anomaly Detection. In Proceedings of the 24th International Conference on Software Engineering, pages 291--301, New York, New York, USA, May 2002. ACM Press.
[12]
B. Lucia and L. Ceze. Finding Concurrency Bugs with Context-Aware Communication Graphs. In Proceedings of the 42nd Annual IEEE/ACM International Symposium on Microarchitecture, number 1, pages 553--563, New York, New York, USA, Dec. 2009. ACM Press.
[13]
J. Poole. A Method to Determine a Basis Set of Paths to Perform Program Testing. 1995.
[14]
F. W. Rauskolb, K. Berger, C. Lipski, M. Magnor, K. Cornelsen, J. Effertz, T. Form, F. Graefe, S. Ohl, W. Schumacher, J.-M. Wille, P. Hecker, T. Nothdurft, M. Doering, K. Homeier, J. Morgenroth, L. Wolf, C. Basarke, C. Berger, T. Gülke, F. Klose, and B. Rumpe. Caroline: An Autonomously Driving Vehicle for Urban Environments. Journal of Field Robotics, 25(9):674--724, Sept. 2008.
[15]
G. Rothermel and M. J. Harrold. A Safe, Efficient Regression Test Selection Technique. ACM Transactions on Software Engineering and Methodology, 6(2):173--210, Apr. 1997.
[16]
W. von Hagen. The Definitive Guide to GCC. Springer-Verlag, New York, NY, USA, 2006.
[17]
Y. Wu. Accuracy of Profile Maintenance in Optimizing Compilers. In Proceedings of the Sixth Annual Workshop on Interaction between Compilers and Computer Architecture, pages 27--38, Boston, MA, USA, Feb. 2002. IEEE Computer Society.

Cited By

View all
  • (2014)Saving virtual testing time for CPS by analyzing code coverage on the example of a lane-following algorithmProceedings of the 4th ACM SIGBED International Workshop on Design, Modeling, and Evaluation of Cyber-Physical Systems10.1145/2593458.2593466(7-10)Online publication date: 14-Apr-2014
  • (2014)Reducing Simulation Testing Time by Parallel Execution of Loosely Coupled Segments of a Test ScenarioProceedings of International Workshop on Engineering Simulations for Cyber-Physical Systems10.1145/2589650.2559635(33-37)Online publication date: 28-Mar-2014
  • (2014)Reducing Simulation Testing Time by Parallel Execution of Loosely Coupled Segments of a Test ScenarioProceedings of International Workshop on Engineering Simulations for Cyber-Physical Systems10.1145/2559627.2559635(33-37)Online publication date: 28-Mar-2014

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
SCSC '13: Proceedings of the 2013 Summer Computer Simulation Conference
July 2013
419 pages
ISBN:9781627482769

Sponsors

  • SCS: Society for Modeling and Simulation International

In-Cooperation

Publisher

Society for Modeling & Simulation International

Vista, CA

Publication History

Published: 07 July 2013

Check for updates

Author Tags

  1. cyber-physical systems
  2. regression simulation
  3. run-time control-flow analysis
  4. self-driving cars

Qualifiers

  • Research-article

Conference

SummerSim '13
Sponsor:
  • SCS
SummerSim '13: 2013 Summer Simulation Multiconference
July 7 - 10, 2013
Ontario, Toronto, Canada

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)1
Reflects downloads up to 12 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2014)Saving virtual testing time for CPS by analyzing code coverage on the example of a lane-following algorithmProceedings of the 4th ACM SIGBED International Workshop on Design, Modeling, and Evaluation of Cyber-Physical Systems10.1145/2593458.2593466(7-10)Online publication date: 14-Apr-2014
  • (2014)Reducing Simulation Testing Time by Parallel Execution of Loosely Coupled Segments of a Test ScenarioProceedings of International Workshop on Engineering Simulations for Cyber-Physical Systems10.1145/2589650.2559635(33-37)Online publication date: 28-Mar-2014
  • (2014)Reducing Simulation Testing Time by Parallel Execution of Loosely Coupled Segments of a Test ScenarioProceedings of International Workshop on Engineering Simulations for Cyber-Physical Systems10.1145/2559627.2559635(33-37)Online publication date: 28-Mar-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media