research-article

AMC: verifying user interface properties for vehicular applications

Authors:

Christopher PeplinAuthors Info & Claims

MobiSys '13: Proceeding of the 11th annual international conference on Mobile systems, applications, and services

Pages 1 - 12

https://doi.org/10.1145/2462456.2464459

Published: 25 June 2013 Publication History

Abstract

Vehicular environments require continuous awareness of the road ahead. It is critical that mobile applications used in such environments (e.g., GPS route planners and location-based search) do not distract drivers from the primary task of operating the vehicle. Fortunately, a large body of research on vehicular interfaces provides best practices that mobile application developers can follow. However, when we studied the most popular vehicular applications in the Android marketplace, no application followed these guidelines. In fact, vehicular applications were not substantially better at meeting best practice guidelines than non-vehicular applications.

To remedy this problem, we have developed a tool called AMC that uses model checking to automatically explore the graphical user interface (GUI) of Android applications and detect violations of vehicular design guidelines. AMC is designed to give developers early feedback on their application GUI and reduce the amount of time required by a human expert to assess an application's suitability for vehicular usage. We have evaluated AMC by comparing the violations that it reports with those reported by an industry expert for 12 applications. AMC generated a definitive assessment for 85% of the guidelines checked; for these cases, it had no false positives and a false negative rate of under 2%. For the remaining 15% of cases, AMC reduced the number of application screens that required manual verification by 95%.

References

[1]

Amalfitano, D., Fasolino, A. R., and Tramontana, P. A GUI crawling-based technique for android mobile application testing. In Proceedings of the 4th IEEE International Conference on Software Testing, Verification and Validation Workshops (Berlin, Germany, March 2011), pp. 252--261.

Digital Library

[2]

Blanchet, B. Automatic verification of correspondences for security protocols. Journal of Computer Security 17, 4 (2009), 363--434.

Digital Library

[3]

Brooks, P. A., and Memon, A. M. Automated GUI testing guided by usage profiles. In Proceedings of the 23rd IEEE/ACM international conference on Automated software engineering (Atlanta, GA, November 2007), pp. 333--342.

Digital Library

[4]

Cadar, C., Dunbar, D., and Engler, D. KLEE: Unassisted and automatic generation of high-coverage tests for complex systems programs. In Proceedings of the 8th Symposium on Operating Systems Design and Implementation (December 2008), pp. 209--224.

Digital Library

[5]

Cadar, C., Ganesh, V., Pawlowski, P. M., Dill, D. L., and Engler, D. R. EXE: Automatically generating inputs of death. In Proceedings of the 13th ACM Conference on Computer and Communications Security (2006).

Digital Library

[6]

Caldwell, B., Cooper, M., Reid, L. G., and Vanderheiden, G. Web Content Accessibility Guidelines (WCAG) 2.0, 2008. http://www.w3.org/TR/WCAG20/#contrast-ratiodef.

[7]

Driver Focus-Telematics Working Group. Statement of principles, criteria and verification procedures on driver interactions with advanced in-vehicle information and communication systems. Tech. rep., Alliance of Automobile Manufacturers, June 2003.

[8]

Dwyer, M. B., Carr, V., and Hines, L. Model checking graphical user interfaces using abstractions. In Proceedings of the 6th European Software Engineering Conference (Zurich, Switzerland, September 1997), pp. 244--261.

Digital Library

[9]

Fitts, P. M. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47 (1954), 381--391.

[10]

Green, P., Levison, W., Paelke, G., and Serafin, C. Suggested human factors design guidelines for driver information systems. Tech. rep., The University of Michigan Transportation Research Institute (UMTRI), August 1994.

[11]

Grilo, A., Paiva, A., and Faria, J. Reverse engineering of GUI models for testing. In Proceedings of the 5th Iberian Conference on Information Systems and Technologies (Santiago de Compostela, Spain, June 2010), pp. 1--6.

[12]

Hierarchy Viewer. http://developer.android.com/tools/help/hierarchy-viewer.html.

[13]

Mariani, L., Pezzè, M., Riganelli, O., and Santoro, M. Autoblacktest: a tool for automatic black-box testing. In Proceedings of the 33rd International Conference on Software Engineering (Waikiki, Honolulu, HI, May 2011), pp. 1013--1015.

Digital Library

[14]

Memon, A., Banerjee, I., and Nagarajan, A. GUI ripping: Reverse engineering of graphical user interfaces for testing. In Proceedings of the 10th working conference on reverse engineering (Victoria, B.C., Canada, November 2003), pp. 260--270.

Digital Library

[15]

Musuvathi, M., Park, D. Y., Chou, A., Engler, D. R., and Dill, D. L. CMC: A pragmatic approach to model checking real code. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (Boston, MA, December 2002), pp. 75--88.

Digital Library

[16]

Nakamura, Y. JAMA guideline for in-vehicle display systems. Tech. rep., Japan Automobile Manufacturers Association, Oct 2008.

[17]

Paiva, A. C., Faria, J. C., Tillmann, N., and Vidal, R. A. A model-to-implementation mapping tool for automated model-based GUI testing. In Proceedings of the 7th International Conference on Formal Engineering Methods (Manchester, United Kingdom, November 2005), pp. 450--464.

Digital Library

[18]

Salvucci, D. D. Predicting the effects of in-car interfaces on driver behavior using a cognitive architecture. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, March 2001), pp. 120--127.

Digital Library

[19]

Stevens, A., Quimby, A., Board, A., Kersloot, T., and Burns, P. Design guidelines for safety of in-vehicle information systems. Tech. rep., Transport Research Laboratory, Feb 2002.

[20]

Takala, T., Katara, M., and Harty, J. Experiences of system-level model-based GUI testing of an android application. In Proceedings of the 4th IEEE International Conference on Software Testing, Verification, and Validation (Berlin, Germany, March 2011), pp. 377--386.

Digital Library

[21]

Task Force HMI. European statement of principles on human machine interface for in-vehicle information and communication systems. Tech. rep., Commission of the European Communities, December 1998.

[22]

Tesseract-ocr. http://code.google.com/p/tesseract-ocr/.

[23]

Tsuchiya, T., and Schiper, A. Model checking of consensus algorithm. In Proceedings of the 26th IEEE International Symposium on Reliable Distributed Systems (Beijing, China, October 2007), pp. 137 --148.

Digital Library

[24]

UI/Application Exerciser Monkey. http://developer.android.com/tools/help/monkey.html.

[25]

Valmari, A. A stubborn attack on state explosion. Formal Methods in System Design 1, 4 (1992), 297--322.

Digital Library

[26]

Yang, J., Sar, C., and Engler, D. eXplode: a lightweight, general system for finding serious storage system errors. In Proceedings of the 7th Symposium on Operating Systems Design and Implementation (Seattle, WA, November 2006), pp. 131--146.

Digital Library

[27]

Ziefle, M. Effects of display resolution on visual performance. Human Factors: The Journal of the Human Factors and Ergonomics Society 40, 4 (1998), 554--568.

Cited By

Xiao YNadkarni ALiao XTorres-Arias SDe Carli LZhang Y(2024)Enhancing Transparency and Accountability of TPLs with PBOM: A Privacy Bill of MaterialsProceedings of the 2024 Workshop on Software Supply Chain Offensive Research and Ecosystem Defenses10.1145/3689944.3696159(1-11)Online publication date: 19-Nov-2024
https://dl.acm.org/doi/10.1145/3689944.3696159
Xiao YLi ZQin YBai XGuan JLiao XXing LCalandrino JTroncoso C(2023)LalaineProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620299(1091-1108)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620299
Rahaman SSamuel RNeamtiu I(2023)Diagnosing Medical Score Calculator AppsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109127:3(1-27)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610912
Show More Cited By

Index Terms

AMC: verifying user interface properties for vehicular applications
1. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software implementation planning
        Software design techniques
    2. Software development process management
  2. Software organization and properties
    1. Software functional properties
      1. Formal methods
        Model checking
2. Theory of computation
  1. Logic
    1. Verification by model checking

Recommendations

Verifying android applications using Java PathFinder

Mobile application testing is a specialised and complex field. Due to mobile applications' event driven design and mobile runtime environment, there currently exist only a small number of tools to verify these applications. This paper describes the ...
An Explorative Study of the Mobile App Ecosystem from App Developers' Perspective
WWW '17: Proceedings of the 26th International Conference on World Wide Web

With the prevalence of smartphones, app markets such as Apple App Store and Google Play has become the center stage in the mobile app ecosystem, with millions of apps developed by tens of thousands of app developers in each major market. This paper ...
Android: Changing the Mobile Landscape

The mobile phone landscape changed last year with the introduction of smart phones running Android, a platform marketed by Google. Android phones are the first credible threat to the iPhone market. Not only did Google target the same consumers as iPhone,...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobiSys '13: Proceeding of the 11th annual international conference on Mobile systems, applications, and services

June 2013

568 pages

ISBN:9781450316729

DOI:10.1145/2462456

General Chairs:
Hao-Hua Chu
National Taiwan University
,
Polly Huang
National Taiwan University
,
Program Chairs:
Romit Roy Choudhury
Duke University
,
Feng Zhao
Microsoft Research

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

In-Cooperation

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobiSys'13

Sponsor:

SIGMOBILE

MobiSys'13: The 11th Annual International Conference on Mobile Systems, Applications, and Services

June 25 - 28, 2013

Taipei, Taiwan

Acceptance Rates

MobiSys '13 Paper Acceptance Rate 33 of 211 submissions, 16%;

Overall Acceptance Rate 274 of 1,679 submissions, 16%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
693
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xiao YNadkarni ALiao XTorres-Arias SDe Carli LZhang Y(2024)Enhancing Transparency and Accountability of TPLs with PBOM: A Privacy Bill of MaterialsProceedings of the 2024 Workshop on Software Supply Chain Offensive Research and Ecosystem Defenses10.1145/3689944.3696159(1-11)Online publication date: 19-Nov-2024
https://dl.acm.org/doi/10.1145/3689944.3696159
Xiao YLi ZQin YBai XGuan JLiao XXing LCalandrino JTroncoso C(2023)LalaineProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620299(1091-1108)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620299
Rahaman SSamuel RNeamtiu I(2023)Diagnosing Medical Score Calculator AppsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109127:3(1-27)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610912
Auer MAdler FFraser G(2022)Improving Search-Based Android Test Generation Using Surrogate ModelsSearch-Based Software Engineering10.1007/978-3-031-21251-2_4(51-66)Online publication date: 15-Nov-2022
https://doi.org/10.1007/978-3-031-21251-2_4
Deka BDoosti BHuang FFranzen CHibschman JAfergan DLi YKumar RDong TNichols J(2021)An Early Rico Retrospective: Three Years of Uses for a Mobile App DatasetArtificial Intelligence for Human Computer Interaction: A Modern Approach10.1007/978-3-030-82681-9_8(229-256)Online publication date: 5-Nov-2021
https://doi.org/10.1007/978-3-030-82681-9_8
Min CLee YYoo CHwang IJu YSong JKang S(2020)Scalable Power Impact Prediction of Mobile Sensing Applications at Pre-Installation TimeIEEE Transactions on Mobile Computing10.1109/TMC.2019.290989719:6(1448-1464)Online publication date: 1-Jun-2020
https://doi.org/10.1109/TMC.2019.2909897
Dong FWang HLi LGuo YBissyandé TLiu TXu GKlein JLeavens GGarcia APăsăreanu C(2018)FraudDroid: automated ad fraud detection for Android appsProceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3236024.3236045(257-268)Online publication date: 26-Oct-2018
https://dl.acm.org/doi/10.1145/3236024.3236045
Kim WChoo KLee YMisra ABalan R(2018)Empath-DProceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services10.1145/3210240.3210331(123-135)Online publication date: 10-Jun-2018
https://dl.acm.org/doi/10.1145/3210240.3210331
Zhang LLiang CLi ZLiu YZhao FChen E(2018)Characterizing Privacy Risks of Mobile Apps with Sensitivity AnalysisIEEE Transactions on Mobile Computing10.1109/TMC.2017.270871617:2(279-292)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1109/TMC.2017.2708716
Eler MRojas JGe YFraser G(2018)Automated Accessibility Testing of Mobile Apps2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST.2018.00021(116-126)Online publication date: Apr-2018
https://doi.org/10.1109/ICST.2018.00021
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents