Integrating usage monitoring for continuous evaluation and testing in the UI of an industry application
Pages 25 - 32
Abstract
Developing interactive systems and testing with realistic scenarios requires a detailed understanding of how these systems are used in their real environment. In this paper, we report on our experience from implementing a usage monitoring approach for the touch-enabled human machine interface of an industrial machine. The approach supports automated recording of user interface events as basis for analyzing interactions of users with the system. It collects information about navigation paths to different screens, activities on these screens, and the usage of functionality provided by the application. We evaluated three different approaches to integrate the required usage monitoring into the UI, considering aspects such as necessary changes to the existing code base, dependencies to third-party libraries, and the entailed performance overhead. The paper provides a detailed description of the implementation of the selected approach and a discussion of the lessons we learned from integrating the monitoring in an existing application.
References
[1]
Richard Atterer, Monika Wnuk, and Albrecht Schmidt. 2006. Knowing the user’s every move: user activity tracking for website usability evaluation and implicit interaction. In Proceedings of the 15th international conference on World Wide Web. 203–212. https://doi.org/10.1145/1135777.1135811
[2]
Paolo Burzacca and Fabio Paternò. 2013. Remote Usability Evaluation of Mobile Web Applications. In Human-Computer Interaction. Human-Centred Design Approaches, Methods, Tools, and Environments - 15th International Conference. 241–248. https://doi.org/10.1007/978-3-642-39232-0_27
[3]
Xavier Ferré, Elena Villalba, Héctor Julio, and Hongming Zhu. 2017. Extending Mobile App Analytics for Usability Test Logging. In Human-Computer Interaction - INTERACT 2017 - 16th IFIP TC 13 International Conference. 114–131. https://doi.org/10.1007/978-3-319-67687-6_9
[4]
Richard S. Hall and Humberto Cervantes. 2004. Challenges in building service-oriented applications for OSGi. IEEE Commun. Mag., 42, 5 (2004), 144–149. https://doi.org/10.1109/MCOM.2004.1299359
[5]
Wilhelm Hasselbring, Sören Henning, Björn Latte, Armin Möbius, Thomas Richter, Stefani Schalk, and Maik Wojcieszak. 2019. Industrial devops. In 2019 IEEE International Conference on Software Architecture Companion (ICSA-C). 123–126. https://doi.org/10.1109/ICSA-C.2019.00029
[6]
David M. Hilbert and David F. Redmiles. 2000. Extracting usability information from user interface events. ACM Comput. Surv., 32, 4 (2000), 384–421. https://doi.org/10.1145/371578.371593
[7]
Jan Ole Johanssen. 2018. Continuous User Understanding for the Evolution of Interactive Systems. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems. 1–6. https://doi.org/10.1145/3220134.3220149
[8]
Glenn E Krasner and Stephen T Pope. 1988. A description of the model-view-controller user interface paradigm in the smalltalk-80 system. Journal of object oriented programming, 1, 3 (1988), 26–49.
[9]
Lucy Ellen Lwakatare, Teemu Karvonen, Tanja Sauvola, Pasi Kuvaja, Helena Holmström Olsson, Jan Bosch, and Markku Oivo. 2016. Towards DevOps in the Embedded Systems Domain: Why is It So Hard? In 2016 49th hawaii international conference on system sciences (hicss). 5437–5446. https://doi.org/10.1109/HICSS.2016.671
[10]
Lucy Ellen Lwakatare, Terhi Kilamo, Teemu Karvonen, Tanja Sauvola, Ville Heikkilä, Juha Itkonen, Pasi Kuvaja, Tommi Mikkonen, Markku Oivo, and Casper Lassenius. 2019. DevOps in practice: A multiple case study of five companies. IST, 217–230. https://doi.org/10.1016/j.infsof.2019.06.010
[11]
James McGovern, Oliver Sims, Ashish Jain, and Mark Little. 2006. Enterprise service oriented architectures - concepts, challenges, recommendations. Kluwer. isbn:978-1-4020-3704-7 https://doi.org/10.1007/1-4020-3705-8
[12]
Naghmeh Niknejad, Waidah Ismail, Imran Ghani, Behzad Nazari, Mahadi Bahari, and Ab Razak Che Hussin. 2020. Understanding Service-Oriented Architecture (SOA): A systematic literature review and directions for further investigation. Inf. Syst., 91 (2020), https://doi.org/10.1016/j.is.2020.101491
[13]
Yonglei Tao. 2007. Capturing User Interface Events with Aspects. In Human-Computer Interaction. HCI Applications and Services, 12th International Conference. 1170–1179. https://doi.org/10.1007/978-3-540-73111-5_128
Index Terms
- Integrating usage monitoring for continuous evaluation and testing in the UI of an industry application
Recommendations
3D Freehand Gestural Navigation for Interactive Public Displays
Users increasingly expect more-interactive experiences with public displays for applications including learning, gaming, urban visualization, and planning. However, user interaction with applications on public displays is challenging and often doesn't ...
Extracting usability information from user interface events
Modern window-based user interface systems generate user interface events as natural products of their normal operation. Because such events can be automatically captured and because they indicate user behavior with respect to an application's user ...
Integrating Point and Touch for Interaction with Digital Tabletop Displays
TractorBeam is a hybrid point-touch interaction technique for tabletop computer displays that seamlessly combines remote pointing and local touch. Results from studies investigating its use for target selection, docking, and puzzle tasks give some ...
Comments
Information & Contributors
Information
Published In
August 2021
40 pages
ISBN:9781450386234
DOI:10.1145/3472672
- General Chairs:
- Sinem Getir Yaman,
- Rui Prada,
- Program Chairs:
- Fitsum Meshesha Kifetew,
- Nicolás Cardozo
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 23 August 2021
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
ESEC/FSE '21
Sponsor:
ESEC/FSE '21: 29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
August 23 - 24, 2021
Athens, Greece
Upcoming Conference
ISSTA '25
- Sponsor:
- sigsoft
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 134Total Downloads
- Downloads (Last 12 months)29
- Downloads (Last 6 weeks)0
Reflects downloads up to 03 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in