Remote Testing of an Augmented Reality System
Article No.: 3, Pages 1 - 4
Abstract
Remote test settings have become more common due to COVID-19. Our paper presents two user tests focusing on the usability and user experience of an augmented reality-based solution, i.e., augmented reality system. We describe the proceeding of the tests from the perspective of what party has participated in the test in the same location as the test participant, i.e., locally, and what party remotely. The importance - or unimportance - of physical presence is contemplated from the perspective of the successfulness of the test. The physical presence of a person providing technical support to the test participant during the testing proved vital for the augmented reality related testing; the location of other test organisers appears more indifferent in this context.
References
[1]
Morten Sieker Andreasen, Henrik Villemann Nielsen, Simon Ormholt Schrøder, and Jan Stage. 2007. What happened to remote usability testing? An empirical study of three methods. In Proceedings of the SIGCHI conference on Human factors in computing systems, 1405-1414.
[2]
Monty Hammontree, Paul Weiler, and Nandini Nayak. 1994. Remote Usability Testing. interactions, 1(3), 21-25.
[3]
Caterina Dinnella, Lapo Pierguidi, Sara Spinelli, Monica Borgogno, Tullia GallinaToschi, Stefano Predieri, Giliana Lavezzi, Francesca Trapani, Matilde Tura, Massimiliano Magli, Alessandra Bendini, and Erminio Monteleone. 2022. Remote testing: Sensory test during Covid-19 pandemic and beyond. Food quality and preference, 96, 104437. https://www.sciencedirect.com/science/article/pii/S0950329321003190
[4]
Anne E. Holland, Carla Malaguti, Mariana Hoffman, Aroub Lahham, Angela T. Burge, Leona Dowman, Anthony K. May, Janet Bondarenko, Marnie Graco, Gabriella Tikellis, Joanna Y.T. Lee, and Narelle S. Cox. 2020. Home-based or remote exercise testing in chronic respiratory disease, during the COVID-19 pandemic and beyond: a rapid review. Chronic respiratory disease, 17, 1-18. https://doi.org/10.1177/1479973120952418
[5]
Maiya R. Geddes, Megan E. O'Connell, John D. Fisk, Serge Gauthier, Richard Camicioli, Zahinoor Ismail, and Alzheimer Society of Canada Task Force on Dementia Care Best Practices for COVID‐19. 2020. Remote cognitive and behavioral assessment: Report of the Alzheimer Society of Canada Task Force on dementia care best practices for COVID‐19. Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring, 12(1), e12111. https://doi.org/10.1002/dad2.12111
[6]
Curtis L. Gittens. 2021. Remote HRI: A methodology for maintaining COVID-19 physical distancing and human interaction requirements in HRI studies. Information Systems Frontiers, 1-16. https://link.springer.com/article/10.1007/s10796-021-10162-4
[7]
Karen Sando, Melissa S. Medina, and Karen Whalen. 2021. The Need for New Guidelines and Training for Remote/Online Testing and Proctoring Due to COVID-19. American Journal of Pharmaceutical Education. Commentary. https://www.ajpe.org/content/ajpe/early/2021/01/28/ajpe8545.full.pdf
[8]
Kaj Helin, Jaakko Karjalainen, Timo Kuula, Paul Kiernan, Gianluca Casarosa, and David Martinez Oliveira. 2021. The Remote User Test of Mixed Reality System for AIT/AIV in the Space Domain. In EuroXR 2021: Proceedings of the Virtual EuroXR Conference, ed K Helin, J Perret and Arlati S (VTT Technical Research Centre of Finland Ltd) https://sarjaweb.vtt.fi/pdf/technology/2021/T395.pdf, 11-13.
[9]
Marja Liinasuo, Timo Kuula, Kaj Helin, Vladimir Goriachev, and Matthias Aust. 2022. Building's digital twin model shown as first-person and third-person views. CIB WBC2022 conference on 27-30 June 2022, Melbourne, Australia.
[10]
ESA 2022. Website of the European Space Agency. Retrieved April 20, 2022 from https://www.esa.int
[11]
BIMprove 2021. Website for the EU project BIMprove. Retrieved January 28, 2022 from https://cordis.europa.eu/project/id/958450
[12]
Felix Giroux, Pierre-Majorique Léger, David Brieu gne, Francois Courtemanche, Frédérique Bouvier, Shang-Lin Chen, Salima Tazi, Emma Rucco, Marc Fredette, Constantinos Coursaris, and Sylvain Sénécal. 2021. Guidelines for collecting automatic facial expression detection data synchronized with a dynamic stimulus in remote moderated user tests. In International Conference on Human-Computer Interaction, 243-254.
[13]
Asimina Vasalou, Brian David Ng, Peter Wiemer-Hastings, and Lidia Oshlyansky. 2004. Human-moderated remote user testing: Protocols and applications. In 8th ERCIM Workshop, User Interfaces for All, Wien, Austria, Vol. 19
[14]
Estella Oncins. 2021. Accessibility in Online User Testing. Journal of Audiovisual Translation, 4(2), 6-22.Kathrine E. Thompson, Evelyn P. Rozanski, and Anne R. Haake. 2004. Here, there, anywhere: Remote usability testing that works. In Proceedings of the 5th conference on Information technology education, 132-137.
[15]
Kevin Chen, and Haoqi Zhang. 2015, April. Remote paper prototype testing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 77-80.
[16]
Aurélie Vasseur, Pierrre-Majorique Léger, Francois Courtemanche, Elise Labonta-Lemoyne, Vanessa, Geroges, Audrey Valiquette, David Brieugne, Emma Rucco, Constantinos Coursaris, Marc Fredette, and Sylvain Sénécal. 2021 Collection for UX evaluation: A pilot project. In International Conference on Human-Computer Interaction, 255-267.
[17]
Andrei M. Reinhorn, Mettupalayam V. Sivaselvan, Zach Liand, and Xiaoyun Shao. 2004. Real-time dynamic hybrid testing of tructural systems. 13th World Conference on Earthquake Engineering, Vancouver, B.C:, Canada, August 1-6, 2004, paper No. 1644.
[18]
D. P. McCrum and M. S. William. 2016. An overview of seismic hybrid testing of engineering structures. Engineering Structures, 118, 240-261.
[19]
Juergen Sauer, Andreas Sonderegger, Klau Heyden, Jasmin Biller, Julia Klotz, and Andreas Uebelbacher. 2019. Extra-laboratorial usability tests: An empirical comparison of remote and classical field testing with lab testing. Applied Ergonomics, 74, 85-96.
[20]
Deborah A. Abowitz, and T. Michael Toole. 2010. Mixed method research: Fundamental issues of design, validity, and reliability in construction research. Journal of construction engineering and management, 136(1), 108.
[21]
David R. Johnson, Christopher P. Scheitle, Elaine Howard Ecklund. 2019. Beyond the In-Person Interview? How Interview Quality Varies Across In-person, Telephone, and Skype Interviews. Social Science Computer Review, 39(6), 1142-1158. https://doi.org/10.1177/0894439319893612
[22]
Aurélie Vasseur, Pierre-Majorique Léger, Francois Courtemanche, Elise Labonte-Lemoyne, Vanessa Georges, Audrey Valiquette, David Brieugne, Emma Rucco, Constantinos Coursaris, Marc Fedette, and Sylvain Sénécal, S. 2021, July. Distributed remote psychophysiological data collection for UX evaluation: a pilot project. In International Conference on Human-Computer Interaction, 255-267.
Index Terms
- Remote Testing of an Augmented Reality System
Recommendations
Wearable mobile augmented reality: evaluating outdoor user experience
VRCAI '11: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in IndustryAugmented Reality (AR) technologies offer the potential to aid users in a number of professional areas. However, to date, most studies have been tested in controlled laboratory conditions. This paper outlines a user experience study of a wearable mobile ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical SystemsAs shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...
Comments
Information & Contributors
Information
Published In
October 2022
183 pages
ISBN:9781450398084
DOI:10.1145/3552327
Copyright © 2022 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 October 2022
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
ECCE 2022
ECCE 2022: 33rd European Conference on Cognitive Ergonomics
October 4 - 7, 2022
Kaiserslautern, Germany
Acceptance Rates
Overall Acceptance Rate 56 of 91 submissions, 62%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 238Total Downloads
- Downloads (Last 12 months)109
- Downloads (Last 6 weeks)19
Reflects downloads up to 08 Feb 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in