research-article

User Experience Evaluation of Mobile AR services

Authors:

Dayang Rohaya Awang RambliAuthors Info & Claims

MoMM '14: Proceedings of the 12th International Conference on Advances in Mobile Computing and Multimedia

Pages 119 - 126

https://doi.org/10.1145/2684103.2684135

Published: 08 December 2014 Publication History

Abstract

Mobile Augmented Reality (MAR) is state-of-the-art technology that has modernized the way of accessing and interacting with information thus invoking new experiences for users all around the world. However User Experience (UX) evaluation for mobile AR is still a widely unexplored area. In order to identify the potential problems faced by the end users while using MAR applications, it is important to evaluate the UX of current Mobile AR service. This paper narrates the findings and analysis from a pilot study. We report a cross-sectional survey for evaluating the user experience of latest mobile AR applications. A framework of qualities related to user experience is applied on the acquired results to understand and articulate different aspects of UX. The outcomes show a positive attitude of users towards mobile AR services. The results help in considering key acceptance issues and potential user expectations in the development of future mobile AR services.

References

[1]

www.junaio.com.

[2]

www.layer.com.

[3]

BlippAR. Available from: https://blippar.com/en/.

[4]

13407, I.O.f.S.I., Human-centered design processes for interactive systems, 1999.

[5]

Azuma, Ronald T and others A survey of augmented reality. Presence., 6(4):355--385, 1997.

Digital Library

[6]

Desmet, P. M. and P. Hekkert. Framework of product experience. International Journal of Design., 1(1):57--66, 2007.

[7]

DIS, I., 9241-210: 2010. Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems. International Standardization Organization (ISO). Switzerland, 2009.

[8]

Dï£¡nser, A. R. Grasset, and M. Billinghurst. A survey of evaluation techniques used in augmented reality studies. Human Interface Technology Laboratory New Zealand, 2008

[9]

Feiner, S., B. Macintyre, and D. Seligmann. Knowledge-based augmented reality. Communications of the ACM., 36(7):53--62, 1993.

Digital Library

[10]

Gliem, J. A. and R. R. Gliem. Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education., 2003.

[11]

Gulliksen and J. Key Principles for user-centred systems design Behaviour and Information Technology., 22(6):397--409, 2003.

[12]

Hassenzahl, M. and N. Tractinsky. User experience-a research agenda. Behaviour and Information Technology., 25(2):91--97, 2006.

[13]

Henrysson, A., M. Billinghurst, and M. Ollila. Face to face collaborative AR on mobile phones. Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality., 2005.

Digital Library

[14]

Hï£¡rst, W. and C. Wezel. Gesture-based interaction via finger tracking for mobile augmented reality. Multimedia Tools and Applications., 62(1):233--258, 2013.

[15]

Jï£¡ï£¡skï£¡, V. and T. Mattelmï£¡ki. Observing and probing. ACM Proceedings of the 2003 international conference on Designing pleasurable products and interfaces., 2003.

Digital Library

[16]

Kaufmann, H. Construct3D: an augmented reality application for mathematics and geometry education. Proceedings of the tenth ACM international conference on Multimedia., 2002.

Digital Library

[17]

Law and E.L.-C. Understanding, scoping and defining user experience: a survey approach. ACM Proceedings of the SIGCHI Conference on Human Factors in Computing Systems., 2009.

Digital Library

[18]

Livingston, M.A. Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies. ACM Proceedings of the 23rd annual conference on Computer graphics and interactive techniques., 1996.

Digital Library

[19]

Matcha, W. and D.R.A. Rambli. Preliminary investigation on the use of augmented reality in collaborative learning, in Informatics Engineering and Information Science. Springer., 189--198, 2011.

[20]

Milgram, P. and F. Kishino. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems., 77(12):1321--1329, 1994.

[21]

Milgram, P. Augmented reality: A class of displays on the reality-virtuality continuum in Photonics for Industrial Applications. International Society for Optics and Photonics., 1995.

[22]

Mohring, M., C. Lessig, and O. Bimber. Video see-through ar on consumer cell-phones. Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality., 2004.

Digital Library

[23]

Mï£¡ller, A., Experimental evaluation of user interfaces for visual indoor navigation. in 32nd Annual ACM Conference on Human Factors in Computing Systems, CHI 2014. 2014. Toronto, ON: Association for Computing Machinery. Desmet, P. M. and P. Hekkert. Framework of product experience. International Journal of Design., 1(1):57--66, 2007.

[24]

Morrison, A. like bees around the hive: a comparative study of a mobile augmented reality map. ACM Proceedings of the SIGCHI Conference on Human Factors in Computing Systems., 2009.

Digital Library

[25]

Mulloni, A., D. Wagner, and D. Schmalstieg. Mobility and social interaction as core gameplay elements in multi-player augmented reality. ACM Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts., 2008.

Digital Library

[26]

Nam, Y. Designing interactive narratives for mobile augmented reality. Cluster Computing., 1--12, 2014.

Digital Library

[27]

Olsson, T. and M. Salo. Online user survey on current mobile augmented reality applications. 10th IEEE International Symposium on Mixed and Augmented Reality, ISMAR, 2011.

Digital Library

[28]

Olsson, T. User evaluation of mobile augmented reality scenarios. Journal of Ambient Intelligence and Smart Environments., 4(1):29--47, 2012.

[29]

Olsson, T. Expected user experience of mobile augmented reality services: a user study in the context of shopping centres. Personal and Ubiquitous Computing, 17(2):287--304, 2013.

Digital Library

[30]

Olsson, T. Reflections on experience-driven design: a case study on designing for playful experiences. ACM Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces. Newcastle upon Tyne, United Kingdom, 165--174, 2013.

Digital Library

[31]

Pfeiffer, T. and P. Renner. EyeSee3D: a low-cost approach for analyzing mobile 3D eye tracking data using computer vision and augmented reality technology. ACM Proceedings of the Symposium on Eye Tracking Research and Applications. Safety Harbor, Florida. 195--202, 2014.

Digital Library

[32]

Regenbrecht, H.T. and R. Specht. A mobile passive augmented reality device-mpard. Proceedings of IEEE and ACM International Symposium on Augmented Reality., 2000.

[33]

Rohs, M. Impact of item density on magic lens interactions. ACM Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services., 2009.

Digital Library

[34]

Roto, V. User experience white paper: bringing clarity to the concept of user experience. Dagstuhl Seminar on User Experience-2010, Dagstuhl. 2011.

[35]

Santos, M.E.C. Augmented reality learning experiences: Survey of prototype design and evaluation. IEEE Transactions on Learning Technologies., 7(1):38--56, 2014.

[36]

Scholtz, J. and S. Consolvo. Toward a framework for evaluating ubiquitous computing applications. Pervasive Computing, IEEE., 3(2):82--88, 2004.

Digital Library

[37]

Speager, G. and R. Huntrods. Augmented Reality: Past, Present, and Future., 2012.

[38]

Takacs, G. Outdoors augmented reality on mobile phone using loxel-based visual feature organization. Proceedings of the 1st ACM international conference on Multimedia information retrieval., 2008.

Digital Library

[39]

Tiefenbacher, P., N.H. Lehment, and G. Rigoll. Augmented reality evaluation: A concept utilizing virtual reality. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)., 226--236, 2014.

[40]

Visual, Q. World Lens. Available from: http://questvisual.com/us/.

[41]

Wagner, D. Real-time detection and tracking for augmented reality on mobile phones. IEEE Transactions on Visualization and Computer Graphics., 16(3):355--368, 2010.

Digital Library

[42]

Zhou, F., H.B.-L. Duh, and M. Billinghurst. Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE Computer Society., 2008.

Digital Library

[43]

Tom Tullis and Bill Albert. Chapter 3 - Planning a Usability Study, In Interactive Technologies. Measuring the User Experience, ISBN 9780123735584, http://dx.doi.org/10.1016/B978-0-12-373558-4.00003-0., 45--62, 2008.

Cited By

Awan AMahmood ASabahat N(2024)Enhancing User Experience: Exploring Mobile Augmented Reality ExperiencesVFAST Transactions on Software Engineering10.21015/vtse.v12i1.174112:1(121-132)Online publication date: 31-Mar-2024
https://doi.org/10.21015/vtse.v12i1.1741
Cheon EXu S(2024)Creative Precarity in Motion: Revealing the Hidden Labor Behind Animating Virtual CharactersProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661545(3471-3484)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661545
Liu PXie C(2023)Designing Between Virtuality and Reality: Improving Inclusiveness in Hybrid SpacesProceedings of the 41st ACM International Conference on Design of Communication10.1145/3615335.3623033(184-190)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3615335.3623033
Show More Cited By

Index Terms

User Experience Evaluation of Mobile AR services
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

A UX Oriented Evaluation approach for Mobile Augmented Reality Applications
MoMM2018: Proceedings of the 16th International Conference on Advances in Mobile Computing and Multimedia

Augmented Reality (AR) presents a digitally enhanced 3D the real world, connecting users with meaningful content. AR is developing with the advancement in fields of computer graphics and HumanComputer Interaction (HCI) and can be experienced on handheld ...
Effects on User Experience in an Edutainment Virtual Environment: Comparison Between CAVE and HMD
ECCE '17: Proceedings of the European Conference on Cognitive Ergonomics

The user experience in immersive virtual environment can be broadly defined by the feeling of presence and immersion in a virtual environment. The propensity of feeling "there" and "enveloped by" in the virtual environment seems to be essential in ...
Multi-layered Mobile Augmented Reality Framework for Positive User Experience
CHIuXiD '16: Proceedings of the 2nd International Conference in HCI and UX Indonesia 2016

Emerging technology like Mobile Augmented Reality (MAR) is becoming increasingly diverse and well established. However, this research field needs conceptual and practical frameworks to be followed while designing for a positive User Experience (UX). ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MoMM '14: Proceedings of the 12th International Conference on Advances in Mobile Computing and Multimedia

December 2014

464 pages

ISBN:9781450330084

DOI:10.1145/2684103

General Chair:
Shyue-Liang Leon Wang
National University of Kaohsiung, Taiwan
,
Program Chairs:
Yu-Hui Tao
National University of Kaohsiung, Taiwan
,
Liming Chen
University of Ulster, UK
,
Chung-Nan Lee
National Sun Yat-sen University, Taiwan

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

JKU: Johannes Kepler Universität Linz

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 December 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MoMM '14

MoMM '14: The 12th International Conference on Advances in Mobile Computing and Multimedia

December 8 - 10, 2014

Kaohsiung, Taiwan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
764
Total Downloads

Downloads (Last 12 months)59
Downloads (Last 6 weeks)2

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Awan AMahmood ASabahat N(2024)Enhancing User Experience: Exploring Mobile Augmented Reality ExperiencesVFAST Transactions on Software Engineering10.21015/vtse.v12i1.174112:1(121-132)Online publication date: 31-Mar-2024
https://doi.org/10.21015/vtse.v12i1.1741
Cheon EXu S(2024)Creative Precarity in Motion: Revealing the Hidden Labor Behind Animating Virtual CharactersProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661545(3471-3484)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661545
Liu PXie C(2023)Designing Between Virtuality and Reality: Improving Inclusiveness in Hybrid SpacesProceedings of the 41st ACM International Conference on Design of Communication10.1145/3615335.3623033(184-190)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3615335.3623033
Park GKim RSong H(2023)Collaborative Virtual 3D Object Modeling for Mobile Augmented Reality Streaming Services Over 5G NetworksIEEE Transactions on Mobile Computing10.1109/TMC.2022.314954322:7(3855-3869)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TMC.2022.3149543
Irshad SRambli DSulaiman S(2020)Design and implementation of user experience model for augmented reality systemsProceedings of the 18th International Conference on Advances in Mobile Computing & Multimedia10.1145/3428690.3429169(48-57)Online publication date: 30-Nov-2020
https://dl.acm.org/doi/10.1145/3428690.3429169
Popovici IVatavu R(2019)Understanding Users' Preferences for Augmented Reality Television2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR.2019.00024(269-278)Online publication date: Oct-2019
https://doi.org/10.1109/ISMAR.2019.00024
Popovici IVatavu R(2019)Consolidating the Research Agenda of Augmented Reality Television with Insights from Potential End-Users2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct.2019.00033(73-74)Online publication date: Oct-2019
https://doi.org/10.1109/ISMAR-Adjunct.2019.00033
Irshad SAwang D(2018)A UX Oriented Evaluation approach for Mobile Augmented Reality ApplicationsProceedings of the 16th International Conference on Advances in Mobile Computing and Multimedia10.1145/3282353.3282357(108-112)Online publication date: 19-Nov-2018
https://dl.acm.org/doi/10.1145/3282353.3282357
Chatzopoulos DBermejo CHuang ZHui P(2017)Mobile Augmented Reality Survey: From Where We Are to Where We GoIEEE Access10.1109/ACCESS.2017.26981645(6917-6950)Online publication date: 2017
https://doi.org/10.1109/ACCESS.2017.2698164
Irshad SRambli D(2017)Advances in Mobile Augmented Reality from User Experience Perspective: A Review of StudiesAdvances in Visual Informatics10.1007/978-3-319-70010-6_43(466-477)Online publication date: 29-Oct-2017
https://doi.org/10.1007/978-3-319-70010-6_43
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents