research-article

Psychometric Properties of the User Experience Questionnaire (UEQ)

Authors:

Andrea Schankin,

Matthias Budde,

Michael BeiglAuthors Info & Claims

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Article No.: 466, Pages 1 - 11

https://doi.org/10.1145/3491102.3502098

Published: 29 April 2022 Publication History

Abstract

User experience (UX) summarizes user perceptions and responses resulting from the interaction with a product, system, or service. The User Experience Questionnaire (UEQ) is one standardized instrument for measuring UX. With six scales, it identifies areas in which product improvements will have the highest impact. In this paper, we evaluate the reliability and validity of this questionnaire. The data of N = 1, 121 participants who interacted with one of 23 products indicated an acceptable to good reliability of all scales. The results show, however, that the scales were not independent of each other. Combining perspicuity, efficiency, and dependability to pragmatic aspects as well as novelty and stimulation to hedonic aspects of UX improved the model fit significantly. The systematic variations of product properties and correlations with the System Usability Scale (SUS) in a second experiment with N=499 participants supported the validity of these two factors. Practical implications of the results are discussed.

Supplementary Material

MP4 File (3491102.3502098-video-preview.mp4)

Video Preview

Download
10.75 MB

References

[1]

W. Albert and T. Tullis. 2013. Measuring the user experience: collecting, analyzing, and presenting usability metrics. Newnes.

[2]

R.W. Belk. 1988. Possessions and the extended self. Journal of consumer research 15, 2 (1988), 139–168.

[3]

D.E. Berlyne. 1966. Curiosity and exploration. Science 153, 3731 (1966), 25–33.

[4]

J. Brooke. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.

[5]

M. Budde, M. Köpke, M. Berning, T. Riedel, and M. Beigl. 2013. Using a 2DST waveguide for usable, physically constrained out-of-band Wi-Fi authentication. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 221–224.

[6]

M. Budde, T. Riedel, M. Köpke, M. Berning, and M. Beigl. 2014. A Comparative Study to Evaluate the Usability of Context-based Wi-Fi Access Mechanisms. In International Conference on Universal Access in Human-Computer Interaction. Springer, 451–462.

[7]

M. Budde, A. Schankin, J. Hoffmann, M. Danz, T. Riedel, and M. Beigl. 2017. Participatory Sensing or Participatory Nonsense? – Mitigating the Effect of Human Error on Data Quality in Citizen Science. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–23.

Digital Library

[8]

M. Burmester, M. Hassenzahl, and F. Koller. 2002. Usability ist nicht alles Wege zu attraktiven Produkten (Beyond Usability Appeal of interactive Products). I-Com Zeitschrift für interaktive und kooperative Medien 1, 1/2002(2002), 32.

[9]

J.M. Carroll and J.C. Thomas. 1988. Fun. ACM SIGCHI Bulletin 19, 3 (1988), 21–24.

Digital Library

[10]

R.B. Cattell. 1966. The scree test for the number of factors. Multivariate Behavioural Research 1 (1966), 245–276.

[11]

J. Cohen. 1988. Statistical power analysis for the behavioral sciences. Erlbaum, Hillsdale.

[12]

L.J. Cronbach and P.E. Meehl. 1955. Construct validity in psychological tests.Psychological Bulletin 52, 4 (1955), 281–302.

[13]

ISO DIN. 2009. 9241-210: 2010. Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems. International Standardization Organization (ISO). Switzerland (2009).

[14]

B. D. Harper and K. L. Norman. 1993. Improving user satisfaction: The questionnaire for user interaction satisfaction version 5.5. In Proceedings of the 1st Annual Mid-Atlantic Human Factors Conference. 224–228.

[15]

M. Hassenzahl. 2001. The effect of perceived hedonic quality on product appealingness. International Journal of Human-Computer Interaction 13, 4(2001), 481–499.

[16]

M. Hassenzahl. 2003. The thing and I: understanding the relationship between user and product. In Funology. Springer, 31–42.

[17]

M. Hassenzahl. 2004. The interplay of beauty, goodness, and usability in interactive products. Human-computer interaction 19, 4 (2004), 319–349.

[18]

M. Hassenzahl, A. Beu, and M. Burmester. 2001. Engineering joy. IEEE Software 18, 1 (2001), 70.

Digital Library

[19]

M. Hassenzahl, M. Burmester, and F. Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In Mensch & Computer 2003. Springer, 187–196.

[20]

M. Hassenzahl, A. Platz, M. Burmester, and K. Lehner. 2000. Hedonic and ergonomic quality aspects determine a software’s appeal. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 201–208.

Digital Library

[21]

M. Hassenzahl and N. Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91–97.

[22]

P.W. Jordan. 2002. Designing pleasurable products: An introduction to the new human factors. CRC press.

[23]

B. Laugwitz, T. Held, and M. Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and Usability Engineering Group. Springer, 63–76.

[24]

R.J. Logan. 1994. Behavioral and emotional usability: Thomson consumer electronics. In Usability in practice: how companies develop user-friendly products. 59–82.

[25]

N. Mundorf, S. Westin, and N. Dholakia. 1993. Effects of hedonic components and user’s gender on the acceptance of screen-based information services. Behaviour & Information Technology 12, 5 (1993), 293–303.

[26]

D.A. Norman. 2004. Emotional design. Ubiquity 4, 45 (2004), 1.

Digital Library

[27]

M. Rauschenberger, M. Schrepp, M.P. Cota, S. Olschner, and J. Thomaschewski. 2013. Efficient measurement of the user experience of interactive products. How to use the user experience questionnaire (ueq). example: spanish language version. IJIMAI 2, 1 (2013), 39–45.

[28]

J. Sauro. 2015. SUPR-Q: a comprehensive measure of the quality of the website user experience. Journal of Usability Studies 10, 2 (2015), 68–86.

Digital Library

[29]

M. Schrepp, A. Hinderks, and J. Thomaschewski. 2014. Applying the User Experience Questionnaire (UEQ) in different evaluation scenarios. In International Conference of Design, User Experience, and Usability. Springer, 383–392.

[30]

M. Schrepp, A. Hinderks, and J. Thomaschewski. 2017. Konstruktion einer Kurzversion des User Experience Questionnaire. Mensch und Computer 2017-Tagungsband(2017).

[31]

M. Thüring. 2013. Nutzererleben Komponenten, Phasen, Phänomene. In Mensch & Computer Workshopband. 113–120.

[32]

M. Thüring and S. Mahlke. 2007. Usability, aesthetics and emotions in human–technology interaction. International Journal of Psychology 42, 4 (2007), 253–264.

[33]

N. Tractinsky, A.S. Katz, and D. Ikar. 2000. What is beautiful is usable. Interacting with computers 13, 2 (2000), 127–145.

Cited By

Alvarez DMonteloyola COgaya LPasaron KPurificacion PSerrano E(2024)Development of a Community-Based Disaster Awareness Web-based Application for Human-Computer Interaction: Pulse PHProceedings of the 2024 9th International Conference on Intelligent Information Technology10.1145/3654522.3654599(512-516)Online publication date: 23-Feb-2024
https://dl.acm.org/doi/10.1145/3654522.3654599
Esfahani SDe Toni GLepri BPasserini ATentori KZancanaro M(2024)Preference Elicitation in Interactive and User-centered Algorithmic Recourse: an Initial ExplorationProceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3627043.3659556(249-254)Online publication date: 22-Jun-2024
https://dl.acm.org/doi/10.1145/3627043.3659556
Nguyen BVande Moere A(2024)The Adaptive Architectural Layout: How the Control of a Semi-Autonomous Mobile Robotic Partition was Shared to Mediate the Environmental Demands and Resources of an Open-Plan OfficeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642465(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642465
Show More Cited By

Index Terms

Psychometric Properties of the User Experience Questionnaire (UEQ)
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. HCI theory, concepts and models

Recommendations

Adaption of user experience questionnaires for different user groups

Products should guarantee a sufficiently high user experience for all intended user groups. A good user experience means not only that it is sufficient to allow users to work effectively and efficiently with a product, but also that non-task-related ...
A questionnaire to measure the user experience in immersive virtual environments
VRIC '16: Proceedings of the 2016 Virtual Reality International Conference

Most of the models of User eXperience (UX) in Immersive Virtual Environment (IVE) are partial due to the components and the measuring methods they suggest. We have presented in a previous work a holistic UX in IVE model, combining key components and ...
Interpreting the Results from the User Experience Questionnaire (UEQ) using Importance-Performance Analysis (IPA)
WEBIST 2019: Proceedings of the 15th International Conference on Web Information Systems and Technologies

User Experience Questionnaire is a common and valid method to measure the User Experience (UX) for a product or service. In recent years, these questionnaires have established themselves to measure various aspects of UX. In addition to the questionnaire,...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

10459 pages

ISBN:9781450391573

DOI:10.1145/3491102

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA
,
Steven Drucker
Microsoft Research, USA
,
Julie Williamson
University of Glasgow, UK
,
Koji Yatani
University of Tokyo, Japan

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Federal Ministry of Transport and Digital Infrastructure, Germany
European Commission
Federal Ministry of Education and Research, Germany

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
1,062
Total Downloads

Downloads (Last 12 months)298
Downloads (Last 6 weeks)32

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Alvarez DMonteloyola COgaya LPasaron KPurificacion PSerrano E(2024)Development of a Community-Based Disaster Awareness Web-based Application for Human-Computer Interaction: Pulse PHProceedings of the 2024 9th International Conference on Intelligent Information Technology10.1145/3654522.3654599(512-516)Online publication date: 23-Feb-2024
https://dl.acm.org/doi/10.1145/3654522.3654599
Esfahani SDe Toni GLepri BPasserini ATentori KZancanaro M(2024)Preference Elicitation in Interactive and User-centered Algorithmic Recourse: an Initial ExplorationProceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3627043.3659556(249-254)Online publication date: 22-Jun-2024
https://dl.acm.org/doi/10.1145/3627043.3659556
Nguyen BVande Moere A(2024)The Adaptive Architectural Layout: How the Control of a Semi-Autonomous Mobile Robotic Partition was Shared to Mediate the Environmental Demands and Resources of an Open-Plan OfficeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642465(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642465
Amalia DMarthamillenia DNabilah AKomalasari YSanjaya Y(2024)Interactive Game-based Learning with AviEdu for Superior Aviation Training2024 3rd International Conference on Creative Communication and Innovative Technology (ICCIT)10.1109/ICCIT62134.2024.10701230(1-6)Online publication date: 7-Aug-2024
https://doi.org/10.1109/ICCIT62134.2024.10701230
Xing YXiao YLuo Y(2024)Integrating restoration and interactive exploration to enhance cultural heritage through VR storytellingScientific Reports10.1038/s41598-024-72182-914:1Online publication date: 11-Sep-2024
https://doi.org/10.1038/s41598-024-72182-9
Rubab SZaman MRashid UYu LWu Y(2024)Audio-visual training and feedback to learn touch-based gesturesJournal of Visualization10.1007/s12650-024-01012-x27:6(1117-1142)Online publication date: 17-Jun-2024
https://doi.org/10.1007/s12650-024-01012-x
Oomori KKawabe WMatulic FIgarashi THiguchi K(2023)Interactive 3D Annotation of Objects in Moving Videos from Sparse Multi-view FramesProceedings of the ACM on Human-Computer Interaction10.1145/36264767:ISS(309-326)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626476
Brie PBurny NSluÿters AVanderdonckt J(2023)Evaluating a Large Language Model on Searching for GUI LayoutsProceedings of the ACM on Human-Computer Interaction10.1145/35932307:EICS(1-37)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593230
Gorichanaz T(2023)Bringing Design Patterns to Life: Applying Christopher Alexander’s Theory of Living Structure in HCIInternational Journal of Human–Computer Interaction10.1080/10447318.2023.226228540:22(7214-7232)Online publication date: 2-Oct-2023
https://doi.org/10.1080/10447318.2023.2262285
Tsui AKuzminykh A(2023)Detect and Interpret: Towards Operationalization of Automated User Experience EvaluationDesign, User Experience, and Usability10.1007/978-3-031-35702-2_6(82-100)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35702-2_6
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents