Article

Comparative analysis of high- and low-fidelity prototypes for more valid usability evaluations of mobile devices

Authors:

Youn-kyung Lim,

Subashini Periyasami,

Shweta AnejaAuthors Info & Claims

NordiCHI '06: Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles

Pages 291 - 300

https://doi.org/10.1145/1182475.1182506

Published: 14 October 2006 Publication History

Abstract

Validation of low-fidelity prototyping test results is difficult because we cannot claim whether the results are the effect of the prototype itself or the essence of the design concept we try to evaluate. However, it will cost too much if we implement a fully functional prototype for more valid evaluation. In this research, we provide a qualitative and reflective analysis of usability evaluations of a text messaging functionality of a mobile phone by comparing three types of prototyping techniques---paper-based and computer-based and fully functional prototype. This analysis led us to realize how significantly the unique characteristics of each different prototype affect the usability evaluation in different ways. We identify what characteristics of each prototype causes the differences in finding usability problems, and then suggest key considerations for designing more valid low-fidelity prototypes based on this analysis.

References

[1]

Archer, N. P., and Yuan, Y. Comparing telephone-computer interface designs: Are software simulations as good as hardware prototypes? International Journal of Human-Computer Studies, 42, 2 (1995), 169--184.

Digital Library

[2]

Avrahami, D., and Hudson, S. Forming interactivity: A tool for rapid prototyping of physical interactive products. Proc. DIS2002, 141--146.

Digital Library

[3]

Buchenau, M. and Suri, J. F. Experience prototyping. In Proc. DIS2000. ACM Press, NY, 2000, 424--433.

Digital Library

[4]

Cockton, G. and Woolrych, A. Sale must end: should discount methods be cleared off hci's shelves? Interactions, 9, 5 (2002), 13--18.

Digital Library

[5]

Convertino, G., Neale, D. C., Hobby, L., Carroll, J. M., and Rosson, M. B. A laboratory method for studying activity awareness. Proc. NordiCHI2004, 313--322.

Digital Library

[6]

Davies, N., Landay, J., Hudson, S., and Schmidt, A. Rapid prototyping for ubiquitous computing. IEEE Pervasive Computing, 4, 4 (2005), 15--17.

Digital Library

[7]

Grady, H. M. Web site design: a case study in usability testing using paper prototypes. Proc. SIGDOC'00, 39--45.

Digital Library

[8]

Greenberg, S., and Boyle, M. Customizable physical interfaces for interacting with conventional applications. Proc. UIST '02, 31--40.

Digital Library

[9]

Gutierrez, O. Prototyping techniques for different problem contexts. Proc. CHI '89, 259--264.

Digital Library

[10]

John, B. E. and Salvucci, D. D. Multipurpose prototypes for assessing user interface in pervasive computing systems. IEEE Pervasive Computing, 4, 4 (2005), 27--34.

Digital Library

[11]

Lee, J. C., Avrahami, D., Hudson, S. E., Forlizzi, J., Dietz, P. H., and Leigh, D. The calder toolkit: wired and wireless components for rapidly prototyping interactive devices. Proc. DIS2004, 167--175.

Digital Library

[12]

Liu, L., and Khooshabeh, P. Paper or interactive? A study of prototyping techniques for ubiquitous computing environments. Proc. CHI '03, 1030--1031.

Digital Library

[13]

MacIntyre, B., Gandy, M., Dow, S., and Bolter, J. D. DART: a toolkit for rapid design exploration of augmented reality experiences. Proc. UIST '04, 197--206.

Digital Library

[14]

Nam, T., and Lee, W. Integrating hardware and software: augmented reality based prototyping method for digital products. Proc. CHI '03, 956--957.

Digital Library

[15]

Nielsen, J., and Landauer, T. K. A mathematical model of the finding of usability problems. Proc. ACM INTERCHI'93, pp. 206--213.

Digital Library

[16]

Pering, C. Interaction design prototyping of communicator devices: Towards meeting the hardware-software challenge. Interactions, 9, 6 (2002), 36--46.

Digital Library

[17]

Reilly, D., Dearman, D., Welsman-Dinelle, M., and Inkpen, K. Evaluating early prototypes in context: tradeoffs, challenges, and successes. IEEE Pervasive Computing, 4, 4 (2005), 42--50.

Digital Library

[18]

Rettig, M. Prototyping for tiny fingers. Communications of the ACM, 37, 4 (1994), 21--27.

Digital Library

[19]

Rudd, J., Stern, K., and Isensee, S. Low vs. high-fidelity prototyping debate. Interactions, 3, 1 (1996), 76--85.

Digital Library

[20]

Schneider, K. Prototypes as assets, not toys: why and how to extract knowledge from prototypes. Proc. ICSE-18 '96, 522--531.

Digital Library

[21]

Sefelin, R., Tscheligi, M., and Giller, V. Paper prototyping - what is it good for? A comparison of paper- and computer-based low-fidelity prototyping. Proc. CHI '03, 778--779.

Digital Library

[22]

Snyder, C. Paper Prototyping: The Fast and Easy Way to Define and Refine User Interfaces. Morgan Kaufmann Publishers, San Francisco, CA, 2003.

[23]

Thompson, M., and Wishbow, N. Prototyping: tools and techniques: improving software and documentation quality through rapid prototyping. Proc. SIGDOC '92, 191--199.

Digital Library

[24]

Virzi, R. A., Sokolov, J. L., and Karis, D. Usability Problem Identification Using Both Low- and High-Fidelity Prototype. Proc. CHI '96, 236--243.

Digital Library

Cited By

MENZİ ÇETİN N(2024)Integrating Usability into Software Engineering Course ProjectsJournal of Computer and Education Research10.18009/jcer.141724512:23(209-240)Online publication date: 21-Mar-2024
https://doi.org/10.18009/jcer.1417245
Gali OTüter GErcan SDelgado ÓAtherton GCross LPares N(2024)Participatory Design of an Embodied Mixed Reality Experience Aimed to Assessing Individual and Collaborative Behaviors of ChildrenProceedings of the ACM on Human-Computer Interaction10.1145/36770938:CHI PLAY(1-27)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677093
Chen JYoon D(2024)Exploring the Diminishing Allure of Paper and Low-Fidelity Prototyping Among Designers in the Software Industry: Impacts of Hybrid Work, Digital Tools, and Corporate CultureProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642774(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642774
Show More Cited By

Index Terms

Comparative analysis of high- and low-fidelity prototypes for more valid usability evaluations of mobile devices
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User centered design
2. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software implementation planning
        Software design techniques
    2. Software development process management

Recommendations

Breaking the fidelity barrier: an examination of our current characterization of prototypes and an example of a mixed-fidelity success
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This paper presents a summary of the space of commonly-used HCI prototyping methods (low-fidelity to high-fidelity) and asserts that with a better understanding of this space, HCI practitioners will be better equipped to direct scarce prototyping ...
The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas

The role of prototypes is well established in the field of HCI and Design. A lack of knowledge, however, about the fundamental nature of prototypes still exists. Researchers have attempted to identify different types of prototypes, such as low- vs. high-...
Comparing Low and High-Fidelity Prototypes in Mobile Phone Evaluation

This study compared usability testing results found with low-and high-fidelity prototypes for mobile phones. The main objective is to obtain deep understanding of usability problems found with different prototyping methods. Three mobile phones from ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '06: Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles

October 2006

517 pages

ISBN:1595933255

DOI:10.1145/1182475

Editors:
Anders Mørch
University of Oslo, Norway
,
Konrad Morgan
University of Bergen, Norway
,
Tone Bratteteig
University of Oslo, Norway
,
Gautam Ghosh
Userminded, Norway
,
Dag Svanaes
Norwegian University of Science and Technology, Trondheim, Norway

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

NORDICHI06

NORDICHI06: The 4th Nordic Conference on Human-Computer Interaction

October 14 - 18, 2006

Oslo, Norway

Acceptance Rates

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

63
Total Citations
View Citations
3,760
Total Downloads

Downloads (Last 12 months)134
Downloads (Last 6 weeks)18

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

MENZİ ÇETİN N(2024)Integrating Usability into Software Engineering Course ProjectsJournal of Computer and Education Research10.18009/jcer.141724512:23(209-240)Online publication date: 21-Mar-2024
https://doi.org/10.18009/jcer.1417245
Gali OTüter GErcan SDelgado ÓAtherton GCross LPares N(2024)Participatory Design of an Embodied Mixed Reality Experience Aimed to Assessing Individual and Collaborative Behaviors of ChildrenProceedings of the ACM on Human-Computer Interaction10.1145/36770938:CHI PLAY(1-27)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677093
Chen JYoon D(2024)Exploring the Diminishing Allure of Paper and Low-Fidelity Prototyping Among Designers in the Software Industry: Impacts of Hybrid Work, Digital Tools, and Corporate CultureProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642774(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642774
Sim GRead J(2024)Using Eye-Tracking to Demonstrate Children’s Attention to Detail When Evaluating Low-Fidelity PrototypesInteracting with Computers10.1093/iwc/iwad052Online publication date: 10-Jan-2024
https://doi.org/10.1093/iwc/iwad052
Song DYuan WChao MHan T(2023)A modular visuo-haptic mixed reality (VHMR) aided prototype technique for in-vehicle human-machine interaction (HMI) evaluationsJournal of Engineering Design10.1080/09544828.2022.215855633:12(969-989)Online publication date: 4-Jan-2023
https://doi.org/10.1080/09544828.2022.2158556
Zhang XSimeone A(2023)Using Think-Aloud Protocol in Immersive VR EvaluationsEveryday Virtual and Augmented Reality10.1007/978-3-031-05804-2_8(197-226)Online publication date: 19-Feb-2023
https://doi.org/10.1007/978-3-031-05804-2_8
Zdanowska STaylor A(2022)A study of UX practitioners roles in designing real-world, enterprise ML systemsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517607(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517607
Filipović MVuković ŽDejanović IMilosavljević G(2021)Rapid Requirements Elicitation of Enterprise Applications Based on Executable MockupsApplied Sciences10.3390/app1116768411:16(7684)Online publication date: 21-Aug-2021
https://doi.org/10.3390/app11167684
Schaper MPares N(2021)Co-design Techniques for and with Children based on Physical Theatre Practice to promote Embodied AwarenessACM Transactions on Computer-Human Interaction10.1145/345044628:4(1-42)Online publication date: 23-Jul-2021
https://dl.acm.org/doi/10.1145/3450446
Lo WZollmann SRegenbrecht H(2021)From off-site to on-site: A Flexible Framework for XR Prototyping in Sports Spectating2021 36th International Conference on Image and Vision Computing New Zealand (IVCNZ)10.1109/IVCNZ54163.2021.9653277(1-6)Online publication date: 9-Dec-2021
https://doi.org/10.1109/IVCNZ54163.2021.9653277
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents