forum

Are usability evaluations reproducible?

Author:

Rolf MolichAuthors Info & Claims

Interactions, Volume 25, Issue 6

Pages 82 - 85

https://doi.org/10.1145/3278154

Published: 25 October 2018 Publication History

Get Access

Abstract

This forum addresses conceptual, methodological, and professional issues that arise in the UX field's continuing effort to contribute robust information about users to product planning and design. --- David Siegel and Susan Dray, Editors

References

[1]

http://www.dialogdesign.dk/CUE.html

Google Scholar

[2]

Molich, R. and Dumas, J.S. Comparative usability evaluation --- CUE-4. Behaviour & Information Technology 27, 3 (2008), 263---281.

Digital Library

Google Scholar

[3]

Molich, R., Hornbæk, K., Krug, S., Scott, J., and Johnson, J. Recommendations on recommendations. User Experiencee 7, 4 (2008), 26--30.

Google Scholar

[4]

Molich, R., Chattratichart, J., Hinkle, V., Jensen, J.J., Kirakowski, J., Sauro, J., Sharon, T., and Traynor, B. Rent a car in just 0, 60, 240 or 1,217 seconds? --- Comparative usability measurement, CUE-8. Journal of Usability Studies 6, 1 (2010), 8--24.

Digital Library

Google Scholar

[5]

Hertzum, M., Molich, R., and Jacobsen, N.E. What you get is what you see: Revisiting the evaluator effect in usability tests. Behaviour & Information Technology 33, 2 (2013), 143--161.

Google Scholar

[6]

Lindgaard, G. and Chattratichart, J. Usability testing: What have we overlooked? Proc. of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, 2007, 1415--1424.

Digital Library

Google Scholar

Cited By

View all

Tjhie DMontague ECafazzo J(2024)Using a Critical FMEA Approach to Identify Equity-Related Failures in Usability Evaluations of Health TechnologiesProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324126038968:1(444-449)Online publication date: 12-Aug-2024
https://doi.org/10.1177/10711813241260389
O'Brien LWilson S(2023)Talking about Thinking Aloud: Perspectives from Interactive Think-Aloud PractitionersJournal of User Experience 10.5555/3605526.360552818:3(113-132)Online publication date: 20-Jun-2023
https://dl.acm.org/doi/10.5555/3605526.3605528
Grüger DWeiblen JWeber PLudwig T(2023)How Gamified Are Sustainable Food Apps? Applying the Gameful Design Heuristics to Evaluate Sustainable Food AppsProceedings of the ACM on Human-Computer Interaction10.1145/36110557:CHI PLAY(919-947)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611055
Show More Cited By

Index Terms

Are usability evaluations reproducible?
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing

Recommendations

Review of Software design and usability: talks with Bonnie Nardi, Jakob Nielsen, David Smith, Austin Henderson and Jed Harris, Terry Winograd, Stephanie Rosenbaum by Klaus Kaasgaard. Copenhagen Business School Press, 2000.
Artificial intelligence researchers: Alan Turing, Marvin Minsky, Seymour Papert, Joseph Weizenbaum, Kevin Warwick, Ray Kurzweil
Usability inspection methods: report on a workshop held at CHI'92, Monterey, CA, May 3–4, 1992

Usability inspection methods, based on informed intuition s about interface design quality, hold promise of providing faster, more cost-effective ways to generate usability evaluations, compared to empirical user evaluation methods . Examples of ...

Comments

Information & Contributors

Information

Published In

Interactions Volume 25, Issue 6

November - December 2018

90 pages

ISSN:1072-5520

EISSN:1558-3449

DOI:10.1145/3289188

Editors:
Simone Barbosa
Association for Computing Machinery, New York, NY
,
Gilbert Cockton
Association for Computing Machinery, New York, NY

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2018

Published in INTERACTIONS Volume 25, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Forum
Popular
Pre-selected

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
2,215
Total Downloads

Downloads (Last 12 months)395
Downloads (Last 6 weeks)51

Reflects downloads up to 12 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Tjhie DMontague ECafazzo J(2024)Using a Critical FMEA Approach to Identify Equity-Related Failures in Usability Evaluations of Health TechnologiesProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324126038968:1(444-449)Online publication date: 12-Aug-2024
https://doi.org/10.1177/10711813241260389
O'Brien LWilson S(2023)Talking about Thinking Aloud: Perspectives from Interactive Think-Aloud PractitionersJournal of User Experience 10.5555/3605526.360552818:3(113-132)Online publication date: 20-Jun-2023
https://dl.acm.org/doi/10.5555/3605526.3605528
Grüger DWeiblen JWeber PLudwig T(2023)How Gamified Are Sustainable Food Apps? Applying the Gameful Design Heuristics to Evaluate Sustainable Food AppsProceedings of the ACM on Human-Computer Interaction10.1145/36110557:CHI PLAY(919-947)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611055
(2023)ReferencesMeasuring the User Experience10.1016/B978-0-12-818080-8.00022-4(333-344)Online publication date: 2023
https://doi.org/10.1016/B978-0-12-818080-8.00022-4
Traynor B(2022)UX standards and UX maturityJournal of Usability Studies10.5555/3542830.354283117:2(31-40)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.5555/3542830.3542831
Buhle J(2021)The best of times for UX research, the worst of times for usability research?Journal of Usability Studies10.5555/3532758.353275916:3(148-155)Online publication date: 1-May-2021
https://dl.acm.org/doi/10.5555/3532758.3532759
Kortum PChaparro B(2021)Preface to the Special Section on the Science Behind Usability and UXHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/0018720821102690663:5(733-735)Online publication date: 9-Jul-2021
https://doi.org/10.1177/00187208211026906
Smith TKheng C(2021)Reliability of Heuristic Evaluation During Usability AnalysisProceedings of the 21st Congress of the International Ergonomics Association (IEA 2021)10.1007/978-3-030-74614-8_88(708-714)Online publication date: 13-Jun-2021
https://doi.org/10.1007/978-3-030-74614-8_88
Molich RWilson CBarnum CCooley DKrug SLaRoche CMartin BPatrowicz JTraynor B(2020)How professionals moderate usability testsJournal of Usability Studies10.5555/3532713.353271515:4(184-209)Online publication date: 1-Aug-2020
https://dl.acm.org/doi/10.5555/3532713.3532715
Vingen DAndrews EFerati M(2020)Usability in Patient-Oriented Drug Interaction Checkers—A Scandinavian Sampling and Heuristic EvaluationInformatics10.3390/informatics70400427:4(42)Online publication date: 9-Oct-2020
https://doi.org/10.3390/informatics7040042
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

Review of Software design and usability: talks with Bonnie Nardi, Jakob Nielsen, David Smith, Austin Henderson and Jed Harris, Terry Winograd, Stephanie Rosenbaum by Klaus Kaasgaard. Copenhagen Business School Press, 2000.

Artificial intelligence researchers: Alan Turing, Marvin Minsky, Seymour Papert, Joseph Weizenbaum, Kevin Warwick, Ray Kurzweil

Usability inspection methods: report on a workshop held at CHI'92, Monterey, CA, May 3–4, 1992

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Digital Edition

HTML Format

Share

Share this Publication link

Share on social media

Affiliations