Article

Free access

Practical usability evaluation

Author:

Gary PerlmanAuthors Info & Claims

CHI EA '97: CHI '97 Extended Abstracts on Human Factors in Computing Systems

Pages 168 - 169

https://doi.org/10.1145/1120212.1120326

Published: 22 March 1997 Publication History

Abstract

Practical Usability Evaluation is an introduction to cost-effective, low-skill, low-investment methods of usability assessment. The methods include (1) Inspection Methods (e.g., heuristic evaluation), (2) Observational Skills and Video (including user testing with think-aloud protocols), (3) Program Instrumentation, and (4) Questionnaires. The tutorial features many step-by-step procedures to aid in evaluation plan design.

References

[1]

AERA, APA, and NCEA (1985) Standards for Educational and Psychological Testing. Washington, DC: American Psychological Association.

[2]

American Psychological Association (1982) Ethical Principles in the Conduct of Research with Human Participants. Washington. DC: APA.

[3]

Bias, R. G. & Mayhew, D. J. (Eds.) (1994) Cost-Justifying Usability, Boston, Mass.: Academic Press.

Digital Library

[4]

Card, S. K., Moran, T. P. & Newell, A. (1983) The Psychology of Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum Associates.

Digital Library

[5]

Chin, J. P., Diehl, V. A. & Norman, K. L. (1988) Development of an Instrument Measuring User Satisfaction of the Human-Computer Interface.ACM CHI'88 Proceedings. 213--218.

Digital Library

[6]

Dumas. J. S & Redish, J. C (1993) A Practical Guide to Usability Testing. Norwood, NJ: Ablex.

Digital Library

[7]

Gould. J. D. & Lewis, C. (1985) Designing for Usability: Key Principles and What Designers ThinkComm. of the ACM, 28:3, 300--311.

Digital Library

[8]

Gould, J. D. (1988) How to Design Usable Systems. In M. Helander (Ed.) Handbook of Human-Computer Interaction. New York: North-Holland. 757--789.

[9]

Grissom, S. B. & Perlman, G. (1995) StEP(3D): A Standardized Evaluation Plan for Three-Dimensional Interaction Techniques.International Journal of Human-Computer Studies, 43:1, 15--41.

Digital Library

[10]

Hix, D. & Hartson, H. R. (1993) Developing User Interface: Ensuring Usability through Product and Process. New York: Wiley.

Digital Library

[11]

Jeffries, R. et al (1991) User Interface Evaluation in the Real World: A Comparison of Four Techniques.ACM CHI'91. 119--124.

Digital Library

[12]

Karat, J. (1988) Software Evaluation Methodologies. Chapter 41 in M. Helander (Ed.) Handbook of Human-Computer Interaction. New York: North-Holland, 891--903.

[13]

Lewis, J. R. (1995) IBM Computer Usability Satisfaction Questionnaires: Psychometric Evaluation and Instructions for Use.Intl. Jl. of HCI, 7:1, 57--78.

Digital Library

[14]

Lewis, C. & Reiman, J. (1993) Task-Centered User Interface Design. (text at ftp.cs.colorado.edu in/pub/cs/distribs/clewis/HCI-Design-Book).

[15]

Landauer, T. K. (1988) Research Methods in Human-Computer Interaction. Chapter 42 in M. Helander (Ed.) Handbook of Human-Computer Interaction. New York: North-Holland, 905--928.

[16]

Nielsen, J. (1993) Usability Engineering, Boston: Academic Press.

[17]

Nielsen, J. & Landauer, T. K. A Mathematical Model of the Finding of Usability Problems.Proceedings of INTERCHI'93. 206--213.

Digital Library

[18]

Nielsen, J. (Ed.) (1994) Special Issue: Usability Laboratories. Behaviour and Information Technology, 13:1--2.

[19]

Nielsen, J. & Mack, R. L. (Eds.) (1994) Usability Inspection Methods. New York: John Wiley & Sons.

Digital Library

[20]

Norman, D. A. (1990) The Design of Everyday Things. Doubleday.

Digital Library

[21]

Preece, J. (Ed.) A Guide to Usability: Human Factors in Computing. Wokingham, England: Addison-Wesley.

Digital Library

[22]

Preece, J., Rogers, Y., Sharp, H., Benyon. D., Holland, S. & Carey, T. (1994) Human-Computer Interaction. Wokingham, UK: Addison-Wesley.

Digital Library

[23]

Rubin, J. (1994) Handbook of Usability Testing. New York. Wiley.

Digital Library

[24]

Ravden, S. J. & Graham I. Johnson, G. I. (1989) Evaluating Usability of Human-Computer Interfaces: A Practical Method. Chichester, England: Wiley.

Digital Library

[25]

Smith, S. L. & Mosier, J. N. (1984) A Design Evaluation Checklist for User-System Interface Software. Bedford, Mass.: MITRE TR-10090.

[26]

Solso, R. L. & Johnson, H. H. (1989) An Introduction to Experimental Design in Psychology: A Case Approach (Fourth Edition). New York: Harper and Row, Publishers.

[27]

Whiteside, J., Bennett, J. & Holtzblatt, K. (1988) Usability Engineering: Our Experience and Evolution. Chapter 36 in M. Helander (Ed.) Handbook of Human-Computer Interaction. New York: North-Holland. 791--817.

[28]

Wiklund, M. E. (Ed.) (1994) Usability in Practice: How Companies Develop User-Friendly Products. Boston: Academic Press.

Digital Library

[29]

Wright, P. C. & Monk, A. F. (1991) A Cost-Effective Evaluation Method for Use by Designers.International Journal of Man-Machine Studies, 35:6, 891--912.

Digital Library

Cited By

Deshmukh AChalmeta R(2024)Validation of system usability scale as a usability metric to evaluate voice user interfacesPeerJ Computer Science10.7717/peerj-cs.191810(e1918)Online publication date: 29-Feb-2024
https://doi.org/10.7717/peerj-cs.1918
Daineko YIpalakova MTsoy DSeitnur AZhenisov DBolatov Z(2020)Virtual Reality Technologies as a Tool for Development of Physics Learning Educational ComplexAugmented Reality, Virtual Reality, and Computer Graphics10.1007/978-3-030-58465-8_15(194-202)Online publication date: 31-Aug-2020
https://doi.org/10.1007/978-3-030-58465-8_15
Khan JArif FMohsin A(2015)Usability concerns of android casual game applications: Analysis and improvements2015 Science and Information Conference (SAI)10.1109/SAI.2015.7237146(206-216)Online publication date: Jul-2015
https://doi.org/10.1109/SAI.2015.7237146
Show More Cited By

Index Terms

Practical usability evaluation
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software implementation planning
        Software design techniques
    2. Software development process management

Recommendations

Usability evaluation methods: mind the gaps
SAICSIT '09: Proceedings of the 2009 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists

The strengths and weaknesses of heuristic evaluation have been well researched. Despite known weaknesses, heuristic evaluation is still widely used since formal usability testing (also referred to as empirical user testing) is more costly and time ...
Usability evaluation of user interfaces in complex tasks applying usability heuristics to CAD UI evaluation in practical work

The importance of the information technology (IT) has increased in design work. The usability and applicability of computer aided design (CAD) to practical work is not in the level that could be expected. There is significant unutilised capacity in ...
Evaluating usability evaluation methods: criteria, method and a case study
HCI'07: Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability

The paper proposes an approach to comparative usability evaluation that incorporates important relevant criteria identified in previous work. It applies the proposed approach to a case study of a comparative evaluation of an academic website employing ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '97: CHI '97 Extended Abstracts on Human Factors in Computing Systems

March 1997

406 pages

ISBN:0897919262

DOI:10.1145/1120212

Conference Chairs:
Alan Edwards
Unisys
,
Steven Pemberton
CWI

Copyright © 1997 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 March 1997

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
945
Total Downloads

Downloads (Last 12 months)59
Downloads (Last 6 weeks)10

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Deshmukh AChalmeta R(2024)Validation of system usability scale as a usability metric to evaluate voice user interfacesPeerJ Computer Science10.7717/peerj-cs.191810(e1918)Online publication date: 29-Feb-2024
https://doi.org/10.7717/peerj-cs.1918
Daineko YIpalakova MTsoy DSeitnur AZhenisov DBolatov Z(2020)Virtual Reality Technologies as a Tool for Development of Physics Learning Educational ComplexAugmented Reality, Virtual Reality, and Computer Graphics10.1007/978-3-030-58465-8_15(194-202)Online publication date: 31-Aug-2020
https://doi.org/10.1007/978-3-030-58465-8_15
Khan JArif FMohsin A(2015)Usability concerns of android casual game applications: Analysis and improvements2015 Science and Information Conference (SAI)10.1109/SAI.2015.7237146(206-216)Online publication date: Jul-2015
https://doi.org/10.1109/SAI.2015.7237146
Martins VKirner TKirner C(2015)Subjective Usability Evaluation Criteria of Augmented Reality ApplicationsVirtual, Augmented and Mixed Reality10.1007/978-3-319-21067-4_5(39-48)Online publication date: 21-Jul-2015
https://doi.org/10.1007/978-3-319-21067-4_5
Liapis AArgyzoudis E(2013)Galileo Case StudyDesigning, Engineering, and Analyzing Reliable and Efficient Software10.4018/978-1-4666-2958-5.ch015(251-282)Online publication date: 2013
https://doi.org/10.4018/978-1-4666-2958-5.ch015
Rico MCorcho ÓMacías JCamacho D(2010)A Tool Suite to Enable Web Designers, Web Application Developers and End-users to Handle Semantic Data1International Journal on Semantic Web and Information Systems10.4018/jswis.20100701036:3(38-60)Online publication date: Sep-2012
https://doi.org/10.4018/jswis.2010070103
De Marsico MLevialdi S(2004)Evaluating web sitesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2003.10.00860:3(381-416)Online publication date: 1-Mar-2004
https://dl.acm.org/doi/10.1016/j.ijhcs.2003.10.008
Diaz PSicilia MAedo I(2002)Evaluation of hypermedia educational systems: criteria and imperfect measuresInternational Conference on Computers in Education, 2002. Proceedings.10.1109/CIE.2002.1186023(621-626)Online publication date: 2002
https://doi.org/10.1109/CIE.2002.1186023
Bernardo FHipólito JTremaine M(2000)Enabling easy access to digital geographic informationCHI '00 Extended Abstracts on Human Factors in Computing Systems10.1145/633292.633398(193-194)Online publication date: 1-Apr-2000
https://dl.acm.org/doi/10.1145/633292.633398

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents