Usability Testing

USABILITY TESTING
1
The Objectives:
Explain how to do usability testing through examples.
Outline the basics of experimental design.
Discuss the methods used in usability testing.
Discuss the role of field studies in evaluation.
ISO Definition (9241-11) for Usability:
“...the extent to which a product can be used by specified

users to achieve specified goals with effectiveness, efficiency
and satisfaction in a specified context of use.”
What is Usability Testing?
Usability testing is an effort to ascertain the

degree to which software has met the
usability needs of its intended user.
Usability is difficult to evaluate and measure

What is Usability Testing?
Usability Testing is an attempt to
quantify software user-friendliness
according to:
1. Skill needed to learn the software
2. Time required to become efficient in using
the software
3. The measured increase in user productivity
4. A subjective assessment of a user’s attitude
toward using the software
Usability factors to evaluate
Usability testing
Test early in the process

Test with 3-5 users (or less!)
Ask the user to think aloud
Same facilitation rules as with interviews,
plus:
◦ Don’t help
◦ Make clear you’re testing the product, not the
user
Formal vs. Informal Testing
Formal testing might entail building a

usability testing lab, equipping it with an
array of computers, audio-video
equipment, then staffing it with
psychologists, technicians, and human-
computer interaction specialists
Formal vs. Informal Testing
Informal approach: No fancy lab or
expensive equipment
A simple test plan and task list are
prepared, notepad and pencil
Participants are observed by an impartial
moderator
The advantage is that informal testing looks
at what people actually do when they are
doing real work in an ordinary setting
Testing Basics: 5-Step Process
Step 1:
PLAN & PREP
Step 2:
SELECT PARTICIPANTS
Step 3:
CONDUCT TESTS
Step 4:
ANALYZE RESULTS
Step 5:
DEVELOP
RECOMENDATIONS
Step 1: Plan & Prepare
Create a Task List:
Create lists of tasks or questions that
a typical user should be able to
complete in an hour
Tasks should not be too simple nor
too difficult to accomplish
◦ e.g., 1. Find a concert show you want to see
2. Purchase tickets on line
3. Find directions to the venue
Step 2: Find Participants
Prior to conducting sessions with
participants:
Test out your test plan beforehand with
co-workers or friends that have an
acceptable degree of Web user experience
The first usability test should be fun,
informative, and low-stress
Step 3: Conduct the Session
Introduce yourself, explain the process to
the user
User will be asked to perform a set of pre-
defined tasks (but do not tell them how
many or how long each will take)
Make the user feel comfortable
Speak only to give a new task and take
notes during the process
Step 3: Conduct the Session
Collect basic data:
◦ Could the user complete the task?
◦ Did they need help?
◦ Track how much time it took them
◦ Note any stumbling blocks
(problems/obstacles)
◦ Overall observations, commentary
◦ Debrief the user, allow user to speak their
mind
◦ Prepare a post-test survey
Step 4: Analyze Results
Identify difficulties and problem
areas
Identify why there was difficulty or
the source of any problems (specific
factors such as navigation, text,
graphics, etc.)
Identify any specific task-oriented
issues
Step 5: Make
Recommendations
Compile and recommend
◦ Gather all your compiled information and
translate into recommendations
◦ Concentrate on high-level functionality first
◦ Then focus on recommendations for improved
user experience (what works and what does not
work well for users!)
◦ Determine the implementation plan
Write up a formal report

Example
Instead of "Why did you click on that
icon?" ask "Can you tell me what about the
icon led you to click on it?"
Instead of, "Why did you choose number
6?" ask "Can you briefly explain why you
chose a 6 when deciding to recommend or
not recommend the product to a friend?"
Usability Laboratory
Monitor users while they use system (or a
prototype)
Evaluators User
one-way
mirror
Usability Laboratory
Eye Tracking
Eye Tracking
Sample questionnaire
The System Usability Scale (SUS) is a ten-item

questionnaire administered to users for
measuring the perceived ease of use of software,
hardware, cell phones and websites.
More
26
27
28
Preparing a Summary Report
Compare the differences of the pictures.
Describe your results:
list key problems identified by users; there is likely
to be some uniformity among responses (e.g.,
common concerns, problems, issues)
sort problems by priority and frequency
Develop and implement solutions
SUMMARY: Usability Testing
To identify problems
Typical users perform typical tasks
Collect data
Objective: Task times, error rates
Subjective: Ratings, Comments, Observations
Analyze data to identify usability
problems
Summary
Usability Testing
assessment of usability of system, in

terms of learnability, ease of use, flexibly,
safety, effectiveness, efficiency, and attitude
of users to system
Usability Labs
special purpose labs for conducting

studies, video & audio facilities, observation
of "subjects" ....
Example Questions
1. What are the four main types of help that users may require? For
each type, give an example of a situation in which it would be
appropriate.
2. Which usability principles are especially important in the design of
help systems, and why?
3. Describe some of the different approaches to providing user support
systems, with examples.
4. Applications are often supported by an online version of the paper
documentation; in some cases there is no paper documentation at
all.
a) What are the advantages of online documentation? What are the
disadvantages, and how can they be overcome?
b) Discuss the presentation issues involved in the design of effective and
relevant help systems.
32

Usability Testing

Uploaded by

Copyright:

Available Formats

Usability Testing

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Usability Testing

Uploaded by

Copyright:

Available Formats

USABILITY TESTING

“...the extent to which a product can be used by specified

Usability testing is an effort to ascertain the

Usability is difficult to evaluate and measure

Test early in the process

Formal testing might entail building a

Write up a formal report

The System Usability Scale (SUS) is a ten-item

assessment of usability of system, in

special purpose labs for conducting

You might also like