research-article

Variation in importance of time-on-task with familiarity with mobile phone models

Authors:

Shunsuke Suzuki,

Victoria Bellotti,

Bonnie E. John,

Toshiyuki Asahi,

Shin'ichi FukuzumiAuthors Info & Claims

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2551 - 2554

https://doi.org/10.1145/1978942.1979314

Published: 07 May 2011 Publication History

Abstract

We studied the extent to which time-on-task is correlated with perception of usability for people who are familiar with a phone model and for those who are not. Our controlled experiment, conducted in Japan, correlated subjective usability assessments with time-on-task for expert and novice users on three different mobile phone models. We found that the correlation between perceived usability and time-on-task is stronger when participants are more familiar with the phone model. While not significant when initially inspecting a new phone model, a negative correlation between time-on-task and perceived usability becomes significant with as little as an hour's time doing tasks on the unfamiliar phone. This suggests that designing the UI to make time-on-task as short as possible may not have much effect on the purchase decision, but as experience increases, it may increase the loyalty of existing users.

References

[1]

Brooke, J. SUS: A 'quick and dirty' usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, and I. L. McClelland (Eds.), Usability Evaluation in Industry (pp. 189--194), Taylor &#38; Francis, London, (1996).

[2]

Card, S. K., Moran, T.P. and Newell, A. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, Hillsdale, NJ (1983).

Digital Library

[3]

Fr&#248;kj&#230;r, E., Hertzum, M. and Hornb&#230;k, K. Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In Proc. CHI 2000, ACM Press (2000), 345--352.

Digital Library

[4]

Goo Ranking: Ranking of functions used commonly on a mobile phone. (2005), Retrieved September 17th, 2010. http://ranking.goo.ne.jp/ranking/065/mobile_use/.

[5]

Goo Ranking: Ranking of functions used commonly on a mobile phone besides call and email. (2008), Retrieved September 17th, 2010, http://ranking.goo.ne.jp/ranking/065/cellular_phone_function/.

[6]

Hassenzahl, M., Burmester, M. and Koller, F. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualit&#228;t. In J. Ziegler and G. Szwillus (Eds.), Mensch &#38; Computer 2003: Interaktion in Bewegung (pp.187--196), B.G. Teubner, Stuttgart, (2003).

[7]

Hornb&#230;k, K. and Law, E.L. Meta-Analysis of correlations among usability measures. In Proc. CHI 2007, ACM Press (2007), 617--626.

Digital Library

[8]

Karjaluoto, H., Karvonen, J., Kesti, M., Koivum&#228;ki, T., Manninen, M., Pakola, J., Ristola, A. and Salo, J. Factors affecting consumer choice of mobile phones: Two studies from Finland. Journal of Euromarketing 14, 3 (2005), 59--82.

[9]

My Voice: Functions used commonly on a mobile phone. (2008), Retrieved September 17th, 2010. http://www.myvoice.co.jp/biz/surveys/11601/index.html.

[10]

Nikkei BP: Which functions used commonly on a mobile phone? (2008), Retrieved September 17th, 2010. http://pc.nikkeibp.co.jp/article/column/20080919/1008086/.

[11]

Oricon: Functions used mainly on a mobile phone. (2009), Retrieved September 17th, 2010. http://life.oricon.co.jp/64543/full/#rk.

[12]

Quinn, J. M. and Tran, T. Q. Attractive phones don't have to work better: Independent effects of attractiveness, effectiveness, and efficiency on perceived usability. In Proc. CHI 2010, ACM Press (2010), 353--362.

Digital Library

[13]

Ryu, Y. S. Development of usability questionnaires for electronic mobile products and decision making methods, Doctoral Dissertation, Virginia Polytechnic Institute and State University, Blacksburg, VA, (2005).

[14]

Ryu, Y. S., Suh, T. and Kim, H. S. Revising the mobile phone usability questionnaire (MPUQ): An item response theory approach. In Proc. Society of Marketing Advances 2008, (2008), 235--236.

[15]

Sauro, J. and Lewis, J.R. Correlations among prototypical usability metrics: evidence for the construct of usability. In Proc. CHI 2009, ACM Press (2009), 1609--1618.

Digital Library

[16]

Sauro, J. Does better usability increase customer loyalty? Measuring Usability article. Retrieved on September 19th, 2010. http://www.measuringusability.com/usability-loyalty.php.

[17]

Seebode, J., Schaffer, S., Wechsung, I. and Metze, F. Influence of training on direct and indirect measures for the evaluation of multimodal systems. In Proc. Interspeech 2009, (2009), 300--303.

[18]

Suzuki, S., Nakao, Y., Asahi, T., Bellotti, V., Yee, N. and Fukuzumi, S. Empirical comparison of task completion time between mobile phone models with matched interaction sequences. In Proc. HCI International 2009, Springer (2009), 114--122.

Digital Library

Cited By

Weichbroth P(2024)Usability Testing of Mobile Applications: A Methodological FrameworkApplied Sciences10.3390/app1405179214:5(1792)Online publication date: 22-Feb-2024
https://doi.org/10.3390/app14051792
Arlinghaus COllermann F(2022)Hey, Siri®! Ok, Google®! Does Talking to Voice Assistants Enhance Emotional Aspects of Mobile Phone User Experience?Proceedings of Mensch und Computer 202210.1145/3543758.3547544(382-388)Online publication date: 4-Sep-2022
https://dl.acm.org/doi/10.1145/3543758.3547544
Tanikawa YSuzuki HKato HFukuzumi SHarada E(2016)Modeling How to Understand a Target SystemProceedings, Part I, of the 18th International Conference on Human-Computer Interaction. Theory, Design, Development and Practice - Volume 973110.1007/978-3-319-39510-4_21(220-232)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1007/978-3-319-39510-4_21
Show More Cited By

Index Terms

Variation in importance of time-on-task with familiarity with mobile phone models
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Index terms have been assigned to the content through auto-classification.

Recommendations

Usability risk level evaluation for physical user interface of mobile phone

The mobile phone has become an indispensable device in everyday life. However, many usability problems were generated by the multi-functionality of mobile phones. There was an important increase on the user interface (UI) design and usability. With the ...
Antecedents and consequences of mobile phone usability

We propose simplicity and interactivity as key determinants of usability.We examine the effects of usability on user satisfaction, trust, and brand loyalty.Increasing simplicity will increase interactivity and usability experience.Usability is a distal ...
Motivations for using the mobile phone for mass communications and entertainment

This study draws on the uses and gratifications framework to examine expanded use of a hybrid medium-the mobile phone-for mass communications and entertainment. Results of a telephone survey of 208 users show different motivations predict diverse uses ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2011

3530 pages

ISBN:9781450302289

DOI:10.1145/1978942

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Carl Gutwin
University of Saskatchewan
,
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
385
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Weichbroth P(2024)Usability Testing of Mobile Applications: A Methodological FrameworkApplied Sciences10.3390/app1405179214:5(1792)Online publication date: 22-Feb-2024
https://doi.org/10.3390/app14051792
Arlinghaus COllermann F(2022)Hey, Siri®! Ok, Google®! Does Talking to Voice Assistants Enhance Emotional Aspects of Mobile Phone User Experience?Proceedings of Mensch und Computer 202210.1145/3543758.3547544(382-388)Online publication date: 4-Sep-2022
https://dl.acm.org/doi/10.1145/3543758.3547544
Tanikawa YSuzuki HKato HFukuzumi SHarada E(2016)Modeling How to Understand a Target SystemProceedings, Part I, of the 18th International Conference on Human-Computer Interaction. Theory, Design, Development and Practice - Volume 973110.1007/978-3-319-39510-4_21(220-232)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1007/978-3-319-39510-4_21
Alonso-Ríos DRaneburger DPopp RKaindl HFalb JCho YShin SKim SHung CHong J(2014)A user study on tailoring GUIs for smartphonesProceedings of the 29th Annual ACM Symposium on Applied Computing10.1145/2554850.2555085(186-192)Online publication date: 24-Mar-2014
https://dl.acm.org/doi/10.1145/2554850.2555085
Raptis DTselios NKjeldskov JSkov MRohs MSchmidt AAshbrook DRukzio E(2013)Does size matter?Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services10.1145/2493190.2493204(127-136)Online publication date: 27-Aug-2013
https://dl.acm.org/doi/10.1145/2493190.2493204
Raneburger DPopp RAlonso-Ríos DKaind HFalb J(2013)A User Study with GUIs Tailored for Smartphones and Tablet PCsProceedings of the 2013 IEEE International Conference on Systems, Man, and Cybernetics10.1109/SMC.2013.635(3727-3732)Online publication date: 13-Oct-2013
https://dl.acm.org/doi/10.1109/SMC.2013.635
Raneburger DAlonso-Ríos DPopp RKaindl HFalb J(2013)A User Study with GUIs Tailored for SmartphonesHuman-Computer Interaction – INTERACT 201310.1007/978-3-642-40480-1_34(505-512)Online publication date: 2013
https://doi.org/10.1007/978-3-642-40480-1_34
Kronbauer ASantos CVieira VMaciel Cde Souza PAnacleto Jde Almeida Neris V(2012)Um estudo experimental de avaliação da experiência dos usuários de aplicativos móveis a partir da captura automática dos dados contextuais e de interaçãoProceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems10.5555/2393536.2393582(305-314)Online publication date: 5-Nov-2012
https://dl.acm.org/doi/10.5555/2393536.2393582

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents