research-article

Skillometers: reflective widgets that motivate and help users to improve performance

Authors:

Sylvain Malacria,

Tovi GrossmanAuthors Info & Claims

UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology

Pages 321 - 330

https://doi.org/10.1145/2501988.2501996

Published: 08 October 2013 Publication History

Abstract

Applications typically provide ways for expert users to increase their performance, such as keyboard shortcuts or customization, but these facilities are frequently ignored. To help address this problem, we introduce skillometers -- lightweight displays that visualize the benefits available through practicing, adopting a better technique, or switching to a faster mode of interaction. We present a general framework for skillometer design, then discuss the design and implementation of a real-world skillometer intended to increase hotkey use. A controlled experiment shows that our skillometer successfully encourages earlier and faster learning of hotkeys. Finally, we discuss general lessons for future development and deployment of skillometers.

Supplementary Material

suppl.mov (uist141.mp4)

Supplemental video

Download
11.52 MB

References

[1]

Apple accessibility api. https://developer.apple.com/library/mac/#documentation/Accessibility/Conceptual/AccessibilityMacOSX/OSXAXIntro/OSXAXintro.html.

[2]

Ribbon hero 2. http://www.ribbonhero.com/.

[3]

Adar, E., Tan, D., and Teevan, J. Benevolent deception in human computer interaction. In CHI '13, ACM (2013).

Digital Library

[4]

Aleven, V., Koedinger, K., Sinclair, H., and Snyder, J. Combatting shallow learning in a tutor for geometry problem solving. In Intelligent Tutoring Systems, Springer (1998).

Digital Library

[5]

Anderson, J., Corbett, A, Fincham, J., Hoffman, D., and Pelletier, R. General principles for an intelligent tutoring architecture. Cognitive approaches to automated instruction (Jan 1992).

[6]

Bailly, G., Pietrzak, T., Deber, J., and Wigdor, D. J. Métamorphe: augmenting hotkey usage with actuated keys. In CHI '13, ACM (2013).

Digital Library

[7]

Banovic, N., Chevalier, F., Grossman, T., and Fitzmaurice, G. Triggering triggers and burying barriers to customizing software. In CHI'12, ACM (2012).

Digital Library

[8]

Bateman, S., Teevan, J., and White, R. The search dashboard: how reflection and comparison impact search behavior. In CHI '12, ACM (2012).

Digital Library

[9]

Bau, O., and Mackay, W. Octopocus: a dynamic guide for learning gesture-based command sets. In UIST '08, ACM (2008).

Digital Library

[10]

Bhavnani, S., Peck, F., and Reif, F. Strategy-based instruction: Lessons learned in teaching the effective and efficient use of computer applications. ACM Trans. Comput.-Hum. Interact. 15, 1 (May 2008).

Digital Library

[11]

Bødker, S. Applying activity theory to video analysis: how to make sense of video data in human-computer interaction. In Context and consciousness, Massachusetts Institute of Technology (1995).

[12]

Carroll, J., and Rosson, M. Paradox of the active user. Interfacing thought: Cognitive aspects of human-computer interaction (1987).

Digital Library

[13]

Czerwinski, M., Horvitz, E., and Cutrell, E. Subjective duration assessment: An implicit probe for software usability. In IHM-HCI '01, vol. 2 (Jan 2001).

[14]

Deterding, S., Dixon, D., Khaled, R., and Nacke, L. From game design elements to gamefulness: defining 'gamification'. In MindTrek'11, ACM (2011).

Digital Library

[15]

Dong, T., Dontcheva, M., Joseph, D., Karahalios, K., Newman, M., and Ackerman, M. Discovery-based games for learning software. In CHI '12, ACM (2012).

Digital Library

[16]

Eagan, J., Beaudouin-Lafon, M., and Mackay, W. Cracking the cocoa nut: user interface programming at runtime. In UIST '11, ACM (2011).

Digital Library

[17]

Ericsson, K., and Simon, H. How to study thinking in everyday life: Contrasting think-aloud protocols with descriptions and explanations of thinking. Mind, Culture, and Activity 5, 3 (1998).

[18]

Evans, A., and Wobbrock, J. Taming wild behavior: the input observer for text entry and mouse pointing measures from everyday computer use. In CHI '12, ACM (2012).

Digital Library

[19]

Fitchett, S., and Cockburn, A. Accessrank: predicting what users will do next. In CHI '12, ACM (2012).

Digital Library

[20]

Grossman, T., Dragicevic, P., and Balakrishnan, R. Strategies for accelerating on-line learning of hotkeys. CHI '07, ACM (2007).

Digital Library

[21]

Kapp, K. The Gamification of Learning and Instruction: Game-based Methods and Strategies for Training and Education. Pfeiffer, 2012.

Digital Library

[22]

Krisler, B., and Alterman, R. Training towards mastery: overcoming the active user paradox. NordiCHI '08, ACM (2008).

Digital Library

[23]

Lane, D., Napier, H., Peres, S., and Sandor, A. Hidden costs of graphical user interfaces: Failure to make the transition from menus and icon toolbars to keyboard shortcuts. International Journal of Human-Computer Interaction 18, 2 (2005).

[24]

Lesgold, A., Eggan, G., Katz, S., and Rao, G. Possibilities for assessment using computer-based apprenticeship environments. Cognitive approaches to automated instruction (Jan 1992).

[25]

Li, W., Grossman, T., and Fitzmaurice, G. Gamicad: a gamified tutorial system for first time autocad users. In UIST '12, ACM (2012).

Digital Library

[26]

Linton, F., and Schaefer, H.-P. Recommender systems for learning: building user and expert models through long-term observation of application use. User Modeling and User-Adapted Interaction 10, 2.

Digital Library

[27]

Mackay, W. Triggers and barriers to customizing software. In CHI '91, ACM (1991).

Digital Library

[28]

Malacria, S., Bailly, G., Harrison, J., Cockburn, A., and Gutwin, C. Promoting hotkey use through rehearsal with exposehk. In CHI '13, ACM (2013).

Digital Library

[29]

Matejka, J., Grossman, T., and Fitzmaurice, G. Patina: Dynamic heatmaps for visualizing application usage. In CHI '13, ACM (2013).

Digital Library

[30]

Matejka, J., Li, W., Grossman, T., and Fitzmaurice, G. Communitycommands: command recommendations for software applications. In UIST '09, ACM (2009).

Digital Library

[31]

Newell, A., and Rosenbloom, P. Mechanisms of skill acquisition and the law of practice. Cognitive skills and their acquisition (1981).

[32]

Odell, D., Davis, R., Smith, A., and Wright, P. Toolglasses, marking menus, and hotkeys: a comparison of one and two-handed command selection techniques. In GI '04, Canadian Human-Computer Communications Society (2004).

Digital Library

[33]

Peres, S., Tamborello, F., Fleetwood, M., Chung, P., and Paige-Smith, D. Keyboard shortcut usage: The roles of social factors and computer experience. the Human Factors and Ergonomics Society Annual Meeting 48, 5 (2004).

[34]

Salmoni, A., Schmidt, R., and Walter, C. Knowledge of results and motor learning: A review and critical reappraisal. Psychological Bulletin 95, 3.

[35]

Scarr, J., Cockburn, A., Gutwin, C., and Quinn, P. Dips and ceilings: understanding and supporting transitions to expertise in user interfaces. In CHI '11, ACM (2011).

Digital Library

[36]

Schmidt, R., and Lee, T. Motor Control and Learning: A Behavioral Emphasis. Human Kinetics, 2011.

[37]

Shroyer, R. Actual readers versus implied readers: role conflicts in office 97. Technical Communication 47, 2 (2000).

[38]

Simon, H. Satisficing. The new Palgrave: a dictionary of economics 4 (1987).

[39]

Tak, S., Westendorp, P., and van Rooij, I. Satisficing and the use of keyboard shortcuts: Being good enough is enough? Interacting with Computers (2013).

Cited By

Akiri SMisal VTaherzadeh SJenkins JWilliams GMentis HKleinsmith A(2024)Enhancing Stress Understanding Through Team Reflection: Technology-Driven Insights in High-Stress Training ScenariosProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663385(1-18)Online publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1145/3663384.3663385
Pasumarthy NNisal SDanaher Jvan den Hoven EKhot R(2024)Go-Go Biome: Evaluation of a Casual Game for Gut Health Engagement and ReflectionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642742(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642742
Xia QSarkar ABrumby DCox A(2024)The Paradox of Spreadsheet Self-Efficacy: Social Incentives for Informal Knowledge Sharing in End-User Programming2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL/HCC60511.2024.00019(81-88)Online publication date: 2-Sep-2024
https://doi.org/10.1109/VL/HCC60511.2024.00019
Show More Cited By

Index Terms

Skillometers: reflective widgets that motivate and help users to improve performance
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Strategies for accelerating on-line learning of hotkeys
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Hotkeys are extremely useful in leveraging expert performance, but learning them is a slow process. This paper investigates alternative menu designs that can motivate and help users remember associations between menu commands and hotkeys. Building upon ...
IconHK: Using Toolbar button Icons to Communicate Keyboard Shortcuts
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

We propose a novel perspective on the design of toolbar buttons that aims to increase keyboard shortcut accessibility. IconHK implements this perspective by blending visual cues that convey keyboard shortcut information into toolbar buttons without ...
Promoting Hotkey use through rehearsal with ExposeHK
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Keyboard shortcuts allow fast interaction, but they are known to be infrequently used, with most users relying heavily on traditional pointer-based selection for most commands. We describe the goals, design, and evaluation of ExposeHK, a new interface ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology

October 2013

558 pages

ISBN:9781450322683

DOI:10.1145/2501988

General Chairs:
Shahram Izadi
Microsoft Research, UK
,
Aaron Quigley
University of St Andrews, UK
,
Program Chairs:
Ivan Poupyrev
Disney Research, USA
,
Takeo Igarashi
The University of Tokyo, Japan

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST'13

Sponsor:

UIST'13: The 26th Annual ACM Symposium on User Interface Software and Technology

October 8 - 11, 2013

St. Andrews, Scotland, United Kingdom

Acceptance Rates

UIST '13 Paper Acceptance Rate 62 of 317 submissions, 20%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
872
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)5

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Akiri SMisal VTaherzadeh SJenkins JWilliams GMentis HKleinsmith A(2024)Enhancing Stress Understanding Through Team Reflection: Technology-Driven Insights in High-Stress Training ScenariosProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663385(1-18)Online publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1145/3663384.3663385
Pasumarthy NNisal SDanaher Jvan den Hoven EKhot R(2024)Go-Go Biome: Evaluation of a Casual Game for Gut Health Engagement and ReflectionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642742(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642742
Xia QSarkar ABrumby DCox A(2024)The Paradox of Spreadsheet Self-Efficacy: Social Incentives for Informal Knowledge Sharing in End-User Programming2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL/HCC60511.2024.00019(81-88)Online publication date: 2-Sep-2024
https://doi.org/10.1109/VL/HCC60511.2024.00019
Karolus JFeger SSchmidt AWoźniak P(2023)Your Text Is Hard to Read: Facilitating Readability Awareness to Support Writing Proficiency in Text ProductionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596052(147-160)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596052
Bailly GKhamassi MGirard B(2023)Computational Model of the Transition from Novice to Expert Interaction TechniquesACM Transactions on Computer-Human Interaction10.1145/350555730:5(1-33)Online publication date: 23-Sep-2023
https://dl.acm.org/doi/10.1145/3505557
Kwon SLee HPark SHeo YLee KKang Y(2023)‘Um, so like, is this how I speak?’: design implications for automated visual feedback systems on speechBehaviour & Information Technology10.1080/0144929X.2023.2271997(1-20)Online publication date: 9-Nov-2023
https://doi.org/10.1080/0144929X.2023.2271997
Giannisakis EDimara EGoujon ABailly GBottoni PPanizzi E(2022)Revisiting Menu Design Through the Lens of Implicit Statistical LearningProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3531113(1-9)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3531113
Bentvelzen MWoźniak PHerbes PStefanidi ENiess J(2022)Revisiting Reflection in HCIProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172336:1(1-27)Online publication date: 29-Mar-2022
https://dl.acm.org/doi/10.1145/3517233
Cockburn AQuinn PGutwin CChen ZSuwanaposee P(2022)Probability Weighting in Interactive DecisionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517477(1-12)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517477
Bhuiyan MBautista Isaza CMitra TLee S(2022)OtherTube: Facilitating Content Discovery and Reflection by Exchanging YouTube Recommendations with StrangersProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502028(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502028
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents