research-article

Distinguishing Users By Pointing Performance in Laboratory and Real-World Tasks

Authors:

Scott E. Hudson,

Jennifer Mankoff,

Shari TrewinAuthors Info & Claims

ACM Transactions on Accessible Computing (TACCESS), Volume 5, Issue 2

Article No.: 5, Pages 1 - 27

https://doi.org/10.1145/2517039

Published: 01 October 2013 Publication History

Abstract

Accurate pointing is an obstacle to computer access for individuals who experience motor impairments. One of the main barriers to assisting individuals with pointing problems is a lack of frequent and low-cost assessment of pointing ability. We are working to build technology to automatically assess pointing problems during every day (or real-world) computer use. To this end, we have gathered and studied real-world pointing use from individuals with motor impairments and older adults. We have used this data to develop novel techniques to analyze pointing performance. In this article, we present learned statistical models that distinguish between pointing actions from diverse populations using real-world pointing samples. We describe how our models could be used to support individuals with different abilities sharing a computer, or one individual who experiences temporary pointing problems. Our investigation contributes to a better understanding of real-world pointing. We hope that these techniques will be used to develop systems that can automatically adapt to users’ current needs in real-world computing environments.

References

[1]

Accot, J. and Zhai, S. 1997. Beyond Fitts’ law: Models for trajectory-based HCI tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’97). ACM, New York, 295--302.

Digital Library

[2]

Ahlström, D., Hitz, M., and Leitner, G. 2006. An evaluation of sticky and force enhanced targets in multi target situations. In Proceedings of the Nordic Conference on Human-Computer Interaction (NordiCHI’06). ACM, New York, 58--67.

Digital Library

[3]

Beauvisage, T. 2009. Computer usage in daily life. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). ACM, New York, 575--584.

Digital Library

[4]

Bigham, J., Cavender, A., Brudvik, J., Wobbrock, J., and Ladner, R. 2007. WebinSitu: A comparative analysis of blind and sighted browsing behavior. In Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’07). ACM, New York, 58--66.

Digital Library

[5]

Brownlow, N., Shein, F., Thomas, D., Milner, M., and Parnes, P. 1989. Direct manipulation: Problems with pointing devices. In Proceedings of the 12th Annual Conference of Rehabilitation Engineering & Assistive Technology (RESNA’’89). Resna Press, Washington, D.C., 246--247.

[6]

Carter, S., Hurst, A., Mankoff, J., and Li, J. 2006. Dynamically adapting GUIs to diverse input devices. In Proceedings of ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’06). ACM, New York, 63--70.

Digital Library

[7]

Chapuis, O., Blanch, R., and Beaudouin-Lafon, M. 2007. Fitts’ law in the wild: A field study of aimed movements. LRI Tech. rep. 1480, Laboratoire de Recherche en Informatique.

[8]

Coyne, K. and Nielsen, J. 2001. How to conduct usability evaluation for accessibility: Methodology guidelines for testing websites and intranets with users who use assistive technology. Nielsen Norman Group.

[9]

Douglas, A., Kirkpatrick, A., and Mackenzie, S. 1999. Testing pointing device performance and user assessment with the IS0 9241, Part 9 Standard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’99). ACM, New York, 215--222.

Digital Library

[10]

Evans, A. and Wobbrock, J. O. 2012. Taming wild behavior: The input observer for obtaining text entry and mouse pointing measures from everyday computer use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). ACM, New York, 1947--1956.

Digital Library

[11]

Fitts, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exper. Psychol. 47, 6, 381--391.

[12]

Gajos, K., Wobbrock, J., and Weld, D. 2008. Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’08). ACM, New York, 1257--1266.

Digital Library

[13]

Gajos, K. Z., Weld, D. S., and Wobbrock, J. O. 2010. Automatically generating personalized user interfaces with SUPPLE. Artif. Intell. 174, 12--13, 910--950.

Digital Library

[14]

Gajos, G., Hurst, A., and Findlater, F. 2012a. Personalized dynamic accessibility. Interactions 19, 2, 69--73.

Digital Library

[15]

Gajos, K. Z., Reinecke, K., and Herrmann, C. 2012b. Accurate measurements of pointing performance from in situ observations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). ACM, New York, 3157--3166.

Digital Library

[16]

Hinckley, K., Cutrell, E., Bathiche, S., and Muss, T. 2002. Quantitative analysis of scrolling techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’02). ACM, New York, 65--72.

Digital Library

[17]

Hourcade, J. P., Perry, K. B., and Sharma, A. 2008. PointAssist: Helping four year olds point with ease. In Proceedings of the ACM Conference on Interaction Design and Children (IDC’08). ACM, New York, 202--209.

Digital Library

[18]

Hurst, A., Hudson, S. E., and Mankoff, J. 2007. Dynamic detection of novice vs. skilled use without a task model. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). ACM, New York, 271--280.

Digital Library

[19]

Hurst, A., Hudson, S. E., Mankoff, J., and Trewin, S. 2008a. Automatically detecting pointing performance. In Proceedings of the 13th International Conference on Intelligent User Interfaces (IUI’08). ACM, New York, 11--19.

Digital Library

[20]

Hurst, A., Mankoff, J., and Hudson, S. E. 2008b. Understanding pointing problems in real world computing environments. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’08). ACM, New York, 43--50.

Digital Library

[21]

Hwang, F. 2003. Partitioning cursor movements in “point and click” tasks. In Extended Abstracts on the SIGCHI Conference on Human Factors in Computing Systems (CHI’03). ACM, New York, 682--683.

Digital Library

[22]

Iqbal, S. T. and Horvitz, E. 2007. Disruption and recovery of computing tasks: Field study, analysis, and directions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). ACM, New York, 677--686.

Digital Library

[23]

Keates, S. and Trewin, S. 2005. Effect of age and Parkinson’s disease on cursor positioning using a mouse. In Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’05). ACM, New York, 68--75.

Digital Library

[24]

Keates, S., Hwang, F., Langdon, P., Clarkson, P. J., and Robinson, P. 2002. Cursor measures for motion-impaired computer users. In Proceedings of the 5th International ACM Conference on Assistive Technologies (ASSETS’02). ACM, New York, 135--142.

Digital Library

[25]

Keates, S., Trewin, S., and Paradise, J. 2005. Using pointing devices: Quantifying differences across user groups. In Proceedings of International Conference on Universal Access and Human-Computer Interaction.

[26]

Kim, J. H., Gunn, D. V., Schuh, E., Phillips, B. C., Pagulayan, R. J., and Wixon, D. 2008. Tracking real-time user experience (TRUE): A comprehensive instrumentation solution for complex systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’08). ACM, New York, 443--451.

Digital Library

[27]

Koester, H. H., Lopresti, E., and Simpson, R. C. 2005. Toward Goldilocks’ pointing device: Determining a “just right” gain setting for users with physical impairments. In Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’05). ACM, New York, 84--89.

Digital Library

[28]

Kohavi, R. and John, G. H. 1997. Wrappers for feature subset selection. Artif. Intell. 97, 1--2, 273--324.

Digital Library

[29]

Krippendorff, K. 1980. Content Analysis: An Introduction to Its Methodology. Sage Publications, Thousand Oaks, CA.

[30]

Kukreja, U., Stevenson, W. E., and Ritter, F. E. 2006. RUI---Recording user input from interfaces under Windows and Mac OS X. Behav. Res. Methods 38, 4, 656--659.

[31]

Levine, I. and Schappert, M. 2002. Method and adapter for performing assistive motion data processing and/or button data processing external to a computer. US Patent 2002/0158843 A1.

[32]

Mackenzie, I. S. and Buxton, W. 1992. Extending Fitts’ law to two-dimensional tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, 219--226.

Digital Library

[33]

Mitchell, T. M. 1997. Machine Learning. McGraw-Hill, Englewood Cliffs, NJ.

Digital Library

[34]

Phillips, T. G. and Triggs, T. J. 2001. Characteristics of cursor trajectories controlled by the computer mouse. Ergonomics 44, 5, 527--536.

[35]

Quinlan, J. R. 1993. C4. 5: Programs for Machine Learning. Morgan Kaufmann, San Francisco, CA.

Digital Library

[36]

Riviere, C. and Thackor, N. 1996. Effects of age and disability on tracking tasks with a computer mouse: Accuracy and linearity. J. Rehab. Res. Dev. 33, 6--15.

[37]

Trewin, S. and Pain, H. 1999. Keyboard and mouse errors due to motor disabilities. Int. J. Hum.-Comput. Stud. 50, 109--144.

Digital Library

[38]

Trewin, S., Keates, S., and Moffatt, K. 2006. Developing steady clicks: A method of cursor assistance for people with motor impairments. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’06). ACM, New York, 26--33.

Digital Library

[39]

Walker, N., Meyer, D. E., and Smelcer, J. B. 1993. Spatial and temporal characteristics of rapid cursor-positioning movements with electromechanical mice in human-computer interaction. Human Factors 35, 3, 431--458.

[40]

Witten, I. H. and Frank, E. 2005. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, San Francisco, CA.

Digital Library

[41]

Wobbrock, J. O., Fogarty, J., Liu, S. Y., Kimuro, S., and Harada, S. 2009. The Angle Mouse: Target-agnostic dynamic gain adjustment based on angular deviation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). ACM, New York, 1401--1410.

Digital Library

[42]

Wobbrock, J., Kane, K., Gajos, K., Harada, S., and Froehlich, J. 2011. Ability-based design: Concept, principles and examples. ACM Trans. Access. Comput. 3, 3, Article 9, ACM, New York.

Digital Library

[43]

Worden, A., Walker, N., Bharat, K., and Hudson, S. E. 1997. Making computers easier for older adults to use: Area cursors and sticky icons. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’97). ACM, New York, 266--271.

Digital Library

Cited By

Ling KZhao HFan XNiu XYin WLiu YWang CBi X(2024)Model Touch Pointing and Detect Parkinson's Disease via a Mobile GameProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596278:2(1-24)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659627
Pandey VKhan NGupta AGajos K(2023)Accuracy and Reliability of At-Home Quantification of Motor Impairments Using a Computer-Based Pointing Task with Children with Ataxia-TelangiectasiaACM Transactions on Accessible Computing10.1145/358179016:1(1-25)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3581790
Sarsenbayeva ZVan Berkel NVelloso EGoncalves JKostakos V(2022)Methodological Standards in Accessibility Research on Motor Impairments: A SurveyACM Computing Surveys10.1145/354350955:7(1-35)Online publication date: 15-Dec-2022
https://dl.acm.org/doi/10.1145/3543509
Show More Cited By

Index Terms

Distinguishing Users By Pointing Performance in Laboratory and Real-World Tasks
1. Social and professional topics
  1. Professional topics
    1. Computing profession
      1. Assistive technologies
  2. User characteristics
    1. People with disabilities

Recommendations

Understanding design considerations for adaptive user interfaces for accessible pointing with older and younger adults
W4A '15: Proceedings of the 12th International Web for All Conference

The Internet has become an important tool for many aspects of modern life. However, some individuals may experience challenges accessing the Internet if they have difficulty accurately controlling a pointing device. These pointing problems can vary in ...
Supporting awareness of pointing behavior among diverse groups
PervasiveHealth '16: Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare

The Internet is a valuable resource for accessing health information and resources. However, for individuals that experience sustained or temporary changes in hand mobility, using an input device to navigate the Internet can be difficult. Further, ...
A real-world deployment of the COACH prompting system
Design and Deployment of Intelligent Environments

The loss of cognition associated with dementia affects an individual's ability to participate in even the most fundamental activities of daily living ADL. Assistive technology for cognition ATC has shown potential to support ADL completion, but few ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Accessible Computing

ACM Transactions on Accessible Computing Volume 5, Issue 2

October 2013

59 pages

ISSN:1936-7228

EISSN:1936-7236

DOI:10.1145/2522990

Issue’s Table of Contents

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2013

Accepted: 01 August 2013

Revised: 01 June 2013

Received: 01 January 2012

Published in TACCESS Volume 5, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
514
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ling KZhao HFan XNiu XYin WLiu YWang CBi X(2024)Model Touch Pointing and Detect Parkinson's Disease via a Mobile GameProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596278:2(1-24)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659627
Pandey VKhan NGupta AGajos K(2023)Accuracy and Reliability of At-Home Quantification of Motor Impairments Using a Computer-Based Pointing Task with Children with Ataxia-TelangiectasiaACM Transactions on Accessible Computing10.1145/358179016:1(1-25)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3581790
Sarsenbayeva ZVan Berkel NVelloso EGoncalves JKostakos V(2022)Methodological Standards in Accessibility Research on Motor Impairments: A SurveyACM Computing Surveys10.1145/354350955:7(1-35)Online publication date: 15-Dec-2022
https://dl.acm.org/doi/10.1145/3543509
Mack KMcDonnell EFindlater LEvans H(2022)Chronically Under-Addressed: Considerations for HCI Accessibility Practice with Chronically Ill PeopleProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544803(1-15)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3544803
Gori JBeaudouin-Lafon MGuiard Y(2019)Multi-evaluation of pointing and application to dyspraxia evaluationProceedings of the 31st Conference on l'Interaction Homme-Machine10.1145/3366550.3372250(1-12)Online publication date: 10-Dec-2019
https://dl.acm.org/doi/10.1145/3366550.3372250
Guerreiro TCarriço LRodrigues A(2019)Mobile WebWeb Accessibility10.1007/978-1-4471-7440-0_37(737-754)Online publication date: 4-Jun-2019
https://doi.org/10.1007/978-1-4471-7440-0_37
Poneres KHamidi FMassey AHurst AHwang FMcGrenere JFlatla D(2018)Using Icons to Communicate Privacy Characteristics of Adaptive Assistive TechnologiesProceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3234695.3241003(388-390)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.1145/3234695.3241003
Hamidi FPoneres KMassey AHurst AHwang FMcGrenere JFlatla D(2018)Who Should Have Access to my Pointing Data?Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3234695.3239331(203-216)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.1145/3234695.3239331
Martin-Hammond AHamidi FBhalerao TOrtega CAli AHornback CMeans CHurst A(2018)Designing an Adaptive Web Navigation Interface for Users with Variable Pointing PerformanceProceedings of the 15th International Web for All Conference10.1145/3192714.3192818(1-10)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3192714.3192818
Kacorri HMascetti SGerino AAhmetovic DAlampi VTakagi HAsakawa C(2018)Insights on Assistive Orientation and Mobility of People with Visual Impairment Based on Large-Scale Longitudinal DataACM Transactions on Accessible Computing10.1145/317885311:1(1-28)Online publication date: 6-Mar-2018
https://dl.acm.org/doi/10.1145/3178853
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents