research-article

Pupil responses during discrete goal-directed movements

Authors:

M. Stella Atkins,

Roman Bednarik,

Bin ZhengAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2075 - 2084

https://doi.org/10.1145/2556288.2557086

Published: 26 April 2014 Publication History

Abstract

Pupil size is known to correlate with the changes of cognitive task workloads, but how the pupil responds to requirements of basic goal-directed motor tasks involved in human-machine interactions is not yet clear. This work conducted a user study to investigate the pupil dilations during aiming in a tele-operation setting, with the purpose of better understanding how the changes in task requirements are reflected by the changes of pupil size. The task requirements, managed by Fitts' index of difficulty (ID), i.e. the size and distance apart of the targets, were varied between tasks, and pupil responses to different task IDs were recorded. The results showed that pupil diameter can be employed as an indicator of task requirements in goal-directed movements-higher task difficulty evoked higher valley to peak pupil dilation, and the peak pupil dilation occurred after a longer delay. These findings contribute to the foundation for developing methods to objectively evaluate interactive task requirements using pupil parameters during goal-directed movements in HCI.

References

[1]

Abrams, R. A., Meyer, D. E., and Kornblum, S. Eyehand coordination: oculomotor control in rapid aimed limb movements. Journal of Experimental Psychology: Human Perception and Performance 16, 2 (1990), 248--267.

[2]

Beatty, J. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin 91, 2 (1982), 276--292.

[3]

Berguer, R., Smith, W. D., and Chung, Y. H. Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery. Surgical Endoscopy 15, 10 (2001), 1204--1207.

[4]

Bradshaw, J. Pupil size as a measure of arousal during information processing. Nature 216, 5114 (1967), 515--516.

[5]

Cassenti, D. N. and Kelley, T. D. Towards the shape of mental workload. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 11 (2006), 1147--1151.

[6]

Chen, H.-J. and Lin, C. J. The investigation of laparoscopic instrument movement control. Lecture Notes in Engineering and Computer Science 2198, 1 (2011), 1309--1313.

[7]

Elliott, D., Helsen, W. F., and Chua, R. A Century Later: Woodworth's (1899) Two-component Model of Goal-directed Aiming. Psychological Bulletin 127, 3 (2001), 342--357.

[8]

Fitts, P. M. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47, 6 (1954), 381--391.

[9]

Fitts, P. M. and Peterson, J. R. Information capacity of discrete motor responses. Journal of Experimental Psychology 67, (1964), 103--112.

[10]

Gawron, V. J., Human Workload, in Human Performance, Workload, and Situational Awareness Measures Handbook, Second Edition. 2008, CRC Press. 87--230.

[11]

Goldinger, S. D. and Papesh, M. H. Pupil dilation reflects the creation and retrieval of memories. Current Directions in Psychological Science 21, 2 (2012), 90--95.

[12]

Guthrie, D. and Buchwald, J. S. Significance testing of difference potentials. Psychophysiology 28, 2 (1991), 240--244.

[13]

Hess, E. H. and Polt, J. M. Pupil size in relation to mental activity during simple problem-solving. Science 143, 3611 (1964), 1190--1192.

[14]

Hoeks, B. and Levelt, W. Pupillary dilation as a measure of attention: a quantitative system analysis. Behavior Research Methods 25, 1 (1993), 16--26.

[15]

Iqbal, S. T., Adamczyk, P. D., Zheng, X. S., and Bailey, B. P. Towards an index of opportunity: understanding changes in mental workload during task execution. In Proc. CHI 2005, ACM Press (2005), 311--320.

Digital Library

[16]

Iqbal, S. T., Zheng, X. S., and Bailey, B. P. Task-evoked pupillary response to mental workload in human-computer interaction. Ext. Abstracts CHI 2004, ACM Press (2004), 1477--1480.

Digital Library

[17]

Jiang, X., Zheng, B., Tien, G., and Atkins, M. S. Pupil response to precision in surgical task execution. Studies in Health Technology and Informatics 184, (2013), 210--214.

[18]

Jiang, X., Zheng, B., Tien, G., Bednarik, R., and Atkins, M. S. Pupil dilations during target-pointing respect Fitts' Law. In Proc. ETRA 2014, ACM Press (2014), In press.

Digital Library

[19]

Klingner, J., Kumar, R., and Hanrahan, P. Measuring the task-evoked pupillary response with a remote eye tracker. In Proc. ETRA 2008, ACM Press (2008), 69--72.

Digital Library

[20]

Marshall, S. P., Method and Apparatus for Eye Tracking and Monitoring Pupil Dilation to Evaluate Cognitive Activity. 2000: USA.

[21]

Moresi, S., et al. Response preparation with adjacent versus overlapped hands: A pupillometric study. International Journal of Psychophysiology 79, 2 (2011), 280--286.

[22]

Otero, S. C., Weekes, B. S., and Hutton, S. B. Pupil size changes during recognition memory. Psychophysiology 48, 10 (2011), 1346--1353.

[23]

Privitera, C. M., Renninger, L. W., Carney, T., Klein, S., and Aguilar, M. Pupil dilation during visual target detection. Journal of Vision 10, 10 (2010), 1--14.

[24]

Richer, F. and Beatty, J. Pupillary dilations in movement preparation and execution. Psychophysiology 22, 2 (1985), 204--207.

[25]

Richstone, L., et al. Eye metrics as an objective assessment of surgical skill. Annals Surgery 252, 1 (2010), 177--182.

[26]

Zheng, B., Cassera, M. A., Martinec, D. V., Spaun, G. O., and Swanstrom, L. L. Measuring mental workload during the performance of advanced laparoscopic tasks. Surgical Endoscopy 24, 1 (2010), 45--50.

Cited By

Wu ZJiang XZheng JZheng BAtkins S(2024)Measuring Motor Task Difficulty using Low/High Index of Pupillary ActivityProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653442(1-6)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653442
Vrzáková HTapiala JIso‐Mustajärvi MTimonen TDietz A(2024)Estimating Cognitive Workload Using Task‐Related Pupillary Responses in Simulated Drilling in Cochlear ImplantationThe Laryngoscope10.1002/lary.31612134:12(5087-5095)Online publication date: 11-Jul-2024
https://doi.org/10.1002/lary.31612
Voudouris DSchuetz ISchinke TFiehler K(2023)Pupil dilation scales with movement distance of real but not of imagined reaching movementsJournal of Neurophysiology10.1152/jn.00024.2023130:1(104-116)Online publication date: 1-Jul-2023
https://doi.org/10.1152/jn.00024.2023
Show More Cited By

Index Terms

Pupil responses during discrete goal-directed movements
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Pupil dilations during target-pointing respect Fitts' law
ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

Pupil size is known to correlate with changes of cognitive task workloads, but the pupillary response to requirements of basic goal-directed motor tasks is not yet clear, although pointing with tools is a ubiquitous human task. This work describes a ...
Pupil responses to continuous aiming movements

Pupillary response is associated with perceptual and cognitive loads in visual and cognitive tasks, but no quantitative link between pupil response and the task workload in visual-motor tasks has been confirmed. The objective of this study is to ...
A Fitts' law study of pupil dilations in a head-mounted display
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Head-mounted displays offer full control over lighting conditions. When equipped with eye tracking technology, they are well suited for experiments investigating pupil dilation in response to cognitive tasks, emotional stimuli, and motor task complexity,...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
436
Total Downloads

Downloads (Last 12 months)34
Downloads (Last 6 weeks)3

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wu ZJiang XZheng JZheng BAtkins S(2024)Measuring Motor Task Difficulty using Low/High Index of Pupillary ActivityProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653442(1-6)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653442
Vrzáková HTapiala JIso‐Mustajärvi MTimonen TDietz A(2024)Estimating Cognitive Workload Using Task‐Related Pupillary Responses in Simulated Drilling in Cochlear ImplantationThe Laryngoscope10.1002/lary.31612134:12(5087-5095)Online publication date: 11-Jul-2024
https://doi.org/10.1002/lary.31612
Voudouris DSchuetz ISchinke TFiehler K(2023)Pupil dilation scales with movement distance of real but not of imagined reaching movementsJournal of Neurophysiology10.1152/jn.00024.2023130:1(104-116)Online publication date: 1-Jul-2023
https://doi.org/10.1152/jn.00024.2023
Jiang XWu ZZheng JZheng BAtkins S(2023)Index Pupil Activity Echoing with Task Difficulty in Fitts’ Law SettingProceedings of the 2023 Symposium on Eye Tracking Research and Applications10.1145/3588015.3589509(1-3)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588015.3589509
Kosch TKarolus JZagermann JReiterer HSchmidt AWoźniak P(2023)A Survey on Measuring Cognitive Workload in Human-Computer InteractionACM Computing Surveys10.1145/358227255:13s(1-39)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3582272
Calvo LChristel ITerrado MCucchietti FPérez-Montoro M(2022)Users’ Cognitive Load: A Key Aspect to Successfully Communicate Visual Climate InformationBulletin of the American Meteorological Society10.1175/BAMS-D-20-0166.1103:1(E1-E16)Online publication date: Jan-2022
https://doi.org/10.1175/BAMS-D-20-0166.1
Shen XJiang HLiu DYang KDeng FLui JLiu JDustdar SLuo J(2022)PupilRec: Leveraging Pupil Morphology for Recommending on SmartphonesIEEE Internet of Things Journal10.1109/JIOT.2022.31816079:17(15538-15553)Online publication date: 1-Sep-2022
https://doi.org/10.1109/JIOT.2022.3181607
Jiang HShen XLiu D(2021)PupilMeter: Modeling User Preference with Time-Series Features of Pupillary Response2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS)10.1109/ICDCS51616.2021.00102(1031-1041)Online publication date: Jul-2021
https://doi.org/10.1109/ICDCS51616.2021.00102
Koskinen JBednarik RVrzakova HElomaa A(2020)Combined Gaze Metrics as Stress-Sensitive Indicators of Microsurgical ProficiencySurgical Innovation10.1177/155335062094298027:6(614-622)Online publication date: 20-Jul-2020
https://doi.org/10.1177/1553350620942980
Zhang TEl Ali AWang CHanjalic ACesar PBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)RCEA: Real-time, Continuous Emotion Annotation for Collecting Precise Mobile Video Ground Truth LabelsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376808(1-15)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376808
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents