research-article

Detection of vigilance performance with pupillometry

Authors:

Lindsey K. McIntire,

John P. McIntire,

R. Andy McKinley,

Chuck GoodyearAuthors Info & Claims

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 167 - 174

https://doi.org/10.1145/2578153.2578177

Published: 26 March 2014 Publication History

Abstract

Sustained attention (vigilance) is required for many professions such as air traffic controllers, imagery analysts, airport security screeners, and cyber operators. A lapse in attention in any of these environments can have deadly consequences. The purpose of this study was to determine the ability of pupillometry to detect changes in vigilance performance. Each participant performed a 40-minute vigilance task while wearing an eye-tracker on each of four separate days. Pupil diameter, pupil eccentricity, and pupil velocity all changed significantly over time (p<.05) during the task. Significant correlations indicate that all metrics increased as vigilance performance declined except for pupil diameter, which decreased and the pupil became miotic. These results are consistent with other research on attention, fatigue, and arousal levels. Using an eye-tracker to detect changes in pupillometry in an operational environment would allow interventions to be implemented.

References

[1]

Ahern, S., and Beatty, J. 1979. Pupillary responses during information processing vary with Scholastic Aptitude Test scores, Science, 205, 4412, 1289--1292.

[2]

Becker, W., and Fuchs, A. F. 1969. Further properties of the human saccadic system: Eye movements and correctional saccades with and without visual fixation point. Vision Research, 9, 1247--1258.

[3]

Di Stasi, L. L., Catena, A., Canas, J. J., Macknik, S. L., and Martinez-Conde, S. 2013, Saccadic velocity as an arousal index in naturalistic tasks. Neuroscience and Biobehavioral Reviews, 37, 968--975.

[4]

Dodge, R. 1917. The law of relative fatigue. Psychological Review, 24, 89--113.

[5]

Frankman, J. P., and Adams, J. A. 1962. Theories of vigilance. Psychological Bulletin, 59, 257--272.

[6]

Funke, M. E. 2009. A Comparison of Cerebral Hemovelocity and Blood Oxygen Saturation Levels During Vigilance Performance. Thesis. University of Cincinnati, Cincinnati, OH.

[7]

Galley, N. 1989. Saccadic eye movement velocity as an indicator of (de)activation. A review of some speculations. Journal of Psychophysiology, 3, 3, 229--244.

[8]

Goldich, Y., Barkana, Y., Pras, E., Zadok, D., Hartstein, M., and Morad, Y. 2010. The effects of sleep deprivation on oculomotor responses. Current Eye Research, 35, 12, 1135--1141.

[9]

Hawley, J. K. 2006. Patriot fratricides: The human dimension lesions of operation Iraqi Freedom. Field Artillery, 18--19.

[10]

Hess, E. H., and Polt, J. M. 1964. Pupil size in relation to mental activity during simple problem-solving. Science, 143, 3611, 1190--1192.

[11]

Hitchcock, E. M., Warm, J. S., Matthews, G., Dember, W. N., Shear, P. K., Tripp, L. D., Mayleben, D. W., and Parasuraman, R. 2003. Automation cuing modulates cerebral blood flow and vigilance in a simulated air traffic control task. Theoretical Issues in Ergonomics, 4, 89--112.

[12]

Hoffman, J. E., and Subramaniam, B. 1995. The role of visual attention in saccadic eye movements. Perception & Psychophysics, 57, 6, 787--795.

[13]

Hollander, T. D., Warm, J. S., Matthews, G. R., Dember, W. N., Parasuraman, R., Hitchcock, E. M., Beam, C. A., and Tripp, L. D. 2002. Effects of signal regularity and salience on vigilance performance and cerebral hemovelocity. Proceedings of the Human Factors and Ergonomics Society 26^th Annual Meeting, 1654--1658.

[14]

Houben, M. M. J, Gourmans, J., and Van Der Steen, J. 2006. Recording three-dimensional eye movements: Scleral search coils versus video oculography. Investigative Ophthalmology & Visual Science, 47, 1, 179--187.

[15]

Knecht, S., Deppe, M., Ebner, A., Henningsen, H., Huber, T., Jokeit, H., and Ringelstein, E. B. 1998. Noninvasive determination of language lateralization by functional transcranial Doppler sonography. Stroke, 29, 82--86.

[16]

Liu, W., Sun, H., and Shen, W. 2010. Driver fatigue detection through pupil detection and yawning analysis. Proceedings of the International Conference on Bioinformatics and Biomedical Technology, 404--407.

[17]

Lowenstein, O., Feinberg, R., and Lowenfeld, I. E. 1963. Pupillary movements during acute and chronic fatigue. Investigative Ophthalmology & Visual Science, 2, 138--157.

[18]

Lowenstein, O., and Loewenfeld, I. E. 1962. The pupil. In H. Dawson (Ed.), The Eye (Vol. 3). New York: Academic Press. 255--337.

[19]

Ludtke, H., Wilhelm, B., Alder, M., Schaeffel, F., and Wilhelm, H. 1998. Mathematical procedures in data recording and processing of papillary fatigue waves. Vision Research, 38, 2889--2896.

[20]

Matessa, M. 2004. Anticipatory eye movements in interleaving templates of human behavior. In: Proceedings of the 6^th International Conference on Cognitive Modeling, July 30-August 1, 2004, Carnegie Mellon University/University of Pittsburgh, Pittsburgh, PA, 184--189.

[21]

McIntire, L., McKinley, R. A., Goodyear, C., Merritt, M., Griffin, K., McIntire, J., and Bridges, N. 2011. Eye Tracking: An Alternative Vigilance Detector. Report No. AFRL-RH-WP-TR-2012-0022. Air Force Research Laboratory, Wright-Patterson Air Force Base, OH.

[22]

Nachreiner, F., and Hanecke, K. 1992. Vigilance. In A. P. Smith & D. M. Jones (Eds.). Handbook of Human Performance (p 262--288). Sand Diego, CA: Academic Press, Inc.

[23]

Nevalainen, S., and Sajaniemi, J. 2004. Comparison of three eye tracking devices in psychology of programming research. 16^th Workshop of the Psychology of Programming Interest Group, Carlow, Ireland: April 2004, 151--158.

[24]

Nishiyama, J., Tanida, K., Kusumi, M., and Hirata, Y. 2007. The pupil as a possible premonitory of drowsiness. Proceedings of the 29^th Annual International Conference of the IEEE-Engineering-in-Medicine-and-Biology-Society, Lyon, France. 1586--1589.

[25]

Salvucci, D. D., Goldberg, J. H. 2000 Identifying fixations and saccades in eye-tracking protocols. Proceedings of the Eye Tracking Research and Applications Symposium, Palm Beach Gardens, Florida. 71--78.

Digital Library

[26]

Schleicher, R., Galley, N., Briest, S., and Galley, L. 2008. Blinks and saccades as indicators of fatigue in sleepiness warnings: Looking tired? Ergonomics, 51, 7, 982--1010.

[27]

Shepherd, M., Findlay, J. M., and Hockey, R. J. 1986. The relationship between eye movements and spatial attention. Quarterly Journal of Experimental Psychology, 38A, 475--491.

[28]

Smith, P., Shah, M., and Lobo, N. 2000. Monitoring head/eye motion for driver alertness using one camera. Proceedings of the International Conference on Pattern Recognition. 499--504.

Digital Library

[29]

Tsai, Y., Viirre, E., Strychacz, C., Chase, B., and Jung, T. 2007. Task performance and eye activity: Predicting behavior relating to cognitive workload. Aviation, Space, and Environmental Medicine, 78, 5.2, B176--B185.

[30]

Van Orden, K. F., Limbert, W., Makeig, S., and Jung, T. P. 2001. Eye activity correlates of workload during a visuospatial memory task. Human Factors, 43. 1, 111--121.

[31]

Warga, M., Ludtke, H., Wilhelm, H., and Wilhelm, B. 2009. How do spontaneous papillary oscillations in light relate to light intensity? Vision Research, 49, 295--300.

[32]

Warm, J. S., Matthews, G., and Parasuraman, R. 2009. Cerebral hemodynamics and vigilance performance. Military Psychology, 21, S75--S100.

Cited By

Pütz SMertens AChuang LNitsch V(2024)Physiological Predictors of Operator Performance: The Role of Mental Effort and Its Link to Task PerformanceHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/00187208241296830Online publication date: 30-Oct-2024
https://doi.org/10.1177/00187208241296830
Herrmann BRyan J(2024)Pupil Size and Eye Movements Differently Index Effort in Both Younger and Older AdultsJournal of Cognitive Neuroscience10.1162/jocn_a_0217236:7(1325-1340)Online publication date: 1-Jun-2024
https://doi.org/10.1162/jocn_a_02172
Zanardi DNenna FOrlando ENannetti MMingardi MBuodo GGamberini L(2024)Pupil Responses as Indicators of Learning and Adaptation in Human-Robot Collaboration ScenariosProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3663909(337-342)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1145/3652037.3663909
Show More Cited By

Index Terms

Detection of vigilance performance with pupillometry
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Tracking
      2. Computer vision tasks
        Scene understanding
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Measuring the task-evoked pupillary response with a remote eye tracker
ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applications

The pupil-measuring capability of video eye trackers can detect the task-evoked pupillary response: subtle changes in pupil size which indicate cognitive load. We performed several experiments to measure cognitive load using a remote video eye tracker, ...
Mean head and shoulder heights when seated: subconscious postural cycles during discrete computerised stimuli
ECCE '13: Proceedings of the 31st European Conference on Cognitive Ergonomics

Discrete, three-minute, computer-presented stimuli (designed to range from engaging to incredibly boring) were used to elicit changes in cognitive/emotional states in seated, healthy volunteers. These stimuli did not require the use of a mouse, so ...
Monitoring Response Quality During Campimetry Via Eye-Tracking
IUI '17 Companion: Companion Proceedings of the 22nd International Conference on Intelligent User Interfaces

In a variety of use-cases, deriving information on user's fatigue is an important step for content adaptation. In this work, we investigate which eye tracking related measures can predict the error rate (as a proxy of subject's fatigue)during a visual ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2014

394 pages

ISBN:9781450327510

DOI:10.1145/2578153

Conference Chairs:
Pernilla Qvarfordt
FX Palo Alto Laboratory
,
Dan Witzner Hansen
IT University, Denmark

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ETRA '14

Sponsor:

ETRA '14: Eye Tracking Research and Applications

March 26 - 28, 2014

Florida, Safety Harbor

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
457
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)5

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pütz SMertens AChuang LNitsch V(2024)Physiological Predictors of Operator Performance: The Role of Mental Effort and Its Link to Task PerformanceHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/00187208241296830Online publication date: 30-Oct-2024
https://doi.org/10.1177/00187208241296830
Herrmann BRyan J(2024)Pupil Size and Eye Movements Differently Index Effort in Both Younger and Older AdultsJournal of Cognitive Neuroscience10.1162/jocn_a_0217236:7(1325-1340)Online publication date: 1-Jun-2024
https://doi.org/10.1162/jocn_a_02172
Zanardi DNenna FOrlando ENannetti MMingardi MBuodo GGamberini L(2024)Pupil Responses as Indicators of Learning and Adaptation in Human-Robot Collaboration ScenariosProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3663909(337-342)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1145/3652037.3663909
Grootjen JWeingärtner HMayer S(2024)Uncovering and Addressing Blink-Related Challenges in Using Eye Tracking for Interactive SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642086(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642086
Guidetti OSpeelman CBouhlas P(2023)The WACDT, a modern vigilance task for network defenseFrontiers in Neuroergonomics10.3389/fnrgo.2023.12154974Online publication date: 21-Nov-2023
https://doi.org/10.3389/fnrgo.2023.1215497
Cui MHerrmann B(2023)Eye Movements Decrease during Effortful Speech ListeningThe Journal of Neuroscience10.1523/JNEUROSCI.0240-23.202343:32(5856-5869)Online publication date: 25-Jul-2023
https://doi.org/10.1523/JNEUROSCI.0240-23.2023
Pütz SMertens AChuang LNitsch V(2023)Physiological measures of operators’ mental state in supervisory process control tasks: a scoping reviewErgonomics10.1080/00140139.2023.228985867:6(801-830)Online publication date: 21-Dec-2023
https://doi.org/10.1080/00140139.2023.2289858
Bodala IDing KAl-Nashash H(2023)Vigilance Assessment and EnhancementHandbook of Neuroengineering10.1007/978-981-16-5540-1_75(2769-2792)Online publication date: 3-Feb-2023
https://doi.org/10.1007/978-981-16-5540-1_75
Greenlee EHess LSimpson BFinomore V(2022)Vigilance to Spatialized Auditory Displays: Initial Assessment of Performance and WorkloadHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/0018720822113974466:4(987-1003)Online publication date: 1-Dec-2022
https://doi.org/10.1177/00187208221139744
Martin JWhittaker AJohnston S(2022)Pupillometry and the vigilance decrement: Task‐evoked but not baseline pupil measures reflect declining performance in visual vigilance tasksEuropean Journal of Neuroscience10.1111/ejn.1558555:3(778-799)Online publication date: 18-Jan-2022
https://doi.org/10.1111/ejn.15585
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents