poster

Event-Based Pupil Tracking Using Bright and Dark Pupil Effect

Authors:

Tatsuya Kagemoto,

Kentaro TakemuraAuthors Info & Claims

UIST '23 Adjunct: Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Article No.: 24, Pages 1 - 3

https://doi.org/10.1145/3586182.3616657

Published: 29 October 2023 Publication History

Get Access

Abstract

Real-time high-speed gaze estimation can enable next-generation gaze-based interaction. The event camera, which captures intensity variations at high frequency, has been employed to this end. However, pupil tracking based only on events is difficult because events are sparse and limited. We propose high-speed pupil tracking using an event camera based on the bright and dark pupil effect. Two illumination sources generate events in the pupil area, and the pupil center is determined in real time at over 2000 Hz without requiring complete image from the events. We implemented gaze target estimation using smooth-pursuit eye movements and confirmed high-speed pupil tracking that may reduce the delay in gaze-based interaction.

Supplemental Material

MP4 File

Video accompanying the poster

Download
48.12 MB

ZIP File

Supplemental File

Download
48.12 MB

References

[1]

Anastasios N. Angelopoulos, Julien N.P. Martel, Amit P. Kohli, Jörg Conradt, and Gordon Wetzstein. 2021. Event-Based Near-Eye Gaze Tracking Beyond 10,000 Hz. IEEE Transactions on Visualization and Computer Graphics 27, 5 (2021), 2577–2586. https://doi.org/10.1109/TVCG.2021.3067784

Crossref

Google Scholar

[2]

Andrew T. Duchowski, Krzysztof Krejtz, Justyna Żurawska, and Donald H. House. 2020. Using Microsaccades to Estimate Task Difficulty During Visual Search of Layered Surfaces. IEEE Transactions on Visualization and Computer Graphics 26, 9 (2020), 2904–2918. https://doi.org/10.1109/TVCG.2019.2901881

Crossref

Google Scholar

[3]

Y. Ebisawa. 1998. Improved video-based eye-gaze detection method. IEEE Transactions on Instrumentation and Measurement 47, 4 (1998), 948–955. https://doi.org/10.1109/19.744648

Crossref

Google Scholar

[4]

Augusto Esteves, Eduardo Velloso, Andreas Bulling, and Hans Gellersen. 2015. Orbits: Gaze Interaction for Smart Watches Using Smooth Pursuit Eye Movements. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 457–466. https://doi.org/10.1145/2807442.2807499

Digital Library

Google Scholar

[5]

Mohamed Khamis, Florian Alt, and Andreas Bulling. 2015. A Field Study on Spontaneous Gaze-Based Interaction with a Public Display Using Pursuits. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers. 863–872. https://doi.org/10.1145/2800835.2804335

Digital Library

Google Scholar

[6]

Mohamed Khamis, Ozan Saltuk, Alina Hang, Katharina Stolz, Andreas Bulling, and Florian Alt. 2016. TextPursuits: Using Text for Pursuits-Based Interaction and Calibration on Public Displays. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 274–285.

Digital Library

Google Scholar

[7]

Shuntaro Miki and Yutaka Hirata. 2013. Microsaccades generated during car driving. In 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 2148–2151. https://doi.org/10.1109/EMBC.2013.6609959

Crossref

Google Scholar

[8]

Timo Stoffregen, Hossein Daraei, Clare Robinson, and Alexander Fix. 2022. Event-Based Kilohertz Eye Tracking using Coded Differential Lighting. In 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). 3937–3945. https://doi.org/10.1109/WACV51458.2022.00399

Crossref

Google Scholar

[9]

Yuto Tamura and Kentaro Takemura. 2019. Estimating Focused Object Using Smooth Pursuit Eye Movements and Interest Points in the Real World. In Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 21–23.

Google Scholar

[10]

Mélodie Vidal, Andreas Bulling, and Hans Gellersen. 2013. Pursuits: Spontaneous Interaction with Displays Based on Smooth Pursuit Eye Movement and Moving Targets. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 439–448. https://doi.org/10.1145/2493432.2493477

Digital Library

Google Scholar

Cited By

View all

Jiang YWang WYu LHe C(2024)Eye Tracking Based on Event Camera and Spiking Neural NetworkElectronics10.3390/electronics1314287913:14(2879)Online publication date: 22-Jul-2024
https://doi.org/10.3390/electronics13142879
Ostaszewska-Liżewska APakuła ASzykiedans K(2024)A Human Eye Model for Investigating the Metrological Properties of Video Eye TrackersActa Physica Polonica A10.12693/APhysPolA.146.623146:4(623-629)Online publication date: Oct-2024
https://doi.org/10.12693/APhysPolA.146.623
Iddrisu KShariff WCorcoran PO'Connor NLemley JLittle S(2024)Event Camera-Based Eye Motion Analysis: A SurveyIEEE Access10.1109/ACCESS.2024.346210912(136783-136804)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3462109

Index Terms

Event-Based Pupil Tracking Using Bright and Dark Pupil Effect
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication

In this paper we present Pupil -- an accessible, affordable, and extensible open source platform for pervasive eye tracking and gaze-based interaction. Pupil comprises 1) a light-weight eye tracking headset, 2) an open source software framework for ...
Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices
Abstract
Spontaneous eye blinks as a means to tap into human cognitive and affective processes have been demonstrated to offer valuable insight in various fields of application, such as human-computer-interaction and driver drowsiness detection. ...
Shifts in reported gaze position due to changes in pupil size: ground truth and compensation
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

Camera-based eye trackers are the mainstay of today's eye movement research and countless practical applications of eye tracking. Recently, a significant impact of changes in pupil size on the accuracy of camera-based eye trackers during fixation has ...

Comments

Information & Contributors

Information

Published In

UIST '23 Adjunct: Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

October 2023

424 pages

ISBN:9798400700965

DOI:10.1145/3586182

Editors:
Sean Follmer
Stanford University, USA
,
Jeff Han,
Jürgen Steimle
Saarland University, Germany
,
Nathalie Henry Riche
Microsoft Research, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2023

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Japan Society for the Promotion of Science

Conference

UIST '23

Sponsor:

UIST '23: The 36th Annual ACM Symposium on User Interface Software and Technology

October 29 - November 1, 2023

CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 355 of 1,733 submissions, 20%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
157
Total Downloads

Downloads (Last 12 months)94
Downloads (Last 6 weeks)17

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Jiang YWang WYu LHe C(2024)Eye Tracking Based on Event Camera and Spiking Neural NetworkElectronics10.3390/electronics1314287913:14(2879)Online publication date: 22-Jul-2024
https://doi.org/10.3390/electronics13142879
Ostaszewska-Liżewska APakuła ASzykiedans K(2024)A Human Eye Model for Investigating the Metrological Properties of Video Eye TrackersActa Physica Polonica A10.12693/APhysPolA.146.623146:4(623-629)Online publication date: Oct-2024
https://doi.org/10.12693/APhysPolA.146.623
Iddrisu KShariff WCorcoran PO'Connor NLemley JLittle S(2024)Event Camera-Based Eye Motion Analysis: A SurveyIEEE Access10.1109/ACCESS.2024.346210912(136783-136804)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3462109

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

Supplemental Material

References

Cited By

Index Terms

Recommendations

Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction

Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices

Shifts in reported gaze position due to changes in pupil size: ground truth and compensation

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations