research-article

Automatic acquisition of a 3D eye model for a wearable first-person vision device

Authors:

Akihiro Tsukada,

Takeo KanadeAuthors Info & Claims

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 213 - 216

https://doi.org/10.1145/2168556.2168597

Published: 28 March 2012 Publication History

Get Access

Abstract

A wearable gaze tracking device can work with users in daily-life. For long time of use, a non-active method that does not employ an infrared illumination system is desirable from safety standpoint. It is well known that the eye model constraints substantially improve the accuracy and robustness of gaze estimation. However, the eye model needs to be calibrated for each person and each device. We propose a method to automatically build the eye model for a wearable gaze tracking device. The key idea is that the eye model, which includes the eye structure and eye-camera relationship, impose constraints on image analysis even when it is incomplete, so we adopt an iterative eye model building process with gradually increasing eye model constraints. Performance of the proposed method is evaluated in various situations, including different eye colors of users and camera configurations. We have confirmed that the gaze tracking system using our eye model works well under general situations: indoor, outdoor and driving scene.

Supplementary Material

MP4 File (p213-tsukada.mp4)

Download
28.24 MB

References

[1]

Basilio Noris, J. -B. K., and Billar, A. 2011. A wearable gaze tracking system for children in unconstrained environments. Computer Vision and Image Understanding.

Digital Library

Google Scholar

[2]

Hansen, D. W., and Ji, Q. 2010. In the eye of the beholder: A survey of models for eyes and gaze. IEEE Transactions on pattern analysis and machine intelligence 32, 478--500.

Digital Library

Google Scholar

[3]

Hansen, D. W., and Pece, A. E. 2005. Eye tracking in the wild. Computer Vision and Image Understanding 98, 155--181.

Digital Library

Google Scholar

[4]

Hayhoe, M., and Ballar, D. 2005. Eye movements in natural behavior. TRENDS in Cognitive Sciences Vol.9 No.4, 188--194.

Crossref

Google Scholar

[5]

Kanade, T. 2009. First person vision. In First Workshop on Egocentric Vision(in conjunction with CVPR2009).

Google Scholar

[6]

Li, D., and Parkhurst, D. 2006. Open-source software for real-time visible- spectrum eye tracking. In The 2nd Conference on Communication by Gaze Interaction (COGAIN).

Google Scholar

[7]

Morimoto, C. H., and Mimica, M. R. 2005. Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding 98 Issue 1, 4--24.

Digital Library

Google Scholar

[8]

Ohno, T., and Mukawa, N. 2004. A free-head, simple calibration, gaze tracking system that enables gaze-based interaction. In ETRA: eye tracking research & application symposium.

Digital Library

Google Scholar

[9]

Pérez, A., Córdoba, M. L., García, A., Méndez, R., Muñoz, M. L., Pedraza, J. L., and Sánchez, F. 2003. A precise eye-gaze detection and tracking system. In WSCG.

Google Scholar

[10]

Tan, K.-H., Kriegman, D. J., and Ahuja, N. 2002. Appearance-based eye gaze estimation. In Workshop on Applications of Computer Vision.

Digital Library

Google Scholar

[11]

Tsukada, A., Shino, M., Devyver, M., and Kanade, T. 2011. Illumination-free gaze estimation method for first-person vision wearable device. In Computer Vision in Vehicle Technology:From Earth to Mars(In conjunction with ICCV 2011).

Google Scholar

[12]

Vester-Christensen, M., Leimberg, D., Ersbøll, B. K., and Hansen, L. K. 2005. Deformable models for eye tracking. In Den 14. Danske Konference i Mønstergenkendelse og Billedanalyse.

Google Scholar

[13]

Wu, H., Kitagawa, Y., Wada, T., Kato, T., and Chen, Q. 2007. Tracking iris contour with a 3d eye-model for gaze estimation. In Asian Conference on Computer Vision.

Digital Library

Google Scholar

Cited By

View all

Kuang CKephart JJi Q(2023)Towards an Accurate 3D Deformable Eye Model for Gaze EstimationPattern Recognition, Computer Vision, and Image Processing. ICPR 2022 International Workshops and Challenges10.1007/978-3-031-37660-3_8(109-123)Online publication date: 30-Jul-2023
https://doi.org/10.1007/978-3-031-37660-3_8
Liang CChen JCai Z(2021)Accurate Annotation of Gaze Point for Wearable Eye Tracking Devices2021 China Automation Congress (CAC)10.1109/CAC53003.2021.9728046(3413-3421)Online publication date: 22-Oct-2021
https://doi.org/10.1109/CAC53003.2021.9728046
Santini TNiehorster DKasneci EKrejtz KSharif B(2019)Get a gripProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications10.1145/3314111.3319835(1-10)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3314111.3319835
Show More Cited By

Index Terms

Automatic acquisition of a 3D eye model for a wearable first-person vision device
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Modeling and simulation
    1. Model development and analysis
      1. Model verification and validation

Recommendations

A novel approach to single camera, glint-free 3D eye model fitting including corneal refraction
ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

Model-based methods for glint-free gaze estimation typically infer eye pose using pupil contours extracted from eye images. Existing methods, however, either ignore or require complex hardware setups to deal with refraction effects occurring at the ...
A fast approach to refraction-aware eye-model fitting and gaze prediction
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

By temporally integrating information about pupil contours extracted from eye images, model-based methods for glint-free gaze estimation can mitigate pupil detection noise. However, current approaches require time-consuming iterative solving of a ...
Eye detection and coarse localization of pupil for video-based eye tracking systems
Abstract
A video-based eye tracking system generally captures NIR images, each of which contains one or two eyes of a subject. The subject’s point of gaze is then determined using 3D eye model and pupil centre corneal reflection technique. Eye detection ...

Comments

Information & Contributors

Information

Published In

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2012

420 pages

ISBN:9781450312219

DOI:10.1145/2168556

Conference Chairs:
Carlos H. Morimoto
University of São Paulo, Brazil
,
Howell Istance
Montfort University, UK
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Jeffrey B. Mulligan
NASA
,
Pernilla Qvarfordt
FX Palo Alto

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ETRA '12

Sponsor:

ETRA '12: Eye Tracking Research and Applications

March 28 - 30, 2012

California, Santa Barbara

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
506
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kuang CKephart JJi Q(2023)Towards an Accurate 3D Deformable Eye Model for Gaze EstimationPattern Recognition, Computer Vision, and Image Processing. ICPR 2022 International Workshops and Challenges10.1007/978-3-031-37660-3_8(109-123)Online publication date: 30-Jul-2023
https://doi.org/10.1007/978-3-031-37660-3_8
Liang CChen JCai Z(2021)Accurate Annotation of Gaze Point for Wearable Eye Tracking Devices2021 China Automation Congress (CAC)10.1109/CAC53003.2021.9728046(3413-3421)Online publication date: 22-Oct-2021
https://doi.org/10.1109/CAC53003.2021.9728046
Santini TNiehorster DKasneci EKrejtz KSharif B(2019)Get a gripProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications10.1145/3314111.3319835(1-10)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3314111.3319835
Dierkes KKassner MBulling AKrejtz KSharif B(2019)A fast approach to refraction-aware eye-model fitting and gaze predictionProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications10.1145/3314111.3319819(1-9)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3314111.3319819
Dierkes KKassner MBulling ASharif BKrejtz K(2018)A novel approach to single camera, glint-free 3D eye model fitting including corneal refractionProceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications10.1145/3204493.3204525(1-9)Online publication date: 14-Jun-2018
https://dl.acm.org/doi/10.1145/3204493.3204525
Tomi ARambli D(2017)A Conceptual Design of Spatial Calibration for Optical See-Through Head Mounted Display Using Electroencephalographic Signal Processing on Eye TrackingAdvances in Visual Informatics10.1007/978-3-319-70010-6_31(331-339)Online publication date: 29-Oct-2017
https://doi.org/10.1007/978-3-319-70010-6_31
Nitschke CNakazawa A(2017)Corneal ImagingThe Wiley Handbook of Human Computer Interaction10.1002/9781118976005.ch21(445-514)Online publication date: 28-Dec-2017
https://doi.org/10.1002/9781118976005.ch21
Lu FGao YChen X(2016)Estimating 3D Gaze Directions Using Unlabeled Eye Images via Synthetic Iris Appearance FittingIEEE Transactions on Multimedia10.1109/TMM.2016.257628418:9(1772-1782)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1109/TMM.2016.2576284
Plopski ANitschke CKiyokawa KSchmalstieg DTakemura HKiyokawa KReiners DSteed A(2015)Hybrid eye trackingProceedings of the 25th International Conference on Artificial Reality and Telexistence and 20th Eurographics Symposium on Virtual Environments10.5555/2852313.2852338(183-190)Online publication date: 28-Oct-2015
https://dl.acm.org/doi/10.5555/2852313.2852338
Borsato FAluani FMorimoto C(2015)A Fast and Accurate Eye Tracker Using Stroboscopic Differential LightingProceedings of the 2015 IEEE International Conference on Computer Vision Workshop (ICCVW)10.1109/ICCVW.2015.72(502-510)Online publication date: 7-Dec-2015
https://dl.acm.org/doi/10.1109/ICCVW.2015.72
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A novel approach to single camera, glint-free 3D eye model fitting including corneal refraction

A fast approach to refraction-aware eye-model fitting and gaze prediction

Eye detection and coarse localization of pupil for video-based eye tracking systems