research-article

A robust 3D eye gaze tracking system using noise reduction

Authors:

Qiang JiAuthors Info & Claims

ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applications

Pages 189 - 196

https://doi.org/10.1145/1344471.1344518

Published: 26 March 2008 Publication History

Abstract

This paper describes a novel real-time 3D gaze estimation system. The system consists of two cameras and two IR light sources. There are three novelties in this method. First, in our system, two IR lights are mounted near the centers of the stereo cameras, respectively. Based on this specific configuration, the 3D position of the corneal center can be simply derived by the 3D reconstruction technique. Then, after extracting the 3D position of the "virtual pupil" correctly, the optical axis of the eye can be obtained directly by connecting the "virtual pupil" with the corneal center. Second, we systematically analyze the noise in our 3D gaze estimation algorithm and propose an effective constraint to reduce this noise. Third, to estimate the user-dependent parameters (i.e. the constraint parameters and the eye parameters), a simple calibration method is proposed by gazing at four positions on the screen. Experimental results show that our system can accurately estimate and track eye gaze under natural head movement.

References

[1]

2006. http://www.a-s-l.com.

[2]

Beymer, D., and Flickner, M. 2003. Eye gaze tracking using an active stereo head. IEEE Conference on CVPR03.

[3]

C. H. Morimoto, Koons, D., A. Amir, and Flickner, M. 2000. Pupil detection and trcking using multiple light sources. Image and Vision Computing 18, 331--336.

[4]

Guestrin, E. D., and Eizenman, M. 2006. General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Transactions on Biomedical Engineering 53, 1124--1133.

[5]

Haro, A., Flickner, M., and Essa, I. 2000. Detecting and tracking eyes by using their physiological properties, dynamics, and appearance. IEEE Conference on CVPR00.

[6]

Huchinson, T., Jr., K. P. W., and Reichert, K. 1989. Human computer interaction using eye-gaze input. IEEE Transactions on Systems, Man, and Cybernetics 19, 1527--1533.

[7]

Jacob, R. J. 1991. The use of eye movements in human computer interaction technqiues: What you look at is what you get. ACM Tracnsations on Information Systems 9, 152--169.

Digital Library

[8]

Lagarias, J. C., Reeds, J. A., Wright, M. H., and Wright, P. E. 1998. Convergence properties of the nelder-mead simplex method in low dimensions. SIAM Journal of Optimization 9, 1.

Digital Library

[9]

2005. Lc technologies, inc. http://www.eyegaze.com.

[10]

Liversedge, S., and Findlay, J. 2000. Saccadic eye movements and cognition. Trends in Cognitive Science 4, 6--14.

[11]

Mason, M., B. Hood, and Macrae, C. 2004. Look into my eyes: Gaze direction and person memory. Memory 12, 637--643.

[12]

Morimoto, C. H., and Mimica, M. R. 2005. Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding, Special Issue on Eye Detection and Tracking 98, 4--24.

Digital Library

[13]

Morimoto, C. H., Amir, A., and Flickner, M. 2002. Detecting eye position and gaze from a single camera and 2 light sources. Proceedings of the International Conference on Parttern Recognition.

Digital Library

[14]

Oyster, C. W. 1999. The Human Eye: Structure and Function. Sinauer Associate, Inc.

[15]

Shih, S.-W., and Liu, J. 2004. A novel approach to 3-d gaze tracking using stereo cameras. IEEE Transactions on Systems, Man and Cybernetics, PartB 34, 1, 234--245.

Digital Library

[16]

2007. http://www.smi.de.

[17]

Trucco, E., and Verri, A. 1998. Introductory Techniques for 3D Computer Vision.

Digital Library

[18]

Wang, J.-G., and Sung, E. 2002. Study on eye gaze estimation. IEEE Transactions on Systems, Man and Cybernetics, PartB 32, 3, 332--350.

Digital Library

[19]

Zhai, S., Morimoto, C., and Ihde, S. 1999. Manual and gaze input cascaded (magic) pointing. Proceedings of the SIGCHI conference on Human factors in computing systems, 246--253.

Digital Library

[20]

Zhang, Z. 2000. A flexible new technique for camera calibration. IEEE Transactions on PAMI 22.

Digital Library

[21]

Zhu, Z., and Ji, Q. 2004. Eye and gaze tracking for interactive graphic display. Machine Vision and Application 15, 3, 139--148.

Digital Library

[22]

Zhu, Z., and Ji, Q. 2005. Eye gaze tracking under natural head movements. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR05).

Digital Library

[23]

Zhu, Z., and Ji, Q. 2007. Novel eye gaze tracking techniques under natural head movement. to appear in IEEE Transactions on Biomedical Engineering.

Cited By

Leharanger MLiu PVandromme LBalédent O(2024)Eye Tracking Post Processing to Detect Visual Artifacts and Quantify Visual Attention under Cognitive Task Activity during fMRISensors10.3390/s2415491624:15(4916)Online publication date: 29-Jul-2024
https://doi.org/10.3390/s24154916
Geise SMaubach K(2024)Catch me if you can: how episodic and thematic multimodal news frames shape policy support by stimulating visual attention and responsibility attributionsFrontiers in Communication10.3389/fcomm.2024.13050489Online publication date: 16-May-2024
https://doi.org/10.3389/fcomm.2024.1305048
Kang SLee KKim CChoi JYoon A(2023)Development of ET-DR Algorithm to Enhance Resolution for Gaze Correction of Low-Resolution Image Based Webcam Eye TrackingJournal of Multimedia Information System10.33851/JMIS.2023.10.1.1510:1(15-24)Online publication date: 31-Mar-2023
https://doi.org/10.33851/JMIS.2023.10.1.15
Show More Cited By

Index Terms

A robust 3D eye gaze tracking system using noise reduction
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation
      1. Image processing
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

3D gaze estimation in the scene volume with a head-mounted eye tracker
COGAIN '18: Proceedings of the Workshop on Communication by Gaze Interaction

Most applications involving gaze-based interaction are supported by estimation techniques that find a mapping between gaze data and corresponding targets on a 2D surface. However, in Virtual and Augmented Reality (AR) environments, interaction occurs ...
Eye and gaze tracking for interactive graphic display
SMARTGRAPH '02: Proceedings of the 2nd international symposium on Smart graphics

This paper describes preliminary results we have obtained in developing a computer vision system based on active IR illumination for real time gaze tracking for interactive graphic display. Unlike most of the existing gaze tracking techniques, which ...
A Simplified 3D Gaze Tracking Technology with Stereo Vision
ICOIP '10: Proceedings of the 2010 International Conference on Optoelectronics and Image Processing - Volume 01

A simplified 3D gaze tracking technology with stereo vision has been developed in this paper. A pair of stereo cameras and two point light sources are used to estimate 3D gaze of user's eye. Compared with other 3D systems, there are two improvements to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applications

March 2008

285 pages

ISBN:9781595939821

DOI:10.1145/1344471

Conference Chairs:
Kari-Jouko Räihä
University of Tampere, Finland
,
Andrew T. Duchowski
Clemson University, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ETRA '08

Sponsor:

ETRA '08: Eye Tracking Research and Applications

March 26 - 28, 2008

Georgia, Savannah

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

65
Total Citations
View Citations
1,236
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)6

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Leharanger MLiu PVandromme LBalédent O(2024)Eye Tracking Post Processing to Detect Visual Artifacts and Quantify Visual Attention under Cognitive Task Activity during fMRISensors10.3390/s2415491624:15(4916)Online publication date: 29-Jul-2024
Geise SMaubach K(2024)Catch me if you can: how episodic and thematic multimodal news frames shape policy support by stimulating visual attention and responsibility attributionsFrontiers in Communication10.3389/fcomm.2024.13050489Online publication date: 16-May-2024
Kang SLee KKim CChoi JYoon A(2023)Development of ET-DR Algorithm to Enhance Resolution for Gaze Correction of Low-Resolution Image Based Webcam Eye TrackingJournal of Multimedia Information System10.33851/JMIS.2023.10.1.1510:1(15-24)Online publication date: 31-Mar-2023
Popovic NChristodoulou DPaudel DWang XVan Gool L(2023)Model-aware 3D Eye Gaze from Weak and Few-shot Supervisions2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00161(746-751)Online publication date: 16-Oct-2023
Fairbairn DHepburn J(2023)Eye-tracking in map use, map user and map usability research: what are we looking for?International Journal of Cartography10.1080/23729333.2023.21890649:2(231-254)Online publication date: 16-Mar-2023
Yang SHe YChen Y(2023)Spatialgaze: towards spatial gaze tracking for extended realityCCF Transactions on Pervasive Computing and Interaction10.1007/s42486-023-00139-45:4(430-446)Online publication date: 16-Oct-2023
Kuang CKephart JJi Q(2023)Towards an Accurate 3D Deformable Eye Model for Gaze EstimationPattern Recognition, Computer Vision, and Image Processing. ICPR 2022 International Workshops and Challenges10.1007/978-3-031-37660-3_8(109-123)Online publication date: 30-Jul-2023
Wang ZZhao YLu F(2022)Gaze-Vergence-Controlled See-Through Vision in Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320311028:11(3843-3853)Online publication date: Nov-2022
Lu CChakravarthula PLiu KLiu XLi SFuchs H(2022)Neural 3D Gaze: 3D Pupil Localization and Gaze Tracking based on Anatomical Eye Model and Neural Refraction Correction2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00053(375-383)Online publication date: Oct-2022
Turk MHua G(2022)Vision-Based InteractionundefinedOnline publication date: 25-Feb-2022
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents