article

Eye and gaze tracking for interactive graphic display

Authors:

Qiang JiAuthors Info & Claims

Machine Vision and Applications, Volume 15, Issue 3

Pages 139 - 148

https://doi.org/10.1007/s00138-004-0139-4

Published: 01 July 2004 Publication History

Abstract

This paper describes a computer vision system based on active IR illumination for real-time gaze tracking for interactive graphic display. Unlike most of the existing gaze tracking techniques, which often require assuming a static head to work well and require a cumbersome calibration process for each person, our gaze tracker can perform robust and accurate gaze estimation without calibration and under rather significant head movement. This is made possible by a new gaze calibration procedure that identifies the mapping from pupil parameters to screen coordinates using generalized regression neural networks (GRNNs). With GRNNs, the mapping does not have to be an analytical function and head movement is explicitly accounted for by the gaze mapping function. Furthermore, the mapping function can generalize to other individuals not used in the training. To further improve the gaze estimation accuracy, we employ a hierarchical classification scheme that deals with the classes that tend to be misclassified. This leads to a 10% improvement in classification error. The angular gaze accuracy is about 5° horizontally and 8° vertically. The effectiveness of our gaze tracker is demonstrated by experiments that involve gaze-contingent interactive graphic display.

References

[1]

1. (ASL) TASL () The applied system laboratory e210 eye tracking systems, http://www.a-s-1.com.

[2]

2. Baluja S, Pomerleau D (1994) Non-intrusive gaze tracking using artificial neural networks. Technical Report CMU-CS-94-102, Carnegie Mellon University, Pittsburgh.

Digital Library

[3]

3. Bour L (1997) Dmi-search scleral coil. Technical Report H2-214, Department of Neurology, Clinical Neurophysiology, Academic Medical Center, AZUA, Meibergdreef 9, 115AZ, Amsterdam.

[4]

4. Ebisawa Y (1995) Unconstrained pupil detection technique using two light sources and the image difference method. In: Visualization and intelligent design in engineering and architecture II. Computational Mechanics Publications, Boston, pp 79-89.

[5]

5. Ebisawa Y (1998) Improved video-based eye-gaze detection method. IEEE Trans Instrum Meas 47(2):948-955.

[6]

6. Gee A, Cipoll R (1994) Determining the gaze of faces in images. Image Vision Comput 30:639-647.

[7]

7. Gips J, Olivieri P, Tecce J (1993) Direct control of the computer through electrodes placed around the eyes. Human-computer interaction: applications and case studies. Elsevier, Amsterdam, pp 630-635.

[8]

8. Hutchinson TE (1988) Eye movement detection with improved calibration and speed. United States patent {19} no. 4,950,069.

[9]

9. Hutchinson TE, White K, Worthy JR, Martin N, Kelly C, Lisa R, Frey A (1989) Human-computer interaction using eye-gaze input. IEEE Trans Sys Man Cybern 19(6):1527-1533.

[10]

10. Ji Q, Yang X (2001) Real time visual cues extraction for monitoring driver vigilance. In: Proceedings of the 2nd international workshop on computer vision systems (ICVS 2001), Vancouver, Canada.

[11]

11. Ji Q, Yang X (2002) Real time 3D face pose discrimination based on active IR illumination. In: Proceedings of the international conference on pattern recognition.

[12]

12. Koons D, Flickner M. IBM Blue Eyes project. http://www.almaden.ibm.com/cs/blueeyes.

[13]

13. Morimoto CH, Koons D, Amir A, Flickner M (1999) Frame-rate pupil detector and gaze tracker. In: Proceedings of the IEEE ICCV'99 frame-rate workshop.

[14]

14. Motwani MC, Ji Q (2001) 3D face pose discrimination using wavelets. In: Proceedings of the IEEE international conference on image processing (ICIP'2001), Thessaloniki, Greece, 7-10 October 2001.

[15]

15. Ohno T, Mukawa N, Yoshikawa A (2002) Freegaze: a gaze tracking system for everyday gaze interaction. In: Proceedings of the symposium on eye tracking research and applications, 25-27 March 2002, New Orleans.

[16]

16. Rae R, Ritter H (1998) Recognition of human head orientation based on artificial neural networks. IEEE Trans Neural Netw 9(2):257-265.

Digital Library

[17]

17. Shih S, Wu Y, Liu J (2000) A calibration-free gaze tracking technique. In: Proceedings of the 15th international conference on pattern recognition, Barcelona, Spain.

[18]

18. Specht DF (1991) A general regression neural network. IEEE Trans Neural Netw 2:568-576.

Digital Library

[19]

19. Wang J, Sung E (2001) Gaze determination via images of irises. Image Vision Comput 19(12):891-911.

[20]

20. Yang G, Waibel A (1996) A real-time face tracker. In: Proceedings of the workshop on applications of computer vision, pp 142-147.

[21]

21. Zhu J, Yang J (2002) Subpixel eye gaze tracking. In: Proceedings of the 5th IEEE international conference on automatic face and gesture recognition.

[22]

22. Zhu Z, Fujimura K, Ji Q (2002) Real-time eye detection and tracking under various light conditions. In: Proceedings of the symposium on eye tracking research and applications, 25-27 March 2002, New Orleans.

Digital Library

Cited By

Pandey NMuppalaneni N(2023)Strabismus free gaze detection system for driver’s using deep learning techniqueProgress in Artificial Intelligence10.1007/s13748-023-00296-812:1(45-59)Online publication date: 31-Jan-2023
https://dl.acm.org/doi/10.1007/s13748-023-00296-8
Putra HOgata K(2022)Seamless Gaze Gesture Interactions With Various Devices Without Moving Objects as Visual StimulationProceedings of the 10th International Conference on Computer and Communications Management10.1145/3556223.3556234(73-78)Online publication date: 29-Jul-2022
https://dl.acm.org/doi/10.1145/3556223.3556234
Cheng SWang JShen XChen YDey A(2022)Collaborative eye tracking based code review through real-time shared gaze visualizationFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-020-0422-116:3Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1007/s11704-020-0422-1
Show More Cited By

Index Terms

Eye and gaze tracking for interactive graphic display
1. Computing methodologies
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Eye and gaze tracking for interactive graphic display
SMARTGRAPH '02: Proceedings of the 2nd international symposium on Smart graphics

This paper describes preliminary results we have obtained in developing a computer vision system based on active IR illumination for real time gaze tracking for interactive graphic display. Unlike most of the existing gaze tracking techniques, which ...
On visual gaze tracking based on a single low cost camera

Gaze tracking technologies provide an unconventional way of human-computer interaction, envisaged to advance practical applications and industrial products in a multitude of fields. The success of such systems depends on selecting the best calibration ...
Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

An eye-gaze-guided computer interface could enable computer use by the seriously disabled but existing systems cost tens of thousands of dollars or have cumbersome setups. This paper presents a methodology for real-time eye gaze tracking using a ...

Comments

Information & Contributors

Information

Published In

cover image Machine Vision and Applications

Machine Vision and Applications Volume 15, Issue 3

July 2004

63 pages

ISSN:0932-8092

Issue’s Table of Contents

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 July 2004

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

31
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pandey NMuppalaneni N(2023)Strabismus free gaze detection system for driver’s using deep learning techniqueProgress in Artificial Intelligence10.1007/s13748-023-00296-812:1(45-59)Online publication date: 31-Jan-2023
https://dl.acm.org/doi/10.1007/s13748-023-00296-8
Putra HOgata K(2022)Seamless Gaze Gesture Interactions With Various Devices Without Moving Objects as Visual StimulationProceedings of the 10th International Conference on Computer and Communications Management10.1145/3556223.3556234(73-78)Online publication date: 29-Jul-2022
https://dl.acm.org/doi/10.1145/3556223.3556234
Cheng SWang JShen XChen YDey A(2022)Collaborative eye tracking based code review through real-time shared gaze visualizationFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-020-0422-116:3Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1007/s11704-020-0422-1
Drakopoulos PKoulieris GMania K(2021)Eye Tracking Interaction on Unmodified Mobile VR Headsets Using the Selfie CameraACM Transactions on Applied Perception10.1145/345687518:3(1-20)Online publication date: 20-May-2021
https://dl.acm.org/doi/10.1145/3456875
Dai LLiu JJu ZGao Y(2020)Iris center localization using energy map synthesis based on gradient and isophoteJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-19128138:4(4511-4523)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.3233/JIFS-191281
Kar PChattopadhyay SChakraborty S(2020)Gestatten: Estimation of User's Attention in Mobile MOOCs From Eye Gaze and Gaze Gesture TrackingProceedings of the ACM on Human-Computer Interaction10.1145/33949744:EICS(1-32)Online publication date: 18-Jun-2020
https://dl.acm.org/doi/10.1145/3394974
Lemley JKar ADrimbarean ACorcoran P(2019)Convolutional Neural Network Implementation for Eye-Gaze Estimation on Low-Quality Consumer Imaging SystemsIEEE Transactions on Consumer Electronics10.1109/TCE.2019.289986965:2(179-187)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1109/TCE.2019.2899869
Jeon JKim GKim J(2019)A Study on the Development of the Psychological Assessment a Using Eye-Tracking: Focused on Eye Gaze Processing of Literacy TextAugmented Cognition10.1007/978-3-030-22419-6_6(74-83)Online publication date: 26-Jul-2019
https://dl.acm.org/doi/10.1007/978-3-030-22419-6_6
Geisler DFox DKasneci E(2018)Real-time 3D Glint Detection in Remote Eye Tracking Based on Bayesian Inference2018 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA.2018.8460800(7119-7126)Online publication date: 21-May-2018
https://dl.acm.org/doi/10.1109/ICRA.2018.8460800
Cheng SFan JDey A(2018)Smooth GazePersonal and Ubiquitous Computing10.1007/s00779-018-1115-822:3(489-501)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s00779-018-1115-8
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents