Cited By
View all- Ahmed MLaskar R(2022)Eye center localization using gradient and intensity information under uncontrolled environmentMultimedia Tools and Applications10.1007/s11042-021-11805-z81:5(7145-7168)Online publication date: 1-Feb-2022
Evaluation of accurate iris center and eye corner localization method in a facial image for gaze estimation
Abstract
Accurate estimation of eye-related information is important for many applications such as gaze estimation, face alignment, driver drowsiness detection, etc. Earlier works fail to estimate eye information in low-resolution images captured by a regular camera or webcam. This paper is aimed at developing an Iris Center (IC) and Eye Corner (EC) localization method in low-resolution facial images with an application of gaze estimation. A three-stage method is proposed for IC and EC localization. In the first stage, a circular gradient-intensity-based operator is proposed for rough ICs estimation and a CNN model is used in the second stage to find true ICs. In the third stage, Explicit Shape Regression (ESR) method is used for EC localization where initialization is done taking the ICs as a reference point to the mean eye contour shape model. The proposed IC localization method is evaluated on BioID and Gi4E database and it shows better accuracy compare to some of the state-of-the-art methods. This method further evaluated for gaze estimation based on IC and EC which does not require any prior calibrations unlike earlier infrared illumination-based gaze trackers. Here, the experiment for gaze estimation is performed in our proposed NITSGoP database that prepared under indoor conditions with complex background and uneven illuminations. The experimental results suggest that the proposed method can be used for gaze estimation with better accuracy both in still images and videos.
References
[1]
Drewes, H. (2014). Eye Gaze Tracking. Interactive Displays: Natural Human Interface Technologies, 251–283.
[2]
Oliveira, L. S., Borges, D. L., Vidal, F. B., and Chang, L (2012). A fast eye localization and verification method to improve face matching in surveillance videos. IEEE International Conference on Systems, Man, and Cybernetics (SMC); pp. 840–845
[3]
Majaranta P and Bulling A Eye tracking and eye-based human–computer interaction Advances in physiological computing 2014 London Springer 39-65
[4]
Duchowski AT Eye tracking methodology Theory Practice 2007 328 614 2-3
[5]
Timm F and Barth E Accurate eye centre localisation by means of gradients Visapp 2011 11 125-130
[6]
Kim, B. S., Lee, H., and Kim, W. Y.: Rapid eye detection method for non-glasses type 3D display on portable devices. IEEE Transactions on consumer electronics, vol. 56, no. 4, pp. 2498-2505 (2010).
[7]
Kim H, Jo J, Toh KA, and Kim J Eye detection in a facial image under pose variation based on multi-scale iris shape feature Image Vis. Comput. 2017 57 147-164
[8]
Cootes TF, Edwards GJ, and Taylor CJ Active appearance models IEEE Trans. Pattern Anal. Mach. Intell. 2001 23 6 681-685
[9]
Cristinacce D and Cootes TF Feature detection and tracking with constrained local models Bmvc 2006 1 2 3
[10]
Xiong, X., and De la Torre, F. (2013). Supervised descent method and its applications to face alignment. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 532–539).
[11]
Cao X, Wei Y, Wen F, and Sun J Face alignment by explicit shape regression Int. J. Comput. Vis. 2014 107 2 177-190
[12]
Song F, Tan X, Chen S, and Zhou ZH A literature survey on robust and efficient eye localization in real-life scenarios Pattern Recogn. 2013 46 12 3157-3173
[13]
Alonso-Fernandez F and Bigun J A survey on periocular biometrics research Pattern Recogn. Lett. 2016 82 92-105
[14]
Jing MQ and Chen LH A novel method for horizontal eye line detection under various environments Int. J. Pattern Recogn. Artif. Intell. 2010 24 03 475-498
[15]
San NN and Aye N Performance evaluation of eye detection system using WSAPG IJCCER 2014 2 2 52-56
[16]
Skodras E and Fakotakis N Precise localization of eye centers in low-resolution color images Image Vis. Comput. 2015 36 51-60
[17]
Hassaballah M, Kanazawa T, and Ido S Efficient eye detection method based on grey intensity variance and independent components analysis IET Comput. Vision 2010 4 4 261-271
[18]
Valenti R and Gevers T Accurate eye center location through invariant isocentric patterns IEEE Trans. Pattern Anal. Mach. Intell. 2012 34 9 1785-1798
[19]
Viola, P., and Jones, M. (2001). Rapid object detection using a boosted cascade of simple features, Computer Vision and Pattern Recognition, Proceedings of the 2001 IEEE Computer Society Conference, Vol. 1, pp. I-I.
[20]
Chen S and Liu C Eye detection using discriminatory Haar features and a new efficient SVM Image Vis. Comput. 2015 33 68-77
[21]
Kroon B, Maas S, Boughorbel S, and Hanjalic A Eye localization in low and standard definition content with application to face matching Comput. Vis. Image Underst. 2009 113 8 921-933
[22]
Savakis, A., Sharma, R., and Kumar, M. (2014). Efficient eye detection using HOG-PCA descriptor. In: Proceedings SPIE 9027, imaging and multimedia analytics in a web and mobile world 2014, 90270J.
[23]
Tan, X., Song, F., Zhou, Z. H., and Chen, S. (2009). Enhanced pictorial structures for precise eye localization under uncontrolled conditions. Computer Vision and Pattern Recognition, IEEE Conference, pp. 1621–1628.
[24]
Monzo D, Albiol A, Sastre J, and Albiol A Precise eye localization using HOG descriptors Mach. Vis. Appl. 2011 22 3 471-480
[25]
Ito, Y., Ohyama, W., Wakabayashi, T., and Kimura, F. (2012). Detection of eyes by circular Hough transform and histogram of gradient, In Pattern Recognition (ICPR), 21st IEEE International Conference, pp. 1795–1798.
[26]
Zhu, J., and Yang, J. (2002). Subpixel eye gaze tracking. In Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition (pp. 131–136).
[27]
Zhou R, He Q, Wu J, Hu C, and Meng QH Inner and outer eye corners detection for facial features extraction based on ctgf algorithm Appl Mech Mater 2011 58 1966-1971 Trans Tech Publications
[28]
Xia, H., Yan, G.: A novel method for eye corner detection based on weighted variance projection function. 2nd International congress on image and signal processing, Tianjin, pp. 1–4. (2009).
[29]
Bengoechea JJ, Cerrolaza JJ, Villanueva A, and Cabeza R Evaluation of accurate eye corner detection methods for gaze estimation J. Eye Mov Res. 2014 7 3 1-8
[30]
Jain AK Fundamentals of digital image processing 1989 Englewood Cliffs, NJ Prentice Hall
[31]
LeCun Y, Bottou L, Bengio Y, and Haffner P Gradient-based learning applied to document recognition Proc. IEEE 1998 86 11 2278-2324
[32]
Krizhevsky, A., Sutskever, I., Hinton, G. E.: ImageNet classification with deep convolutional neural networks. Communications of the ACM 60(6), 84–90 (2017).
[33]
Jariwala KN, Nandi A, and Dalal UD A real-time robust eye center localization using geometric eye model and edge gradients in unconstrained visual environment Int. J. Comput. Appl. 2015 128 1 22-27
[34]
Ross, A., and Govindarajan, R. (2004). Feature level fusion in biometric systems, In Proceedings of Biometric Consortium Conference (BCC); pp. 1–2.
[35]
Hao, Y., Zhu, H., Wu, K., Lin, X., Ma, L.: Salient-points-guided face alignment. In: Multimedia systems 25, 475–485.
[36]
Kazemi, V., and Sullivan, J. (2014). One millisecond face alignment with an ensemble of regression trees. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1867–1874).
[37]
Jesorsky O, Kirchberg KJ, and Frischholz RW Robust face detection using the Hausdorff distance International Conference on Audio-and Video-based Biometric Person Authentication 2001 Berlin, Heidelberg Springer 90-95
[38]
BioID Technology Research, the BioID Face Database, https://ftp.uni-erlangen.de/pub/facedb/, 2001.
[39]
Ponz, V., Villanueva, A., and Cabeza, R. (2012). Dataset for the evaluation of eye detector for gaze estimation, In Proceedings of the 2012 ACM Conference on Ubiquitous Computing, pp. 681–684.
[40]
Asadifard M and Shanbezadeh J Automatic adaptive center of pupil detection using face detection and CDF analysis Proc. Int. Multiconf. Eng. Comput. Sci. 2010 1 3
[41]
Hamouz M, Kittler J, Kamarainen JK, Paalanen P, Kalviainen H, and Matas J Feature-based affine-invariant localization of faces IEEE Trans. Pattern Anal. Mach. Intell. 2005 27 9 1490-1495
[42]
Ren Y, Wang S, Hou B, and Ma J A novel eye localization method with rotation invariance IEEE Trans. Image Process. 2014 23 1 226-239
[43]
George A and Routray A Fast and accurate algorithm for eye localization for gaze tracking in low-resolution images IET Comput. Vis. 2016 10 7 660-669
[44]
Leo M, Cazzato D, De Marco T, and Distante C Unsupervised eye pupil localization through differential geometry and local self-similarity matching PLoS ONE 2014 9 8 e102829
[45]
Baek SJ, Choi KA, Ma C, Kim YH, and Ko SJ Eyeball model-based iris center localization for visible image-based eye-gaze tracking systems IEEE Trans. Consum. Electron. 2013 59 2 415-421
[46]
Daugman, J.: How iris recognition works. The Essential Guide to Image Processing (Second Edition), 715–739 (2009).
[47]
Wang, J., Sung, A., and Venkateswarlu, R. (2003). Eye gaze estimation from a single image of one eye, In Computer Vision, Proceedings, Ninth IEEE International Conference; pp. 136–143.
[48]
Martinez, A. M. (1998). The AR face database. CVC Technical Report24.
[49]
Gross R, Matthews I, Cohn J, Kanade T, and Baker S Multi-pie Image Vis. Comput. 2010 28 5 807-813
[50]
Laddi A and Prakash NR An augmented image gradients based supervised regression technique for iris center localization Multimed. Tools Appl. 2017 76 5 7129-7139
[51]
Ahmed M and Laskar RH Eye center localization in a facial image based on geometric shapes of iris and eyelid under natural Variability Image Vis. Comput. 2019
[52]
Laddi A and Prakash NR Eye gaze tracking based directional control interface for interactive applications Multimed. Tools Appl. 2019 78 22 31215-31230
[53]
Kim HI, Kim JB, and Park RH Efficient and fast iris localization using binary radial gradient features for human–computer interaction Int. J. Pattern Recogn. Artif. Intell. 2017 31 11 1756015
[54]
Ahmed, M., Ahmed, R., Thakuria, A. J., and Laskar, R. H. (2019). Eye center guided constrained local model for landmark localization in facial image," 9th Annual Information Technology, Electromechanical Engineering and Microelectronics Conference (IEMECON), Jaipur, India, 2019, pp. 168-173,
[55]
Ahmed, M., Laskar, R. H., and Laskar, R. H. ( 2019). Analyzing the effect of eye center localization on accurate landmark localization in a facial image," International Conference on Automation, Computational and Technology Management (ICACTM), London, United Kingdom, 2019, pp. 544–549,
[56]
Larrazabal AJ, Cena CG, and Martínez CE Video-oculography eye tracking towards clinical applications: a review Comput. Biol. Med. 2019 108 57-66
[57]
Xia Y, Lou J, Dong J, Qi L, Li G, and Yu H Hybrid regression and isophote curvature for accurate eye center localization Multimed. Tools Appl. 2020 79 1 805-824
[58]
Dai L, Liu J, Ju Z, and Gao Y Iris center localization using energy map with image inpaint technology and post-processing correction IEEE Access 2020 8 16965-16978
[59]
Ahmed, N. Y.: Real-time accurate eye center localization for low-resolution grayscale images. J Real-Time Image Proc 1–28.
[60]
Choi JH, Lee KI, and Song BC Eye pupil localization algorithm using convolutional neural networks Multimed. Tools Appl. 2020 79 43 32563-32574
[61]
Levinshtein A, Phung E, and Aarabi P Hybrid eye center localization using cascaded regression and hand-crafted model fitting Image Vis. Comput. 2018 71 17-24
[62]
Abbasi M and Khosravi MR A robust and accurate particle filter-based pupil detection method for big datasets of eye video J. Grid Comput. 2020 18 2 305-325
Recommendations
Eye-gaze estimation under various head positions and iris states
A new method for eye-gaze estimation under normal head movement is investigated.Head position and orientations are acquired by Kinect depth data and eye direction is obtained from high resolution images.Bayesian multinomial logistic regression is used ...
Eye-Model-Based Gaze Estimation by RGB-D Camera
CVPRW '14: Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition WorkshopsThis paper proposes a method of eye-model-based gaze estimation by RGB-D camera, Kinect sensor. Different from other methods, our method sets up a model to calibrate the eyeball center by gazing at a target in 3D space, not predefined. And then by ...
Eye detection in a facial image under pose variation based on multi-scale iris shape feature
The accurate location of eyes in a facial image is important to many human facial recognition-related applications, and has attracted considerable research interest in computer vision. However, most prevalent methods are based on the frontal pose of the ...
Comments
Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer-Verlag GmbH, DE part of Springer Nature 2021.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 01 June 2021
Accepted: 23 December 2020
Received: 28 October 2019
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 12 Feb 2025
Other Metrics
Citations
Cited By
View all- Ahmed MLaskar R(2022)Eye center localization using gradient and intensity information under uncontrolled environmentMultimedia Tools and Applications10.1007/s11042-021-11805-z81:5(7145-7168)Online publication date: 1-Feb-2022