Abstract
The head pose estimation technique predicts the rotation of the human head by analyzing a person’s face in a digital image. The head pose estimation framework uses two processes for the estimation. The first step is the detection of the face and facial features using a Haar-like feature detector. Methods proposed in previous studies generally provided a low overall detection ratio of each facial feature. Therefore, the pre-processing step for storing the facial features as a template could be time consuming. We propose a calibration method that finds one eye feature that cannot be found on the front part of the face. The method was evaluated by conducting an experiment to measure the detection accuracy of the face and facial features. The second process is used for the template-matching algorithm while the facial features are being tracked. As the experiment proceeded, we measured the time required to execute the estimation on an Android device. The head pose estimation procedure uses the coordinates of facial features. The algorithms used in the proposed systems show that the detection and tracking processes require approximately 230 ms and 20 ms, respectively. In addition, the calibration method proved to be effective in terms of decreasing the detection failure rate by approximately 8 %. Thus, this result confirms the effectiveness of our method on mobile devices.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Murphy-Chutorian E, Trivedi MM (2009) Head pose estimation in computer vision : a survey. IEEE Trans Pattern Anal Mach Intell 31(4):607–626
Horprasert T, Yacoob Y, Davis L (1997) Computing 3-D Head Orientation from a Monocular Image Sequence, 25th Annual AIPR Workshop on Emerging Applications of Computer Vision. International Society for Optics and Photonics, 244–252
Beymer D, James D (1994) Face recognition under varying pose, Computer Vision and Pattern Recognition,1994 IEEE Computer Society Conference on, 756–761
Zhao G, Chen L, Song J, Chen G (2007) Large Head Movement Tracking Using SIFT-based Registration, Proceedings of the 15th ACM international conference on Multimedia. ACM, 807–810
Wang JG, Sung E (2007) EM Enhancement of 3D Head Pose Estimated by Point at Infinity. Image Vis Comput 25(12):1864–1874
Ren J, Rahman M, Kehtarnavaz N, Estevez L (2010) Real-time head pose estimation on mobile platforms. J Syst, Cybern Inform 8(3):56–62
Jones M, Viola P (2013) Fast multi-view face detection, Mitsubishi Electric Research Lab TR-20003-96 3(14)
Zhao G, Chen L, Song J, Chen G (2007) Large head movement tracking using sift-based registration. In: Proceedings of the 15th ACM international conference on Multimedia, pp 807–810
Viola P, Jones MJ (2004) Robust Real-Time face detection. Int J Comput Vis 57(2):137–154
Freund Y, Schapire ER (1997) A decision-theoretic generalization of on-line learning and an application to boosting. In: European conference on computational learning theory. Springer berlin heidelberg, p 23-37
Whoang I, Chang SH, Choi K (2009) Tracking Objects with Radical Color Changes Using a Modified Mean Shift Algorithm, Journal of Imaging Science and Technology, 53(2)
Son H, Kim C, Choi K (2010) Rapid 3D object detection and modeling using range data from 3D range imaging camera for heavy equipment operation. Autom Constr 19(7):898–906
Whoang I, Kim JH, Choi K (2012) Object tracking using maximum colour distance under illumination change. Int J Adv Robot Syst:9
Chang SH, Shim DS, Kim HY, Choi K (2012) Object motion tracking using a moving direction estimate and color updates. Int J Control Autom Syst 10(1):136–142
Nguyen DT, Jung JE (2017) Real-time event detection for online behavioral analysis of big social data. Futur Gener Comput Syst 66:137–145
Jung JJ (2016) Exploiting geotagged resources for spatial clustering on social network services. Concurrency Comput: Pract Experience 28(4):1356–1367
Bello-Orgaz G, Jung JJ, Camacho D (2016) Social Big Data: Recent achievements and new challenges. Inform Fusion 28:45–59
Nguyen DT, Jung JE (2015) Real-time event detection on social data stream. Mobile Netw Appl 20 (4):475–486
Lee O -J, Hong M, Jung JJ, Shin J, Kim P (2016) Adaptive collaborative filtering based on scalable clustering for big recommender systems. ACTA Polytechnica Hungarica 13(2):179–194
Sapienza M, Camilleri KP (2014) Fasthpe: A recipe for quick head pose estimation
Asteriadis S, Soufleros D, Karpouzis K, Kollias S A Natural Head Pose and Eye Gaze Dataset, International Conference on Multimodal Interfaces (ICMI 2009), November 2-6, Boston, MA
Cristina S, Camilleri KP (2015) Model-Free head pose estimation based on shape factorisation and particle filtering in computer analysis of images and patterns, Springer International Publishing, 628–639
Asteriadis S, Karpouzis K, Kollias S (2010) Head pose estimation with one camera, in uncalibrated environments, Inproceedings of the 2010 workshop on Eye gaze in intelligent human machine interaction. ACM, 55–62
Choi HJ, Lee YS, Shim D -S, Lee CG, Choi K (2016) Effective pedestrian detection using deformable part model based on human model Internaltional. Int J Control Autom Syst 14(6):1618–1625
Acknowledgments
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (NRF-2010-0025512).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kim, J., Lee, G.H., Jung, J.J. et al. Real-Time Head Pose Estimation Framework for Mobile Devices. Mobile Netw Appl 22, 634–641 (2017). https://doi.org/10.1007/s11036-016-0801-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11036-016-0801-x