Abstract
Human-machine interaction is a hot topic nowadays in the communities of computer vision and robotics. In this context, face recognition algorithms (used as primary cue for a person’s identity assessment) work well under controlled conditions but degrade significantly when tested in real-world environments. This is mostly due to the difficulty of simultaneously handling variations in illumination, pose, and occlusions. In this paper, we propose a novel approach for robust pose-invariant face recognition for human-robot interaction based on the real-time fitting of a 3D deformable model to input images taken from video sequences. More concrete, our approach generates a rectified face image irrespective with the actual head-pose orientation. Experimental results performed on Honda video database, using several manifold learning techniques, show a distinct advantage of the proposed method over the standard 2D appearance-based snapshot approach.
Chapter PDF
Similar content being viewed by others
Keywords
- Face Recognition
- Face Image
- Locally Linear Embedding
- Locality Preserve Projection
- Active Appearance Model
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Cai, D., He, X., Zhou, K., Han, J., Bao, H.: Locality sensitive discriminant analysis. In: International Joint Conference on Artificial Intelligence, pp. 708–713 (2007)
Tenenbaum, J.B., de Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5500), 2319–2323 (2000)
Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Transactions on PAMI 25(9), 1063–1074 (2003)
Cootes, T.F., Wheeler, G.V., Walker, K.N., Taylor, C.J.: View-based active appearance models. Image and Vision Computing 20(9-10), 4165–4176 (2002)
Chai, X., Shan, S., Chen, X., Gao, W.: Locally linear regression for pose-invariant face recognition. IEEE Trans. on Image Processing 16(7), 1716–1725 (2007)
Shan, T., Lovell, B.C., Chen, S.: Face recognition robust to head pose from one sample image. In: IEEE Intl. Conf. on Face and Gesture Recognition, pp. 515–518 (2006)
Blanz, V., Grother, P., Phillips, P.J., Vetter, T.: Face recognition based on frontal views generated from non-frontal images. In: IEEE Intl. Conf. on Computer Vision and Pattern Recognition, pp. 454–461 (2005)
Huisman, P., Munster, R., Veldhuis, R., Bazen, A.: Making 2d face recognition more robust using AAMs for pose compensation. In: IEEE International Conference on Face and Gesture Recognition, pp. 113–116 (2006)
Ahlberg, J.: An active model for facial feature tracking. EURASIP Journal on Applied Signal Processing 2002(6), 566–571 (2002)
Faugeras, O.: Three-Dimensional Computer Vision: a Geometric Viewpoint. The MIT Press (1993)
Lu, L., Zhang, Z., Shum, H., Liu, Z., Chen, H.: Model- and exemplar-based robust head pose tracking under occlusion and varying expression. In: Proc. IEEE Workshop on Models versus Exemplars in Computer Vision (CVPR 2001), pp. 1–8 (2001)
Dornaika, F., Raducanu, B.: Person-specific face shape estimation under varying head pose from single snapshots. In: IEEE Intl. Conf. on Pattern Recognition, pp. 3496–3499 (2010)
Ahlberg, J.: Real-time facial feature tracking using an active model with fast image warping. In: International Workshop on Very Low Bitrate Video (VLBV), Athens, Greece, pp. 39–43 (2001)
Dornaika, F., Davoine, F.: On appearance based face and facial action tracking. IEEE Transactions on Circuits and Systems for Video Technology 16(9), 1107–1124 (2006)
Gleicher, M.: Projective registration with difference decomposition. In: Proc. of Intl. Conf. on Computer Vision and Pattern Recognition, pp. 331–337 (1997)
Lee, K.-C., Ho, J., Yang, M.-H., Kriegman, D.: Visual tracking and recognition using probabilistic appearance manifolds. Computer Vision and Image Understanding 99, 303–331 (2005)
Lee, K.-C., Kriegman, D.: Online learning of probabilistic appearance manifolds for video-based recognition and tracking. In: Proc. of Intl. Conf. on Computer Vision and Pattern Recognition, pp. 852–859 (2005)
Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)
He, X., Niyogi, P.: Locality preserving projections. In: Conference on Advances in Neural Information Processing Systems (2003)
Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation 15(6), 1373–1396 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Raducanu, B., Dornaika, F. (2012). Pose-Invariant Face Recognition in Videos for Human-Machine Interaction. In: Fusiello, A., Murino, V., Cucchiara, R. (eds) Computer Vision – ECCV 2012. Workshops and Demonstrations. ECCV 2012. Lecture Notes in Computer Science, vol 7584. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33868-7_56
Download citation
DOI: https://doi.org/10.1007/978-3-642-33868-7_56
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33867-0
Online ISBN: 978-3-642-33868-7
eBook Packages: Computer ScienceComputer Science (R0)