Article

Evaluation of 3d face recognition using registration and PCA

Authors:

Theodoros Papatheodorou,

Daniel RueckertAuthors Info & Claims

AVBPA'05: Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication

Pages 997 - 1009

https://doi.org/10.1007/11527923_104

Published: 20 July 2005 Publication History

Abstract

We introduce a novel technique for face recognition by using 3D face data that has been reconstructed from a stereo camera system. The face data consists of a dense 3D mesh of vertices describing the facial shape and geometry as well as a 2D texture map describing the facial appearance of each subject. We propose a recognition algorithm based on two steps: The first step involves the cleaning of the facial surface followed by a registration and normalization to a standard template face. The second step involves the creation of a PCA model and the use of a reduced dimensionality face space for the calculation of facial similarity. We use this technique on 3D surface and texture data comprising 83 subjects. Our results demonstrate the wealth of 3D information on the face as well as the importance of standardization and noise elimination in the datasets.

References

[1]

G.C. Baylis, E.T. Rollis, C.M. Leonard, Selectivity between faces in the response of a population of neurons in the cortex in the superior suculus of the monkey, Brain Res. 342 (1985) 91-102

[2]

J.V. Haxby, E.A. Hoffman, M.I. Gobbini, The distributed human neural system for face perception, Trends Cognitive Science 4 (2000) 223-233

[3]

R. Chellapa, C.L. Wilson and S. Sirohey, Human and Machine recognition of faces: A survey, Proceedings of the IEEE, Vol. 83, No. 5, (1995)

[4]

A.J. O. Toole, T. Price, T. Vetter, J.C. Bartlett, V. Blanz, 3D shape and 2D surface textures of human faces: the role of averages in attractiveness and age, Image and Vision Computing 18 (1999) 9-19

[5]

B. Hwang, S. Lee, Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model, IEEE Transcactions on pattern analysis and machine intelligence, Vol 24, No. 3, (2003), 365-372

Digital Library

[6]

H. Hill, A. Johnston, Categorizing sex and identity from the biological motion of faces, Current Biology, (2001), 11:880-885

[7]

M.A. Turk, A.P. Pentland, Face Recognition Using Eigenfaces, Journal of Cognitive Neuroscience, 3(1), (1991).

Digital Library

[8]

V. Blanz, T. Vetter, A Morphable Model for the synthesis of 3D faces, Computer Graphics Proceedings, Siggraph (1999), Los Angeles, 187-194

Digital Library

[9]

C. Beumier, M. Acheroy, Automatic 3D face authentication, Image and Vision Computing 18 (2000) 315-321

[10]

A.M. Bronstein, M.M.Bronstein, and R. Kimmel, Expression-Invariant 3D Face Recognition, Proceedings of 4th International Conference, AVBPA (2003), Guildford, UK, 62-69

Digital Library

[11]

C. Beumier, M. Acheroy, Face verification from 3D and grey level clues, Pattern Recognition Letters 22, (2001), 1321-1329

Digital Library

[12]

F. Tsalakanidou, D. Tzocaras, M. Strintzis, Use of depth and colour eigenfaces for face recognition, Pattern Recognition Letters, (2003), 24:1427-1435.

Digital Library

[13]

K. Chang, K. Bowyer, P. Flynn, Face recognition using 2D and 3D facial data, 2003 Multimodal User Authentication Workshop, (2003), 25-32.

[14]

A. Bronstein, M. Bronstein and R. Kimmel, Expression-invariant 3D face recognition, Proc. Audio & Video-based Biometric Person Authentication (AVBPA), Lecture Notes in Comp. Science 2688, Springer, (2003), 62-69

Digital Library

[15]

G. Zigelman, R. Kimmel, N. Kiryati, Texture mapping using surface flattening via multidimensional scaling, IEEE Transactions in Visualization and Computer Graphics, vol. 8, (2002), 198-207.

Digital Library

[16]

R. Grossman, N. Kiryati, R. Kimmel, Computational surface flattening: a voxel-based approach, IEEE Transactions PAMI, vol. 24, (2002), 433-441.

Digital Library

[17]

N. Smith, I. Meir, G. Hale, R. Howe, L. Johnson, P. Edwards, D. Hawkes, M. Bidmead, D. Landau, Real-Time 3D Surface Imaging for Patient Positioning in Radiotherapy, awaiting publication in the ASTRO 2003 proceedings

[18]

P.J. Besl, N.D. McKay, A Method for Registration of 3-D Shapes, IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 14, No 2, (1992), 239-256

Digital Library

[19]

S. Lee, G. Wolberg, S.Y. Shin, Scattered data interpolation with multilevel b-splines, IEEE Transactions on Visualization and Computer Graphics, vol. 3, no. 3, (1997).

Digital Library

[20]

V. Blanz, T. Vetter, Face recognition based on fitting a 3D Morphable Model, IEEE transactions on pattern analysis and machine intelligence, vol. 25, no.9, (2003)

Digital Library

[21]

R. Szeliski, S. Lavallee, ''Matching 3D Anatomical Surfaces with Non-Rigid Deformations using Octree-Splines'', IEEE Workshop on Biomed. Image Anal., June, (1994), 144- 153

[22]

K. Chang, K. Bowyer, P. Flynn, Face recognition using 2D and 3D facial data, 2003 Multimodal User Authentication Workshop, (2003), 25-32.

[23]

N.P. Costen, T.F. Cootes, G.J. Edwards, C.J. Taylor, Automatic extraction of the face identity-subspace, Image and Vision Computing, vol. 20, (2002), 319-329

Cited By

Pui SMinoi J(2019)A Non-template Based Automatic Landmarking on 3D Face DataProceedings of the 3rd International Conference on Video and Image Processing10.1145/3376067.3376073(212-216)Online publication date: 20-Dec-2019
https://dl.acm.org/doi/10.1145/3376067.3376073
Kaushik VBudhwar ADubey AAgrawal RGupta SPathak VGupta P(2009)An efficient 3D face recognition algorithmProceedings of the 3rd international conference on New technologies, mobility and security10.5555/1790343.1790393(259-263)Online publication date: 20-Dec-2009
https://dl.acm.org/doi/10.5555/1790343.1790393
Yang JLiao ZLiao ZWu Z(2009)A Method for Robust Nose Tip Location across Pose Variety in 3D Face DataProceedings of the 2009 International Asia Conference on Informatics in Control, Automation and Robotics10.1109/CAR.2009.86(114-117)Online publication date: 1-Feb-2009
https://dl.acm.org/doi/10.1109/CAR.2009.86
Show More Cited By

Index Terms

Evaluation of 3d face recognition using registration and PCA
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation
    2. Shape modeling

Index terms have been assigned to the content through auto-classification.

Recommendations

3D Face Factorisation for Face Recognition Using Pattern Recognition Algorithms
Abstract
The face is the preferable biometrics for person recognition or identification applications because person identifying by face is a human connate habit. In contrast to 2D face recognition, 3D face recognition is practically robust to illumination ...
3D face recognition: a survey

3D face recognition has become a trending research direction in both industry and academia. It inherits advantages from traditional 2D face recognition, such as the natural recognition process and a wide range of applications. Moreover, 3D face ...
3D face recognition using local binary patterns

It is well recognized that expressions can significantly change facial geometry that results in a severe problem for robust 3D face recognition. So it is crucial for many applications that how to extract expression-robust features to describe 3D faces. ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

AVBPA'05: Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication

July 2005

1129 pages

ISBN:3540278877

Editors:
Takeo Kanade
The Robotics Institute, Carnegie Mellon University., Pittsburgh, Pennsylvania
,
Anil Jain
Withington Hospital, Nightingale Centre, Manchester, UK
,
Nalini K. Ratha
Withington Hospital, IBM Thomas J. Watson Research Center, 19 Skyline Drive, Hawthorne, UK

Sponsors

Springer
Motorola: Motorola
IAPR: International Association for Pattern Recognition
IBMR: IBM Research
Identix: Identix

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 20 July 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pui SMinoi J(2019)A Non-template Based Automatic Landmarking on 3D Face DataProceedings of the 3rd International Conference on Video and Image Processing10.1145/3376067.3376073(212-216)Online publication date: 20-Dec-2019
https://dl.acm.org/doi/10.1145/3376067.3376073
Kaushik VBudhwar ADubey AAgrawal RGupta SPathak VGupta P(2009)An efficient 3D face recognition algorithmProceedings of the 3rd international conference on New technologies, mobility and security10.5555/1790343.1790393(259-263)Online publication date: 20-Dec-2009
https://dl.acm.org/doi/10.5555/1790343.1790393
Yang JLiao ZLiao ZWu Z(2009)A Method for Robust Nose Tip Location across Pose Variety in 3D Face DataProceedings of the 2009 International Asia Conference on Informatics in Control, Automation and Robotics10.1109/CAR.2009.86(114-117)Online publication date: 1-Feb-2009
https://dl.acm.org/doi/10.1109/CAR.2009.86
Jeong KHong SJoo ILee JMoon H(2009)Face Recognition Technology for Ubiquitous Computing EnvironmentProceedings of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. Part II: Intelligent and Ubiquitous Interaction Environments10.1007/978-3-642-02710-9_40(365-373)Online publication date: 14-Jul-2009
https://dl.acm.org/doi/10.1007/978-3-642-02710-9_40
Moon HHong T(2009)Biometric User Authentication Based on 3D Face Recognition Under Ubiquitous Computing EnvironmentProceedings of the 3rd International Conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence10.1007/978-3-540-74205-0_111(1076-1081)Online publication date: 17-Nov-2009
https://dl.acm.org/doi/10.1007/978-3-540-74205-0_111
Moon HLee K(2007)Biometric driver authentication based on 3D face recognition for telematics applicationsProceedings of the 4th international conference on Universal access in human computer interaction: coping with diversity10.5555/1766311.1766366(473-480)Online publication date: 22-Jul-2007
https://dl.acm.org/doi/10.5555/1766311.1766366
Lee YHong TMoon HKim Y(2007)3D model based face recognition by face representation using PVM and pose approximationProceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction10.5555/1763296.1763403(943-951)Online publication date: 22-Jul-2007
https://dl.acm.org/doi/10.5555/1763296.1763403
Hong TKim HMoon HKim YLee JMoon S(2006)Face representation method using pixel-to-vertex map (PVM) for 3d model based face recognitionProceedings of the 2006 international conference on Computer Vision in Human-Computer Interaction10.1007/11754336_3(21-28)Online publication date: 13-May-2006
https://dl.acm.org/doi/10.1007/11754336_3

View Options

View options

Media

Figures

Other

Tables

View Table of Contents