Three-Dimensional Face Shape by Local Fitting to a Single Reference Model
Pages 17 - 29
Abstract
The authors present a simple method to estimate the three-dimensional shape of a face from an input image using a single reference model, based on least squares between the output of the linear-nonlinear (LN) neuronal model applied to blocks from an intensity image and blocks from a depth reference model. The authors present the results obtained by varying the LN model parameters and estimate their best values, which provide an acceptable reconstruction of each subject's depth. The authors show that increasing the light source angle over the horizontal plane in the input image produces slight increases in reconstruction error, but increasing the ambient light proportion produces greater increases in reconstruction error. The authors applied the method to predict each subject's unknown depth using different individual reference models and an average reference model, which provides the best results. As a noise reduction technique, the authors perform a point by point weighted averaging with the average reference model with weights equal to the fractions of the squares of the Laplacian of a Gaussian applied to the prediction and to the reference depth over the sum of both. Finally, the authors present acceptable visual results obtained from external images of faces under arbitrary illumination, having performed an illumination estimation previously.
References
[1]
Atick, J. J., Griffin, P. A., & Redlich, A. N. (1996). Statistical approach to shape from shading: Reconstruction of three-dimensional face surfaces from single two-dimensional images. Neural Computation, 8(6), 1321-1340. 8768397.
[2]
Barron, J. T., & Malik, J. (2011). High-frequency shape and albedo from shading using natural image statistics. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2521-2528).
[3]
Basri, R., & Jacobs, D. W. (2003). Lambertian reflectance and linear subspaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(2), 218-233.
[4]
Blanz, V., & Vetter, T. (1999). A morphable model for the synthesis of 3D faces. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (pp. 187-19).
[5]
Castelán, M., Puerto-Souza, G. A., & Van Horebeek, J. (2009). Using subspace multiple linear regression for 3d face shape prediction from a single image. Advances in Visual Computing, 662-673.
[6]
Castelán, M., Smith, W. A., & Hancock, E. R. (2007). A coupled statistical model for face shape recovery from brightness images. IEEE Transactions on Image Processing, 16(4), 1139-1151. 17405444.
[7]
Castelán, M., & Van Horebeek, J. (2008). 3D face shape approximation from intensities using partial least squares. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (pp. 1-8).
[8]
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001). Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6), 681-685.
[9]
Gupta, S., Castleman, K. R., Markey, M. K., & Bovik, A. C. (2010). Texas 3D face recognition database. IEEE Southwest Symposium on Image Analysis & Interpretation, 97-100.
[10]
Horn, B. K. (1990). Height and gradient from shading. International Journal of Computer Vision, 5(1), 37-75.
[11]
Kemelmacher, I., & Basri, R. (2006). Molding face shapes by example (pp. 277-288). Computer Vision - ECCV.
[12]
Kemelmacher-Shlizerman, I., & Basri, R. (2011). 3d face reconstruction from a single image using a single reference face shape. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(2), 394-405. 21193812.
[13]
Knill, D. C., & Kersten, D. (1990). Learning a near-optimal estimator for surface shape from shading. Computer Vision Graphics and Image Processing, 50(1), 75-100.
[14]
Peleg, S., & Ron, G. (1990). Nonlinear multiresolution: A shape-from-shading example. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(12), 1206-1210.
[15]
Pentland, A. (1988). Shape information from shading: A theory about human perception. In Proceedings of the International Conference on Computer Vision (pp. 404-413).
[16]
Pentland, A. P. (1990). Linear shape from shading. International Journal of Computer Vision, 4(2), 153-162.
[17]
Ping-Sing, T., & Shah, M. (1994). Shape from shading using linear approximation. Image and Vision Computing, 12(8), 487-498.
[18]
Prados, E., & Faugeras, O. (2005). Shape from shading: A well-posed problem? In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2, 870-877.
[19]
Reiter, M., Dormer, R., Langs, G., & Bischof, H. (2006). 3d and infrared face reconstruction from rgb data using canonical correlation analysis. In Proceedings of the International Conference on Pattern Recognition (Vol. 1, pp. 425-428).
[20]
Ron, G., & Peleg, S. (1989). Multiresolution shape from shading. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (pp. 350-355).
[21]
Sanderson, C., Bengio, S., & Gao, Y. (2006). On transforming statistical models for non-frontal face verification. Pattern Recognition, 39(2), 288-302.
[22]
Sanderson, C., Saban, M., & Gao, Y. (2005). On local features for GMM based face verification. In Proceedings of the International Conference on Information Technology and Applications (Vol. 1, pp. 650-655).
[23]
Torreão, J. R., & Fernandes, J. L. (2011). Linear-nonlinear neuronal model for shape from shading. Pattern Recognition Letters, 32(9), 1223-1239.
[24]
Wong, Y., Sanderson, C., & Lovell, B. C. (2009). Regression based non-frontal face synthesis for improved identity verification. In Computer Analysis of Images and Patterns (pp. 116-124). Springer Berlin Heidelberg.
[25]
Zhang, R., Tsai, P. S., Cryer, J. E., & Shah, M. (1999). Shape-from-shading: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(8), 690-706.
- Three-Dimensional Face Shape by Local Fitting to a Single Reference Model
Recommendations
3D Face Reconstruction from a Single Image Using a Single Reference Face Shape
Human faces are remarkably similar in global properties, including size, aspect ratio, and location of main features, but can vary considerably in details across individuals, gender, race, or due to facial expression. We propose a novel method for 3D ...
Surface radiance correction for shape from shading
It is well known that many surfaces exhibit reflectance that is not well modelled by Lambert's law. This is the case not only for surfaces that are rough or shiny, but also those that are matte and composed of materials that are particle suspensions. As ...
Shape from fluorescence
ECCV'12: Proceedings of the 12th European conference on Computer Vision - Volume Part VIIBeyond day glow highlighters and psychedelic black light posters, it has been estimated that fluorescence is a property exhibited by 20% of objects. When a fluorescent material is illuminated with a short wavelength light, it re-emits light at a longer ...
Comments
Information & Contributors
Information
Published In
Publisher
IGI Global
United States
Publication History
Published: 01 January 2014
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 08 Feb 2025