Abstract
In this paper, we present a novel model for representing facial feature point tracks during an facial expression. The model is composed of a static shape part and a time-dependent expression part. We learn the model by tracking the points of interest in video recordings of trained actors making different facial expressions. Our results indicate that the proposed sum of two linear models – a person-dependent shape model and a person-independent expression model – approximates the true feature point motion well.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Adolphs, R.: Recognizing emotion from facial expressions: psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews 1(1), 21–62 (2002)
Ekman, P., Friesen, W., Hager, J.: Facial Action Coding System. Consulting Psychologists Press, Palo Alto (1978)
Essa, I.A., Pentland, A.P.: Coding, analysis, interpretation and recognition of facial expressions. IEEE TPAMI 19(7), 757–763 (1997)
Tian, Y.-l., Kanade, T., Cohn, J.F.: Recognizing action units for facial expression analysis. IEEE TPAMI 23(2), 97–115 (2001)
Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying facial actions. IEEE TPAMI 21(10), 974–989 (1999)
Ekman, P.: Expression and the nature of emotion. In: Scherer, K., Ekman, P. (eds.) Approaches to Emotion. Lawrence Erlbaum, Mahwah (1984)
Ekman, P., Friesen, W.: Unmasking the Face. A Guide to Recognizing Emotions from Facial Expressions. Consulting Psychologists Press, Palo Alto (1975)
Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proc. Imaging Understanding Workshop, pp. 121–130 (1981)
Tomasi, C., Kanade, T.: Detection and tracking of feature points, Carnegie Mellon University Technical Report CMU-CS-91-132 (1991)
Bourel, F., Chibelushi, C.C., Low, A.A.: Robust Facial Feature Tracking. In: Proc. BMVC 2000 (2000)
Daugman, J.G.: Complete discrete 2-d Gabor transforms by neural networks for image analysis and compression. IEEE TASSP 36(7), 1169–1179 (1988)
Gelman, A., Carlin, J.B., Stern, H.S., Rubin, D.R.: Bayesian Data Analysis, 2nd edn. Chapman & Hall, Boca Raton (2004)
McKenna, S.J., Gong, S., Wurtz, R.P., Tanner, J., Banin, D.: Tracking facial feature points with Gabor wavelets and shape models. In: Proc. 1st International Conference on Audio- and Video-based Biometric Person Authentication (1997)
Wiskott, L., Fellous, J.-M., Krüger, N., von der Malsburg, C.: Face Recognition by Elastic Bunch Graph Matching. In: Jain, L.C., Halici, U., Hayashi, I., Lee, S.B. (eds.) Intelligent Biometric Techniques in Fingerprint and Face Recognition, CRC Press, Boca Raton (1999)
Tamminen, T., Lampinen, J.: Bayesian object matching with hierarchical priors and Markov chain Monte Carlo. In: Bernardo, J.M., Bayarri, M.J., Berger, J.O., Dawid, A.P., Heckerman, D., Smith, A.F.M., West, M. (eds.) Bayesian Statistics 7. Oxford University Press, Oxford (2003)
Abboud, B., Davoine, F.: Appearance factorization for facial expression analysis. In: Proc. BMVC 2004, pp. 507–516 (2004)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE TPAMI 23(6), 681–685 (2001)
Chatfield, C., Collins, A.J.: Introduction to Multivariate Analysis. Chapman & Hall, Boca Raton (1995)
Frydrych, M., Kätsyri, J., Dobšík, M., Sams, M.: Toolkit for animation of Finnish talking head. In: Proc. AVSP 2003, pp. 199–204 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tamminen, T., Kätsyri, J., Frydrych, M., Lampinen, J. (2005). Joint Modeling of Facial Expression and Shape from Video. In: Kalviainen, H., Parkkinen, J., Kaarna, A. (eds) Image Analysis. SCIA 2005. Lecture Notes in Computer Science, vol 3540. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11499145_17
Download citation
DOI: https://doi.org/10.1007/11499145_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26320-3
Online ISBN: 978-3-540-31566-7
eBook Packages: Computer ScienceComputer Science (R0)