Video Facial Expression Recognition Based on Multi-angle Feature Fusion
Pages 34 - 38
Abstract
In view of the problems of high computational complexity and low recognition rate of video facial expression recognition, this paper proposes a new method of video facial texture representation and facial expression recognition, which is based on multi-angle feature fusion algorithm of local Gabor adaptive ternary orientation pattern (LGATOP). Firstly, in order to obtain an enhanced Gabor amplitude spectrum, Gabor wavelet transform with different scales and directions is applied to each face image normalized in the video frame set. Then the LGATOP features of the video texture are extracted by using the local three-value model on three orthogonal planes. Finally, the SVM is used to complete the emotion classification of the texture and motion information after fusion. Through the cross experiment on CK+ and MMI databases, it has been proved that the proposed method has better robustness to mination change, expression changes and so on. Contrast experiments with other related methods have also verified the superiority of the method.
References
[1]
Hui Fang, Neil Mac Parthalain, Andrew J. Aubrey, et al. Facial Expression Recognition in Dynamic Sequences: an Integrated Approach{J}. Pattern Recognition, 2014, 47(3): 1271--1281,
[2]
ZHAO G and PIETIKAINEN M. Dynamic texture recognition using local binary patterns with an application to facial expressions{J}. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(6):915--928,
[3]
Y Yaddaden, M Adda, A Bouzouane, S Gaboury, B Bouchard. Facial Expression Recognition from Video using Geometric Features{J}. International Conference of Pattern Recognition Systems, 2017:4(6.)-4(6.),
[4]
Huang D, Shan C F, Ardabilian M, et al. Local binary patterns and its application to facial image analysis:a survey{J}. IEEE Trans on Systems, Man, and Cybernetics, 2011, 41(6): 765--781,
[5]
Zhao G Y, Ahonen T, Matas J, et al. Rotation-invariant image and video discription with local binary pattern features{J-}. IEEE Trans on Image Processing, 2012, 21(4): 1465--1477,
[6]
M Yang, L Zhang, SCK Shiu, D Zhang. Gabor feature based robust representation and classification for face recognition with Gabor occlusion dictionary {J}. Pattern Recognition, 2013, 46(7): 1865--1878,
[7]
Fu X F, Fu X J, Li J J, Yu Z S. Facial Expression Recognition Using Multiscale Spatiotemporal Local Orientational Pattern Histogram Projection in Video Sequences{J}. Journal of Computer-Aided Design & Computer Graphics.2015(06): 1060--1066.
[8]
Haralick, R.M, Shanmugam, K, Dinsteinm, Its'Hak. Its'hak Dinstein. Textural Features for Image Classification{J}. Systems Man and Cybernetics IEEE Transactions. 1973, smc-3(6):610--621,
[9]
LUCEY P, COHN J F, KANADE T, et al. The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression{C}.2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), California, USA, 2010: 94--101,
[10]
PANTIC M, VALSTAR M, RADEMAKER R, et al. Web-based database for facial expression analysis{C}. IEEE International Conference on Multimedia and Expo, Amsterdam, The Netherlands, 2005:317--321,
[11]
L. Zhong, Q. Liu, P. Yang, et al. Learning active facial patches for expression analysis{C}, Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on IEEE, 2012:2562--2569,
[12]
QIU Yu, ZHAO Jieyu, and WANG Yanfang. Facial expression recognition using temporal relations among facial movements{J}. Acta Electronica Sinica, 2016, 44(6): 1307--1313.
[13]
FAN X and TJAHJADI T. A spatial-temporal framework based on histogram of gradients and optical flow for facial expression recognition in video sequences{J}. Pattern Recognition, 2015, 48(11): 3407--3416,
[14]
GUPTA O, RAVIV D, and RASKAR R. Multi-velocity neural networks for facial expression recognition in videos{J}. IEEE Transactions on Affective Computing, 2017, pp(99):1--1,
[15]
FANG H, MAC Parthaláin N, AUBREY A J, et al. Facial expression recognition in dynamic sequences: An integrated approach{J}. Pattern Recognition, 2014, 47(3):1271--1281.
[16]
JUNG H, LEE S, YIM J, et al. Joint fine-tuning in deep neural networks for facial expression recognition{C}. Proceedings of the IEEE International Conference on Computer Vision. Santiago, Chile, 2015:2983--2991,
Index Terms
- Video Facial Expression Recognition Based on Multi-angle Feature Fusion
Recommendations
Expression recognition methods based on feature fusion
BI'10: Proceedings of the 2010 international conference on Brain informaticsExpression recognition is popular research focus in Artificial Intelligence and Pattern Recognition. Feature fusion is one of the most important technical methods in expression recognition. To study how the feature information extracted from different ...
Facial Expression Recognition under Partial Occlusion Based on Gabor Multi-orientation Features Fusion and Local Gabor Binary Pattern Histogram Sequence
IIH-MSP '13: Proceedings of the 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal ProcessingIn this paper, we propose a novel facial expression recognition method under partial occlusion based on Gabor multi-orientation features fusion and local Gabor binary pattern histogram sequence (LGBPHS). Firstly, the Gabor filter is adopted to extract ...
Image ratio features for facial expression recognition application
Special issue on game theoryVideo-based facial expression recognition is a challenging problem in computer vision and human-computer interaction. To target this problem, texture features have been extracted and widely used, because they can capture image intensity changes raised ...
Comments
Information & Contributors
Information
Published In
June 2018
261 pages
ISBN:9781450364607
DOI:10.1145/3239576
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- University of Electronic Science and Technology of China: University of Electronic Science and Technology of China
- Southwest Jiaotong University
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 June 2018
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICAIP '18
ICAIP '18: 2018 the 2nd International Conference on Advances in Image Processing
June 16 - 18, 2018
Chengdu, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 91Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 26 Jul 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in