Advances in computer–human interaction for detecting facial expression using dual tree multi band wavelet transform and Gaussian mixture model
Authors: 
Jenni Kommineni, Satria Mandala, Mohd Shahrizal Sunar, Parvathaneni Midhu ChakravarthyAuthors Info & Claims
Jenni Kommineni, Satria Mandala, Mohd Shahrizal Sunar, Parvathaneni Midhu ChakravarthyAuthors Info & ClaimsPages 15397 - 15408
Abstract
In human communication, facial expressions play an important role, which carries enough information about human emotions. Last two decades, it becomes a very active research area in pattern recognition and computer vision. In this type of recognition, there is a drawback of how to extract the features because of its dynamic nature of facial structures, which are extracted from the facial images and to predict the level of difficulties in the extraction of the facial expressions. In this research, an efficient approach for emotion or facial expression analysis based on dual-tree M-band wavelet transform (DTMBWT) and Gaussian mixture model (GMM) is presented. Different facial expressions are represented by DTMBWT at various decomposition levels from one to six. From the representations, DTMBWT energy and entropy features are extracted as features for the corresponding facial expression. These features are analyzed for the recognition using GMM classifier by varying the number of Gaussians used. Japanese female facial expression database which contains seven facial expressions; happy, sad, angry, fear, neutral, surprise and disgust are employed for the evaluation. Results show that the framework provides 98.14% accuracy using fourth-level decomposition, which is considerably high.
References
[1]
Kim DH, Jung SU, and Chung MJ Extension of cascaded simple feature based face detection to facial expression recognition Pattern Recognit Lett 2008 29 11 1621-1631
[2]
Toole AJO Face recognition algorithms surpass humans matching faces over changes in illumination IEEE Trans Pattern Anal Mach Intell 2007 29 9 1642
[3]
Sharma UM Hybrid feature based face verification and recognition system using principal component analysis and artificial neural network Indian J Sci Technol 2015 8 S1 115-120
[4]
Ko BC A brief review of facial emotion recognition based on visual information Sensors (Basel) 2018 18 2 pii: E401
[5]
Kaschte B Biometric authentication systems today and in the future 2012 Auckland University of Auckland
[6]
Tivatansakul S, Ohkura M, Puangpontip S, Achalakul T (2014) Emotional healthcare system: emotion detection by facial expressions using japanese database. In: 2014 6th Computer science and electronic engineering conference (CEEC). 978-1-4799-6692-9/14/$31.00 ©2014 IEEE, University of Essex, UK
[7]
Matyáš V, Říha Z (2002) Biometric authentication—security and usability. Faculty of Informatics, Masaryk University Brno, Czech Republic
[8]
Kumbhar M, Jadhav A, and Patil M Facial expression recognition based on image feature Int J Comput Commun Eng 2012 1 2 117
[9]
Powar NU, Foytik JD, Asari VK (2011) Facial expression analysis using 2D and 3D features. 978-1-4577-1041-4/11/$26.00 ©2011 IEEE
[10]
Matyáš V, Říha Z (2011) Security of biometric authentication systems. Int J Comput Inf Syst Ind Manag Appl 3:174–184. ISSN 2150-7988. www.mirlabs.net/ijcisim/index.html
[11]
Saini R, Rana N (2014) Comparison of various biometric methods. Int J Adv Sci Technol (IJAST) 2(I). ISSN 2348-5426
[12]
Boia R, Dogaru R, Florea L (2013) A comparison of several classifiers for eye detection on emotion expressing faces. 978-1-4799-2442-4/13/$31.00 ©2013 IEEE
[13]
Odoyo WO, Lee G-B, Park J-J, Cho B-J (2009) Facial expression classification using eigen-components of principal expressions. ISBN 978-89-5519-139-4, Feb. 15–18, 2009 ICACT
[14]
Molavi M, bin Yunus J, Akbari E (2012) Comparison of different methods for emotion classification. In: 2012 Sixth Asia modelling symposium. 978-0-7695-4730-5/12 $26.00 © 2012 IEEE.
[15]
Molavi M, bin Yunus J (2012) The effect of noise removing on emotional classification. In: 2012 International conference on computer & information science (ICCIS). 978-1-4673-1938-6/12/$31.00 ©2012 IEEE
[16]
Sariyanidi E, Gunes H, and Cavallaro A Learning bases of activity for facial expression recognition IEEE Trans Image Process 2017 26 1965-1978
[17]
Mao Q, Rao Q, Yu Y, and Dong M Hierarchical Bayesian theme models for multipose facial expression recognition IEEE Trans Multim 2017 19 4 861-873
[18]
Xie S and Hu H Facial expression recognition with FRR-CNN Electron Lett 2017 53 4 235-237
[19]
Chu WS, De la Torre F, and Cohn JF Selective transfer machine for personalized facial expression analysis IEEE Trans Pattern Anal Mach Intell 2017 39 3 529-545
[20]
Meena HK, Sharma KK, and Joshi SD Improved facial expression recognition using graph signal processing Electron Lett 2017 53 11 718-720
[21]
Ding Y, Zhao Q, Li B, and Yuan X Facial expression recognition from image sequence based on LBP and Taylor expansion IEEE Access 2017 5 19409-19419
[22]
Ryu B, Rivera AR, Kim J, and Chae O Local directional ternary pattern for facial expression recognition IEEE Trans Image Process 2017 26 12 6006-6018
[23]
Jiang X, Feng B, and Jin L Facial expression recognition via sparse representation using positive and reverse templates IET Image Process 2016 10 8 616-623
[24]
Zen G, Porzi L, Sangineto E, Ricci E, and Sebe N Learning personalized models for facial expression analysis and gesture recognition IEEE Trans Multime 2016 18 4 775-788
[25]
Lee SI, Lee SH, Plataniotis KN, and Ro YM Experimental investigation of facial expressions associated with visual discomfort: feasibility study towards an objective measurement of visual discomfort based on facial expression J Disp Technol 2016 12 1785-1797
[26]
Lee SH and Ro YM Partial matching of facial expression sequence using over-complete transition dictionary for emotion recognition IEEE Trans Affect Comput 2016 7 4 389-408
[27]
Mariooryad S and Busso C Facial expression recognition in the presence of speech using blind lexical compensation IEEE Trans Affect Comput 2016 7 4 346-359
[28]
Zhang T, Zheng W, Cui Z, Zong Y, Yan J, and Yan K A deep neural network-driven feature learning method for multi-view facial expression recognition IEEE Trans Multim 2016 18 12 2528-2536
[29]
Ren F and Huang Z Automatic facial expression learning method based on humanoid robot XIN-REN IEEE Trans Hum-Mach Syst 2016 46 6 810-821
[30]
Liu M, Shan S, Wang R, and Chen X Learning expressionlets via universal manifold model for dynamic facial expression recognition IEEE Trans Image Process 2016 25 12 5920-5932
[31]
Yan J, Zheng W, Xu Q, Lu G, Li H, and Wang B Sparse kernel reduced-rank regression for bimodal emotion recognition from facial expression and speech IEEE Trans Multim 2016 18 7 1319-1329
[32]
Ali IR, Kolivand H, and Alkawaz MH Lip syncing method for realistic expressive 3D face model Multim Tools Appl 2018 77 5 5323-5366
[33]
Kamarol SKA, Jaward MH, Parkkinen J, and Parthiban R Spatiotemporal feature extraction for facial expression recognition IET Image Process 2016 10 7 534-541
[34]
Testa RL, Corrêa CG, Machado-Lima A, and Santos Nunes FL Synthesis of facial expressions in photographs: characteristics, approaches, and challenges ACM Comput Surv 2019
[35]
Mahmood A, Hussain S, Iqbal K, and Elkilani WS Recognition of facial expressions under varying conditions using dual-feature fusion Math Probl Eng 2019 2019 9185481
[36]
Gritti T, Shan C, Jeanne V, Braspenning R (2008) Local features based facial expression recognition with face registration. 978-1-4244-2154-1/08/$25.00 ©2008 IE
[37]
Ghimire D and Lee J Geometric feature-based facial expression recognition in image sequences using multi-class adaboost and support vector machines Sensors 2013 13 7714-7734
[38]
Sajjad M, Shah A, Jan Z, Shah SI, Baik SW, and Mehmood I Facial appearance and texture feature-based robust facial expression recognition framework for sentiment knowledge discovery Clust Comput 2018 21 549-567
[39]
Chaux C, Duval L, and Pesquet JC Image analysis using a dual-tree M-band wavelet transforms IEEE Trans Image Process 2006 15 8 2397-2412
[40]
Selesnick IW, Baraniuk RG, and Kingsbury NC The dual-tree complex wavelet transforms IEEE Signal Process Mag 2005 22 6 123-151
[41]
Sonawane JM, Gaikwad SD, and Prakash G Microarray data classification using dual tree M-band wavelet features Int J Adv Signal Image Sci 2017 3 1 19-24
[42]
Keerthi Anand VD Wavelets for speaker recognition using GMM classifier Int J Adv Signal Image Sci 2017 3 1 13-18
[43]
Lyons M, Akamatsu S, Kamachi M, Gyoba J (1998) Coding facial expressions with gabor wavelets. In: 3rd IEEE international conference on automatic face and gesture recognition, pp 200–205
Index Terms
- Advances in computer–human interaction for detecting facial expression using dual tree multi band wavelet transform and Gaussian mixture model
Index terms have been assigned to the content through auto-classification.
Recommendations
Human-Computer Interaction Using Emotion Recognition from Facial Expression
EMS '11: Proceedings of the 2011 UKSim 5th European Symposium on Computer Modeling and SimulationThis paper describes emotion recognition system based on facial expression. A fully automatic facial expression recognition system is based on three steps: face detection, facial characteristic extraction and facial expression classification. We have ...
Natural facial expression recognition using differential-AAM and manifold learning
This paper proposes a novel natural facial expression recognition method that recognizes a sequence of dynamic facial expression images using the differential active appearance model (AAM) and manifold learning as follows. First, the differential-AAM ...
A bi-modal face recognition framework integrating facial expression with facial appearance
Among many biometric characteristics, the facial biometric is considered to be the least intrusive technology that can be deployed in the real-world visual surveillance environment. However, in facial biometric, little research attention has been paid ...
Comments
Information & Contributors
Information
Published In
© Springer-Verlag London Ltd., part of Springer Nature 2020.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 01 September 2022
Accepted: 12 May 2020
Received: 04 March 2020
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Jan 2025