article

Skin color modeling for face detection and segmentation: a review and a new approach

Authors:

Ming LiAuthors Info & Claims

Multimedia Tools and Applications, Volume 75, Issue 2

Pages 839 - 862

https://doi.org/10.1007/s11042-014-2328-0

Published: 01 January 2016 Publication History

Abstract

Detecting skin-colored pixels, although seems a straightforward easy task, has proven to be quite a challenging task in images that are captured under complex unconstrained imaging conditions. Color segmentation is an important method of segmenting the body in images. In this paper, we first provides a review of skin color modeling research works for face detection. In particular, we focus on discussing the challenges of skin color modeling, detection, and segmentation, and then we present the skin color modeling and region-based skin segmentation. We also propose a new approach to analyze the hue characteristics of monitoring personnel in coal mine. We determine the skin color boundaries of the miners using the boundary detection method based on the response of visual hue. And then, we apply to determining hue area method using dual hue detector to segment skin color for miners. Experiments show that the method has excellent ability to segment skin regions of miners. We also summarize the most widely used methods for skin detection approaches and collecting their numerical evaluation results.

References

[1]

Aghbari ZA, Al-haj R (2006) Hill-manipulation: an effective algorithm for color image segmentation. Image Vis Comput 24:894---903

[2]

Argyros AA, Lourakis MIA (2004) Real-time tracking of multiple skin-colored objects with a possibly moving camera. Proceedings, European Conference in Computer Vision. 368---379

[3]

Baskan S, Bulut MM, Atalay V (2002) Projection based method for segmentation of human face and its evaluation. Pattern Recogn Lett 23:1623---1629

Digital Library

[4]

Brown D, Craw I, Lewthwaite J (2001) A SOM based approach to skin detection with application in real time systems. Proc. of the British Machine Vision Conference. Citeseer, 491---500

[5]

Chai D, Ngan KN (1999) Face segmentation using skin-color map in videophone applications. IEEE Trans Circ Systems Video Technol 9:551---564

Digital Library

[6]

Chai D, Phung S, Bouzerdoum A (2003) A bayesian skin/non-skin color classifier using non-parametric density estimation. Proc Int Symp Circ Systems 2:464---467

[7]

Chen W, Sun TF, Yang XD, Wang L (2009a) Face detection based on half face-template. Proceedings of 9th International Conference on Electronic Measurement and Instruments, 454---458

[8]

Chen WC, Wang MS (2007) Region-based and content adaptive skin detection in color images. Int J Pattern Recognit Artif Intell 21:831

[9]

Chen W et al (2009b) Face location in dim-lightening coal mine surveillance images. Proceedings of the 2nd International Congress on Image and. Signal Process 1:208---211

[10]

Chen W et al (2013) Agglomerative clustering using improved rough sets and its applications in cooperative object localization. Comput Electr Eng 39(7):1962---1969

Digital Library

[11]

Chen W, et al (2014) A new image co-segmentation method using saliency detection for surveillance image of coal miners. Computers & Electrical Engineering, Article

[12]

Cho KM, Jang JH, Hong KS (2001) Adaptive skin-color filter. Pattern Recogn 34:1067---1073

[13]

Do HC, You JY, Chien SI (2007) Skin color detection through estimation and conversion of illuminant color under various illuminations. IEEE Trans Consum Electron 53:1103---1108

Digital Library

[14]

Duda RO, Hart PE, Stork DG (2001) Pattern classification

[15]

Garcia C, Tziritas G (1999) Face detection using quantized skin color regions merging and wavelet packet analysis. IEEE Transactions on Multimedia 1:264---277

Digital Library

[16]

Gasparini F, Schettini R (2006) Skin segmentation using multiple thresholding. Proc. Internet Imaging VII. 128---135

[17]

Gomez G, Sanchez M, Enrique Sucar L (2002a) On selecting an appropriate colour space for skin detection. MICAI 2002: Advances in Artificial Intelligence, Volume 2313, 3---18

[18]

Gomez G, Sanchez M, Sucar LE (2002b) On selecting colour components for skin detection. 16th International Conference on Pattern Recognition, 2, 961---964 vol. 2

[19]

Gonzalez RC, Woods RE, Eddins SL (2007) Digital Image Processing Using MATLAB, Prentice Hall Press

[20]

Han J, Awad G, Sutherland A (2009) Automatic skin segmentation and tracking in sign language recognition. Comput Vis IET 3:24---35

[21]

Hsu RL, Abdel-Mottaleb M, Jain AK (2002) Face detection in color images. IEEE Trans Pattern Anal Mach Intel 24:696---706

Digital Library

[22]

Huang YZ, Long YJ (2006) Super-resolution using neural networks based on the optimal recovery theory. J Comput Electron 5(4):275---281

[23]

Jain AK (1989) Fundamentals of digital image processing. Prentice-Hall, Inc, New York

[24]

Jones MJ, Rehg JM (2002) Statistical color models with application to skin detection. Int J Comput Vis 46(1):81---96

Digital Library

[25]

Juang CF, Shiu SJ (2008) Using self-organizing fuzzy network with support vector learning for face detection in color images. Neurocomputing 71:3409---3420

Digital Library

[26]

Kakumanu P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. Pattern Recogn 40:1106---1122

Digital Library

[27]

Kawulok M, Kawulok J, Nalepa J (2014) Spatial-based skin detection using discriminative skin-presence features. Pattern Recogn Lett 41:3---13

[28]

Khan R, Hanbury A, Ttinger JS, BAIS A (2012) Color based skin classification. Pattern Recogn Lett 33(2):157---163

Digital Library

[29]

Kim M, Park J, Joo Y (2005) New fuzzy skin model for face detection. Adv Artif Intell 3809:557---566

[30]

Kim C, You BJ, Jeong MH, KIM H (2008) Color segmentation robust to brightness variations by using B-spline curve modeling. Pattern Recogn 41:22---37

Digital Library

[31]

Lee JY, Yoo SI (2002) An elliptical boundary model for skin color detection. Proc. of the Int. Conf. on Imaging Science, Systems, and Technology

[32]

Li B, Xue X, Fan J (2007) A robust incremental learning framework for accurate skin region segmentation in color images. Pattern Recogn 40:3621---3632

Digital Library

[33]

Liu Z, Yang J, Peng NS (2005) An efficient face segmentation algorithm based on binary partition tree. Signal Process Image Commun 20:295---314

[34]

Long YJ, Huang YZ (2006) Image based source camera identification using demosaicking, IEEE 8th Workshop on Multimedia Signal Processing, 419---424

[35]

Ma Z, Leijon A (2010) Human skin color detection in RGB space with Bayesian estimation of beta mixture models. Proceedings, European Conference in Computer Vision

[36]

Ma YQ, Yu Q, Cohen I (2009) Target tracking with incomplete detection. Comput Vis Image Underst 113(4):580---587

Digital Library

[37]

Moallem P, Mousavi BS, Monadjemi SA (2010) A novel fuzzy rule base system for pose independent faces detection. Applied Soft Computing, 11

[38]

Naji S, Zainuddin R, Jalab HA (2012) Skin segmentation based on multi pixel color clustering models. Digit Signal Process 22:933---940

Digital Library

[39]

Peer P, Solina F (1999) An automatic human face detection method. Proceedings of Computer Vision Winter Workshop. 122---130

[40]

Phung SL, Bouzerdoum A, Chai D (2003) Skin segmentation using color and edge information. IEEE, 525---528 vol. 1

[41]

Phung SL, Bouzerdoum A, Chai D (2005) Skin segmentation using color pixel classification: analysis and comparison. IEEE Transactions on Pattern Analysis and Machine Intelligence, 148---154

[42]

Phung SL, Chai D, Bouzerdoum A (2001) A universal and robust human skin color model using neural networks. Proceedings of International Joint Conference on Neural Networks. IEEE 4:2844---2849

[43]

Pratt WK (2002) Digital image processing: PIKS inside. Recherche 67:02

[44]

Russ JC (2007) The image processing handbook. CRC, Boca Raton

[45]

Sebe N, Cohen I, Huang TS, Gevers T (2004) Skin detection: A bayesian network approach. Proceedings of the 17th International Conference on Pattern Recognition. IEEE, 903---906

[46]

Seow MJ, Valaparla D, Asari VK (2003) Neural network based skin color model for face detection. Proceedings of the 32nd Applied Imagery Pattern Recognition Workshop (AIPR'03). IEEE, 141---145

[47]

Shapiro L, Stockman G (2000) Computer Vision

[48]

Shih FY, Cheng S, Chuang CF, Wang PSP (2008) Extracting faces and facial features from color images. Int J Pattern Recognit Artif Intell 22:515---534

[49]

Sigal L, Sclaroff S, Athitsos V (2000) Estimation and prediction of evolving color distributions for skin segmentation under varying illumination. Proceedings IEEE Conference on Computer Vision and Pattern Recognition, 2000. IEEE, 152---159 vol. 2

[50]

Sobottka K, Pitas I (1998) A novel method for automatic face segmentation, facial feature extraction and tracking. Signal Process Image Commun 12:263---281

[51]

Solina F, Peer P, Batagelj B, Juvans S (2002) Fifteen seconds of fame-an interactive, computer-vision based art installation. Control, Automation, Robotics and Vision, 2002. ICARCV 2002. 7th International Conference on. IEEE, 198---204

[52]

Soriano M, Martinkauppi B, Huovinen S, Laaksonen M (2000) Skin detection in video under changing illumination conditions. Pattern Recognition 1:839---842

[53]

Soriano M, Martinkauppi B, Huovinen S, Laaksonen M (2003) Adaptive skin color modeling using the skin locus for selecting training pixels. Pattern Recogn 36:681---690

[54]

Storring M (2004) Computer vision and human skin colour. Ph.D., Aalborg University, Denmark

[55]

Tan W, Chan C, Yogarajah P, Condell J (2012) A Fusion Approach for Efficient Human Skin Detection. IEEE Transactions on Industrial Informatics, IEEE Transactions on, 1---1

[56]

Taqa AY, Jalab H (2010) Increasing the reliability of skin detectors. Sci Res Essays 5:2480---2490

[57]

Terrillon JC, Shirazi MN, Fukamachi H, Akamatsu S (2000) Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images. Fourth IEEE International Conference on Automatic Face and Gesture Recognition, 2000. IEEE, 54---61

[58]

Vadakkepat P, Lim P, DE Silva LC, Jing L, Ling LL (2008) Multimodal approach to human-face detection and tracking. IEEE Trans Ind Electron 55:1385---1393

[59]

Vezhnevets V, Sazonov V, Andreeva A (2003) A survey on pixel-based skin color detection techniques. Graphicon 3

[60]

Wang Y, Yuan B (2001) A novel approach for human face detection from color images under complex background. Pattern Recogn 34:1983---1992

[61]

Wu H, Chen Q, Yachida M (1999) Face detection from color images using a fuzzy pattern matching method. IEEE Trans Pattern Anal Machine Intell 21:557---563

Digital Library

[62]

Xu T, Wang YH, ZHANG ZX (2013) Pixel-wise skin colour detection based on flexible neural tree. IET Image Process 7(8):751---761

[63]

Yang MH (2000) Hand gesture recognition and face detection in images. University of Illinois at Urbana-Champaign

[64]

Yang MH, Ahuja N (1998) Detecting human faces in color images. IEEE, 127---130 vol. 1

[65]

Yang HM, Kriegman DJ, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24:34---58

Digital Library

[66]

Yang KF, et al (2013) Efficient Color Boundary Detection with Color-opponent Mechanisms. IEEE Conference on Computer Vision and Pattern Recognition. 2810---2817

[67]

Yogarajah P et al (2010) A dynamic threshold approach for skin segmentation in color images. Proceedings, IEEE International Conference on Image Processing. 2225---2228

[68]

Zaqout I, Zainuddin R, Baba S (2004) Human face detection in color images. Adv Complex Syst 7:369---383

[69]

Zarit BD, Super BJ, Quek FKH (1999) Comparison of five color models in skin pixel classification. IEEE, 58---63

Cited By

Vu HNguyen MPham C(2022)Masked face recognition with convolutional neural networks and local binary patternsApplied Intelligence10.1007/s10489-021-02728-152:5(5497-5512)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1007/s10489-021-02728-1
Ben Salah KOthmani MKherallah M(2022)A novel approach for human skin detection using convolutional neural networkThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02108-338:5(1833-1843)Online publication date: 1-May-2022
https://dl.acm.org/doi/10.1007/s00371-021-02108-3
Juneja KRana C(2021)An Extensive Study on Traditional-to-Recent Transformation on Face Recognition SystemWireless Personal Communications: An International Journal10.1007/s11277-021-08170-3118:4(3075-3128)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1007/s11277-021-08170-3
Show More Cited By

Skin color modeling for face detection and segmentation: a review and a new approach
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
  2. Machine learning
    1. Learning paradigms
      1. Supervised learning

Recommendations

Skin color enhancement based on favorite skin color in HSV color space

Skin color enhancement based on favorite skin color is proposed to make skin color displayed on large screen flat panel TVs agree with human favorite skin color. A robust skin detection method in different intensity is obtained after analyzing the ...
Skin Color Pixel Classification for Face Detection with Hijab and Niqab
ICISPC 2017: Proceedings of the International Conference on Imaging, Signal Processing and Communication

Skin color pixel classification in color spaces with respect to threshold values of color components has been widely used in face detection algorithms. Color based face detection becomes difficult when faces are covered with hijab or niqab due to effect ...
Some Notes on Accuracy Constraints of Pixel Based Skin Color Detection
ICFCC '09: Proceedings of the 2009 International Conference on Future Computer and Communication

In recent years color as a good cue that can be used in early stages of objects detection in digital images absorbed attention of the researchers. As a special problem, skin color detection gained high application in face detection, image content ...

Comments

Information & Contributors

Information

Published In

cover image Multimedia Tools and Applications

Multimedia Tools and Applications Volume 75, Issue 2

January 2016

663 pages

ISSN:1380-7501

Issue’s Table of Contents

Copyright © Copyright © 2016 Springer Science+Business Media New York.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 January 2016

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vu HNguyen MPham C(2022)Masked face recognition with convolutional neural networks and local binary patternsApplied Intelligence10.1007/s10489-021-02728-152:5(5497-5512)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1007/s10489-021-02728-1
Ben Salah KOthmani MKherallah M(2022)A novel approach for human skin detection using convolutional neural networkThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02108-338:5(1833-1843)Online publication date: 1-May-2022
https://dl.acm.org/doi/10.1007/s00371-021-02108-3
Juneja KRana C(2021)An Extensive Study on Traditional-to-Recent Transformation on Face Recognition SystemWireless Personal Communications: An International Journal10.1007/s11277-021-08170-3118:4(3075-3128)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1007/s11277-021-08170-3
Samson GLu J(2021)PKT: fast color-based spatial model for human skin detectionMultimedia Tools and Applications10.1007/s11042-021-10955-480:21-23(32807-32839)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1007/s11042-021-10955-4
Chakraborty BBhuyan M(2020)Image specific discriminative feature extraction for skin segmentationMultimedia Tools and Applications10.1007/s11042-020-08762-479:27-28(18981-19004)Online publication date: 1-Jul-2020
https://dl.acm.org/doi/10.1007/s11042-020-08762-4
García-Lamont FCervantes JLópez-Chau ARuiz-Castilla S(2020)Color image segmentation using saturated RGB colors and decoupling the intensity from the hueMultimedia Tools and Applications10.1007/s11042-019-08278-679:1-2(1555-1584)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1007/s11042-019-08278-6
Pandey PTyagi AAmbekar SPrathosh A(2020)Unsupervised Domain Adaptation for Semantic Segmentation of NIR Images Through Generative Latent SearchComputer Vision – ECCV 202010.1007/978-3-030-58539-6_25(413-429)Online publication date: 23-Aug-2020
https://dl.acm.org/doi/10.1007/978-3-030-58539-6_25
Chang L(2017)The research of face detection method based on adaboost algorithm and skin color segmentation2017 IEEE International Conference on Imaging Systems and Techniques (IST)10.1109/IST.2017.8261538(1-5)Online publication date: 18-Oct-2017
https://dl.acm.org/doi/10.1109/IST.2017.8261538
Kumar SSingh S(2017)Automatic identification of cattle using muzzle point patternMultimedia Tools and Applications10.1007/s11042-016-4181-976:24(26551-26580)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s11042-016-4181-9

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents