Face Skin Detection and Color Transferring

doi:10.16182/j.issn1004731x.joss.18-VR0744

Abstract

Abstract: The reliable and accurate extraction of facial skin is a key and urgent problem for skin detection. This paper proposes a face alignment and GMM (Gaussian mixture model) to achieve face skin detection. We use the SCUT-FBP5500 face database, combined with SOM (self-organizing Maps) and K-means clustering method to cluster 9 pairs of facial features, and then use ResNet50 to predict face score. The color migration algorithm based on Lab space is used to migrate and edit the face color.The facts prove that the method has certain effect.

Key words: face alignment, facial features, Gaussian mixture model, color transfer algorithm

CLC Number:

TP391

Chen Fangfang, Ji Zhongping. Face Skin Detection and Color Transferring[J]. Journal of System Simulation, 2019, 31(7): 1377-1386.

References

[1] Hu W, Wu O, Chen Z, et al.Recognition of Pornographic Web Pages by Classifying Texts and Images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence (S0162-8828), 2007, 29(6): 1019-1034.
[2] Kakumanu P, Makrogiannis S, Bourbakis N.A survey of skin-color modeling and detection methods[J]. Pattern Recognition (S0031-3203), 2007, 40(3): 1106-1122.
[3] Lee J S, Kuo Y M, Chung P C, et al.Naked image detection based on adaptive and extensible skin color model[J]. Pattern Recognition (S0031-3203), 2007, 40(8): 2261-2270.
[4] Devi M S, Bajaj P R.Driver Fatigue Detection Based on Eye Tracking[C]// International Conference on Emerging Trends in Engineering and Technology. Nagpur, Maharashtra, India: IEEE, 2008: S453-S463.
[5] Chai D, Phung S L, Bouzerdoum A.Skin color detection for face localization in human-machine communications[C]//Signal Processing and ITS Applications, Sixth International, Symposium on. IEEE. Kuala Lumpur, Malaysia, 2001: 343-346.
[6] Jaimes A, Sebe N.Multimodal human computer interaction: a survey[C]// International Conference on Computer Vision in Human-Computer Interaction. Beijing, China: Springer-Verlag, 2005: 1-15.
[7] Herland M, Khoshgoftaar T M, Wald R.Survey of Clinical Data Mining Applications on Big Data in Health Informatics[C]// International Conference on Machine Learning and Applications. Copenhagen, Denmark: IEEE, 2014: 465-472.
[8] Mahmoodi M R, Sayedi S M.A Comprehensive Survey on Human Skin Detection[J]. International Journal of Image Graphics & Signal Processing (S2074-9074), 2016, 8(5): 1-35.
[9] Jones M J, Rehg J M.Statistical color models with application to skin detection[M]. New York: Kluwer Academic Publishers, 2002.
[10] Khan R, Hanbury A, Ttinger J, et al.Color based skin classification[J]. Pattern Recognition Letters (S0167-8655), 2012, 33(2): 157-163.
[11] Chaves-González J M, Vega-Rodríguez M A, Gómez-Pulido J A, et al. Detecting skin in face recognition systems: A colour spaces study[J]. Digital Signal Processing (S1051-2004), 2010, 20(3): 806-823.
[12] Muhammad B, Abu-Bakar S A R. A hybrid skin color detection using HSV and YCgCr color space for face detection[C]// IEEE International Conference on Signal and Image Processing Applications. Kuala Lumpur: IEEE, 2016: 95-98.
[13] Villagra A, Leguizamón G, Alba E.Active components of metaheuristics in cellular genetic algorithms[J]. Soft Computing (S1432-7643), 2015, 19(5): 1-15.
[14] Osman M Z, Maarof M A, Rohani M F.Towards Integrating Statistical Color Features for Human Skin Detection[C]// International Conference on Engineering and Applied Sciences. Hong Kong, China: IEEE, 2016.
[15] Al-Mohair H K, Mohamad Saleh J, Suandi S A. Hybrid Human Skin Detection Using Neural Network and Kmeans Clustering Technique[J]. Applied Soft Computing (S1568-4946), 2015, 33(C): 337-347.
[16] Kawulok M, Kawulok J, Nalepa J.Spatial-based skin detection using discriminative skin-presence features[J]. Pattern Recognition Letters (S0167-8655), 2014, 41(C): 3-13.
[17] Lin L, Goodrich M A.Hierarchical Heuristic Search Using a Gaussian Mixture Model for UAV Coverage Planning[J]. IEEE Transactions on Systems, Man, and Cybernetics (S0018-9472), 2014, 44(12): 2532-2544.
[18] Zhu Q, Cheng K T, Wu C T.A unified adaptive approach to accurate skin detection[C]// International Conference on Image Processing. Singapore, Singapore: IEEE, 2004, 2: 1189-1192.
[19] Bhoyar K K, Kakde O G.Skin Color Detection Model Using Neural Networks and its Performance Evaluation[J]. Journal of Computer Science (S1549-3636), 2010, 6(9): 955-960.
[20] Khan R, Hanbury A, Stoettinger J.Skin detection: A random forest approach[C]// IEEE International Conference on Image Processing. Hong Kong, China: IEEE, 2010: 4613-4616.
[21] Reinhard E, Ashikhmin M, Gooch B, et al.Color Transfer between Images[J]. IEEE Computer Graphics & Applications (S0272-1716), 2002, 21(5): 34-41.
[22] Welsh T, Ashikhmin M, Mueller K.Transferring color to greyscale images[J]. Acm Trans Graphics (S0730-0301), 2002, 21(3): 277-280.
[23] Widrow B, Rumelhart D E, Lehr M A.Neural networks: applications in industry, business and science[J]. Communications of the Acm (S0001-0782), 1994, 37(3): 93-105.
[24] Chang C H, Xu P, Xiao R, et al.New adaptive color quantization method based on self-organizing maps[J]. IEEE Transactions on Neural Networks (S1045-9227), 2005, 16(1): 237-249.
[25] Fayyad U M, Reina C A, Bradley P S.Initialization of Iterative Refinement Clustering Algorithms[C]// knowledge discovery and data mining. New York. KDD. 1998: 194-198.
[26] Zhang D, Chen F, Xu Y.Computer Models for Facial Beauty Analysis[M]. Springer: Springer Publishing Company, Incorporated, 2016.
[27] Liu Luoqi, Xu Hui, Liu Si, et al."Wow! you are so beautiful today!"[C]// ACM International Conference on Multimedia. New York: ACM, 2013: 437-438.
[28] Perronnin F, Marchesotti L, Murray N.AVA: A large-scale database for aesthetic visual analysis[C]// IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI: IEEE Computer Society, 2012: 2408-2415.
[29] Liang L, Jin L, Li X.Facial Skin Beautification Using Adaptive Region-Aware Masks[J]. IEEE Transactions on Cybernetics (S2168-2267), 2017, 44(12): 2600-2612.
[30] Liang L, Jin L, Zhang X, et al.Multiple Facial Image Editing Using Edge-Aware PDE Learning[J]. Computer Graphics Forum (S0167-7055), 2015, 34(7): 203-212.
[31] Zhou E, Fan H, Cao Z, et al.Extensive Facial Landmark Localization with Coarse-to-Fine Convolutional Network Cascade[C]// IEEE International Conference on Computer Vision Workshops. Sydney, NSW: IEEE Computer Society, 2013: 386-391.
[32] Liang L, Lin L, Jin L, et al.SCUT-FBP5500: A diverse benchmark dataset for multi-paradigm facial beauty prediction[C]// 2018 24th International Conference on Pattern Recognition (ICPR). Beijing, China: IEEE, 2018: 1598-1603.
[33] Xie D, Liang L, Jin L, et al.SCUT-FBP: A benchmark dataset for facial beauty perception[C]// 2015 IEEE International Conference on Systems, Man, and = Cybernetics. Kowloon: IEEE, 2015: 1821-1826.