人脸肤色检测与编辑

doi:10.16182/j.issn1004731x.joss.18-VR0744

系统仿真学报 ›› 2019, Vol. 31 ›› Issue (7): 1377-1386.doi: 10.16182/j.issn1004731x.joss.18-VR0744

人脸肤色检测与编辑

陈芳芳, 计忠平

杭州电子科技大学图形图像研究所,杭州 310018

收稿日期:2018-06-14 修回日期:2018-11-05 发布日期:2019-12-12
作者简介:陈芳芳(1993-),女,安徽安庆,硕士生,研究方向为计算机图形图像;计忠平(通讯作者1980-),男,浙江桐乡,博士生,副教授,硕导,研究方向为数字几何处理、计算机图形学和机器学习。
基金资助:
国家自然科学基金(61572161, 61202278, 61202279)

Face Skin Detection and Color Transferring

Chen Fangfang, Ji Zhongping

Institute of Graphics and Image, Hangzhou Dianzi University, Hangzhou 310018, China

Received:2018-06-14 Revised:2018-11-05 Published:2019-12-12

摘要/Abstract

摘要： 可靠而准确的提取脸部皮肤是皮肤检测中关键而又紧迫的问题,为了解决这一问题,提出一种结合人脸对齐技术和高斯混合模型GMM (Gaussian mixture Model)来实现人脸皮肤检测。利用SCUT-FBP5500人脸数据库,利用SOM (Self-organizing Maps)与Kmeans结合的聚类方法对其中9对人脸脸型特征进行聚类处理,利用ResNet50进行人脸颜值打分预测,利用基于Lab空间的颜色移植算法对人脸肤色进行迁移编辑操作,事实证明方法是有一定效果的。

关键词: 人脸对齐, 脸型特征, 高斯混合模型, 颜色移植算法

Abstract: The reliable and accurate extraction of facial skin is a key and urgent problem for skin detection. This paper proposes a face alignment and GMM (Gaussian mixture model) to achieve face skin detection. We use the SCUT-FBP5500 face database, combined with SOM (self-organizing Maps) and K-means clustering method to cluster 9 pairs of facial features, and then use ResNet50 to predict face score. The color migration algorithm based on Lab space is used to migrate and edit the face color.The facts prove that the method has certain effect.

Key words: face alignment, facial features, Gaussian mixture model, color transfer algorithm

中图分类号:

TP391

陈芳芳, 计忠平. 人脸肤色检测与编辑[J]. 系统仿真学报, 2019, 31(7): 1377-1386.

Chen Fangfang, Ji Zhongping. Face Skin Detection and Color Transferring[J]. Journal of System Simulation, 2019, 31(7): 1377-1386.

参考文献

[1] Hu W, Wu O, Chen Z, et al.Recognition of Pornographic Web Pages by Classifying Texts and Images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence (S0162-8828), 2007, 29(6): 1019-1034.
[2] Kakumanu P, Makrogiannis S, Bourbakis N.A survey of skin-color modeling and detection methods[J]. Pattern Recognition (S0031-3203), 2007, 40(3): 1106-1122.
[3] Lee J S, Kuo Y M, Chung P C, et al.Naked image detection based on adaptive and extensible skin color model[J]. Pattern Recognition (S0031-3203), 2007, 40(8): 2261-2270.
[4] Devi M S, Bajaj P R.Driver Fatigue Detection Based on Eye Tracking[C]// International Conference on Emerging Trends in Engineering and Technology. Nagpur, Maharashtra, India: IEEE, 2008: S453-S463.
[5] Chai D, Phung S L, Bouzerdoum A.Skin color detection for face localization in human-machine communications[C]//Signal Processing and ITS Applications, Sixth International, Symposium on. IEEE. Kuala Lumpur, Malaysia, 2001: 343-346.
[6] Jaimes A, Sebe N.Multimodal human computer interaction: a survey[C]// International Conference on Computer Vision in Human-Computer Interaction. Beijing, China: Springer-Verlag, 2005: 1-15.
[7] Herland M, Khoshgoftaar T M, Wald R.Survey of Clinical Data Mining Applications on Big Data in Health Informatics[C]// International Conference on Machine Learning and Applications. Copenhagen, Denmark: IEEE, 2014: 465-472.
[8] Mahmoodi M R, Sayedi S M.A Comprehensive Survey on Human Skin Detection[J]. International Journal of Image Graphics & Signal Processing (S2074-9074), 2016, 8(5): 1-35.
[9] Jones M J, Rehg J M.Statistical color models with application to skin detection[M]. New York: Kluwer Academic Publishers, 2002.
[10] Khan R, Hanbury A, Ttinger J, et al.Color based skin classification[J]. Pattern Recognition Letters (S0167-8655), 2012, 33(2): 157-163.
[11] Chaves-González J M, Vega-Rodríguez M A, Gómez-Pulido J A, et al. Detecting skin in face recognition systems: A colour spaces study[J]. Digital Signal Processing (S1051-2004), 2010, 20(3): 806-823.
[12] Muhammad B, Abu-Bakar S A R. A hybrid skin color detection using HSV and YCgCr color space for face detection[C]// IEEE International Conference on Signal and Image Processing Applications. Kuala Lumpur: IEEE, 2016: 95-98.
[13] Villagra A, Leguizamón G, Alba E.Active components of metaheuristics in cellular genetic algorithms[J]. Soft Computing (S1432-7643), 2015, 19(5): 1-15.
[14] Osman M Z, Maarof M A, Rohani M F.Towards Integrating Statistical Color Features for Human Skin Detection[C]// International Conference on Engineering and Applied Sciences. Hong Kong, China: IEEE, 2016.
[15] Al-Mohair H K, Mohamad Saleh J, Suandi S A. Hybrid Human Skin Detection Using Neural Network and Kmeans Clustering Technique[J]. Applied Soft Computing (S1568-4946), 2015, 33(C): 337-347.
[16] Kawulok M, Kawulok J, Nalepa J.Spatial-based skin detection using discriminative skin-presence features[J]. Pattern Recognition Letters (S0167-8655), 2014, 41(C): 3-13.
[17] Lin L, Goodrich M A.Hierarchical Heuristic Search Using a Gaussian Mixture Model for UAV Coverage Planning[J]. IEEE Transactions on Systems, Man, and Cybernetics (S0018-9472), 2014, 44(12): 2532-2544.
[18] Zhu Q, Cheng K T, Wu C T.A unified adaptive approach to accurate skin detection[C]// International Conference on Image Processing. Singapore, Singapore: IEEE, 2004, 2: 1189-1192.
[19] Bhoyar K K, Kakde O G.Skin Color Detection Model Using Neural Networks and its Performance Evaluation[J]. Journal of Computer Science (S1549-3636), 2010, 6(9): 955-960.
[20] Khan R, Hanbury A, Stoettinger J.Skin detection: A random forest approach[C]// IEEE International Conference on Image Processing. Hong Kong, China: IEEE, 2010: 4613-4616.
[21] Reinhard E, Ashikhmin M, Gooch B, et al.Color Transfer between Images[J]. IEEE Computer Graphics & Applications (S0272-1716), 2002, 21(5): 34-41.
[22] Welsh T, Ashikhmin M, Mueller K.Transferring color to greyscale images[J]. Acm Trans Graphics (S0730-0301), 2002, 21(3): 277-280.
[23] Widrow B, Rumelhart D E, Lehr M A.Neural networks: applications in industry, business and science[J]. Communications of the Acm (S0001-0782), 1994, 37(3): 93-105.
[24] Chang C H, Xu P, Xiao R, et al.New adaptive color quantization method based on self-organizing maps[J]. IEEE Transactions on Neural Networks (S1045-9227), 2005, 16(1): 237-249.
[25] Fayyad U M, Reina C A, Bradley P S.Initialization of Iterative Refinement Clustering Algorithms[C]// knowledge discovery and data mining. New York. KDD. 1998: 194-198.
[26] Zhang D, Chen F, Xu Y.Computer Models for Facial Beauty Analysis[M]. Springer: Springer Publishing Company, Incorporated, 2016.
[27] Liu Luoqi, Xu Hui, Liu Si, et al."Wow! you are so beautiful today!"[C]// ACM International Conference on Multimedia. New York: ACM, 2013: 437-438.
[28] Perronnin F, Marchesotti L, Murray N.AVA: A large-scale database for aesthetic visual analysis[C]// IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI: IEEE Computer Society, 2012: 2408-2415.
[29] Liang L, Jin L, Li X.Facial Skin Beautification Using Adaptive Region-Aware Masks[J]. IEEE Transactions on Cybernetics (S2168-2267), 2017, 44(12): 2600-2612.
[30] Liang L, Jin L, Zhang X, et al.Multiple Facial Image Editing Using Edge-Aware PDE Learning[J]. Computer Graphics Forum (S0167-7055), 2015, 34(7): 203-212.
[31] Zhou E, Fan H, Cao Z, et al.Extensive Facial Landmark Localization with Coarse-to-Fine Convolutional Network Cascade[C]// IEEE International Conference on Computer Vision Workshops. Sydney, NSW: IEEE Computer Society, 2013: 386-391.
[32] Liang L, Lin L, Jin L, et al.SCUT-FBP5500: A diverse benchmark dataset for multi-paradigm facial beauty prediction[C]// 2018 24th International Conference on Pattern Recognition (ICPR). Beijing, China: IEEE, 2018: 1598-1603.
[33] Xie D, Liang L, Jin L, et al.SCUT-FBP: A benchmark dataset for facial beauty perception[C]// 2015 IEEE International Conference on Systems, Man, and = Cybernetics. Kowloon: IEEE, 2015: 1821-1826.

人脸肤色检测与编辑

Face Skin Detection and Color Transferring

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

本文评价

[1]	祁成, 熊伟丽. 基于BGMM的即时学习软测量建模方法[J]. 系统仿真学报, 2019, 31(8): 1555-1561.
[2]	赵帅, 史旭东, 熊伟丽. 一种分层集成的高斯过程回归软测量建模方法[J]. 系统仿真学报, 2019, 31(10): 2042-2051.