Robust Image Cloning with Color Harmonization

Abstract

Abstract: Image cloning has always been an important part of image editing. In general, it can be divided into three methods, based on a component, based on gradient domain, and based on coordinate respectively, but the color discordant and boundary distortion problems have not been well solved. In order to solve the color discordant problem in the method based on mean value coordinate, a method of image cloning was proposed based on local affinity propagation. The affinity considered the location information of pixels, color information, background information comprehensively, thus it could ease the color discordant and reach color harmonization. The affinity function could detect the real boundary of the interested object, which was used to constrain the interpolation on boundary, thus effectively ease the boundary distortion, and make the cloning more robust. The experimental results show that this method can get satisfactory results.

Key words: color harmonization, affinity, robust, image cloning

CLC Number:

TP391.9

Li Bei, Wang Hao, Yu Jiajun, Xie Zhifeng, Ding Youdong. Robust Image Cloning with Color Harmonization[J]. Journal of System Simulation, 2015, 27(4): 723-730.

References

[1] 吴昊, 徐丹. 数字图像合成技术综述[J]. 中国图象图形学报, 2012, 17(11): 1333-1346.
[2] Sun J, Jia J, Tang C K, et al. Poisson Matting[J]. ACM Trans. Graph.(S0730-0301), 2004, 23(3): 315-321.
[3] Levin A, Lischinski D, Weiss Y.A Closed Form Solution to Natural Image Matting[C]// IEEE Computer Society Conference on Computer Vision and Pattern Recognition (S1063-6919). Washington, DC, USA: IEEE Computer Society, 2006, 1: 61-68.
[4] Gastale S L, Oliveiram M.Shared Sampling for Real-Time Alpha Matting[J]. Computer Graphics Forum (S0167-7055), 2010, 29(2): 575-584.
[5] Levin A, Rav Acha A, Lischinski D.Spectral Matting[J]. Pattern Analysis and Machine Intelligence, IEEE Transactions on (S1063-6919), 2008, 30(10): 1699-1712.
[6] Pérez P, Gangnet M, Blake A.Poisson Image Editing[J]. ACM Trans. Graph.(S0730-0301), 2003, 22(3): 313-318.
[7] Agarwala A.Efficient Gradient-domain Compositing Using Quadtrees[J]. ACM Trans. Graph.(S0730-0301), 2007, 26(3): 94.
[8] Jeschke S, Cline D, Wonka P. A GPU Laplacian Solver for Diffusion Curves and Poisson Image Editing [J]. ACM Trans. Graph. (S0730-0301), 2009, 28(5): 116: 1-116: 8.
[9] Kazhdan M, Hoppe H. Streaming Multigrid for Gradient-domain Operations on Large Images [J]. ACM Trans. Graph. (S0730-0301), 2008, 27(3): 21: 1-21: 10.
[10] Szeliski R.Locally Adapted Hierarchical Basis Preconditioning[J]. ACM Trans. Graph.(S0730-0301), 2006, 25(3): 1135-1143.
[11] Jia J, Sun J, Tang C K, et al. Drag-and-drop Pasting[J]. ACM Trans. Graph.(S0730-0301), 2006, 25(3): 631-637.
[12] Chen T, Cheng M M, Tan P, ,et al. Sketch2Photo: Internet Image Montage [J]. ACM Trans. Graph.. Sketch2Photo: Internet Image Montage [J]. ACM Trans. Graph. (S0730-0301), 2009, 28(5): 124: 1-124: 10.
[13] Farbman Z, Hoffer G, Lipman Y, ,et al. Coordinates for Instant Image Cloning [J]. ACM Trans. Graph.. Coordinates for Instant Image Cloning [J]. ACM Trans. Graph., (S0730-0301), 2009, 28(3): 67: 1-67: 9.
[14] Lee S Y, Lee I K.Improved Coordinate-based Image and Video Cloning Algorithm[C]// ACM SIGGRAPH ASIA 2009 Posters. USA: ACM, 2009: 48.
[15] Ding M, Feng Tong R.Content-aware Copying and Pasting in Images[J]. The Visual Computer,(S0178-2789), 2010, 26(6-8): 721-729.
[16] Xie Z F, Shen Y, Ma L, et al. Seamless Video Composition Using Optimized Mean-value Cloning[J]. The Visual Computer,(S0178-2789), 2010, 26(6-8): 1123-1134.
[17] Zhang Y, Tong R.Environment-Sensitive Cloning in Images[J]. The Visual Computer (S0178-2789), 2011, 27(6-8): 739-748.
[18] Tanaka M, Kamio R, Okutomi M.Seamless Image Cloning by A Closed Form Solution of A Modified Poisson Problem[C]// SIGGRAPH Asia 2012 Posters. USA: ACM, 2012: 15.
[19] Du H, Jin X.Object Cloning Using Constrained Mean Value Interpolation[J]. The Visual Computer,(S0178-2789), 2013, 29(3): 217-229.
[20] Bie X, Wang W, Sun H, et al. Intent-aware Image Cloning[J]. The Visual Computer (S0178-2789), 2013, 29(6-8): 599-608.
[21] Chen T, Zhu J Y, Shamir A, et al. Motion-aware Gradient Domain Video Composition[J]. IEEE Transactions on Image Processing: A Publication of the IEEE Signal Processing Society (S1057-7149), 2013, 22(7): 2532-2544.
[22] Wang R, Chen W, Pan M, et al. Harmonic Coordinates for Real-time Image Cloning[J]. Journal of Zhejiang University Science C (S1869-1951), 2010, 11(9): 690-698.
[23] Guo D, Sim T.Color Me Right-seamless Image Compositing[C]// Computer Analysis of Images and Patterns (S0302-9743). Germany: Springer Berlin Heidelberg, 2009: 444-451.
[24] Li X Y, Gu Y, Hu S M, et al. Mixed-domain Edge-aware Image Manipulation[J]. IEEE Transactions on Image Processing: A Publication of the IEEE Signal Processing Society (S1057-7149), 2013, 22(5): 1915-1925.