颜色协调的鲁棒式图像克隆

系统仿真学报 ›› 2015, Vol. 27 ›› Issue (4): 723-730.

• 仿真建模与仿真算法及数值仿真 • 上一篇下一篇

颜色协调的鲁棒式图像克隆

李贝¹, 汪浩¹, 于佳骏², 谢志峰¹, 丁友东¹

1.上海大学影视艺术技术学院, 上海 200072;
2.上海大学计算机工程与科学学院, 上海 200072

收稿日期:2013-12-20 修回日期:2014-04-04 发布日期:2020-08-20
作者简介:李贝(1989-),女,湖南长沙人,硕士,研究方向为图像克隆等;汪浩(1989-),男,安徽合肥人,硕士,研究方向为真三维与嵌入式开发等;于佳骏(1991-),男,江苏吴江人,硕士生,研究方向为图形图像等;谢志峰(1982-),江苏如东人,博士,讲师,研究方向为图像克隆等;丁友东(1967-),男,福建上杭人,博士,教授,研究方向为计算机图形学等。
基金资助:
国家自然科学基金项目(61303093);上海市科委科技攻关项目(13511505002);上海市教育委员会科研创新项目(14YZ023)

Robust Image Cloning with Color Harmonization

Li Bei¹, Wang Hao¹, Yu Jiajun², Xie Zhifeng¹, Ding Youdong¹

1. School of Film and TV Arts and Technology, Shanghai University, Shanghai 200072, China;
2. School of Computer Engineering and Science, Shanghai University, Shanghai 200072, China

Received:2013-12-20 Revised:2014-04-04 Published:2020-08-20

摘要/Abstract

摘要： 图像克隆一直是图像编辑中的重要组成部分,概括来说有基于透明度分量的、基于梯度域的、基于坐标的3种图像克隆方法,但图像克隆领域中存在的颜色不协调和边界失真问题一直没有得到很好的解决。为了缓解基于均值坐标克隆方法中的颜色不协调问题,提出一种基于局部亲和力传播的图像克隆方法,亲和力综合考虑了像素点与边界的坐标距离、颜色距离以及该点颜色在边界颜色分布中的概率,以此来缓解失色,达到颜色协调。亲和力还可以检测出真正感兴趣对象的边界,用它来约束边界插值,可以有效缓解边界失真,使得克隆更加鲁棒,最后的实验结果表明该方法能得到令人满意的结果。

关键词: 颜色协调, 亲和力, 鲁棒, 图像克隆

Abstract: Image cloning has always been an important part of image editing. In general, it can be divided into three methods, based on a component, based on gradient domain, and based on coordinate respectively, but the color discordant and boundary distortion problems have not been well solved. In order to solve the color discordant problem in the method based on mean value coordinate, a method of image cloning was proposed based on local affinity propagation. The affinity considered the location information of pixels, color information, background information comprehensively, thus it could ease the color discordant and reach color harmonization. The affinity function could detect the real boundary of the interested object, which was used to constrain the interpolation on boundary, thus effectively ease the boundary distortion, and make the cloning more robust. The experimental results show that this method can get satisfactory results.

Key words: color harmonization, affinity, robust, image cloning

中图分类号:

TP391.9

李贝, 汪浩, 于佳骏, 谢志峰, 丁友东. 颜色协调的鲁棒式图像克隆[J]. 系统仿真学报, 2015, 27(4): 723-730.

Li Bei, Wang Hao, Yu Jiajun, Xie Zhifeng, Ding Youdong. Robust Image Cloning with Color Harmonization[J]. Journal of System Simulation, 2015, 27(4): 723-730.

参考文献

[1] 吴昊, 徐丹. 数字图像合成技术综述[J]. 中国图象图形学报, 2012, 17(11): 1333-1346.
[2] Sun J, Jia J, Tang C K, et al. Poisson Matting[J]. ACM Trans. Graph.(S0730-0301), 2004, 23(3): 315-321.
[3] Levin A, Lischinski D, Weiss Y.A Closed Form Solution to Natural Image Matting[C]// IEEE Computer Society Conference on Computer Vision and Pattern Recognition (S1063-6919). Washington, DC, USA: IEEE Computer Society, 2006, 1: 61-68.
[4] Gastale S L, Oliveiram M.Shared Sampling for Real-Time Alpha Matting[J]. Computer Graphics Forum (S0167-7055), 2010, 29(2): 575-584.
[5] Levin A, Rav Acha A, Lischinski D.Spectral Matting[J]. Pattern Analysis and Machine Intelligence, IEEE Transactions on (S1063-6919), 2008, 30(10): 1699-1712.
[6] Pérez P, Gangnet M, Blake A.Poisson Image Editing[J]. ACM Trans. Graph.(S0730-0301), 2003, 22(3): 313-318.
[7] Agarwala A.Efficient Gradient-domain Compositing Using Quadtrees[J]. ACM Trans. Graph.(S0730-0301), 2007, 26(3): 94.
[8] Jeschke S, Cline D, Wonka P. A GPU Laplacian Solver for Diffusion Curves and Poisson Image Editing [J]. ACM Trans. Graph. (S0730-0301), 2009, 28(5): 116: 1-116: 8.
[9] Kazhdan M, Hoppe H. Streaming Multigrid for Gradient-domain Operations on Large Images [J]. ACM Trans. Graph. (S0730-0301), 2008, 27(3): 21: 1-21: 10.
[10] Szeliski R.Locally Adapted Hierarchical Basis Preconditioning[J]. ACM Trans. Graph.(S0730-0301), 2006, 25(3): 1135-1143.
[11] Jia J, Sun J, Tang C K, et al. Drag-and-drop Pasting[J]. ACM Trans. Graph.(S0730-0301), 2006, 25(3): 631-637.
[12] Chen T, Cheng M M, Tan P, ,et al. Sketch2Photo: Internet Image Montage [J]. ACM Trans. Graph.. Sketch2Photo: Internet Image Montage [J]. ACM Trans. Graph. (S0730-0301), 2009, 28(5): 124: 1-124: 10.
[13] Farbman Z, Hoffer G, Lipman Y, ,et al. Coordinates for Instant Image Cloning [J]. ACM Trans. Graph.. Coordinates for Instant Image Cloning [J]. ACM Trans. Graph., (S0730-0301), 2009, 28(3): 67: 1-67: 9.
[14] Lee S Y, Lee I K.Improved Coordinate-based Image and Video Cloning Algorithm[C]// ACM SIGGRAPH ASIA 2009 Posters. USA: ACM, 2009: 48.
[15] Ding M, Feng Tong R.Content-aware Copying and Pasting in Images[J]. The Visual Computer,(S0178-2789), 2010, 26(6-8): 721-729.
[16] Xie Z F, Shen Y, Ma L, et al. Seamless Video Composition Using Optimized Mean-value Cloning[J]. The Visual Computer,(S0178-2789), 2010, 26(6-8): 1123-1134.
[17] Zhang Y, Tong R.Environment-Sensitive Cloning in Images[J]. The Visual Computer (S0178-2789), 2011, 27(6-8): 739-748.
[18] Tanaka M, Kamio R, Okutomi M.Seamless Image Cloning by A Closed Form Solution of A Modified Poisson Problem[C]// SIGGRAPH Asia 2012 Posters. USA: ACM, 2012: 15.
[19] Du H, Jin X.Object Cloning Using Constrained Mean Value Interpolation[J]. The Visual Computer,(S0178-2789), 2013, 29(3): 217-229.
[20] Bie X, Wang W, Sun H, et al. Intent-aware Image Cloning[J]. The Visual Computer (S0178-2789), 2013, 29(6-8): 599-608.
[21] Chen T, Zhu J Y, Shamir A, et al. Motion-aware Gradient Domain Video Composition[J]. IEEE Transactions on Image Processing: A Publication of the IEEE Signal Processing Society (S1057-7149), 2013, 22(7): 2532-2544.
[22] Wang R, Chen W, Pan M, et al. Harmonic Coordinates for Real-time Image Cloning[J]. Journal of Zhejiang University Science C (S1869-1951), 2010, 11(9): 690-698.
[23] Guo D, Sim T.Color Me Right-seamless Image Compositing[C]// Computer Analysis of Images and Patterns (S0302-9743). Germany: Springer Berlin Heidelberg, 2009: 444-451.
[24] Li X Y, Gu Y, Hu S M, et al. Mixed-domain Edge-aware Image Manipulation[J]. IEEE Transactions on Image Processing: A Publication of the IEEE Signal Processing Society (S1057-7149), 2013, 22(5): 1915-1925.

颜色协调的鲁棒式图像克隆

Robust Image Cloning with Color Harmonization

PDF (PC)

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	王丽梅, 么红岩, 张康. 直接驱动H型平台鲁棒最优同步控制仿真研究[J]. 系统仿真学报, 2022, 34(3): 527-535.
[2]	路宏广, 赵树恩. 基于鲁棒模型预测的智能汽车轨迹跟踪控制研究[J]. 系统仿真学报, 2022, 34(1): 153-162.
[3]	尤一琛, 王艳, 纪志成. 基于博弈论的柔性作业车间动态调度研究[J]. 系统仿真学报, 2021, 33(11): 2579-2588.
[4]	钟麟, 佟明安, 张健, 梁建海. 基于效果作战的武器系统组合效费分析[J]. 系统仿真学报, 2020, 32(4): 718-726.
[5]	王哲, 李建华, 康东. 基于极大连通子图边界的复杂网络恢复研究[J]. 系统仿真学报, 2020, 32(12): 2306-2316.
[6]	张倩, 熊英, 何明珂, 张浩. 不确定需求生鲜电商配送路径规划多目标模型[J]. 系统仿真学报, 2019, 31(8): 1582-1590.
[7]	李从东, 李文博, 曹策俊, 王玉. 面向级联故障的相依网络鲁棒性分析[J]. 系统仿真学报, 2019, 31(3): 538-548.
[8]	叶恒舟, 李陶深, 关云慧. 组合服务的时序鲁棒性仿真分析[J]. 系统仿真学报, 2018, 30(9): 3399-3403.
[9]	朱林, 方胜良, 王劲松, 吴付祥. 面向体系作战的空间通信网络级联失效模型[J]. 系统仿真学报, 2018, 30(6): 2144-2152.
[10]	葛为民, 闫珂珂, 王肖锋, 刘增昌. 可重构机械臂的鲁棒模糊自适应补偿控制[J]. 系统仿真学报, 2018, 30(5): 1950-1956.
[11]	张丽娇, 陈力. 柔性关节和柔性臂空间机器人的L₂增益鲁棒控制[J]. 系统仿真学报, 2018, 30(4): 1448-1455.
[12]	杨磊, 庞芳, 胡豁生. 基于低秩-稀疏联合表示的视频序列运动目标检测[J]. 系统仿真学报, 2018, 30(12): 4693-4702.
[13]	张明智, 马力. 体系对抗OODA循环鲁棒性建模及仿真分析[J]. 系统仿真学报, 2017, 29(9): 1968-1975.
[14]	张丽娇, 陈力. 柔性关节空间机器人自适应模糊鲁棒H_∞控制[J]. 系统仿真学报, 2017, 29(6): 1223-1228.
[15]	苗依迪, 吕军, 李秀梅. 两种基于压缩感知的图像数字水印方法[J]. 系统仿真学报, 2017, 29(11): 2649-2656.