Co-matting of Natural Image Pairs

doi:10.16182/j.issn1004731x.joss.201811016

Abstract

Abstract: Aiming at dealing with the problem of natural image matting, this study focused on a closed-form solution to image pairs matting. For given two images and their corresponding trimaps, the affinity matrix between the two images is calculated. The matting Laplacian which characters an image to co-matting Laplacian which characters a pair of images is generalized. The alpha mattes of image pairs were obtained by optimizing the energy function which derived from co-matting Laplacian. To validate the approach, the experiments on several datasets are conducted. The results demonstrate that the method can achieve higher quality and is suitable for matting of a sequence of images.

Key words: natural image matting, co-matting, affinity estimation, co-matting Laplacian

CLC Number:

TP391.9

Wei Yi, Shang Liu, Qiu Jiahe, Zhang Guijuan, Zhu Dengming, Shen Yanfei. Co-matting of Natural Image Pairs[J]. Journal of System Simulation, 2018, 30(11): 4180-4186.

References

[1] 沈洋, 林晓, 谢志峰, 等. 交互式前景抠图技术综述[J]. 计算机辅助设计与图形学学报, 2014, 26(4): 511-519.
Shen Yang, Lin Xiao, Xie Zhifeng, et al.A survey on interactive alpha matting technology[J]. Journal of Computer-Aided Design & Computer Graphics, 2014, 26(4): 511-519.
[2] Porter T, Duff T.Compositing digital images[C]//Proc of the 11th Annual Conference on Computer Graphics and Interactive Techniques. New York: ACM Press, 1984: 253-259.
[3] Chuang Y Y, Curless B, Salesin D H, et al.A Bayesian approach to digital matting[C]//Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Kauai: IEEE Computer Society Press, 2001: 264-271.
[4] Guan Y, Chen W, Liang X, et al.Easy matting-a stroke based approach for continuous image matting[J]. Computer Graphics Forum (S1467-8659), 2006, 25(3): 567-576.
[5] Shahrian E, Rajan D, Price B.Improving image matting using comprehensive sampling sets[C]//Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Portland: IEEE Computer Society Press, 2013: 636-643.
[6] Levent K, Aykut, E, Erkut E. Alpha matting with KL-divergence-based sparse sampling[J]. IEEE Transactions on Image Processing (S1057-7149), 2017, 26(9): 4523-4536.
[7] Jubin J, Ehsan S V, Hisham C, et al.Sparse coding for alpha matting[J]. IEEE Transactions on Image Processing (S1057-7149), 2016, 25(7): 3032-3043.
[8] Sun J, Jia J, Tang C K, et al.Poisson matting[J]. ACM Transactions on Graphics (S1557-7368), 2004, 23(3): 315-321.
[9] Grady L, Schiwietz T, Aharon S, et al.Random walks for interactive alpha-matting[C]//Proc of Visualization, Im-aging, and Image Processing. Benidorm: ACTA Press, 2005: 423-429.
[10] Levin A, Lischinski D, Weiss Y.A closed-form solution to natural image matting[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence (S0162-8828), 2008, 30(2): 228-242.
[11] Wang J, Cohen M F.Optimized color sampling for robust matting[C]//Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Minnesota: IEEE Computer Society Press, 2007: 1-8.
[12] He K, Rhemann C, Rother C, et al.A global sampling method for alpha matting[C]//Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Colorado: IEEE Computer Society Press, 2011: 2049-2056.
[13] Jin M, Kim B, Song W.Adaptive propagation-based color sampling for alpha matting[J]. IEEE Transactions on Circuits and Systems for Video Technology (S1051-8215), 2014, 24(7): 1101-1110.
[14] Rother C, Minka T, Blake A, et al.Cosegmentation of image pairs by histogram matching-incorporating a global constraint into MRFS[C]// Proc of the IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE Computer Society Press, 2006: 993-1000.
[15] Sun J, Li Y, Kang S B, et al.Flash matting[J]. ACM Transactions on Graphics (S1557-7368), 2006, 25(3): 772-778.
[16] Wang L, Xia T, Guo Y, et al.Confidence-driven image co-matting[J]. Computers & Graphics (S0097-8493), 2014, 38(1): 131-139.
[17] Koen E A, Theo G, Cees G M.Evaluating color descriptors for object and scene recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence (S0162-882 8), 2010, 32(9): 1582-1596.
[18] Rhemann C, Rother C, Wang J, et al. Alpha matting evaluation website[DB/OL]. [2018-05-05]. http://www.alphamatting. com
[19] Batra D, Kowdle A, Parikh D, et al.iCoseg: interactive co-segmentation with intelligent scribble guidance[C]// Proc of the IEEE Conference on Computer Vision and Pattern Recognition. San Francisco: IEEE Computer Society Press, 2010: 3169-3176.
[20] Ning Xu, Brian Price, Scott Cohen, et al.Deep Image Matting[C]//Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE Computer Society Press, 2017: 311-320.