结合显著性检测和图割的RGBD图像共分割算法

doi:10.16182/j.issn1004731x.joss.201807016

系统仿真学报 ›› 2018, Vol. 30 ›› Issue (7): 2558-2567.doi: 10.16182/j.issn1004731x.joss.201807016

结合显著性检测和图割的RGBD图像共分割算法

李晓阳^1,2, 万丽莉^1,2, 李赫男^1,2, 王升辉^1,2

1. 北京交通大学计算机与信息技术学院信息科学研究所,北京 100044;
2. 北京交通大学现代信息科学与网络技术北京市重点实验室,北京 100044

收稿日期:2017-07-30 出版日期:2018-07-10 发布日期:2019-01-08
作者简介:李晓阳(1989-), 女, 河北, 硕士, 研究方向为图像处理; 万丽莉(1979-), 女, 湖北, 博士, 副教授, 研究方向为三维形状分析、图像分析、虚拟现实。
基金资助:
国家自然科学基金(61572064),中央高校基本科研业务费专项资金(2014JBZ004)

RGBD Image Co-segmentation via Saliency Detection and Graph Cut

Li Xiaoyang^1,2, Wan Lili^1,2, Li Henan^1,2, Wang Shenghui^1,2

1. Institute of Information Science, Beijing Jiaotong University, Beijing 100044, China;
2. Beijing Key Laboratory of Advanced Information Science and Network Technology, Beijing 100044, China

Received:2017-07-30 Online:2018-07-10 Published:2019-01-08

摘要/Abstract

摘要： 针对前背景颜色相近的图像难以准确分割的问题,提出了一种结合显著性检测和图割的RGBD图像共分割算法。不仅实现了对多幅图像的共分割,还借助深度数据来解决前背景混淆的问题。将深度引入超像素分割算法,每幅RGBD图像变成超像素块的集合;构建超像素块的图模型,结合显著性检测来扩充种子点区域,基于Biased Normalized Cuts来实现共分割;借助深度信息来优化分割结果。实验表明：对于前背景颜色相近的RGBD场景,能显著提高分割结果的准确度。

关键词: 共分割, 深度, 显著性检测, 超像素, 图割

Abstract: In order to solve the problem that it is difficult to accurately segment images with similar colors in the foreground, we propose a RGBD image co-segmentation algorithm that utilizes saliency detection and graph cut. Our algorithm not only achieves the co-segmentation of multiple images, but also uses depth data to solve the foreground and background confusion problem caused by color similarity. Depth is incorporated into a superpixel segmentation algorithm to change each RGBD image into a set of superpixel blocks. A graph model of superpixels is constructed and saliency detection is used to extend the seed nodes area. The co-segmentation is achieved based on the Biased Normalized Cuts. Depth information is used to further optimize the segmentation results. Extensive experiments show that our method can significantly improve the accuracy of segmentation for those scenes with similar foreground and background colors.

Key words: co-segmentation, depth, saliency detection, superpixel, graph cut

中图分类号:

TN911.73

李晓阳, 万丽莉, 李赫男, 王升辉. 结合显著性检测和图割的RGBD图像共分割算法[J]. 系统仿真学报, 2018, 30(7): 2558-2567.

Li Xiaoyang, Wan Lili, Li Henan, Wang Shenghui. RGBD Image Co-segmentation via Saliency Detection and Graph Cut[J]. Journal of System Simulation, 2018, 30(7): 2558-2567.

参考文献

[1] 秦绪佳, 陈新鸿, 吴正强, 等. 基于Canny算子的水平集数字虚拟人图像分割算法[J]. 系统仿真学报, 2010, 22(7): 1674-1677.
QIN Xujia, CHEN Xinhong, WU Zhengqiang, et al.Level Set Digital Virtual Human Image Segmentation Algorithm Based on Canny Operator[J]. Journal of System Simulation, 2010, 22(7): 1674-1677.
[2] Rother C, Minka T, Blake A, et al.Cosegmentation of Image Pairs by Histogram Matching - Incorporating a Global Constraint into MRFs[C]// IEEE Computer Vision and Pattern Recognition, Los Alamitos: IEEE Computer Society Press, 2006: 993-1000.
[3] Hochbaum D S, Singh V.An efficient algorithm for Cosegmentation[C]//2010 IEEE International Conference on Computer Vision. New York: IEEE, 2010: 269-276.
[4] Joulin A, Bach F, Ponce J.Discriminative clustering for image co-segmentation[C]//2010 IEEE Computer Vision and Pattern Recognition, Los Alamitos: IEEE Computer Society Press, 2010: 1943-1950.
[5] Batra D, Kowdle A, Parikh D, et al.iCoseg: Interactive co-segmentation with intelligent scribble guidance[C]// 2010 IEEE Computer Vision and Pattern Recognition, Los Alamitos: IEEE Computer Society Press, 2010: 3169-3176.
[6] 刘松涛, 殷福亮. 基于图割的图像分割方法及其新进展[J]. 自动化学报, 2012, 38(6): 911-922.
LIU Songtao, YIN Fuliang.Image Segmentation Method Based on Graph Cut and Its New Progress[J]. Acta Automatica Sinica, 2012, 38(6): 911-922.
[7] 栾悉道, 谢毓湘, 张芯, 等. 融合多特征的运动目标特征提取方法[J]. 系统仿真学报, 2017, 29(6): 1304-1310.
LUAN Xidao, XIE Yuxiang, Zhang Xin, et al.Multi-feature fusion of moving target feature extraction method[J]. Journal of System Simulation, 2017, 29(6): 1304-1310.
[8] Collins M D, Xu J, Grady L, et al.Random walks based multi-image segmentation: Quasiconvexity results and GPU-based solutions[C]//2012 IEEE Conference on Computer Vision and Pattern Recognition, New York: IEEE, 2012: 1656-1663.
[9] Liang Q, Miao Z.Local spectral method to seeded image cosegmentation[J]. Journal of Electronic Imaging (S1017-9909), 2014, 23(2): 1709-1717.
[10] Maji S, Vishnoi N K, Malik J.Biased normalized cuts[C]//2011 IEEE Computer Vision and Pattern Recognition, New York: IEEE, 2011: 2057-2064.
[11] 余烨, 李冰飞, 张小魏, 等. 面向RGBD图像的标记分水岭分割[J]. 中国图象图形学报, 2016, 21(2): 145-154.
YU Ye, LI Bing-fei, ZHANG Xiao-wei, et al.Marking watershed segmentation for RGBD images[J]. Journal of Image and Graphics, 2016, 21(2): 145-154.
[12] Mishra A K, Shrivastava A, Aloimonos Y.Segmenting “simple” objects using RGB-D[C]//2012 IEEE International Conference on Robotics and Automation, New York: IEEE, 2012: 4406-4413.
[13] Hickson S, Birchfield S, Essa I, et al.Efficient Hierarchical Graph-Based Segmentation of RGBD Videos[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition, New York: IEEE, 2014: 344-351.
[14] Achanta R, Shaji A, Smith K, et al.SLIC Superpixels Compared to State-of-the-Art Superpixel Methods[J]. 2012 IEEE Transactions on Pattern Analysis & Machine Intelligence (S0162-8828), 2012, 34(11): 2274.
[15] Weikersdorfer D, Gossow D, Beetz M.Depth-adaptive superpixels[C]//2012 IEEE International Conference on Pattern Recognition, New York: IEEE, 2012: 2087-2090.
[16] Y Cheng, H Fu, X Wei, et al.Depth enhanced saliency detectionmethod[C]. Proceedings of International Conference on Internet Multimedia Computing and Service, 2014: 23-28.
[17] 刘毅, 黄兵, 孙怀江, 等. 利用视觉显著性与图割的图像分割算法[J]. 计算机辅助设计与图形学学报, 2013, 25(3): 402-409.
LIU Yi, HUANG Bing, SUN Huaijiang, et al.Image segmentation algorithm using visual saliency and graph cut[J]. Computer Assisted Design and Graphics, 2013, 25(3): 402-409.
[18] Levinshtein A, Stere A, Kutulakos K N, et al.TurboPixels: Fast Superpixels Using Geometric Flows[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence (S0162-8828), 2009, 31(12): 2290-2297.
[19] Geng Y.Leveraging stereopsis for saliency analysis[C]// 2012 IEEE Computer Vision and Pattern Recognition, New York: IEEE, 2009: 269-276.
[20] Shi J, Malik J.Normalized Cuts and Image Segmentation[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence (S0162-8828), 2000, 22(8): 888-905.
[21] Mahoney M W, Orecchia L, Vishnoi N K.A local spectral method for graphs: with applications to improving graph partitions and exploring data graphs locally[J]. Journal of Machine Learning Research(S1532-4435), 2012, 13(1): 2339-2365.
[22] Choi S, Zhou Q Y, Miller S, et al. A Large Dataset of Object Scans[OL]. arXiv:1602.02481, 2016.
[23] Dakua S P, Abi-Nahed J.Patient oriented graph-based image seg-mentation[J]. Biomedical Signal Processing & Control (S1746-8094), 2013, 8(3): 325-332.
[24] Li J, Levine M D, An X, et al.Visual saliency based on scale-space analysis in the frequency domain[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence (S0162-8828), 2013, 35(4): 996-1010.

结合显著性检测和图割的RGBD图像共分割算法

RGBD Image Co-segmentation via Saliency Detection and Graph Cut

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	王银, 王飞翔, 孙前来. 多尺度特征融合车辆检测方法[J]. 系统仿真学报, 2022, 34(6): 1219-1229.
[2]	周培培, 侯幸林. 一种用于图像融合的无监督深度神经网络[J]. 系统仿真学报, 2022, 34(6): 1267-1274.
[3]	张森, 张孟炎, 邵敬平, 普杰信. 基于随机策略搜索的多机三维路径规划方法[J]. 系统仿真学报, 2022, 34(6): 1286-1295.
[4]	倪凌佳, 黄晓霞, 李红旮, 张子博. 基于协作式深度强化学习的火灾应急疏散仿真研究[J]. 系统仿真学报, 2022, 34(6): 1353-1366.
[5]	康旭, 张晓峰. 基于生成对抗神经网络的雷达遥感数据增广方法[J]. 系统仿真学报, 2022, 34(4): 920-927.
[6]	周思锦, 陈棣成, 涂耿, 姜大志. 基于个性化和记忆机制的多模态情感计算模型[J]. 系统仿真学报, 2022, 34(4): 745-758.
[7]	唐传谦, 刘志强, 苏毅俊, 刘晓静. 基于Kinect的皮影动作实时匹配研究[J]. 系统仿真学报, 2022, 34(3): 633-639.
[8]	王红微, 杨鹏. 基于深度强化学习的机场货运业务优化研究[J]. 系统仿真学报, 2022, 34(3): 651-660.
[9]	李启锐, 彭心怡. 基于深度强化学习的云作业调度及仿真研究[J]. 系统仿真学报, 2022, 34(2): 258-268.
[10]	聂凯, 曾科军, 孟庆海. 基于深度贝叶斯网络学习的不确定性建模方法[J]. 系统仿真学报, 2022, 34(1): 79-85.
[11]	林硕, 安磊, 高治军, 单丹, 尚文利. 结合栈式自编码及长短时记忆的入侵检测研究[J]. 系统仿真学报, 2021, 33(6): 1288-1296.
[12]	程文聪, 史小康, 王志刚. 基于生成对抗网络的仿真卫星云图生成方法[J]. 系统仿真学报, 2021, 33(6): 1297-1306.
[13]	孙伟卿, 宋赫, 韩冬, 田坤鹏. 火电深度调峰改造近似动态规划方法[J]. 系统仿真学报, 2021, 33(6): 1415-1426.
[14]	董书琴, 张斌. 面向不平衡数据的网络流量异常检测方法[J]. 系统仿真学报, 2021, 33(3): 679-689.
[15]	高昂, 董志明, 张国辉, 梁涛, 郭齐胜. LVC训练系统中计算机生成兵力生成技术研究[J]. 系统仿真学报, 2021, 33(3): 745-752.