基于Gestalt优化的红外视频时空显著性检测

doi:10.16182/j.issn1004731x.joss.18-0668

系统仿真学报 ›› 2020, Vol. 32 ›› Issue (6): 1021-1031.doi: 10.16182/j.issn1004731x.joss.18-0668

基于Gestalt优化的红外视频时空显著性检测

王鑫^1,2, 张春燕¹, 宁晨³

1. 河海大学计算机与信息学院，江苏南京 211100;
2. 江苏省社会安全图像与视频理解重点实验室(南京理工大学)，江苏南京 210000;
3.南京师范大学物理科学与技术学院，江苏南京 210000

收稿日期:2018-10-10 修回日期:2018-12-19 出版日期:2020-06-25 发布日期:2020-06-25
作者简介:王鑫(1981-)，女，安徽阜阳，博士，副教授，研究方向为图像处理和模式识别。
基金资助:
国家自然科学基金(61603124)，教育部中央高校基本科研业务费专项资金(2019B15314，30918014107)，江苏省“六大人才高峰”高层次人才(XYDXX-007)

Spatiotemporal Saliency Detection of Infrared Videos Based on Gestalt-guided Optimization

Wang Xin^1,2, Zhang Chunyan¹, Ning Chen³

1. College of Computer and Information, Hohai University, Nanjing 211100, China;
2. Jiangsu Key Laboratory of Image and Video Understanding for Social Safety, Nanjing University of Science and Technology, Nanjing 210000, China;
3.School of Physics and Technology, Nanjing Normal University, Nanjing 210000, China

Received:2018-10-10 Revised:2018-12-19 Online:2020-06-25 Published:2020-06-25

摘要/Abstract

摘要： 针对红外视频时空显著性检测问题，提出一种基于Gestalt 优化的方法。设计基于多尺度局部稀疏表示和局部对比度测量的方法计算红外视频的空间显著性；为提取视频中显著性目标的运动信息，设计基于多帧对称差分的算法计算时间显著性；为得到初始时空显著图，设计基于交互一致性的融合策略将空间显著图和时间显著图进行自适应融合；提出基于Gestalt 优化的最终时空显著图计算方法。实验结果表明，提出算法能有效检测红外视频的时空显著性。

关键词: 红外, 显著性检测, 稀疏表示, Gestalt理论

Abstract: A spatiotemporal saliency detection method based on Gestalt optimization is proposed. A method based on the multi-scale local sparse representation and local contrast measure is proposed to compute the spatial saliency in the infrared videos. A multi-frame symmetric difference approach is adopted to detect the temporal saliency. To get the initial spatiotemporal saliency map, a scheme based on the mutual-consistency is designed to fuse the spatial and temporal saliency maps adaptively. A Gestalt-guided optimization method is designed to calculate the final spatiotemporal saliency map. Experimental results show that the proposed method can effectively detect the spatiotemporal saliency of infrared videos.

Key words: infrared, saliency detection, sparse representation, Gestalt theory

中图分类号:

TP391.9

王鑫, 张春燕, 宁晨. 基于Gestalt优化的红外视频时空显著性检测[J]. 系统仿真学报, 2020, 32(6): 1021-1031.

Wang Xin, Zhang Chunyan, Ning Chen. Spatiotemporal Saliency Detection of Infrared Videos Based on Gestalt-guided Optimization[J]. Journal of System Simulation, 2020, 32(6): 1021-1031.

参考文献

[1] 王仕民, 叶继华, 王明文, 等. 基于多尺度区域协方差的显著性特征提取方法[J]. 系统仿真学报, 2018, 30(7): 2767-2775.
Wang Shimin, Ye Jihua, Wang Mingwen, et al. Saliency Feature Extraction Method Based on Multi-scale Region Covariance [J]. Journal of System Simulation, 2018, 30(7): 2767-2775.
[2] Wang X, Lv G, Xu L. Infrared dim target detection based on visual attention[J]. Infrared Physics & Technology (S1350-4495), 2012, 55(6): 513-521.
[3] 李晓阳, 万丽莉, 李赫男, 等. 结合显著性检测和图割的RGBD 图像共分割算法[J]. 系统仿真学报, 2018, 30(7): 2558-2567.
Li Xiaoyang, Wan Lili, Li Henan, et al. RGBD Image Co-segmentation via Saliency Detection and Graph Cut[J]. Journal of System Simulation, 2018, 30(7): 2558-2567.
[4] Itti L. Automatic foveation for video compression using a neurobiological model of visual attention[J]. IEEE Transactions on Image Processing (S1057-7149), 2004, 13(10): 1304-1318.
[5] Itti L, Koch C, Niebur E. A Model of Saliency-Based Visual Attention for Rapid Scene Analysis[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence (S0162-8828), 1998, 20(11): 1254-1259.
[6] Harel J, Koch C, Perona P. Graph-Based Visual Saliency[C]// Proceedings of International Conference on Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2006: 545-552.
[7] Zhai Y, Shah M. Visual attention detection in video sequences using spatiotemporal cues[C]// Proceedings of ACM International Conference on Multimedia. Santa Barbara, CA, USA: ACM, 2006, 177(1): 815-824.
[8] Hou X, Zhang L. Dynamic Visual Attention: Searching for coding length increments[C]// Proceedings of International Conference on Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2009: 681-688.
[9] Kim H, Kim Y, Sim J Y, et al. Spatiotemporal Saliency Detection for Video Sequences Based on Random Walk With Restart[J]. IEEE Transactions on Image Processing (S1057-7149), 2015, 24(8): 2552-2564.
[10] Wang X, Zhang C Y, Ning C, et al. Detecting Saliency in Infrared Images via Multiscale Local Sparse Representation and Local Contrast Measure[J]. Mathematical Problems in Engineering (S1024-123X), 2017, 5: 2483169.
[11] Dickinson P, Hunter A, Appiah K. A spatially distributed model for foreground segmentation[J]. Image & Vision Computing (S0262-8856), 2009, 27(9): 1326-1335.
[12] Mahapatra D, Gilani S O, Saini M K. Coherency Based Spatio-Temporal Saliency Detection for Video Object Segmentation[J]. IEEE Journal of Selected Topics in Signal Processing (S1932-4553), 2014, 8(3): 454-462.
[13] Yang G, Wang Z, Shitang M U, et al. An Improved Optical Flow Algorithm[J]. Computer Engineering (S1000-3428), 2006, 32(15): 187-188.
[14] Wang Z, Liao K, Xiong J, et al. Moving object detection based on temporal information[J]. IEEE Signal Processing Letters (S1070-9908), 2014, 21(11): 1403-1407.
[15] Wang X, Zhang Y, Ning C. A novel visual saliency detection method for infrared video sequences[J]. Infrared Physics & Technology (S1350-4495), 2017, 87: 91-103.
[16] Ren Z, Gao S, Chia L T, et al. Regularized feature reconstruction for spatio-temporal saliency detection[J]. IEEE Transactions on Image Processing (S1057-7149), 2013, 22(8): 3120-3132.
[17] Kim W, Kim C. Spatiotemporal Saliency Detection Using Textural Contrast and Its Applications[J]. IEEE Transactions on Circuits & Systems for Video Technology (S1051-8215), 2014, 24(4): 646-659.
[18] Li Y, Tan Y, Yu J G, et al. Kernel regression in mixed feature spaces for spatio-temporal saliency detection[J]. Computer Vision & Image Understanding (S1077-3142), 2015, 135: 126-140.
[19] Wang X, Ning C, Xu L. Saliency detection using mutual consistency-guided spatial cues combination[J]. Infrared Physics & Technology (S1350-4495), 2015, 72: 106-116.
[20] Ren Z, Gao S, Chia L T, et al. Regularized feature reconstruction for spatio-temporal saliency detection[J]. IEEE Transactions on Image Processing (S1057-7149), 2013, 22(8): 3120-3132.
[21] King D B, Wertheimer M. Max Wertheimer and Gestalt Theory[M]. Piscataway: Transaction Publishers, 2005: 438.
[22] 李炜烨. 基于格式塔理论的建筑物区域提取方法研究[D]. 南昌: 南昌航空大学, 2014.
Li W Y. Building area detection method based on the principle of gestalt theory [D]. Nanchang: Nanchang Hangkong University, 2014.
[23] Davis J W. OTCBVS Benchmark Dataset Collection[EB/OL]. (2005-06-20)[2018-01-03]. http://www. cse.ohio-state.edu/otcbvs- bench/.
[24] Wang X, Ning C, Xu L. Spatiotemporal saliency model for small moving object detection in infrared videos[J]. Infrared Physics & Technology (S1350-4495), 2015, 69: 111-117.

基于Gestalt优化的红外视频时空显著性检测

Spatiotemporal Saliency Detection of Infrared Videos Based on Gestalt-guided Optimization

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	刘浩, 毛宏霞, 肖志河, 刘铮. 基于动态时间规整的火箭尾喷焰识别仿真[J]. 系统仿真学报, 2022, 34(1): 126-133.
[2]	胡蕾, 王足根, 陈田, 张永梅. 一种改进的SRGAN红外图像超分辨率重建算法[J]. 系统仿真学报, 2021, 33(9): 2109-2118.
[3]	王坤, 吉尧, 刘沛伦, 王力. 基于Otsu和改进易经占卜进化算法的红外图像分割[J]. 系统仿真学报, 2021, 33(2): 421-433.
[4]	宋晓瑞, 邹玲, 吴玲达, 徐万朋. 基于背景重建的高光谱图像异常检测[J]. 系统仿真学报, 2020, 32(7): 1287-1293.
[5]	肖艳军, 杨欢, 康炎平. 锂电池极片涂布机NMP回收系统的红外辐射研究[J]. 系统仿真学报, 2020, 32(1): 96-104.
[6]	高阳, 马静, 曲慧杨, 魏群, 费锦东. 基于紧缩场的射频/红外复合半实物仿真方法研究[J]. 系统仿真学报, 2019, 31(8): 1484-1494.
[7]	王远明, 张珺, 秦远辉, 柴秀娟. 基于多特征融合的指挥手势识别方法研究[J]. 系统仿真学报, 2019, 31(2): 346-352.
[8]	贺梦嘉, 吴迎年, 杨睿. 基于改进深度回归网络的无创血糖检测算法研究[J]. 系统仿真学报, 2019, 31(11): 2492-2498.
[9]	李晓阳, 万丽莉, 李赫男, 王升辉. 结合显著性检测和图割的RGBD图像共分割算法[J]. 系统仿真学报, 2018, 30(7): 2558-2567.
[10]	唐善军, 宋敏敏, 王碧云, 张宇. 基于MOS电阻阵半实物仿真的红外场景生成技术[J]. 系统仿真学报, 2018, 30(4): 1319-1327.
[11]	王献忠, 刘禹, 汤敏兰, 张丽敏. 星光折射敏感器谱宽选择及探测能力分析[J]. 系统仿真学报, 2018, 30(2): 722-730.
[12]	黎明, 彭秀姣, 王艳. 基于改进的字典学习与稀疏表示的人脸表情识别[J]. 系统仿真学报, 2018, 30(1): 28-36.
[13]	王坤, 张杨, 宋胜博, 诸葛晶昌. 改进二维OTSU和自适应遗传算法的红外图像分割[J]. 系统仿真学报, 2017, 29(6): 1229-1236.
[14]	牛为华, 梁贵书, 赵鹏. 基于稀疏表示和M-ELM的断路器故障诊断模型[J]. 系统仿真学报, 2017, 29(11): 2828-2839.
[15]	王仕民, 叶继华, 程柏良, 王明文. 基于多尺度张量空间的改进Itti视觉显著性检测[J]. 系统仿真学报, 2016, 28(9): 2138-2145.