基于上下文语境传播的多媒体语义标注改善

doi:10.16182/j.issn1004731x.joss.201611029

系统仿真学报 ›› 2016, Vol. 28 ›› Issue (11): 2860-2867.doi: 10.16182/j.issn1004731x.joss.201611029

基于上下文语境传播的多媒体语义标注改善

田枫, 尚福华

东北石油大学计算机与信息技术学院,大庆 163318;

收稿日期:2016-04-30 修回日期:2016-07-14 出版日期:2016-11-08 发布日期:2020-08-13
作者简介:田枫(1980-), 男, 黑龙江安达, 博士, 副教授, 研究方向为多媒体理解; 尚福华(通讯作者1962-), 男, 吉林延吉, 教授, 博士, 研究方向为机器学习。
基金资助:
国家自然科学基金(61502094, 61402099); 黑龙江省自然科学基金(F2016002, F2015020); 黑龙江省教育科学规划重点课题(GJB1215019)

Multimedia Annotation Refinement Based on Contextual Information Diffusion

Tian Feng, Shang Fuhua

School of Computer and Information Technology, Northeast Petroleum University, Daqing 163318, China

Received:2016-04-30 Revised:2016-07-14 Online:2016-11-08 Published:2020-08-13

摘要/Abstract

摘要： 提出了一种数据驱动的多媒体对象标注改善方法,利用数据集蕴含的丰富语境相关信息对基本多媒体对象标注结果进行优化。以标签为节点,相关度为边,构造标签语境相关图,实现概念空间上的相关性传播;将多媒体对象内容特征和文本模态特征互增强过程集成为一个优化框架,通过近似求解策略,实现上下文语境信息传播。该方法充分利用了标签的上下文相关性和多媒体对象的内容相关性。数据集上的实验结果表明,该方法可大幅度提升标注性能。

关键词: 多媒体标注, 语义标注, 语义改善, 语境传播

Abstract: A data driven multimedia annotation refinement method based on dataset contextual information diffusion was proposed. The label contextual graph was constructed, and the label correlation can be diffused on textual label space; Multimedia object content relevant graph was constructed. Label contextual graph and multimedia object content relevant graph were mutually reinforced and formulated into a regularized framework. The proposed method incorporated both multimedia content correlation and label contextual information, and the optimization process was solved by approximate solution algorithm. The experimental results on real world dataset show that the proposed method can obviously improve the annotation performance.

Key words: multimedia annotation, semantic annotation, annotation refinement, contextual diffusion

中图分类号:

TP391

田枫, 尚福华. 基于上下文语境传播的多媒体语义标注改善[J]. 系统仿真学报, 2016, 28(11): 2860-2867.

Tian Feng, Shang Fuhua. Multimedia Annotation Refinement Based on Contextual Information Diffusion[J]. Journal of System Simulation, 2016, 28(11): 2860-2867.

参考文献 15

[1]	Jin Y H, Khan L, Wang L.Image annotations by combining multiple evidence & Wordnet[C]// Proceedings of the 13th annual ACM international conference on Multimedia. New York, USA: ACM, 2005: 706-715.
[2]	Jin YH, Khan L, Prabhakaran B.Knowledge Based Image Annotation Refinement[J]. Journal of Signal Processing Systems, 2010, 58(3): 387-406.
[3]	Wang CH, Feng J, Zhang L, et al.Image annotation refinement using random walk with restarts[C]// Proceedings of the ACM International Conference on Multimedia. New York, USA: ACM, 2006: 647-650.
[4]	Wang CH, Feng J, Zhang L, et al.Content-Based Image Annotation Refinement[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2007: 1-8.
[5]	Li XR, Snoek C.G.M, Worring M. Learning social tag relevance by neighbor voting[C]// IEEE Transactions on Multimedia. USA: IEEE, 2009: 1310-1322
[6]	Chen L, Xu D, Tsang IW.Tag-based Web Photo Retrieval Improved by Batch Mode Re-Tagging[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2010: 3440-3446.
[7]	Liu D, Hua XC, Yang LJ, et al.Tag ranking[C]// Proceedings of the Intenational World Wide Web Conference. New York, USA: ACM, 2009: 351-360.
[8]	Xu H, Wang JD, Hua XS.Tag Refinement by Regularized LDA [C]// Proceedings of the ACM Multimedia Conference. New York, USA: ACM Press, 2009: 573-576.
[9]	Zhu GY, Yan SC, Ma Y.Image tag refinement towards low-rank, content-tag prior and error sparsity [C]// Proceedings of the ACM Multimedia Conference. New York, USA: ACM Press, 2010: 461-470.
[10]	Wang H, Huang H, Ding C.Image annotation using multi-label correlated Green's function[C]// Proceedings of IEEE International Conference on Computer Vision. Piscataway, NJ, USA: IEEE Computer Society, 2009: 1-8
[11]	Wang H, Huang H, Ding C.Multi-label Feature Transform for Image Classifications [C]// Proceedings of European Conference on Computer Vision. Berlin, Germany: Springer Press, 2010: 793-806.
[12]	Wang H, Huang H, Ding C.Image Annotation Using Bi-Relational Graph of Images and Semantic Labels[C]// IEEE Conference on Computer Vision and Pattern Recognition, Piscataway, NJ, USA: IEEE Computer Society, 2011: 793-800.
[13]	Xiang Y, Zhou XD, Liu ZT, et al.Semantic context modeling with maximal margin conditional random fields for automatic image annotation[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2010: 3368-3375.
[14]	Chua TS, Tang JH, Hong RH.NUS-WIDE: A real-world web image database from national university of singapore[C]// Proceedings of ACM Conference on Image and Video Retrieval. New York, USA: ACM, 2009: 1-9.
[15]	Huiskes M J, Lew M S.The MIR Flickr retrieval evaluation[C]// Proceedings of the ACM Intenational Conference on Multimedia Information Retrieval. New York, USA: ACM, 2008: 39-43.

基于上下文语境传播的多媒体语义标注改善

Multimedia Annotation Refinement Based on Contextual Information Diffusion

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献 15

相关文章 15

编辑推荐

Metrics

本文评价

[1]	李智杰, 石昊琦, 李昌华, 张颉. 基于改进遗传算法的影像中心布局优化方法[J]. 系统仿真学报, 2022, 34(6): 1173-1184.
[2]	陆淼嘉, 黄承媛, 滕靖. 基于多智能体的网购生鲜无人车配送调度仿真[J]. 系统仿真学报, 2022, 34(6): 1185-1195.
[3]	陈斌, 刘悦, 杨亚磊. 基于STN的机场航班过站保障时间协同规划建模[J]. 系统仿真学报, 2022, 34(6): 1196-1207.
[4]	窦欣宇, 陈晓辉, 梁德群, 林彬. 一种高谱效海上甚高频通信技术及其仿真研究[J]. 系统仿真学报, 2022, 34(6): 1208-1218.
[5]	段绍米, 罗会龙, 刘海鹏. 人群搜索和樽海鞘群的混合算法优化PID参数[J]. 系统仿真学报, 2022, 34(6): 1230-1246.
[6]	杨凯, 陈纯毅, 胡小娟, 于海洋. 蒙卡渲染画面多特征非局部均值滤波降噪算法[J]. 系统仿真学报, 2022, 34(6): 1259-1266.
[7]	周培培, 侯幸林. 一种用于图像融合的无监督深度神经网络[J]. 系统仿真学报, 2022, 34(6): 1267-1274.
[8]	陈麒, 崔昊杨. 基于改进鸽群层级的无人机集群视觉巡检模型[J]. 系统仿真学报, 2022, 34(6): 1275-1285.
[9]	王沐晴, 张磊, 范秀敏, 骆晓萌, 朱文敏. VR外设驱动的虚拟人姿态优化仿真方法[J]. 系统仿真学报, 2022, 34(6): 1296-1303.
[10]	程鹏, 张文柱, 谢书翰, 杨子轩. 基于移动边缘计算的车联网任务卸载研究与仿真[J]. 系统仿真学报, 2022, 34(6): 1304-1311.
[11]	陆承, 靳学胜. 基于Steam VR的交互仿真水枪灭火训练系统设计[J]. 系统仿真学报, 2022, 34(6): 1312-1319.
[12]	高宏鼐, 付丽疆, 夏倩, 郭亚. 可观测度在光合作用模型性能评估中的应用[J]. 系统仿真学报, 2022, 34(6): 1330-1342.
[13]	倪凌佳, 黄晓霞, 李红旮, 张子博. 基于协作式深度强化学习的火灾应急疏散仿真研究[J]. 系统仿真学报, 2022, 34(6): 1353-1366.
[14]	孙一铃, 陈谊, 单桂华, 李晓兴. 基于AR技术的多人互动地球仪系统[J]. 系统仿真学报, 2022, 34(6): 1367-1374.
[15]	蒙盾, 胡卓, 张华军. 基于改进A^*算法的多层邮轮疏散系统仿真[J]. 系统仿真学报, 2022, 34(6): 1375-1382.