基于上下文语境传播的多媒体语义标注改善

doi:10.16182/j.issn1004731x.joss.201611029

系统仿真学报 ›› 2016, Vol. 28 ›› Issue (11): 2860-2867.doi: 10.16182/j.issn1004731x.joss.201611029

基于上下文语境传播的多媒体语义标注改善

田枫, 尚福华

东北石油大学计算机与信息技术学院,大庆 163318;

收稿日期:2016-04-30 修回日期:2016-07-14 出版日期:2016-11-08 发布日期:2020-08-13
第一作者简介:田枫(1980-), 男, 黑龙江安达, 博士, 副教授, 研究方向为多媒体理解; 尚福华(通讯作者1962-), 男, 吉林延吉, 教授, 博士, 研究方向为机器学习。
基金资助:
国家自然科学基金(61502094, 61402099); 黑龙江省自然科学基金(F2016002, F2015020); 黑龙江省教育科学规划重点课题(GJB1215019)

Multimedia Annotation Refinement Based on Contextual Information Diffusion

Tian Feng, Shang Fuhua

School of Computer and Information Technology, Northeast Petroleum University, Daqing 163318, China

Received:2016-04-30 Revised:2016-07-14 Online:2016-11-08 Published:2020-08-13

摘要/Abstract

摘要： 提出了一种数据驱动的多媒体对象标注改善方法,利用数据集蕴含的丰富语境相关信息对基本多媒体对象标注结果进行优化。以标签为节点,相关度为边,构造标签语境相关图,实现概念空间上的相关性传播;将多媒体对象内容特征和文本模态特征互增强过程集成为一个优化框架,通过近似求解策略,实现上下文语境信息传播。该方法充分利用了标签的上下文相关性和多媒体对象的内容相关性。数据集上的实验结果表明,该方法可大幅度提升标注性能。

关键词: 多媒体标注, 语义标注, 语义改善, 语境传播

Abstract: A data driven multimedia annotation refinement method based on dataset contextual information diffusion was proposed. The label contextual graph was constructed, and the label correlation can be diffused on textual label space; Multimedia object content relevant graph was constructed. Label contextual graph and multimedia object content relevant graph were mutually reinforced and formulated into a regularized framework. The proposed method incorporated both multimedia content correlation and label contextual information, and the optimization process was solved by approximate solution algorithm. The experimental results on real world dataset show that the proposed method can obviously improve the annotation performance.

Key words: multimedia annotation, semantic annotation, annotation refinement, contextual diffusion

中图分类号:

TP391

田枫,尚福华 . 基于上下文语境传播的多媒体语义标注改善[J]. 系统仿真学报, 2016, 28(11): 2860-2867.

Tian Feng,Shang Fuhua . Multimedia Annotation Refinement Based on Contextual Information Diffusion[J]. Journal of System Simulation, 2016, 28(11): 2860-2867.

参考文献 15

[1]	Jin Y H, Khan L, Wang L.Image annotations by combining multiple evidence & Wordnet[C]// Proceedings of the 13th annual ACM international conference on Multimedia. New York, USA: ACM, 2005: 706-715.
[2]	Jin YH, Khan L, Prabhakaran B.Knowledge Based Image Annotation Refinement[J]. Journal of Signal Processing Systems, 2010, 58(3): 387-406.
[3]	Wang CH, Feng J, Zhang L, et al.Image annotation refinement using random walk with restarts[C]// Proceedings of the ACM International Conference on Multimedia. New York, USA: ACM, 2006: 647-650.
[4]	Wang CH, Feng J, Zhang L, et al.Content-Based Image Annotation Refinement[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2007: 1-8.
[5]	Li XR, Snoek C.G.M, Worring M. Learning social tag relevance by neighbor voting[C]// IEEE Transactions on Multimedia. USA: IEEE, 2009: 1310-1322
[6]	Chen L, Xu D, Tsang IW.Tag-based Web Photo Retrieval Improved by Batch Mode Re-Tagging[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2010: 3440-3446.
[7]	Liu D, Hua XC, Yang LJ, et al.Tag ranking[C]// Proceedings of the Intenational World Wide Web Conference. New York, USA: ACM, 2009: 351-360.
[8]	Xu H, Wang JD, Hua XS.Tag Refinement by Regularized LDA [C]// Proceedings of the ACM Multimedia Conference. New York, USA: ACM Press, 2009: 573-576.
[9]	Zhu GY, Yan SC, Ma Y.Image tag refinement towards low-rank, content-tag prior and error sparsity [C]// Proceedings of the ACM Multimedia Conference. New York, USA: ACM Press, 2010: 461-470.
[10]	Wang H, Huang H, Ding C.Image annotation using multi-label correlated Green's function[C]// Proceedings of IEEE International Conference on Computer Vision. Piscataway, NJ, USA: IEEE Computer Society, 2009: 1-8
[11]	Wang H, Huang H, Ding C.Multi-label Feature Transform for Image Classifications [C]// Proceedings of European Conference on Computer Vision. Berlin, Germany: Springer Press, 2010: 793-806.
[12]	Wang H, Huang H, Ding C.Image Annotation Using Bi-Relational Graph of Images and Semantic Labels[C]// IEEE Conference on Computer Vision and Pattern Recognition, Piscataway, NJ, USA: IEEE Computer Society, 2011: 793-800.
[13]	Xiang Y, Zhou XD, Liu ZT, et al.Semantic context modeling with maximal margin conditional random fields for automatic image annotation[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2010: 3368-3375.
[14]	Chua TS, Tang JH, Hong RH.NUS-WIDE: A real-world web image database from national university of singapore[C]// Proceedings of ACM Conference on Image and Video Retrieval. New York, USA: ACM, 2009: 1-9.
[15]	Huiskes M J, Lew M S.The MIR Flickr retrieval evaluation[C]// Proceedings of the ACM Intenational Conference on Multimedia Information Retrieval. New York, USA: ACM, 2008: 39-43.

基于上下文语境传播的多媒体语义标注改善

Multimedia Annotation Refinement Based on Contextual Information Diffusion

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献 15

相关文章 15

编辑推荐

Metrics

本文评价

[1]	董志明, 胡忠奇, 戴浩然, 高建成. 基于大语言模型的作战仿真想定自动化生成方法[J]. 系统仿真学报, 2026, 38(5): 1129-1145.
[2]	李校男, 晁涛, 马萍, 杨明, 王玉轩. 基于期望最大化方法的非线性SSM黑箱鲁棒辨识[J]. 系统仿真学报, 2026, 38(5): 1146-1158.
[3]	刘银钢, 马明, 张荣华. 基于大语言模型的兵棋推演动态任务规划[J]. 系统仿真学报, 2026, 38(5): 1187-1204.
[4]	苏泓嘉, 张成, 刘飞. 基于模糊功能依赖网分析的体系效能评估方法[J]. 系统仿真学报, 2026, 38(5): 1224-1238.
[5]	梅华威, 杨鹏慧, 余洋. 计及数据漂移改进PatchTST的超短期光伏功率预测[J]. 系统仿真学报, 2026, 38(5): 1239-1254.
[6]	李权, 苏鹏, 万海英, 张承玺, 何志坚, 倪艺洋, 赵忠盖, 刘飞. 基于多阶段LHS-EPRCC方法的青霉素发酵过程建模[J]. 系统仿真学报, 2026, 38(5): 1255-1276.
[7]	周子聪, 曾俊杰, 胡越, 朱正秋, 尹全军. 基于次优示例引导的兵棋推演多智能体强化学习方法[J]. 系统仿真学报, 2026, 38(5): 1277-1289.
[8]	石敏, 郭诗盛, 王素琴, 李兆歆, 朱登明. 融合物理与几何先验的无抓取标注6-DoF抓取检测方法[J]. 系统仿真学报, 2026, 38(5): 1290-1302.
[9]	姜彦吉, 肖星佚, 董浩, 于淼, 黄金山, 刘大千, 费博雯. 融合点线特征的图关系优化3D车道线检测方法[J]. 系统仿真学报, 2026, 38(5): 1303-1319.
[10]	张鑫, 张平, 张琛, 刘威, 韩博阳. 非均质土壤条件下挖掘阻力计算模型研究[J]. 系统仿真学报, 2026, 38(5): 1320-1332.
[11]	陶冶, 汤锦辉, 周臣, 王冲. 基于图像表征与特征协同感知的航迹补全方法研究[J]. 系统仿真学报, 2026, 38(5): 1333-1349.
[12]	王伟, 刘东, 崔新豪, 李博, 肖依永, 任羿. 复杂项目多级动态挣值管理数字化模型及应用[J]. 系统仿真学报, 2026, 38(5): 1350-1364.
[13]	彭莉峻, 苏庭琪, 刘沛津, 何林, 周协武, 张闽心. 融合人体关键点的实验室PPE规范穿戴检测方法[J]. 系统仿真学报, 2026, 38(5): 1365-1382.
[14]	滕靖, 童文聪, 张中杰, 姚幸, 李君羡. 有轨电车交叉口速度自动引导方法及仿真评价[J]. 系统仿真学报, 2026, 38(5): 1426-1439.
[15]	范双豪, 何芳, 赵建伟, 胡豪杰, 朱丰超, 李向阳. 基于窗口重构协同表示的高光谱异常检测算法[J]. 系统仿真学报, 2026, 38(5): 1440-1452.