基于上下文语境传播的多媒体语义标注改善

doi:10.16182/j.issn1004731x.joss.201611029

系统仿真学报 ›› 2016, Vol. 28 ›› Issue (11): 2860-2867.doi: 10.16182/j.issn1004731x.joss.201611029

基于上下文语境传播的多媒体语义标注改善

田枫, 尚福华

东北石油大学计算机与信息技术学院,大庆 163318;

收稿日期:2016-04-30 修回日期:2016-07-14 出版日期:2016-11-08 发布日期:2020-08-13
第一作者简介:田枫(1980-), 男, 黑龙江安达, 博士, 副教授, 研究方向为多媒体理解; 尚福华(通讯作者1962-), 男, 吉林延吉, 教授, 博士, 研究方向为机器学习。
基金资助:
国家自然科学基金(61502094, 61402099); 黑龙江省自然科学基金(F2016002, F2015020); 黑龙江省教育科学规划重点课题(GJB1215019)

Multimedia Annotation Refinement Based on Contextual Information Diffusion

Tian Feng, Shang Fuhua

School of Computer and Information Technology, Northeast Petroleum University, Daqing 163318, China

Received:2016-04-30 Revised:2016-07-14 Online:2016-11-08 Published:2020-08-13

摘要/Abstract

摘要： 提出了一种数据驱动的多媒体对象标注改善方法,利用数据集蕴含的丰富语境相关信息对基本多媒体对象标注结果进行优化。以标签为节点,相关度为边,构造标签语境相关图,实现概念空间上的相关性传播;将多媒体对象内容特征和文本模态特征互增强过程集成为一个优化框架,通过近似求解策略,实现上下文语境信息传播。该方法充分利用了标签的上下文相关性和多媒体对象的内容相关性。数据集上的实验结果表明,该方法可大幅度提升标注性能。

关键词: 多媒体标注, 语义标注, 语义改善, 语境传播

Abstract: A data driven multimedia annotation refinement method based on dataset contextual information diffusion was proposed. The label contextual graph was constructed, and the label correlation can be diffused on textual label space; Multimedia object content relevant graph was constructed. Label contextual graph and multimedia object content relevant graph were mutually reinforced and formulated into a regularized framework. The proposed method incorporated both multimedia content correlation and label contextual information, and the optimization process was solved by approximate solution algorithm. The experimental results on real world dataset show that the proposed method can obviously improve the annotation performance.

Key words: multimedia annotation, semantic annotation, annotation refinement, contextual diffusion

中图分类号:

TP391

田枫,尚福华 . 基于上下文语境传播的多媒体语义标注改善[J]. 系统仿真学报, 2016, 28(11): 2860-2867.

Tian Feng,Shang Fuhua . Multimedia Annotation Refinement Based on Contextual Information Diffusion[J]. Journal of System Simulation, 2016, 28(11): 2860-2867.

参考文献 15

[1]	Jin Y H, Khan L, Wang L.Image annotations by combining multiple evidence & Wordnet[C]// Proceedings of the 13th annual ACM international conference on Multimedia. New York, USA: ACM, 2005: 706-715.
[2]	Jin YH, Khan L, Prabhakaran B.Knowledge Based Image Annotation Refinement[J]. Journal of Signal Processing Systems, 2010, 58(3): 387-406.
[3]	Wang CH, Feng J, Zhang L, et al.Image annotation refinement using random walk with restarts[C]// Proceedings of the ACM International Conference on Multimedia. New York, USA: ACM, 2006: 647-650.
[4]	Wang CH, Feng J, Zhang L, et al.Content-Based Image Annotation Refinement[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2007: 1-8.
[5]	Li XR, Snoek C.G.M, Worring M. Learning social tag relevance by neighbor voting[C]// IEEE Transactions on Multimedia. USA: IEEE, 2009: 1310-1322
[6]	Chen L, Xu D, Tsang IW.Tag-based Web Photo Retrieval Improved by Batch Mode Re-Tagging[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2010: 3440-3446.
[7]	Liu D, Hua XC, Yang LJ, et al.Tag ranking[C]// Proceedings of the Intenational World Wide Web Conference. New York, USA: ACM, 2009: 351-360.
[8]	Xu H, Wang JD, Hua XS.Tag Refinement by Regularized LDA [C]// Proceedings of the ACM Multimedia Conference. New York, USA: ACM Press, 2009: 573-576.
[9]	Zhu GY, Yan SC, Ma Y.Image tag refinement towards low-rank, content-tag prior and error sparsity [C]// Proceedings of the ACM Multimedia Conference. New York, USA: ACM Press, 2010: 461-470.
[10]	Wang H, Huang H, Ding C.Image annotation using multi-label correlated Green's function[C]// Proceedings of IEEE International Conference on Computer Vision. Piscataway, NJ, USA: IEEE Computer Society, 2009: 1-8
[11]	Wang H, Huang H, Ding C.Multi-label Feature Transform for Image Classifications [C]// Proceedings of European Conference on Computer Vision. Berlin, Germany: Springer Press, 2010: 793-806.
[12]	Wang H, Huang H, Ding C.Image Annotation Using Bi-Relational Graph of Images and Semantic Labels[C]// IEEE Conference on Computer Vision and Pattern Recognition, Piscataway, NJ, USA: IEEE Computer Society, 2011: 793-800.
[13]	Xiang Y, Zhou XD, Liu ZT, et al.Semantic context modeling with maximal margin conditional random fields for automatic image annotation[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2010: 3368-3375.
[14]	Chua TS, Tang JH, Hong RH.NUS-WIDE: A real-world web image database from national university of singapore[C]// Proceedings of ACM Conference on Image and Video Retrieval. New York, USA: ACM, 2009: 1-9.
[15]	Huiskes M J, Lew M S.The MIR Flickr retrieval evaluation[C]// Proceedings of the ACM Intenational Conference on Multimedia Information Retrieval. New York, USA: ACM, 2008: 39-43.

基于上下文语境传播的多媒体语义标注改善

Multimedia Annotation Refinement Based on Contextual Information Diffusion

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献 15

相关文章 15

编辑推荐

Metrics

本文评价

[1]	黄涛, 张智, 丁玉杰, 陈艳波, 王晶, 张文倩. 考虑动态频率安全与N-k故障的鲁棒应急调度方法[J]. 系统仿真学报, 2025, 37(12): 2981-2993.
[2]	张润昭, 陈艳波, 黄涛, 田昊欣, 强涂奔, 张智. 基于异构负荷特征解析预测的虚拟电厂调度方法[J]. 系统仿真学报, 2025, 37(12): 2994-3006.
[3]	于祥星, 赵艳东, 张宝琳. 基于电涡流NES的海上风机塔架振动控制[J]. 系统仿真学报, 2025, 37(12): 3007-3017.
[4]	李斌, 王于绰. 基于多策略融合的光伏系统故障诊断方法[J]. 系统仿真学报, 2025, 37(12): 3018-3032.
[5]	李孝斌, 胡冰, 尹超, 李波, 马军. 基于时空图卷积的汽车配件供应链需求预测与仿真分析[J]. 系统仿真学报, 2025, 37(12): 3060-3074.
[6]	彭艺, 雷云揆, 杨青青, 李辉, 王健明. 改进PID搜索算法的山地环境无人机路径规划[J]. 系统仿真学报, 2025, 37(12): 3075-3086.
[7]	伍枢珩, 刘永奎, 张霖, 肖莹莹, 王力翚. 基于改进YOLOv8的轻量级装配工件检测算法[J]. 系统仿真学报, 2025, 37(12): 3099-3111.
[8]	陈逸, 邱思航, 朱正秋, 季雅泰, 赵勇, 鞠儒生. 基于启发式的人-大模型协作寻源方法[J]. 系统仿真学报, 2025, 37(12): 3112-3127.
[9]	任亮, 周泽榕, 马云峰. “货到人”系统订单拣选和分拣协同优化问题[J]. 系统仿真学报, 2025, 37(12): 3128-3139.
[10]	索婧怡, 卢柏宏, 屈澈. 影视LED光源光强分布测定及其在游戏引擎中的仿真研究[J]. 系统仿真学报, 2025, 37(12): 3140-3151.
[11]	龚建兴, 胡海, 任海慧, 吴瑞祥. 面向虚实结合的军事训练系统互操作模型与运用[J]. 系统仿真学报, 2025, 37(12): 3161-3175.
[12]	徐智霞, 王蕊, 孙楠, 何兵, 沈晓卫, 朱晓菲. 基于改进遗传算法的协同干扰资源分配问题研究[J]. 系统仿真学报, 2025, 37(12): 3176-3189.
[13]	刘翔, 金乾坤. 基于PAC-Bayes的多目标强化学习A2C算法研究[J]. 系统仿真学报, 2025, 37(12): 3212-3223.
[14]	杨兰英, 李超, 邹海锋, 万江涛, 张仁强, 刘惠, 卢宏. 基于改进蚁群算法与A*算法相融合的机器人路径规划优化[J]. 系统仿真学报, 2025, 37(11): 2956-2965.
[15]	苏筱婷, 张小威, 田义, 李奇, 王帅豪. 星光导航动态仿真场景时序设计方法研究[J]. 系统仿真学报, 2025, 37(11): 2946-2955.