基于用户生成标签的多视角特征学习方法

系统仿真学报 ›› 2016, Vol. 28 ›› Issue (10): 2362-2368.

基于用户生成标签的多视角特征学习方法

田枫¹, 尚福华¹, 刘卓炫¹, 沈旭昆²

1.东北石油大学计算机与信息技术学院,大庆 163318;
2.北京航空航天大学虚拟现实技术与系统国家重点实验室,北京 100191

收稿日期:2016-04-28 修回日期:2016-07-14 出版日期:2016-10-08 发布日期:2020-08-13
作者简介:田枫(1980-),男,黑龙江,博士,副教授,研究方向为多媒体理解;尚福华(通讯作者1962-),男,黑龙江,博士,教授,研究方向为机器学习。
基金资助:
国家自然科学基金(61502094,61402099); 黑龙江省自然科学基金(F2016002,F2015020); 黑龙江省教育科学规划重点课题(GJB1215019)

Multi-View Feature Learning Based on User Contributed Tag

Tian Feng¹, Shang Fuhua¹, Liu Zhuoxuan¹, Shen Xukun²

1. School of Computer and Information Technology, Northeast Petroleum University, Daqing 163318, China;
2. The State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China

Received:2016-04-28 Revised:2016-07-14 Online:2016-10-08 Published:2020-08-13

摘要/Abstract

摘要： 提出了一种基于用户生成标签的多视角特征学习方法。采用词袋模型分别得到媒体的内容特征表示和标签特征表示;通过媒体词汇和文本词汇的相关性建模,学习文本特征空间和内容特征空间的映射模型。在此基础上,给出了优化前后的特征表示具备近似等距映射保持的理论依据。该方法相对数据集规模具备线性时间复杂度,适用于大规模数据集,具备多视角特征融合能力。基准数据集上测试表明,优化后的特征表示较特征拼接和相关成分分析等方法鉴别力更强。

关键词: 多视角特征, 多视角学习, 用户生成标签, 特征学习

Abstract: A multi-view feature learning method based on user contributed tag was proposed. Bag-of-words representation for content feature and textual feature was learned. A multi-view feature learning framework was proposed to explicitly model the relevance between multimedia object and tags by learning a linear mapping from textual representation to visual representation. The learned feature encoded the information conveyed by original feature, and inner products of leaned features were preserved with a high probability with visual features and textual features. The complexity of the method is linear with respect to the size of dataset. Furthermore, the method can be extended to deal with more than two views. The performance of the proposed method indicts it’s superiority over other representative method.

Key words: multi-view feature, multi-view learning, user contributed tag, feature learning

中图分类号:

TP391

田枫, 尚福华, 刘卓炫, 沈旭昆. 基于用户生成标签的多视角特征学习方法[J]. 系统仿真学报, 2016, 28(10): 2362-2368.

Tian Feng, Shang Fuhua, Liu Zhuoxuan, Shen Xukun. Multi-View Feature Learning Based on User Contributed Tag[J]. Journal of System Simulation, 2016, 28(10): 2362-2368.

参考文献 35

[1]	Guyon I, Elisseeff A.An introduction to variable and feature selection[J]. The Journal of Machine Learning Research (S1532-4435), 2003, 3(9): 1157-1182.
[2]	Lanckriet G R G, Cristianini N, Bartlett P, et al. Learning the kernel matrix with semidefinite programming[J]. The Journal of Machine Learning Research (S1532-4435), 2002, 5(1): 323-330.
[3]	Vedaldi A, Gulshan V, Varma M, et al.Multiple kernels for object detection[C]// Computer Vision, 2009 IEEE 12th International Conference on. USA: IEEE, 2009: 606-613.
[4]	Wang S, Jiang S, Huang Q, et al.S3MKL: scalable semi-supervised multiple kernel learning for image data mining[C]// Proceedings of the international conference on Multimedia. USA: ACM, 2010: 163-172.
[5]	Xu Z, King I, Lyu M R T, et al. Discriminative semi-supervised feature selection via manifold regularization[J]. Neural Networks, IEEE Transactions on (S1045-9227), 2010, 21(7): 1033-1047.
[6]	Xing E P, Karp R M.CLIFF: clustering of high-dimensional microarray data via iterative feature filtering using normalized cuts[J]. Bioinformatics (S1367-4803), 2001, 17(S1): 306-315.
[7]	Cai D, Zhang C, He X.Unsupervised feature selection for multi-cluster data[C]// Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery And Data Mining. USA: ACM, 2010: 333-342.
[8]	Zhang S T, Huang J Z, Huang Y C, et al.Automatic image annotation using group sparsity[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Piscataway, NJ, USA: IEEE Computer Society, 2010: 3312-3319.
[9]	Wu F, Han Y H, Tian Q, et al.Multi-label Boosting for image annotation by structural grouping sparsity[C]// Proceedings of the ACM Multimedia International Conference. New York, USA: ACM, 2010: 15-24.
[10]	Yang Y, Yang Y, Huang Z, et al.Tag localization with spatial correlations and joint group sparsity[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE Computer Society, 2011: 881-888.
[11]	Yang Y, Xu D, Nie F, et al.Ranking with local regression and global alignment for cross media retrieval[C]// Proceedings of the 17th ACM international conference on Multimedia. USA: ACM, 2009: 175-184.
[12]	Zhuang Y T, Yang Y, Wu F.Mining semantic correlation of heterogeneous multimedia data for cross-media retrieval[J]. Multimedia, IEEE Transactions on (S1520-9210), 2008, 10(2): 221-229.
[13]	Yang Y, Zhuang Y T, Wu F, et al.Harmonizing hierarchical manifolds for multimedia document semantics understanding and cross-media retrieval[J]. Multimedia, IEEE Transactions on (S1520-9210), 2008, 10(3): 437-446.
[14]	Wu P, Hoi S C H, Xia H, et al. Online multimodal deep similarity learning with application to image retrieval[C]// Proceedings of the 21st ACM International Conference on Multimedia. USA: ACM, 2013: 153-162.
[15]	Xia H, Wu P, Hoi S C H. Online multi-modal distance learning for scalable multimedia retrieval[C]// Proceedings of the sixth ACM international conference on Web search and data mining. USA: ACM, 2013: 455-464.
[16]	Zhai X, Peng Y, Xiao J.Effective heterogeneous similarity measure with nearest neighbors for cross-media retrieval[M]. Germany: Springer Berlin Heidelberg, 2012: 312-322.
[17]	Zhai X, Peng Y, Xiao J.Cross-modality correlation propagation for cross-media retrieval[C]// Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on. USA: IEEE, 2012: 2337-2340.
[18]	Guillaumin M, Mensink T, Verbeek J, et al.Tagprop: Discriminative metric learning in nearest neighbor models for image auto-annotation[C]// Proceedings of Intel Conference on Computer Vision. Piscataway, NJ, USA: Institute of Electrical and Electronics Engineers Inc, 2009: 309-316.
[19]	Verbeek J, Guillaumin M, Mensink T, et al.Image annotation with TagProp on the MIRFLICKR set[C]// Proceedings of the ACM SIGMM Intel Conference on Multimedia Information Retrieval. New York, USA: ACM, 2010: 537-546.
[20]	Li Z, Liu J, Jiang Y, et al.Low rank metric learning for social image retrieval[C]// Proceedings of the 20th ACM international conference on Multimedia. USA: ACM, 2012: 853-856.
[21]	Hotelling H.Relations Between Two Sets of Variates[M]. Breakthroughs in Statistics. USA: Springer New York, 1992: 321-377.
[22]	Kidron E, Schechner Y Y, Elad M.Pixels that sound[C]// Computer Vision and Pattern Recognition, IEEE Computer Society Conference on. USA: IEEE, 2005, 1: 88-95.
[23]	Bredin H, Chollet G.Audio-visual speech synchrony measure for talking-face identity verification[C]// Acoustics, Speech and Signal Processing, IEEE International Conference on. USA: IEEE, 2007, 2: 233-236.
[24]	Blaschko M B, Lampert C H.Correlational spectral clustering[C]// Computer Vision and Pattern Recognition, IEEE Conference on. USA: IEEE, 2008: 1-8.
[25]	Torres D A, Turnbull D, Barrington L, et al.Identifying Words that are Musically Meaningful[C]// International Conference on Music Information Retrieval. Sydney: Austrian Computer Society, 2007, 7: 405-410.
[26]	Torres D A, Turnbull D, Sriperumbudur B K, et al.Finding musically meaningful words by sparse CCA[C]// Neural Information Processing Systems (NIPS) Workshop on Music, the Brain and Cognition, Germany: Springer Berlin Heidelberg, 2007: 1-8.
[27]	Rai P, Daume H.Multi-label prediction via sparse infinite CCA[C]// Advances in Neural Information Processing Systems, Germany: Springer Berlin Heidelberg, 2009: 1518-1526.
[28]	Hardoon D R, Shawe-Taylor J.Sparse canonical correlation analysis[J]. Machine Learning (S0885-6125), 2011, 83(3): 331-353.
[29]	庄凌, 庄越挺, 吴江琴, 等. 一种基于稀疏典型性相关分析的图像检索方法[J]. Journal of Software (S1000-9825), 2012, 23(5): 1295-1304.
[30]	Vempala S S.The random projection method[M]. American: American Mathematical Society, 2005: 312-322.
[31]	Duygulu P, Barnard K, Freitas JFG, et al.Object recognition as machine translation: learning a lexicon for a fixed image vocabulary [C]// Proceedings of the European Conference on Computer Vision. Berlin, Germany: Springer Press, 2002: 97-112.
[32]	Chua T S, Tang J H, Hong R H.NUS-WIDE: A real-world web image database from national university of singapore[C]// Proceedings of ACM Conference on Image and Video Retrieval. New York, USA: ACM, 2009: 1-9.
[33]	Lowe D G.Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision (S0920-5691), 2004, 60(2): 91-110.
[34]	Hotelling H.Analysis of a complex of statistical variables into principal components[J]. Journal of Educational Psychology (S2044-8279), 1933, 24(6): 417-441.
[35]	Fan R E, Chang K W, Hsieh C J, et al.LIBLINEAR: A library for large linear classification[J]. The Journal of Machine Learning Research (S1532-4435), 2008, 9(9): 1871-1874.