一种基于多模态数据自组织的城市移动增强现实方法

doi:10.16182/j.issn1004731x.joss.201711005

系统仿真学报 ›› 2017, Vol. 29 ›› Issue (11): 2629-2636.doi: 10.16182/j.issn1004731x.joss.201711005

一种基于多模态数据自组织的城市移动增强现实方法

官万先¹, 李万鹏², 葛林², 万华根²

1.浙江大学计算机系统结构研究所,杭州 310027;
2.浙江大学CAD & CG国家重点实验室,杭州 310058

收稿日期:2015-05-31 发布日期:2020-06-05
作者简介:官万先(1992-),男,浙江,硕士生,研究方向为计算机视觉、机器学习;李万鹏(1990-),男,广西,壮族,硕士生,研究方向为计算机图形学。
基金资助:
国家自然科学基金(61272299),国家863计划(2013AA013802)

Urban Mobile Augmented Reality Method Based on Self Organization of Multi-Modal Data

Guan Wanxian¹, Li Wanpeng², Ge Lin², Wan Huagen²

1. Advanced Computing and System Laboratory, Zhejiang University, Hangzhou, 310027, China;
2. State Key Lab of CAD&CG, Zhejiang University, Hangzhou, 310058, China

Received:2015-05-31 Published:2020-06-05

摘要/Abstract

摘要： 城市移动增强现实近年来受到研究界和应用界的高度关注。然而面对城市大场景,如何采集数据、合理管理和组织数据、以及高效利用数据成为了制约移动增强现实系统性能的重要问题。以城市街景增强为应用背景,提出一种基于多模态数据自组织的城市移动增强现实方法。通过以面向移动增强现实系统的多模态数据为中心,从数据采集、数据组织、数据使用三方面出发,研究如何有效获取和处理原始数据、合理组织数据、高效准确使用数据。实验结果验证了所提出方法的有效性和实用性。

关键词: 移动增强现实, 多模态数据, 数据自组织, 信息检索

Abstract: In recent years, urban mobile augmented reality has important application prospects. However, with the large-scale scenes in the cities, how to collect and reasonably manage and organize as well as efficiently use the big data sets has become an important issue for the performance of mobile augmented reality. To solve this problem, this paper proposed an urban mobile augmented reality method based on the free organization of multi-modal data, with the application scenario of urban streetscape enhancement. The proposed method takes the multi-modal data as the centric context and aims at how to acquire and process raw data effectively, organize data reasonably, and use data efficiently and accurately. The validity and practicability of the proposed method are verified through the experiment results.

Key words: mobile augmented reality, multi-modal data, free data organization, information retrieval

中图分类号:

TP391.9

官万先, 李万鹏, 葛林, 万华根. 一种基于多模态数据自组织的城市移动增强现实方法[J]. 系统仿真学报, 2017, 29(11): 2629-2636.

Guan Wanxian, Li Wanpeng, Ge Lin, Wan Huagen. Urban Mobile Augmented Reality Method Based on Self Organization of Multi-Modal Data[J]. Journal of System Simulation, 2017, 29(11): 2629-2636.

参考文献

[1] Van Krevelen D W F, Poelman R. A survey of augmented reality technologies, applications and limitations[J]. International Journal of Virtual Reality (S1081-1451), 2010, 9(2): 1.
[2] Langlotz T, Degendorfer C, Mulloni A, et al.Robust detection and tracking of annotations for outdoor augmented reality browsing[J]. Computers & graphics (S0097-8493), 2011, 35(4): 831-840.
[3] Takacs G, Chandrasekhar V, Gelfand N, et al.Outdoors augmented reality on mobile phone using loxel-based visual feature organization[C]//Proceedings of the 1st ACM international conference on Multimedia information retrieval. ACM, 2008: 427-434.
[4] Belimpasakis P, You Y, Selonen P.Enabling rapid creation of content for consumption in mobile augmented reality[C]//Next Generation Mobile Applications, Services and Technologies (NGMAST), 2010 Fourth International Conference on. IEEE, 2010: 1-6.
[5] Höllerer T, Feiner S, Terauchi T, et al.Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system[J]. Computers & Graphics (S0097-8493), 1999, 23(6): 779-785.
[6] Rekimoto J.Matrix: A realtime object identification and registration method for augmented reality[C]//Computer Human Interaction, 1998. Proceedings. 3rd Asia Pacific. IEEE, 1998: 63-68.
[7] 葛林, 庄晓斌, 华炜, 等. 面向城市增强现实的高融合度信息标注方法[J]. 系统仿真学报, 2014, 26(9): 2015-2022.
GE L, ZHUANG X B, HUA W, et al.High Fusion Information Annotation Method for City Augmented Reality[J]. Journal of System Simulation, 2014, 26(9): 2015-2022.
[8] 史鸿志, 丁杨子, 罗国明, 等. 具有空间一致性的集成式混合现实三维用户创作工具[J]. 计算机辅助设计与图形学学报, 2013, 25(6): 918-923.
SHI H Z, DING Y Z, LUO G M, et al.An Integrated Mixed Reality 3D Authoring Tool with Spatial Consistency[J]. Journal of Computer-Aided Design, 2013, 25(6): 918-923.
[9] Chal Schall G, Wagner D, Reitmayr G, et al.Global pose estimation using multi-sensor fusion for outdoor augmented reality[C]// Mixed and Augmented Reality, ISMAR 2009. 8th IEEE International Symposium, 2009: 153-162.
[10] Henrysson A, Ollila M.UMAR: Ubiquitous mobile augmented reality[C]// Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia, 2004: 41-45.
[11] Menzel JR, Königs M, Kobbelt L.A framework for vision-based mobile ar applications[C]// Proceedings of the Workshop on Mobile Vision and HCI (MobiVis). Held in Conjunction with Mobile HCI, 2012.
[12] You Y, Fan L, Mattila VV, et al.In-situ web mashup and hypermedia support for mobile vision-based ar applications[C]// Green Computing and Communications (GreenCom), 2013 IEEE and Internet of Things (iThings/CPSCom), IEEE International Conference on and IEEE Cyber, Physical and Social Computing, 2013: 797-803.
[13] Wu C.SiftGPU: A GPU implementation of scale invariant feature transform (SIFT)[J]. 2007 在线出版.
[14] 刘鑫, 许华荣. 基于GPU的特征点提取与匹配算法比较[J]. 计算机辅助设计与图形学学报, 2013, 25(10): 1496-1502.
LIU X, XU H R.A Comparison of Image Feature Detection and Matching on CPU and GPU Implementation[J]. Journal of Computer-Aided Design, 2013, 25(10): 1496-1502.

一种基于多模态数据自组织的城市移动增强现实方法

Urban Mobile Augmented Reality Method Based on Self Organization of Multi-Modal Data

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

本文评价

[1]	侯守明, 葛倩, 刘彦彦. 基于MAR的非物质文化遗产数字化保护系统研究[J]. 系统仿真学报, 2021, 33(6): 1334-1341.
[2]	张志利, 王超, 龙勇, 王韶迪. 基于移动增强现实的双机协同仿真[J]. 系统仿真学报, 2019, 31(4): 608-617.