Urban Mobile Augmented Reality Method Based on Self Organization of Multi-Modal Data

doi:10.16182/j.issn1004731x.joss.201711005

Abstract

Abstract: In recent years, urban mobile augmented reality has important application prospects. However, with the large-scale scenes in the cities, how to collect and reasonably manage and organize as well as efficiently use the big data sets has become an important issue for the performance of mobile augmented reality. To solve this problem, this paper proposed an urban mobile augmented reality method based on the free organization of multi-modal data, with the application scenario of urban streetscape enhancement. The proposed method takes the multi-modal data as the centric context and aims at how to acquire and process raw data effectively, organize data reasonably, and use data efficiently and accurately. The validity and practicability of the proposed method are verified through the experiment results.

Key words: mobile augmented reality, multi-modal data, free data organization, information retrieval

CLC Number:

TP391.9

Guan Wanxian, Li Wanpeng, Ge Lin, Wan Huagen. Urban Mobile Augmented Reality Method Based on Self Organization of Multi-Modal Data[J]. Journal of System Simulation, 2017, 29(11): 2629-2636.

References

[1] Van Krevelen D W F, Poelman R. A survey of augmented reality technologies, applications and limitations[J]. International Journal of Virtual Reality (S1081-1451), 2010, 9(2): 1.
[2] Langlotz T, Degendorfer C, Mulloni A, et al.Robust detection and tracking of annotations for outdoor augmented reality browsing[J]. Computers & graphics (S0097-8493), 2011, 35(4): 831-840.
[3] Takacs G, Chandrasekhar V, Gelfand N, et al.Outdoors augmented reality on mobile phone using loxel-based visual feature organization[C]//Proceedings of the 1st ACM international conference on Multimedia information retrieval. ACM, 2008: 427-434.
[4] Belimpasakis P, You Y, Selonen P.Enabling rapid creation of content for consumption in mobile augmented reality[C]//Next Generation Mobile Applications, Services and Technologies (NGMAST), 2010 Fourth International Conference on. IEEE, 2010: 1-6.
[5] Höllerer T, Feiner S, Terauchi T, et al.Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system[J]. Computers & Graphics (S0097-8493), 1999, 23(6): 779-785.
[6] Rekimoto J.Matrix: A realtime object identification and registration method for augmented reality[C]//Computer Human Interaction, 1998. Proceedings. 3rd Asia Pacific. IEEE, 1998: 63-68.
[7] 葛林, 庄晓斌, 华炜, 等. 面向城市增强现实的高融合度信息标注方法[J]. 系统仿真学报, 2014, 26(9): 2015-2022.
GE L, ZHUANG X B, HUA W, et al.High Fusion Information Annotation Method for City Augmented Reality[J]. Journal of System Simulation, 2014, 26(9): 2015-2022.
[8] 史鸿志, 丁杨子, 罗国明, 等. 具有空间一致性的集成式混合现实三维用户创作工具[J]. 计算机辅助设计与图形学学报, 2013, 25(6): 918-923.
SHI H Z, DING Y Z, LUO G M, et al.An Integrated Mixed Reality 3D Authoring Tool with Spatial Consistency[J]. Journal of Computer-Aided Design, 2013, 25(6): 918-923.
[9] Chal Schall G, Wagner D, Reitmayr G, et al.Global pose estimation using multi-sensor fusion for outdoor augmented reality[C]// Mixed and Augmented Reality, ISMAR 2009. 8th IEEE International Symposium, 2009: 153-162.
[10] Henrysson A, Ollila M.UMAR: Ubiquitous mobile augmented reality[C]// Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia, 2004: 41-45.
[11] Menzel JR, Königs M, Kobbelt L.A framework for vision-based mobile ar applications[C]// Proceedings of the Workshop on Mobile Vision and HCI (MobiVis). Held in Conjunction with Mobile HCI, 2012.
[12] You Y, Fan L, Mattila VV, et al.In-situ web mashup and hypermedia support for mobile vision-based ar applications[C]// Green Computing and Communications (GreenCom), 2013 IEEE and Internet of Things (iThings/CPSCom), IEEE International Conference on and IEEE Cyber, Physical and Social Computing, 2013: 797-803.
[13] Wu C.SiftGPU: A GPU implementation of scale invariant feature transform (SIFT)[J]. 2007 在线出版.
[14] 刘鑫, 许华荣. 基于GPU的特征点提取与匹配算法比较[J]. 计算机辅助设计与图形学学报, 2013, 25(10): 1496-1502.
LIU X, XU H R.A Comparison of Image Feature Detection and Matching on CPU and GPU Implementation[J]. Journal of Computer-Aided Design, 2013, 25(10): 1496-1502.