Research on Digital Protection System of Intangible Cultural Heritage Based on Mobile Augmented Reality Technology

doi:10.16182/j.issn1004731x.joss.20-0081

Abstract

Abstract: Aiming at the problem of the single form and poor interaction of intangible cultural heritage protection, a non-heritage digital online display system is designed and implemented based on mobile augmented reality technology. Taking clay sculpture non-heritage protection as an example, the main functional modules of the system cloud and mobile terminal are designed. Based on a combination of 3D scanning and iterative mesh simplification, a fast modeling method is proposed. ORB-FV and optical flow tracking algorithm are used for online recognition and tracking registration of images. The system is developed based on Unity3D. The test results show that, the system not only improves the realism and fluency non-heritage products on the mobile end display, but also implements the real-time interactive coloring and displaying function after enhanced display of the model, which enhances the fun and interaction of intangible heritage protection and dissemination.

Key words: intangible cultural heritage, mobile augmented reality, ORB-FV, Unity3D

CLC Number:

TP391.9

Hou Shouming, Ge Qian, Liu Yanyan. Research on Digital Protection System of Intangible Cultural Heritage Based on Mobile Augmented Reality Technology[J]. Journal of System Simulation, 2021, 33(6): 1334-1341.

References

[1] 邹湘军, 孙健, 何汉武,等. 虚拟现实技术的演变发展与展望[J]. 系统仿真学报, 2004, 16(9): 1905-1909.
Zou Xiangjun, Sun Jian, He Hanwu, et al.Evolution and Development of Virtual Reality Technology[J]. Journal of System Simulation, 2004, 16(9): 1905-1909.
[2] Gleue T.Design and Implementation of a Mobile Device for Outdoor Augmented Reality in the Archeoguide Project[C]// Conference on Virtual Reality, Archeology, and Cultural Heritage, Glyfada, Greece, November. DBLP, 2001: 161-168.
[3] Magnenat-Thalmann N, Papagiannakis G, Foni A, et al.Simulating Life in Ancient Sites using Mixed Reality Technology[J]. Francisco R Feito Higueruela (S1017-4656), 2004, CEIG04: 313-330.
[4] Han J, Park K, Ban K, et al.Cultural Heritage Sites Visualization System Based on Outdoor Augmented Reality[C]// Proceedings of the 2013 AASRI Conference on Intelligent Systems and Control (ISC 2013 V4). American Applied Sciences Research Institute, AASRI, 2013: 8.
[5] Younes G, Kahil R, Jallad M, et al. Virtual and Augmented Reality for Rich Interaction with Cultural Heritage Sites: A Case Study from the Roman Theater at Byblos[J]. Digital Applications in Archaeology and Cultural Heritage, 2017(5).
[6] 师国伟, 王涌天, 刘越, 等. 增强现实技术在文化遗产数字化保护中的应用[J]. 系统仿真学报, 2009, 21(7): 2090-2093.
Shi Guowei, Wang Yongtian, Liu Yue, et al.Application of Augmented Reality Technology to Digital Protection of Cultural Heritage[J]. Journal of System Simulation, 2009, 21(7): 2090-2093.
[7] 张世程. 手势识别与民族弓弦乐器虚拟演奏研究[D]. 杭州: 杭州师范大学, 2015.
Zhang Shicheng.Research on Gesture Recognition and Virtual Playing of Ethnic Bowed String Instruments [D]. Hangzhou: Hangzhou Normal University, 2015.
[8] 陶燎亮. 基于移动增强现实技术的非物质文化遗产数字化研究与应用——以龙泉青瓷为例[J]. 数字技术与应用, 2017(3): 112-113, 117.
Tao Liaoliang.Digital Research and Application of Intangible Cultural Heritage Based on Mobile Augmented Reality——A Case Study of Longquan Celadon[J]. Digital Technology and Application, 2017(3): 112-113, 117.
[9] 龚晨源, 赵忠波. 文化遗产的新时代保护方式[J]. 戏剧之家, 2019(7): 239.
Gong Chenyuan, Zhao Zhongbo.New Era Protection Method of Cultural Heritage[J]. The House of Drama, 2019(7): 239.
[10] Wang X Y, Lü D S. Research on Digital Protection of Cultural Heritage Dujiangyan[C]// Proceedings of the2019 3rd International Conference on Education, Culture and Social Development (ICECSD 2019).
[11] Yirci M, Ulusoy I.A Comparative Study on Polygonal Mesh Simplification Algorithms[C]// Signal Processing and Communications Applications Conference, 2009. SIU 2009. IEEE 17th. Antalya, Turkey: IEEE, 2009: 736-739.
[12] Uchida Y, Sakazawa S, Satoh S.Image Retrieval with Fisher Vectors of Binary Features[J]. ITE Transactions on Media Technology and Applications, 2016, 4(4): 23-28.
[13] Perronnin F, Mensink T.Improving the Fisher Kernel for Large-scale Image Classification[C]// European Conference on Computer Vision. Berlin, Heidelberg: Springer-Verlag, 2010: 143-156.
[14] Jaakkola T S, Haussler D.Exploiting Generative Models in Discriminative Classifiers[J]. Advances in Neural Information Processing Systems (S1049-5258), 1998, 11(11): 487-493.
[15] 陈泽婵, 陈靖, 严雷, 等. 基于Unity3D的移动增强现实光学实验平台[J]. 计算机应用, 2015, 35(S2): 194-199.
Chen Zechan, Chen Jing, Yan Lei, et al.Unity3D-based Mobile Optical Experiment Platform for Augmented Reality[J]. Journal of Computer Applications, 2015, 35(S2): 194-199.
[16] 何福本, 梁延德, 张红哲, 等. 增强现实技术在车削加工实训教学中的应用[J]. 实验技术与管理, 2017, 34(3): 127-129, 150.
He Fuben, Liang Yande, Zhang Hongzhe, et al.Application of Augmented Reality Technology in Turning Machining Training Teaching[J]. Experiment Technology and Management, 2017, 34(3): 127-129, 150.