基于MAR的非物质文化遗产数字化保护系统研究

doi:10.16182/j.issn1004731x.joss.20-0081

系统仿真学报 ›› 2021, Vol. 33 ›› Issue (6): 1334-1341.doi: 10.16182/j.issn1004731x.joss.20-0081

基于MAR的非物质文化遗产数字化保护系统研究

侯守明¹, 葛倩¹, 刘彦彦²

1.河南理工大学计算机科学与技术学院,河南焦作 454003;
2.杭州师范大学阿里巴巴商学院,浙江杭州 311100

收稿日期:2020-02-21 修回日期:2020-04-27 出版日期:2021-06-18 发布日期:2021-06-23
作者简介:侯守明(1972-),男,博士,教授,主要从事计算机图形图像、虚拟现实与增强现实技术的研究与教学工作。E-mail：housm@163.com
基金资助:
国家重点研发项目(2018YFB1004900); 河南省科技攻关项目(172102210273,162102310090)

Research on Digital Protection System of Intangible Cultural Heritage Based on Mobile Augmented Reality Technology

Hou Shouming¹, Ge Qian¹, Liu Yanyan²

1. School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo 454003, China;
2. Alibaba Business School, Hangzhou Normal University, Hangzhou 311100, China

Received:2020-02-21 Revised:2020-04-27 Online:2021-06-18 Published:2021-06-23

摘要/Abstract

摘要： 针对目前非物质文化遗产保护形式单一、交互性差的问题,基于移动增强现实技术设计并实现了一个非遗数字化在线展示系统。以泥咕咕非遗保护为例,设计系统云端和移动端的主要功能模块,提出基于三维扫描和网格迭代简化相结合的快速建模方法,采用ORB-FV和光流跟踪算法实现图像的在线识别和跟踪注册,基于Unity3D完成系统开发。测试结果表明,该系统不仅满足了非遗产品移动端增强展示的真实感和流畅度要求,而且实现了模型增强显示后的实时交互涂色展示功能,增强了非遗保护和传播的趣味性和互动性。

关键词: 非物质文化遗产, 移动增强现实, ORB-FV, Unity3D

Abstract: Aiming at the problem of the single form and poor interaction of intangible cultural heritage protection, a non-heritage digital online display system is designed and implemented based on mobile augmented reality technology. Taking clay sculpture non-heritage protection as an example, the main functional modules of the system cloud and mobile terminal are designed. Based on a combination of 3D scanning and iterative mesh simplification, a fast modeling method is proposed. ORB-FV and optical flow tracking algorithm are used for online recognition and tracking registration of images. The system is developed based on Unity3D. The test results show that, the system not only improves the realism and fluency non-heritage products on the mobile end display, but also implements the real-time interactive coloring and displaying function after enhanced display of the model, which enhances the fun and interaction of intangible heritage protection and dissemination.

Key words: intangible cultural heritage, mobile augmented reality, ORB-FV, Unity3D

中图分类号:

TP391.9

侯守明, 葛倩, 刘彦彦. 基于MAR的非物质文化遗产数字化保护系统研究[J]. 系统仿真学报, 2021, 33(6): 1334-1341.

Hou Shouming, Ge Qian, Liu Yanyan. Research on Digital Protection System of Intangible Cultural Heritage Based on Mobile Augmented Reality Technology[J]. Journal of System Simulation, 2021, 33(6): 1334-1341.

参考文献

[1] 邹湘军, 孙健, 何汉武,等. 虚拟现实技术的演变发展与展望[J]. 系统仿真学报, 2004, 16(9): 1905-1909.
Zou Xiangjun, Sun Jian, He Hanwu, et al.Evolution and Development of Virtual Reality Technology[J]. Journal of System Simulation, 2004, 16(9): 1905-1909.
[2] Gleue T.Design and Implementation of a Mobile Device for Outdoor Augmented Reality in the Archeoguide Project[C]// Conference on Virtual Reality, Archeology, and Cultural Heritage, Glyfada, Greece, November. DBLP, 2001: 161-168.
[3] Magnenat-Thalmann N, Papagiannakis G, Foni A, et al.Simulating Life in Ancient Sites using Mixed Reality Technology[J]. Francisco R Feito Higueruela (S1017-4656), 2004, CEIG04: 313-330.
[4] Han J, Park K, Ban K, et al.Cultural Heritage Sites Visualization System Based on Outdoor Augmented Reality[C]// Proceedings of the 2013 AASRI Conference on Intelligent Systems and Control (ISC 2013 V4). American Applied Sciences Research Institute, AASRI, 2013: 8.
[5] Younes G, Kahil R, Jallad M, et al. Virtual and Augmented Reality for Rich Interaction with Cultural Heritage Sites: A Case Study from the Roman Theater at Byblos[J]. Digital Applications in Archaeology and Cultural Heritage, 2017(5).
[6] 师国伟, 王涌天, 刘越, 等. 增强现实技术在文化遗产数字化保护中的应用[J]. 系统仿真学报, 2009, 21(7): 2090-2093.
Shi Guowei, Wang Yongtian, Liu Yue, et al.Application of Augmented Reality Technology to Digital Protection of Cultural Heritage[J]. Journal of System Simulation, 2009, 21(7): 2090-2093.
[7] 张世程. 手势识别与民族弓弦乐器虚拟演奏研究[D]. 杭州: 杭州师范大学, 2015.
Zhang Shicheng.Research on Gesture Recognition and Virtual Playing of Ethnic Bowed String Instruments [D]. Hangzhou: Hangzhou Normal University, 2015.
[8] 陶燎亮. 基于移动增强现实技术的非物质文化遗产数字化研究与应用——以龙泉青瓷为例[J]. 数字技术与应用, 2017(3): 112-113, 117.
Tao Liaoliang.Digital Research and Application of Intangible Cultural Heritage Based on Mobile Augmented Reality——A Case Study of Longquan Celadon[J]. Digital Technology and Application, 2017(3): 112-113, 117.
[9] 龚晨源, 赵忠波. 文化遗产的新时代保护方式[J]. 戏剧之家, 2019(7): 239.
Gong Chenyuan, Zhao Zhongbo.New Era Protection Method of Cultural Heritage[J]. The House of Drama, 2019(7): 239.
[10] Wang X Y, Lü D S. Research on Digital Protection of Cultural Heritage Dujiangyan[C]// Proceedings of the2019 3rd International Conference on Education, Culture and Social Development (ICECSD 2019).
[11] Yirci M, Ulusoy I.A Comparative Study on Polygonal Mesh Simplification Algorithms[C]// Signal Processing and Communications Applications Conference, 2009. SIU 2009. IEEE 17th. Antalya, Turkey: IEEE, 2009: 736-739.
[12] Uchida Y, Sakazawa S, Satoh S.Image Retrieval with Fisher Vectors of Binary Features[J]. ITE Transactions on Media Technology and Applications, 2016, 4(4): 23-28.
[13] Perronnin F, Mensink T.Improving the Fisher Kernel for Large-scale Image Classification[C]// European Conference on Computer Vision. Berlin, Heidelberg: Springer-Verlag, 2010: 143-156.
[14] Jaakkola T S, Haussler D.Exploiting Generative Models in Discriminative Classifiers[J]. Advances in Neural Information Processing Systems (S1049-5258), 1998, 11(11): 487-493.
[15] 陈泽婵, 陈靖, 严雷, 等. 基于Unity3D的移动增强现实光学实验平台[J]. 计算机应用, 2015, 35(S2): 194-199.
Chen Zechan, Chen Jing, Yan Lei, et al.Unity3D-based Mobile Optical Experiment Platform for Augmented Reality[J]. Journal of Computer Applications, 2015, 35(S2): 194-199.
[16] 何福本, 梁延德, 张红哲, 等. 增强现实技术在车削加工实训教学中的应用[J]. 实验技术与管理, 2017, 34(3): 127-129, 150.
He Fuben, Liang Yande, Zhang Hongzhe, et al.Application of Augmented Reality Technology in Turning Machining Training Teaching[J]. Experiment Technology and Management, 2017, 34(3): 127-129, 150.

基于MAR的非物质文化遗产数字化保护系统研究

Research on Digital Protection System of Intangible Cultural Heritage Based on Mobile Augmented Reality Technology

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	陆承, 靳学胜. 基于Steam VR的交互仿真水枪灭火训练系统设计[J]. 系统仿真学报, 2022, 34(6): 1312-1319.
[2]	李承恩, 邹湘军, 曾泽钦, 何建华, 李慧, 黄钊丰. 基于虚拟碰撞体的弧齿锥齿轮网格实体构建算法[J]. 系统仿真学报, 2021, 33(4): 837-844.
[3]	徐劲力, 周铮. 基于HoloLens的有限元分析变形结果可视化研究[J]. 系统仿真学报, 2021, 33(1): 109-117.
[4]	任福深, 孙雅琪, 胡庆, 李兆亮, 孙鹏宇, 范玉坤. 基于Unity3D的水下机器人半实物仿真系统[J]. 系统仿真学报, 2020, 32(8): 1546-1555.
[5]	文国军, 夏雨, 王玉丹, 胡自飞, 吴丹. 基于Unity3D的水平定向钻机虚拟实训系统设计[J]. 系统仿真学报, 2020, 32(5): 801-807.
[6]	孙小添, 肖伯祥, 刘正东. 群体演出活动服装虚拟仿真系统设计与实现[J]. 系统仿真学报, 2020, 32(11): 2282-2287.
[7]	谷学静, 张凯峰, 郭宇承, 王志良. 基于Unity3D的ASD儿童认知教育系统设计与实现[J]. 系统仿真学报, 2019, 31(5): 893-900.
[8]	张志利, 王超, 龙勇, 王韶迪. 基于移动增强现实的双机协同仿真[J]. 系统仿真学报, 2019, 31(4): 608-617.
[9]	纪显俐, 丁宇龙, 杨双华. 智能沙盘地理教学演示系统[J]. 系统仿真学报, 2019, 31(12): 2816-2828.
[10]	张波, 孙俊, 商蕾, 徐弘基, 杨诚. 基于HMD的船舶虚拟消防训练系统设计及实现[J]. 系统仿真学报, 2019, 31(1): 43-52.
[11]	张晓曦, 尹勇, 梁民仓. 蛟龙号下潜及水下作业过程的交互仿真开发[J]. 系统仿真学报, 2018, 30(7): 2715-2721.
[12]	程伯文, 郑一力, 黄青青, 刘晋浩. 基于Unity3D的林木联合采育机虚拟训练系统研究[J]. 系统仿真学报, 2018, 30(4): 1310-1318.
[13]	王大虎, 陈侠, 高会争. 虚拟现实技术在PLC燃气锅炉培训系统中的应用[J]. 系统仿真学报, 2017, 29(12): 3010-3015.
[14]	官万先, 李万鹏, 葛林, 万华根. 一种基于多模态数据自组织的城市移动增强现实方法[J]. 系统仿真学报, 2017, 29(11): 2629-2636.
[15]	何高奇, 郁明强, 蒋正清, 卢兴见. 基于VR火灾逃生游戏的应急行为评估系统[J]. 系统仿真学报, 2017, 29(11): 2796-2804.