基于增强现实的特种材料加工培训模拟系统

doi:10.16182/j.issn1004731x.joss.201801015

摘要/Abstract

摘要： 介绍了基于增强现实的屏蔽环境特种材料加工培训模拟系统。该系统使用由模拟摄像机和网络高速球摄像机构成的观察系统扩展了操作人员观察视场;将观察系统与单手指手势识别技术结合,实现了操作人员与模拟系统的友好交互,可执行交互式虚拟培训;使用增强现实技术创建了虚实融合的观察视景,实现了锥体工件加工增强引导功能。系统初步试验显示,该系统能够降低辐射威胁,舒缓操作人员身体疲劳,缩短培训周期,指导现场操作,既提高工作效率又增强安全性。

关键词: 增强现实, 特种材料加工, 指尖识别, 交互式培训, 增强引导

Abstract: A simulation system for special material processing training within the shielded environment is developed based on augmented reality technology. An observation system composed of analogue camera and network high dome system camera is designed and constructed to extend the view scope of operators. Single hand finger recognition technology is then combined with the observation system to implement friendly interactions between operators and the simulation system, and to achieve interactive training. Augmented reality technology is applied to create fused virtual-real vision, which leads to the implementation of augmented processing induction of cone-shaped part. Primary tests show that the developed system is capable of reducing radiation threat, alleviating operators’ body fatigue, executing more efficient training and reducing training duration so as to increase safety and improve efficiency of operators to a certain extent.

Key words: augmented reality, special material processing, finger tip recognition, interactive training, augmented induction

中图分类号:

TP391

罗斌, 葛双全. 基于增强现实的特种材料加工培训模拟系统[J]. 系统仿真学报, 2018, 30(1): 122-131.

Luo Bin, Ge Shuangquan. Simulation System for Special Material Processing Training Based on Augmented Reality Technology[J]. Journal of System Simulation, 2018, 30(1): 122-131.

参考文献

[1] Jcarmigniani J, Furht B, Anisetti M, et al.Augmented reality technologies, systems and applications[J]. Multimedia Tools and Applications(S1573-7721), 2011, 51: 341-377.
[2] Wild F, Scott P, karjalainen J, et al. An augmented reality job performance aid for kinaesthetic learning in manufacturing work places[J]. Lecture Notes in Computer Science, Springer(S0302-9743), 2014, 8719(1): 470-475.
[3] Julier S, Baillot Y, Lanzagorta M, et al.BARS: Balltlefield augmented reality system[C]//NATO Symposium on Information Processing Techniques for Military Systems. Istanbul, Turkey: IEEE, 2000: 9-11.
[4] Kang X, Oh J, Wilson E, et al.Towards a clinical stereoscopic augmented reality system for laparoscopic surgery[J]. Lecture Notes in Computer Science, Springer (S0302-9743), 2014, 1(1): 108-116.
[5] Rattanarugnrot S, White M, Patoli Z, et al.The application of augmented reality for reanimating culture heritage[J]. Lecture Notes in Computer Science, Springer (S0302-9743), 2014, 8526(1): 85-95.
[6] Yamabe T, Nakajima T.Playful training with augmented reality games: case studies toward reality-oriented system design[J]. Multimedia Tools and Applications. Springer (S1573-7721), 2013, 62(1): 259-286.
[7] Corby Jr N R, Nafis C A. Augmented reality telemanipulation system for nuclear reactor inspection[C]//SPIE on Telemani-pulator and Telepresence Technologies. SPIE, 1994: 360-365.
[8] Fuchs P, Nashashibi F, Maman D.Assistance for tele-presence by stereovision-based augmented reality and interactivity in 3D space[J]. Presence: Teleoperators and Virtual Environments(S1531-3263), 2012, 11(5): 515-535.
[9] Klinker G, Creighton O, Dutoit A H, et al.Augmented maintenance of power plants: a prototyping case study of a mobile AR system[C]//Proceedings of IEEE and ACM International Symposium on Augmented Reality (ISAR 2001). USA: IEEE, 2001: 124-133.
[10] Bian Z, Ishii H, Shimoda H, et al. Development of a Tracking Method for Augmented Reality Applied to NPP Maintenance Work and its Experimental Evaluation[J]. IEICE TRANSACTIONS on Information and Systems (S0916-8532), 2007, E90-D(6): 963-974.
[11] Ishii H, Bian Z, Fujino H, et al.Augmented reality applications for nuclear power plant maintenance work[C]//International symposium on symbiotic nuclear power systems for 21st century(ISSNP), 2013: 262-268.
[12] Ishii H, Shimoda H, Nakai T, et al.Proposal and Evaluation of a Supporting Method for NPP Decommissioning Work by Augmented Reality[C]//12th World Multi-Conference on Systemics, Cybernetics, 2008, 6: 157-162.
[13] Shimoda H, Ishii H, Yamazaki Y, et al.A support system for water system isolation task in NPP by using augmented reality and RFID[C]//The IEEE 6th International Conference on Nuclear Thermal Hydraulics, Operations and Safety (NUTHOS-6). Nara Japan, 2004: 23-28.
[14] Leutert F, Schilling K, Robotik L F, et al.Support of power plant tele-maintenance with rotots by augmented reality methods[C]//2012 2nd International Conference on Applied Robotics of the Power industry(CARPI), ETH Zurich, Switzerland, IEEE, 2012: 45-49.
[15] Eursch A.Increased Safety for Manual Tasks in the Field of Nuclear Science using the technology of augmented reality[C]//IEEE Nuclear Science Symposium Conference Record, IEEE, 2007: 2053.
[16] Bai H, Billing Hurst M, Gao L, et al.Markerless 3D gesture-based interaction for handheld augmented reality interfaces[C]//Proc. of 12th IEEE International Symposium on Mixed and Augmented Reality. Adelaide, Australia, IEEE, 2013, 8783(6): 1-12.
[17] Henderson S J, Feiner S.Opportunistic controls: Leveraging natural affordances as tangible user interfaces for augmented reality[C]//Proc. of the ACM Symposium on Virtual Reality Software and Technology. Bordeaux, France: IEEE, 2008.
[18] Mirzaei M R, Ghorshi S, Mortazavi M.Combining augmented reality and speech technologies to help deaf hand hard of hearing people[C]//2012 14th Symposium on virtual and augmented reality. IEEE, 2012: 174-181.
[19] Luo Bin, Ge Shuang-quan.Single finger gesture interaction method supporting assembly guidance[J]. Computer Engineering, 2013, 39(8): 243-248.
[20] Hassner T, mayzels V, Zelnik-Manor L. On SIFTs and their scales[C]//2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012). IEEE, 2012: 1522-1529.
[21] Mohamed Ba, Mohamed Be.Proposition of a 3D ppattern for e-learning augmented reality applications based on ARToolKit library[C]//2012 international Conference on Education and e-Learning Innovations, IEEE, 2012: 1-4.
[22] Celozzi C, Paravati G, Sanna A, et al.A 6-DOF ARTag-based tracking system[C]//2010 Digest of technical Papers International Conference on Consumer Electronics (ICCE). IEEE, 2010: 243-244.
[23] Hartley R, Zisserman A.Multiple View Geometry in Computer Vision[M]. New York: Cambridge University Press, 2003.
[24] Zhang Z Y.A flexible new technique for camera calibration[J]. IEEE Transaction on Pattern Analysis and Machine Intelligence(S0162-8828), 2000, 22(11): 1330-1334.
[25] Kjeldsen R, Kender J.Finding skin in color images[C]//Proc. 2nd International Conference on Automatic Face and Gesture Recognition. Killington, Vermont, USA: IEEE, 1996: 312-317.