Simulation System for Special Material Processing Training Based on Augmented Reality Technology

doi:10.16182/j.issn1004731x.joss.201801015

Abstract

Abstract: A simulation system for special material processing training within the shielded environment is developed based on augmented reality technology. An observation system composed of analogue camera and network high dome system camera is designed and constructed to extend the view scope of operators. Single hand finger recognition technology is then combined with the observation system to implement friendly interactions between operators and the simulation system, and to achieve interactive training. Augmented reality technology is applied to create fused virtual-real vision, which leads to the implementation of augmented processing induction of cone-shaped part. Primary tests show that the developed system is capable of reducing radiation threat, alleviating operators’ body fatigue, executing more efficient training and reducing training duration so as to increase safety and improve efficiency of operators to a certain extent.

Key words: augmented reality, special material processing, finger tip recognition, interactive training, augmented induction

CLC Number:

TP391

Luo Bin, Ge Shuangquan. Simulation System for Special Material Processing Training Based on Augmented Reality Technology[J]. Journal of System Simulation, 2018, 30(1): 122-131.

References

[1] Jcarmigniani J, Furht B, Anisetti M, et al.Augmented reality technologies, systems and applications[J]. Multimedia Tools and Applications(S1573-7721), 2011, 51: 341-377.
[2] Wild F, Scott P, karjalainen J, et al. An augmented reality job performance aid for kinaesthetic learning in manufacturing work places[J]. Lecture Notes in Computer Science, Springer(S0302-9743), 2014, 8719(1): 470-475.
[3] Julier S, Baillot Y, Lanzagorta M, et al.BARS: Balltlefield augmented reality system[C]//NATO Symposium on Information Processing Techniques for Military Systems. Istanbul, Turkey: IEEE, 2000: 9-11.
[4] Kang X, Oh J, Wilson E, et al.Towards a clinical stereoscopic augmented reality system for laparoscopic surgery[J]. Lecture Notes in Computer Science, Springer (S0302-9743), 2014, 1(1): 108-116.
[5] Rattanarugnrot S, White M, Patoli Z, et al.The application of augmented reality for reanimating culture heritage[J]. Lecture Notes in Computer Science, Springer (S0302-9743), 2014, 8526(1): 85-95.
[6] Yamabe T, Nakajima T.Playful training with augmented reality games: case studies toward reality-oriented system design[J]. Multimedia Tools and Applications. Springer (S1573-7721), 2013, 62(1): 259-286.
[7] Corby Jr N R, Nafis C A. Augmented reality telemanipulation system for nuclear reactor inspection[C]//SPIE on Telemani-pulator and Telepresence Technologies. SPIE, 1994: 360-365.
[8] Fuchs P, Nashashibi F, Maman D.Assistance for tele-presence by stereovision-based augmented reality and interactivity in 3D space[J]. Presence: Teleoperators and Virtual Environments(S1531-3263), 2012, 11(5): 515-535.
[9] Klinker G, Creighton O, Dutoit A H, et al.Augmented maintenance of power plants: a prototyping case study of a mobile AR system[C]//Proceedings of IEEE and ACM International Symposium on Augmented Reality (ISAR 2001). USA: IEEE, 2001: 124-133.
[10] Bian Z, Ishii H, Shimoda H, et al. Development of a Tracking Method for Augmented Reality Applied to NPP Maintenance Work and its Experimental Evaluation[J]. IEICE TRANSACTIONS on Information and Systems (S0916-8532), 2007, E90-D(6): 963-974.
[11] Ishii H, Bian Z, Fujino H, et al.Augmented reality applications for nuclear power plant maintenance work[C]//International symposium on symbiotic nuclear power systems for 21st century(ISSNP), 2013: 262-268.
[12] Ishii H, Shimoda H, Nakai T, et al.Proposal and Evaluation of a Supporting Method for NPP Decommissioning Work by Augmented Reality[C]//12th World Multi-Conference on Systemics, Cybernetics, 2008, 6: 157-162.
[13] Shimoda H, Ishii H, Yamazaki Y, et al.A support system for water system isolation task in NPP by using augmented reality and RFID[C]//The IEEE 6th International Conference on Nuclear Thermal Hydraulics, Operations and Safety (NUTHOS-6). Nara Japan, 2004: 23-28.
[14] Leutert F, Schilling K, Robotik L F, et al.Support of power plant tele-maintenance with rotots by augmented reality methods[C]//2012 2nd International Conference on Applied Robotics of the Power industry(CARPI), ETH Zurich, Switzerland, IEEE, 2012: 45-49.
[15] Eursch A.Increased Safety for Manual Tasks in the Field of Nuclear Science using the technology of augmented reality[C]//IEEE Nuclear Science Symposium Conference Record, IEEE, 2007: 2053.
[16] Bai H, Billing Hurst M, Gao L, et al.Markerless 3D gesture-based interaction for handheld augmented reality interfaces[C]//Proc. of 12th IEEE International Symposium on Mixed and Augmented Reality. Adelaide, Australia, IEEE, 2013, 8783(6): 1-12.
[17] Henderson S J, Feiner S.Opportunistic controls: Leveraging natural affordances as tangible user interfaces for augmented reality[C]//Proc. of the ACM Symposium on Virtual Reality Software and Technology. Bordeaux, France: IEEE, 2008.
[18] Mirzaei M R, Ghorshi S, Mortazavi M.Combining augmented reality and speech technologies to help deaf hand hard of hearing people[C]//2012 14th Symposium on virtual and augmented reality. IEEE, 2012: 174-181.
[19] Luo Bin, Ge Shuang-quan.Single finger gesture interaction method supporting assembly guidance[J]. Computer Engineering, 2013, 39(8): 243-248.
[20] Hassner T, mayzels V, Zelnik-Manor L. On SIFTs and their scales[C]//2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012). IEEE, 2012: 1522-1529.
[21] Mohamed Ba, Mohamed Be.Proposition of a 3D ppattern for e-learning augmented reality applications based on ARToolKit library[C]//2012 international Conference on Education and e-Learning Innovations, IEEE, 2012: 1-4.
[22] Celozzi C, Paravati G, Sanna A, et al.A 6-DOF ARTag-based tracking system[C]//2010 Digest of technical Papers International Conference on Consumer Electronics (ICCE). IEEE, 2010: 243-244.
[23] Hartley R, Zisserman A.Multiple View Geometry in Computer Vision[M]. New York: Cambridge University Press, 2003.
[24] Zhang Z Y.A flexible new technique for camera calibration[J]. IEEE Transaction on Pattern Analysis and Machine Intelligence(S0162-8828), 2000, 22(11): 1330-1334.
[25] Kjeldsen R, Kender J.Finding skin in color images[C]//Proc. 2nd International Conference on Automatic Face and Gesture Recognition. Killington, Vermont, USA: IEEE, 1996: 312-317.