AR-based Simulation Interaction and Human Factor Assessment for Human Robot Cooperation Assembly Planning

doi:10.16182/j.issn1004731x.joss.19-0415

Abstract

Abstract: To improve assembly efficiency, it has become a trend for traditional manual assembly workstations to be carried out human-robot collaboration transformation. To realize the safe and fast evaluation of the improvement scheme, a general human-robot collaboration simulation method and human factor evaluation method based on Augmented Reality are proposed. Four levels of human-robot collaboration assembly simulation are established. An interactive scheme between real human and virtual robot for visual detection, perception and feedback is established. A fuzzy comprehensive evaluation model of human physiological and psychological indicators for workstation design is constructed. The prototype system is developed. Taking the assembly station modification of gearbox as an example, the human factor analysis data are collected, and the artificial assembly and human robot collaborative assembly schemes are compared and analyzed, which verifies the feasibility of this method.

Key words: human robot cooperation, assembly planning, human factor, augmented reality, simulation

CLC Number:

TP391.9

Wang Qiang, Fan Xiumin, He Qichang, Zhu Wenmin. AR-based Simulation Interaction and Human Factor Assessment for Human Robot Cooperation Assembly Planning[J]. Journal of System Simulation, 2021, 33(2): 389-400.

References

[1] 刘检华, 孙清超, 程晖, 等. 产品装配技术的研究现状, 技术内涵及发展趋势[J]. 机械工程学报, 2018, 54(11): 2-28.
Liu Jianhua, Sun Qingchao, Cheng Hui, et al.The State-of-the-art, Connotation and Developing Trends of the Products Assembly Technology[J]. Journal of Mechanical Engineering, 2018, 54(11): 2-28.
[2] 邹方. 人机协作标准及应用动态研究[J]. 航空制造技术, 2016, 59(23/24): 58-63.
Zou Fang.Standard for Human-Robot Collaboration and its Application Trend[J]. Aeronautical Manufacturing Technology, 2016, 59(23/24): 58-63.
[3] Mohammed A, Schmidt B, Wang L.Active Collision Avoidance for Human-robot Collaboration Driven by Vision Sensors[J]. International Journal of Computer Integrated Manufacturing (S0951-192X), 2017, 30(9): 970-980.
[4] 黄诚, 刘华平, 左小五, 等. 基于Kinect的人机协作[J]. 中南大学学报(自然科学版), 2013(增1): 386-393.
Huang Cheng, Liu Huaping, Zuo Xiaowu, et al.Human-robot Cooperation Using Kinect[J]. Journal of Central South University (Natural Science Edition), 2013(S1): 386-393.
[5] Maurtua I, Ibarguren A, Kildal J, et al.Human-robot Collaboration in Industrial Applications: Safety, Interaction and Trust[J]. International Journal of Advanced Robotic Systems (S1729-8806), 2017, 14(4): 1-10.
[6] Arai T, Kato R, Fujita M.Assessment of Operator Stress Induced by Robot Collaboration in Assembly[J]. CIRP Annals - Manufacturing Technology (S0007-8506), 2010, 59(1): 5-8.
[7] 徐红旗, 史冀鹏, 张欣, 等. 美国NIOSH手工提举方程在中国的验证研究[J]. 人类工效学, 2018(3): 31-36.
Xu Hongqi, Shi Jipeng, Zhang Xin, et al.The Chinese Confirmatory Study for NIOSH Lifting Equation of America[J]. Chinese Journal of Ergonomics, 2018(3): 31-36.
[8] Paas F G W C, Van Merriënboer J J G. Variability of Worked Examples and Transfer of Geometrical Problem-solving Skills: A Cognitive-load Approach[J]. Journal of Educational Psychology (S0022-0663), 1994, 86(1): 122-133.
[9] Neuhöfer J A, Kausch B, Schlick C M. Embedded Augmented Reality Training System for Dynamic Human-Robot Cooperation[R]. Human Dimensions in Embedded Virtual Simulation, Proceedings of the NATO RTO HFM-169 Research Workshop in Orlando, FL, 20-22 Oct.2009, Hrsg.: Sottilare, Robert; Alexander, Thomas Page(s): 13 S.
[10] Lasota P A, Shah J A.Analyzing the Effects of Human-Aware Motion Planning on Close-Proximity Human-Robot Collaboration[J]. Human Factors: The Journal of the Human Factors and Ergonomics Society (S1547-8181), 2015, 57(1): 21-33.
[11] 王巍, 高雪松, 穆志国, 等. 人机工程仿真技术在飞机零组件装配中的应用[J]. 航空制造技术, 2017, 60(9): 92-96.
Wang Wei, Gao Xuesong, Mu Zhiguo, et al.Application of Man-Machine Engineering Simulation Technology in Aircraft Component Assembly[J]. Aeronautical Manufacturing Technology, 2017, 60(9): 92-96.
[12] Dombrowski U, Stefanak T, Perret J.Interactive Simulation of Human-Robot Collaboration Using a Force Feedback Device[J]. Procedia Manufacturing (S2351-9789), 2017, 11: 124-131.
[13] Tsarouchi P, Matthaiakis A S, Makris S, et al.On a Human-robot Collaboration in an Assembly Cell[J]. International Journal of Computer Integrated Manufacturing (S0951-192X), 2017, 30(6): 580-589.
[14] Holubek R, Ružarovský R, Sobrino D R D, et al. Novel Trends in the Assembly Process as the Results of Human-the Industrial Robot Collaboration[J]. MATEC Web of Conferences(S2261-236X), 2017, 137: 04005.
[15] Matsas E, Vosniakos G C.Design of a Virtual Reality Training System for Human-robot Collaboration in Manufacturing Tasks[J]. International Journal on Interactive Design and Manufacturing (IJIDeM)(S1955-2513), 2017, 11(2): 139-153.
[16] 王宇希, 张凤军, 刘越. 增强现实技术研究现状及发展趋势[J]. 科技导报, 2018, 36(10): 75-83.
Wang Yuxi, Zhang Fengjun, Liu Yue.Augmented Reality Technology[J]. Science & Technology Review, 2018, 36(10): 75-83.
[17] 邹湘军, 孙健, 何汉武, 等. 虚拟现实技术的演变发展与展望[J]. 系统仿真学报, 2004, 16(9): 44-48.
Zou Xiangjun, Sun Jian, He Hanwu, et al.The Development and Prospects of Virtual Reality[J]. Journal of System Simulation, 2004, 16(9): 44-48.
[18] Zou X, Zou H, Lu J.Virtual Manipulator-based Binocular Stereo Vision Positioning System and Errors Modelling[J]. Machine Vision and Applications (S0932-8092), 2012, 23(1): 43-63.
[19] 胡弘, 晁建刚, 杨进, 等. Leap Motion关键点模型手姿态估计方法[J]. 计算机辅助设计与图形学学报, 2015, 27(7): 1211-1216.
Hu Hong, Chao Jianggang, Yang Jin, et al.Key Point Model for Hand Pose Estimation Based on Leap Motion[J]. Journal of Computer-Aided Design and Computer Graphics, 2015, 27(7): 1211-1216.
[20] 徐立云, 刘琨, 陈贻平, 等. 考虑作业人员疲劳度均衡的第一类装配线平衡[J]. 同济大学学报 (自然科学版), 2019, 47(2): 241-247, 290.
Xu Liyun, Liu Kun, Chen Yiping, et al.Assembly Line Balancing Problem-1 Considering Fatigue Balance of Workers[J]. Journal of Tongji University (Natural Science Edition), 2019, 47(2): 241-247, 290.
[21] 王跃, 谭昌柏, 安鲁陵, 等. 基于支持向量机的飞机装配工艺模糊综合评价方法[J]. 机械制造与自动化, 2017, 46(5): 62-66.
Wang Yue, Tan Changbai, An Luling, et al.Fuzzy Comprehensive Evaluation Method of Aircraft Assembly Process Based on SVM[J]. Machinery, 2017, 46(5): 62-66.
[22] 张振铭. 变速箱装配辅线装配任务可操作性分析与评价[D]. 长春: 吉林大学, 2018: 17-21.
Zhang Zhenming.Operability Analysis and Evaluation of Gear-box Auxiliary Line Assembly Task[D]. Changchun: Jilin University, 2018: 17-21.