面向人机协作装配规划的AR仿真交互与人因评估

doi:10.16182/j.issn1004731x.joss.19-0415

系统仿真学报 ›› 2021, Vol. 33 ›› Issue (2): 389-400.doi: 10.16182/j.issn1004731x.joss.19-0415

• 仿真支撑平台/系统技术 • 上一篇下一篇

面向人机协作装配规划的AR仿真交互与人因评估

王强¹, 范秀敏^1,2, 何其昌¹, 朱文敏¹

1.上海交通大学机械与动力工程学院,上海 200240;
2.上海市网络化制造与企业信息化重点实验室,上海 200230

收稿日期:2019-08-12 修回日期:2019-11-17 出版日期:2021-02-18 发布日期:2021-02-20
作者简介:王强(1993-),男,硕士生,研究方向为人机协作装配/维修、AR/VR。E-mail: 18221015765@163.com
基金资助:
国家自然科学基金(51975362)

AR-based Simulation Interaction and Human Factor Assessment for Human Robot Cooperation Assembly Planning

Wang Qiang¹, Fan Xiumin^1,2, He Qichang¹, Zhu Wenmin¹

1. School of Mechanical Engineering, Shanghai Jiaotong University, Shanghai 200240, China;
2. Shanghai Key Lab of Advanced Manufacturing Environment, Shanghai 200230, China

Received:2019-08-12 Revised:2019-11-17 Online:2021-02-18 Published:2021-02-20

摘要/Abstract

摘要： 为提高装配效率,传统手工装配工位进行人—机器人协作改造已成为一种发展趋势。为实现对人机协作工位改进方案的安全快捷评估,提出一种基于增强现实技术的通用人机协作仿真方法与人因评估方法。建立人机协作装配仿真构建总体思路的4个层次;建立真人与虚拟机器人的视觉检测、感知、增强现实反馈的交互方案;构建工位设计方案的人因生理和心理指标模糊综合评价模型;开发原型系统,以变速箱的装配工位改造为例,采集人因分析数据,对人工装配和人机协作装配方案进行对比分析,验证了本文方法的可行性。

关键词: 人机协作, 装配规划, 人因评价, 增强现实, 建模仿真

Abstract: To improve assembly efficiency, it has become a trend for traditional manual assembly workstations to be carried out human-robot collaboration transformation. To realize the safe and fast evaluation of the improvement scheme, a general human-robot collaboration simulation method and human factor evaluation method based on Augmented Reality are proposed. Four levels of human-robot collaboration assembly simulation are established. An interactive scheme between real human and virtual robot for visual detection, perception and feedback is established. A fuzzy comprehensive evaluation model of human physiological and psychological indicators for workstation design is constructed. The prototype system is developed. Taking the assembly station modification of gearbox as an example, the human factor analysis data are collected, and the artificial assembly and human robot collaborative assembly schemes are compared and analyzed, which verifies the feasibility of this method.

Key words: human robot cooperation, assembly planning, human factor, augmented reality, simulation

中图分类号:

TP391.9

王强, 范秀敏, 何其昌, 朱文敏. 面向人机协作装配规划的AR仿真交互与人因评估[J]. 系统仿真学报, 2021, 33(2): 389-400.

Wang Qiang, Fan Xiumin, He Qichang, Zhu Wenmin. AR-based Simulation Interaction and Human Factor Assessment for Human Robot Cooperation Assembly Planning[J]. Journal of System Simulation, 2021, 33(2): 389-400.

参考文献

[1] 刘检华, 孙清超, 程晖, 等. 产品装配技术的研究现状, 技术内涵及发展趋势[J]. 机械工程学报, 2018, 54(11): 2-28.
Liu Jianhua, Sun Qingchao, Cheng Hui, et al.The State-of-the-art, Connotation and Developing Trends of the Products Assembly Technology[J]. Journal of Mechanical Engineering, 2018, 54(11): 2-28.
[2] 邹方. 人机协作标准及应用动态研究[J]. 航空制造技术, 2016, 59(23/24): 58-63.
Zou Fang.Standard for Human-Robot Collaboration and its Application Trend[J]. Aeronautical Manufacturing Technology, 2016, 59(23/24): 58-63.
[3] Mohammed A, Schmidt B, Wang L.Active Collision Avoidance for Human-robot Collaboration Driven by Vision Sensors[J]. International Journal of Computer Integrated Manufacturing (S0951-192X), 2017, 30(9): 970-980.
[4] 黄诚, 刘华平, 左小五, 等. 基于Kinect的人机协作[J]. 中南大学学报(自然科学版), 2013(增1): 386-393.
Huang Cheng, Liu Huaping, Zuo Xiaowu, et al.Human-robot Cooperation Using Kinect[J]. Journal of Central South University (Natural Science Edition), 2013(S1): 386-393.
[5] Maurtua I, Ibarguren A, Kildal J, et al.Human-robot Collaboration in Industrial Applications: Safety, Interaction and Trust[J]. International Journal of Advanced Robotic Systems (S1729-8806), 2017, 14(4): 1-10.
[6] Arai T, Kato R, Fujita M.Assessment of Operator Stress Induced by Robot Collaboration in Assembly[J]. CIRP Annals - Manufacturing Technology (S0007-8506), 2010, 59(1): 5-8.
[7] 徐红旗, 史冀鹏, 张欣, 等. 美国NIOSH手工提举方程在中国的验证研究[J]. 人类工效学, 2018(3): 31-36.
Xu Hongqi, Shi Jipeng, Zhang Xin, et al.The Chinese Confirmatory Study for NIOSH Lifting Equation of America[J]. Chinese Journal of Ergonomics, 2018(3): 31-36.
[8] Paas F G W C, Van Merriënboer J J G. Variability of Worked Examples and Transfer of Geometrical Problem-solving Skills: A Cognitive-load Approach[J]. Journal of Educational Psychology (S0022-0663), 1994, 86(1): 122-133.
[9] Neuhöfer J A, Kausch B, Schlick C M. Embedded Augmented Reality Training System for Dynamic Human-Robot Cooperation[R]. Human Dimensions in Embedded Virtual Simulation, Proceedings of the NATO RTO HFM-169 Research Workshop in Orlando, FL, 20-22 Oct.2009, Hrsg.: Sottilare, Robert; Alexander, Thomas Page(s): 13 S.
[10] Lasota P A, Shah J A.Analyzing the Effects of Human-Aware Motion Planning on Close-Proximity Human-Robot Collaboration[J]. Human Factors: The Journal of the Human Factors and Ergonomics Society (S1547-8181), 2015, 57(1): 21-33.
[11] 王巍, 高雪松, 穆志国, 等. 人机工程仿真技术在飞机零组件装配中的应用[J]. 航空制造技术, 2017, 60(9): 92-96.
Wang Wei, Gao Xuesong, Mu Zhiguo, et al.Application of Man-Machine Engineering Simulation Technology in Aircraft Component Assembly[J]. Aeronautical Manufacturing Technology, 2017, 60(9): 92-96.
[12] Dombrowski U, Stefanak T, Perret J.Interactive Simulation of Human-Robot Collaboration Using a Force Feedback Device[J]. Procedia Manufacturing (S2351-9789), 2017, 11: 124-131.
[13] Tsarouchi P, Matthaiakis A S, Makris S, et al.On a Human-robot Collaboration in an Assembly Cell[J]. International Journal of Computer Integrated Manufacturing (S0951-192X), 2017, 30(6): 580-589.
[14] Holubek R, Ružarovský R, Sobrino D R D, et al. Novel Trends in the Assembly Process as the Results of Human-the Industrial Robot Collaboration[J]. MATEC Web of Conferences(S2261-236X), 2017, 137: 04005.
[15] Matsas E, Vosniakos G C.Design of a Virtual Reality Training System for Human-robot Collaboration in Manufacturing Tasks[J]. International Journal on Interactive Design and Manufacturing (IJIDeM)(S1955-2513), 2017, 11(2): 139-153.
[16] 王宇希, 张凤军, 刘越. 增强现实技术研究现状及发展趋势[J]. 科技导报, 2018, 36(10): 75-83.
Wang Yuxi, Zhang Fengjun, Liu Yue.Augmented Reality Technology[J]. Science & Technology Review, 2018, 36(10): 75-83.
[17] 邹湘军, 孙健, 何汉武, 等. 虚拟现实技术的演变发展与展望[J]. 系统仿真学报, 2004, 16(9): 44-48.
Zou Xiangjun, Sun Jian, He Hanwu, et al.The Development and Prospects of Virtual Reality[J]. Journal of System Simulation, 2004, 16(9): 44-48.
[18] Zou X, Zou H, Lu J.Virtual Manipulator-based Binocular Stereo Vision Positioning System and Errors Modelling[J]. Machine Vision and Applications (S0932-8092), 2012, 23(1): 43-63.
[19] 胡弘, 晁建刚, 杨进, 等. Leap Motion关键点模型手姿态估计方法[J]. 计算机辅助设计与图形学学报, 2015, 27(7): 1211-1216.
Hu Hong, Chao Jianggang, Yang Jin, et al.Key Point Model for Hand Pose Estimation Based on Leap Motion[J]. Journal of Computer-Aided Design and Computer Graphics, 2015, 27(7): 1211-1216.
[20] 徐立云, 刘琨, 陈贻平, 等. 考虑作业人员疲劳度均衡的第一类装配线平衡[J]. 同济大学学报 (自然科学版), 2019, 47(2): 241-247, 290.
Xu Liyun, Liu Kun, Chen Yiping, et al.Assembly Line Balancing Problem-1 Considering Fatigue Balance of Workers[J]. Journal of Tongji University (Natural Science Edition), 2019, 47(2): 241-247, 290.
[21] 王跃, 谭昌柏, 安鲁陵, 等. 基于支持向量机的飞机装配工艺模糊综合评价方法[J]. 机械制造与自动化, 2017, 46(5): 62-66.
Wang Yue, Tan Changbai, An Luling, et al.Fuzzy Comprehensive Evaluation Method of Aircraft Assembly Process Based on SVM[J]. Machinery, 2017, 46(5): 62-66.
[22] 张振铭. 变速箱装配辅线装配任务可操作性分析与评价[D]. 长春: 吉林大学, 2018: 17-21.
Zhang Zhenming.Operability Analysis and Evaluation of Gear-box Auxiliary Line Assembly Task[D]. Changchun: Jilin University, 2018: 17-21.

面向人机协作装配规划的AR仿真交互与人因评估

AR-based Simulation Interaction and Human Factor Assessment for Human Robot Cooperation Assembly Planning

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	孙一铃, 陈谊, 单桂华, 李晓兴. 基于AR技术的多人互动地球仪系统[J]. 系统仿真学报, 2022, 34(6): 1367-1374.
[2]	古鹏飞, 张霖, 陈真, 叶俊杰. 基于X语言的起飞场景民机协同设计与仿真一体化方法[J]. 系统仿真学报, 2022, 34(5): 929-943.
[3]	周鑫, 王维平, 朱一凡, 王涛, 井田. 基于人机协作的无人集群搜索方法研究[J]. 系统仿真学报, 2022, 34(4): 735-744.
[4]	李伯虎, 柴旭东, 张霖, 卿杜政, 施国强, 林廷宇, 郭丽琴, 杨晨, 谷牧, 贾政轩, 公慧, 唐震. 面向智慧物联网的新型嵌入式仿真技术研究[J]. 系统仿真学报, 2022, 34(3): 419-441.
[5]	施国强, 刘泽伟, 林廷宇, 徐钊, 杨星熠, 郭丽琴, 贾政轩. 面向复杂产品建模与仿真系统的开放式云架构设计[J]. 系统仿真学报, 2022, 34(3): 442-451.
[6]	张霖, 王昆玉, 赖李媛君, 任磊. 基于建模仿真的体系工程[J]. 系统仿真学报, 2022, 34(2): 179-190.
[7]	侯守明, 葛倩, 刘彦彦. 基于MAR的非物质文化遗产数字化保护系统研究[J]. 系统仿真学报, 2021, 33(6): 1334-1341.
[8]	魏士松, 周正东, 章栩苓, 毛玲, 贾峻山, 刘传乐. 基于桌面虚拟现实技术的航天器虚拟维修训练系统[J]. 系统仿真学报, 2021, 33(6): 1358-1363.
[9]	郑菱莎, 姜兵, 赵喆, 杨朝旭. 航空复杂嵌入式系统时间性能仿真分析技术研究[J]. 系统仿真学报, 2021, 33(6): 1489-1499.
[10]	张霖, 陆涵. 从建模仿真看数字孪生[J]. 系统仿真学报, 2021, 33(5): 995-1007.
[11]	初阳, 刘志, 窦林涛. 面向大尺度战场的飞行机动建模仿真技术[J]. 系统仿真学报, 2021, 33(3): 613-621.
[12]	余田甜, 王晓萍, 李蔚清, 苏智勇. 面向AR虚拟沙盘的虚拟化身定位定向技术研究[J]. 系统仿真学报, 2021, 33(2): 324-330.
[13]	王峻峰, 张玉帆, 邵瑶琪, 李世其. 面向生产性能数字孪生的仿真数据映射研究[J]. 系统仿真学报, 2021, 33(10): 2470-2477.
[14]	邓晨, 游雄, 智梅霞. 户外增强现实地理配准精度测试评估[J]. 系统仿真学报, 2020, 32(9): 1693-1704.
[15]	蔡兴泉, 杨哲, 何鑫, 陈超. 结合伺服电机的古建筑物增强现实交互展示系统[J]. 系统仿真学报, 2020, 32(6): 1145-1154.