面向电力变压器虚拟装配的多感官融合交互方法

doi:10.16182/j.issn1004731x.joss.21-0604

系统仿真学报 ›› 2022, Vol. 34 ›› Issue (10): 2244-2254.doi: 10.16182/j.issn1004731x.joss.21-0604

• 仿真支撑平台/系统技术 • 上一篇下一篇

面向电力变压器虚拟装配的多感官融合交互方法

邵绪强(), 张浩伟, 冯小华()

华北电力大学(保定)，河北保定 071000

收稿日期:2021-06-29 修回日期:2021-08-27 出版日期:2022-10-30 发布日期:2022-10-18
通讯作者: 冯小华 E-mail:shaoxuqiang@163.com;1064522174@qq.com
作者简介:邵绪强(1982-)，男，博士，副教授，研究方向为计算机图形学。E-mail：shaoxuqiang@163.com
基金资助:
国家自然科学基金(61502168);河北省自然科学基金(F2020502014);中央高校基本科研业务费专项(2021MS095);北京市自然科学基金(4182018)

Multi-sensory Fusion Method for Power Transformer Virtual Assembly

Xuqiang Shao(), Haowei Zhang, Xiaohua Feng()

North China Electric Power University, Baoding 071000, China

Received:2021-06-29 Revised:2021-08-27 Online:2022-10-30 Published:2022-10-18
Contact: Xiaohua Feng E-mail:shaoxuqiang@163.com;1064522174@qq.com

摘要/Abstract

摘要：

虚拟装配技术旨在真实还原设备和物理场景，在真实环境中人们可以通过视觉、听觉、触觉等多种感官与物理世界进行信息交互。针对已有虚拟装配系统的真实感受限于单一感官人机交互方式的问题，提出一种多感官融合的信息交互方法，以提升沉浸感和操作性。提出一种在待装配体零部件体积差异性大的情况下的改进八叉树AABB包围盒碰撞检测算法，提升计算精度的同时极大减少计算量。实验结果表明：该方法在提高操作性和沉浸感方面有优越性。

关键词: 虚拟现实, 虚拟装配, 感觉交互, 碰撞检测, 电力变压器

Abstract:

Virtual assembly technology is to truly restore the equipments and physical scenarios. In the real world, people can interact with the physical world through visual, auditory, tactile and other sense organ. Aiming at the existing virtual assembly system being limited the single sense human-computer interaction mode, so a multi-sense fusion information interaction method is proposed to improve the sense of immersion and operability. An improved AABB Octree bounding box collision detection algorithm of large size diffidence component to be assembled is proposed, which can greatly reduce the amount of calculation and improve the calculation accuracy. The experimental result verifies the operability and the sense of immersion improvement.

Key words: virtual reality, virtual assembly, sensory fusion, collision detection, power transformer

中图分类号:

TP391.9

邵绪强, 张浩伟, 冯小华. 面向电力变压器虚拟装配的多感官融合交互方法[J]. 系统仿真学报, 2022, 34(10): 2244-2254.

Xuqiang Shao, Haowei Zhang, Xiaohua Feng. Multi-sensory Fusion Method for Power Transformer Virtual Assembly[J]. Journal of System Simulation, 2022, 34(10): 2244-2254.

图/表 16

图1

图2

图3

图4

图5

图6

图7

图8

图9

图10

图11

图12

图13

图14

表1

表2

参考文献 15

1	Sagardia M, Hulin T, Hertkorn K, et al. A Platform for Bimanual Virtual Assembly Training with Haptic Feedback in Large Multi-Object Environments[C]// 22nd ACM Conference on Virtual Reality Software and Technology. New York: ACM, 2016: 153-162.
2	Lu Y, Gao B Y, Long J, et al. Hand Motion with Eyes-Free Interaction for Authentication in Virtual Reality[C]// 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops. Piscataway, NJ: IEEE, 2020: 714-715.
3	刘惠义, 王治. 一种基于手势的虚拟场景交互方法[J]. 系统仿真学报, 2011, 23(12): 2671-2675.
	Liu Huiyi, Wang Zhi. Method on Hand Gesture-Based in Virtual Scene[J]. Journal of System Simulation, 2011, 23(12): 2671-2675.
4	鲁明, 王真水, 田元, 等. 一种基于Kinect的虚拟现实姿态交互工具[J]. 系统仿真学报, 2013, 25(9): 2124-2130.
	Lu Ming, Wang Zhenshui, Tian Yuan, et al. Posture Interaction Tool for Virtual Reality Based on Kinect[J]. Journal of System Simulation, 2013, 25(9): 2124-2130.
5	Demir T, Mutlu U, Yıldırım T. Motion-Controlled Virtual Reality Robotic Arm with Kinect[C]//2018 Innovations in Intelligent Systems and Applications. Piscataway, NJ: IEEE, 2018: 1-5.
6	Chang Y J, Chen S F, Chuang A F. A Gesture Recognition System to Transition Autonomously Through Vocational Tasks for Individuals with Cognitive Impairments[J]. Research in Developmental Disabilities (S0891-4222), 2011, 32(6): 2064-2068.
7	刘晓晖, 万丽莉, 季红, 等. 基于中文语音交互的虚拟装配技术研究[J]. 系统仿真学报, 2014, 26(9): 2056-2061.
	Liu Xiaohui, Wan Lili, Ji Hong, et al. Research on Virtual Assembly Technique Based on Chinese Voice Interaction[J]. Journal of System Simulation, 2014, 26(9): 2056-2061.
8	Sun Q, Patney A, Wei L Y, et al. Towards Virtual Reality Infinite Walking: Dynamic Saccadic Redirection[J]. ACM Transactions on Graphics(S0730-0301), 2018, 37(4): 1-13.
9	Li Z, Akkil D, Raisamo R. Gaze-Based Kinaesthetic Interaction for Virtual Reality[J]. Interacting with Computers(S0953-5438), 2020, 32(1): 17-32.
10	Gugenheimer J, Dobbelstein D, Winkler C, et al. Facetouch: Enabling Touch Interaction in Display Fixed Uis for Mobile Virtual Reality[C]//The 29th Annual Symposium on User Interface Software and Technology. New York, NY: ACM, 2016: 49-60.
11	Lindeman R W, Sibert J L, Hahn J K. Towards Usable VR: An Empirical Study of User Interfaces for Immersive Virtual Environments[C]//SIGCHI Conference on Human Factors in Computing Systems. New York, NY: ACM, 1999: 64-71.
12	Gunkel S, Prins M, Stokking H, et al. WebVR Meets WebRTC: Towards 360-Degree Social VR Experiences [C]//2017 IEEE Virtual Reality. Los Alamitos, CA: IEEE Computer Society, 2017: 457-458.
13	Zielinski D, Macdonald B, Kopper R. Comparative Study of Input Devices for a VR Mine Simulation [C]// 2014 IEEE Virtual Reality. Los Alamitos, CA: IEEE Computer Society, 2014: 125-126.
14	邹俞, 晁建刚, 杨进. 航天员虚拟交互操作训练多体感融合驱动方法研究[J]. 图学学报, 2018, 39(4): 742-751.
	Zou Yu, Chao Jiangang, Yang Jin. On Multi- Somatosensory Driven Method for Virtual Interactive Operation Training of Astronaut[J]. Journal of Graphics, 2018, 39(4): 742-751.
15	林莹莹, 蔡睿凡, 朱雨真, 等. 基于Leap Motion的虚拟现实陶艺体验系统[J]. 图学学报, 2020, 41(1): 57-65.
	Lin Yingying, Cai Ruifan, Zhu Yuzhen, et al. Virtual Reality Pottery Modeling System Based on Leap Motion[J]. Journal of Graphics, 2020, 41(1): 57-65.

零件	体积参数/(mm)			顶点数	三角面片数
阀门	48	24	24	14 830	13 886
油枕	72	105	233	1 988	1 950

组别	包围盒分层数		运算时间/ms
组别	阀门	油枕	运算时间/ms
实验组	3	4	6.083 2
对照组A	3	3	6.012 6
对照组B	4	4	6.127 8

[1]	周晓光, 朱鹏, 张源原, 路欢, 周媛. 六自由度跳伞模拟训练系统设计与实现[J]. 系统仿真学报, 2022, 34(6): 1320-1329.
[2]	许世健, 赵丹, 苏铖宇, 王赋攀, 张晓蓉, 王昉, 吴亚东. 面向流场可视化的沉浸式虚拟现实交互系统研究[J]. 系统仿真学报, 2022, 34(5): 1160-1172.
[3]	孙佳文, 任鸿翔, 肖方兵, 蒋效彬. 基于虚拟现实的整船仿真训练平台[J]. 系统仿真学报, 2021, 33(9): 2243-2251.
[4]	舒亮, 张洁, 杨艳芳, 杨秒, 吴自然. 考虑节拍约束的断路器孪生车间模型动力学控制[J]. 系统仿真学报, 2021, 33(6): 1277-1287.
[5]	魏士松, 周正东, 章栩苓, 毛玲, 贾峻山, 刘传乐. 基于桌面虚拟现实技术的航天器虚拟维修训练系统[J]. 系统仿真学报, 2021, 33(6): 1358-1363.
[6]	李承恩, 邹湘军, 曾泽钦, 何建华, 李慧, 黄钊丰. 基于虚拟碰撞体的弧齿锥齿轮网格实体构建算法[J]. 系统仿真学报, 2021, 33(4): 837-844.
[7]	贾春洋, 邹湘军, 李锦慧, 曾泽钦, 王杰. 虚拟环境下的复杂变速箱交互式装配仿真平台[J]. 系统仿真学报, 2020, 32(9): 1736-1743.
[8]	郭园, 童倩倩, 郑宇铠, 王子琦, 张玉茹, 王党校. 融合多元触觉和沉浸式视觉的可移植VR软件框架[J]. 系统仿真学报, 2020, 32(7): 1385-1392.
[9]	文国军, 夏雨, 王玉丹, 胡自飞, 吴丹. 基于Unity3D的水平定向钻机虚拟实训系统设计[J]. 系统仿真学报, 2020, 32(5): 801-807.
[10]	刘畅, 贾金原, 陆一凡, 张乾, 赵磊. 光图树：Web3D动态场景全局光照的协同实时渲染[J]. 系统仿真学报, 2019, 31(8): 1591-1604.
[11]	谭力恒, 马强, 蒋秉川, 李锋. 面向头盔式虚拟现实的OsgEarth立体视觉生成方法[J]. 系统仿真学报, 2019, 31(7): 1290-1299.
[12]	解翠, 耿俊美, 李健, 董军宇. 压缩性骨折内固定手术仿真[J]. 系统仿真学报, 2019, 31(7): 1351-1357.
[13]	祁彬斌, 朱学芳, 范丽鹏. 基于触觉交互的三维弹性物体形变仿真算法[J]. 系统仿真学报, 2019, 31(11): 2296-2305.
[14]	闫丰亭, 史志才, 苏前敏, 董婧, 陈珏, 石蕴玉, 汤显. 物联网与虚拟现实融合的智能火灾营救机制[J]. 系统仿真学报, 2019, 31(11): 2306-2322.
[15]	焦欢欢, 潘志庚, 徐舒畅, 袁庆曙. 基于VR的言语失用症康复训练系统[J]. 系统仿真学报, 2019, 31(11): 2344-2349.

面向电力变压器虚拟装配的多感官融合交互方法

Multi-sensory Fusion Method for Power Transformer Virtual Assembly

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

图/表 16

参考文献 15

相关文章 15

编辑推荐

Metrics

本文评价