面向多视角渲染任务的超实时可视仿真系统

doi:10.16182/j.issn1004731x.joss.21-0248

系统仿真学报 ›› 2022, Vol. 34 ›› Issue (7): 1619-1628.doi: 10.16182/j.issn1004731x.joss.21-0248

• 仿真支撑平台/系统技术 • 上一篇下一篇

面向多视角渲染任务的超实时可视仿真系统

刘逊韵(), 徐新海(), 朱成璋, 李豪, 曾蕾

军事科学院战争研究院，北京 100091

收稿日期:2021-03-24 修回日期:2021-06-07 出版日期:2022-07-30 发布日期:2022-07-20
通讯作者: 徐新海 E-mail:xunyunliu@outlook.com;xuxinhai@nudt.edu.cn
作者简介:刘逊韵（1989-），男，博士，助理研究员，研究方向为高性能计算与并行仿真。E-mail：xunyunliu@outlook.com

Ultra-Real-Time Visual Simulation System for Multi-View Rendering Tasks

Xunyun Liu(), Xinhai Xu(), Chengzhang Zhu, Hao Li, Lei Zeng

Academy of Military Science, Beijing 100091, China

Received:2021-03-24 Revised:2021-06-07 Online:2022-07-30 Published:2022-07-20
Contact: Xinhai Xu E-mail:xunyunliu@outlook.com;xuxinhai@nudt.edu.cn

摘要/Abstract

摘要：

针对多视角渲染任务超实时可视仿真这一难题，从理论上分析了面向多视角渲染任务的超实时仿真实现原理及可行性，提出了一种仿真计算与渲染计算分离的超实时可视仿真系统架构；提出了一种基于并行渲染的超实时可视仿真方法，解决了渲染任务分配、仿真世界同步、渲染时机选择等关键问题。实现了基于虚幻引擎（unreal engine4，UE4）主从模式的超实时可视仿真系统；设计系统应用案例，测试了超实时仿真性能，验证了该超实时可视仿真系统在多视角渲染场景下的渲染效率和超实时仿真能力。

关键词: 超实时仿真, 可视仿真, 多视角渲染, 虚幻引擎

Abstract:

For multi-view rendering tasks, a theoretical analysis of ultra-real-time visual simulation is given in terms of implementation principle and feasibility. Based on the theoretical results, an ultra-real-time visual simulation architecture is designed, which decouples the simulation and rendering computation. A parallel-rendering-based ultra-real-time visual simulation method is proposed to solve the problems of rendering task assignment, simulation world synchronization, and rendering-execution time selection. An ultra-real-time visual simulation system is implemented based on Unreal Engine 4 (UE4), the performance of which is demonstrated on a designated application case per rendering efficiency and ultra-real-time simulation.

Key words: ultra-real-time simulation, visual simulation, multi-view rendering, UE4

中图分类号:

TP391.9

刘逊韵, 徐新海, 朱成璋, 李豪, 曾蕾. 面向多视角渲染任务的超实时可视仿真系统[J]. 系统仿真学报, 2022, 34(7): 1619-1628.

Xunyun Liu, Xinhai Xu, Chengzhang Zhu, Hao Li, Lei Zeng. Ultra-Real-Time Visual Simulation System for Multi-View Rendering Tasks[J]. Journal of System Simulation, 2022, 34(7): 1619-1628.

图/表 9

图1

图2

图3

图4

图5

图6

图7

图8

图9

参考文献 14

1	Koenig, Nathan, Howard Andrew. Design and Use Paradigms for Gazebo, An Open-source Multi-Robot Simulator[C]// IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan: IEEE, 2004: 2149-2154.
2	Vaughan, Richard. Massively Multi-Robot Simulation in Stage[J]. Swarm Intelligence (S1935-3812), 2008(2): 189-208.
3	Todorov, Emanuel, Erez Tom, and Tassa Yuval. Mujoco: A Physics Engine for Model-based Control[C]// IEEE/RSJ International Conference on Intelligent Robots and Systems. Viamoura-Algarve, Portugal: IEEE, 2012: 5026-5033.
4	Qiu, Weichao, and Yuille Alan. Unrealcv: Connecting Computer Vision to Unreal Engine[C]// European Conference on Computer Vision. Amsterdam, The Netherlands Springer Cham, 2016, 9-16.
5	Martinez-Gonzalez, Pablo, Oprea Sergiu, Garcia-Garcia Alberto, et al. Unrealrox: An Extremely Photorealistic Virtual Reality Environment for Robotics Simulations and Synthetic Data Generation[J]. Virtual Reality (S1359-4338), 2020, 24: 271-288.
6	Shah, Shital, Dey Debadeepta, Lovett Chris, et al. Airsim: High-fidelity Visual and Physical Simulation for Autonomous Vehicles[J]. Field and Service Robotics (S2511-1256). 2018, 5: 621-635.
7	Dosovitskiy, Alexey, Ros German, Codevilla Felipe, et al. CARLA: An Open Urban Driving Simulator[C]//Conference on Robot Learning. Montain view,California, USA: CARLA, 2017: 1-16.
8	Yan, Claudia, Misra Dipendra, Bennnett Andrew, et al. Chalet: Cornell House Agent Learning Environment [M/OL]. arXiv. 2018: 1-5.[2018-01-23]..
9	Ros, German, Sellart Laura, Materzynska Joanna, et al. The Synthia Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban Scenes[C]// IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA: IEEE, 2016: 3234-3243.
10	Savva, Manolis, X. Chang Angel, Dosovitskiy Alexey, et al. MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments [M/OL]// arXiv, 2017: 1-14 [2017-12-11]. .
11	Sanders, Andrew. An Introduction to Unreal Engine 4 [M]. AK Peters/CRC Press, 2016.
12	谭亚新, 罗建华, 范锐, 等. 一种基于作战编成并行仿真方法及其实现[J]. 系统仿真学报, 2019, 31(11): 2350–2355.
	Tan Yaxin, Luo Jianhua, Fan Rui, et al. A Parallel Simulation Method for Combat Organization and Implementation[J]. Journal of System Simulation. 2019, 31(11): 2350–2355.
13	屈洪春, 姚献慧, 尹力, 等. 多 Agent 系统在空间直观仿真建模中的并行化[J]. 系统仿真学报, 2020, 32(3): 446-454.
	Qu Hongchun, Yao Xianhui, Yin Li, et al. Parallel Computing of Multi-Agent System in Spatially-Explicit Modeling and Simulation[J]. Journal of System Simulation. 2020, 32(3): 446-454.
14	曾蕾, 李豪, 林宇斐, 等. 基于异步机制的 Gazebo 仿真优化研究 [J]. 计算机科学, 2020, 47(11A): 593-598.
	Zeng Lei, Li Hao, Lin Yufei, et al. Study on Simulation on Optimization of Gazebo Based on Asynchronous Mechanism[J]. Computer Science. 2020, 47(11A): 593-598.

[1]	邸彦强, 李婷, 冯少冲, 刘琼瑶, 吕建红, 陈志佳, 张阳, 曹朋飞. 云边端架构的装备精确维修平行仿真系统[J]. 系统仿真学报, 2022, 34(09): 1909-1919.
[2]	李铭浩, 毕文豪, 张安, 孙文轩. 穿透性制空下无人飞行器发射母机作战体系及关键技术[J]. 系统仿真学报, 2022, 34(9): 1920-1932.
[3]	傅妍芳, 张楠, 魏佳宁, 曲少春, 卢颖, 刘畅. 基于OPNET的机群数据链混合TDMA协议仿真[J]. 系统仿真学报, 2022, 34(9): 1933-1940.
[4]	罗俊仁, 张万鹏, 袁唯淋, 胡振震, 陈少飞, 陈璟. 面向多智能体博弈对抗的对手建模框架[J]. 系统仿真学报, 2022, 34(9): 1941-1955.
[5]	张莉, 张惠珍, 刘冬, 陆雨欣. 考虑紧迫度的应急物资调度及粒子群算法求解[J]. 系统仿真学报, 2022, 34(9): 1988-1998.
[6]	祁启明, 傅瑞罡, 王平, 汪敏, 范红旗. 面向小型航空器应用的光学复眼仿真软件设计[J]. 系统仿真学报, 2022, 34(9): 1999-2008.
[7]	朱依婷, 闫云, 何兆成. 公交与社会车辆混合的中观交通建模与仿真[J]. 系统仿真学报, 2022, 34(9): 2019-2027.
[8]	李成兵, 李云飞, 吴鹏. 考虑时间特性的城市群客运网络抗毁性研究[J]. 系统仿真学报, 2022, 34(9): 2037-2045.
[9]	盛俊杰, 唐兆, 董少迪, 吴舒扬, 梁浩. 铁道车辆动力学云平台架构设计及原型验证[J]. 系统仿真学报, 2022, 34(9): 2056-2064.
[10]	张立峰, 苗雨. 一种声学层析成像温度分布高分辨率重建方法[J]. 系统仿真学报, 2022, 34(9): 2065-2073.
[11]	郑文, 张喆, 朱静宜. 双平台市场排他性竞争仿真[J]. 系统仿真学报, 2022, 34(9): 2098-2106.
[12]	金炜东, 张述礼, 唐鹏, 张曼. 基于稠密残差块与通道像素注意力的图像去雾网络[J]. 系统仿真学报, 2022, 34(8): 1663-1673.
[13]	张会林, 金玉洁, 杨海马. ANFIS优化磁链滑模观测器的PMSM无传感器控制[J]. 系统仿真学报, 2022, 34(8): 1682-1690.
[14]	谢启苗, 郭帅帅. 基于社会力模型的客船人员疏散仿真研究[J]. 系统仿真学报, 2022, 34(8): 1710-1724.
[15]	胡万杰, 董建军, 任睿, 陈志龙. 考虑模糊不确定的地铁货运系统成网布局规划[J]. 系统仿真学报, 2022, 34(8): 1725-1740.

面向多视角渲染任务的超实时可视仿真系统

Ultra-Real-Time Visual Simulation System for Multi-View Rendering Tasks

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

图/表 9

参考文献 14

相关文章 15

编辑推荐

Metrics

本文评价