光图树：Web3D动态场景全局光照的协同实时渲染

doi:10.16182/j.issn1004731x.joss.18-VR0731

系统仿真学报 ›› 2019, Vol. 31 ›› Issue (8): 1591-1604.doi: 10.16182/j.issn1004731x.joss.18-VR0731

光图树：Web3D动态场景全局光照的协同实时渲染

刘畅^1,2, 贾金原¹, 陆一凡², 张乾³, 赵磊⁴

1. 同济大学,上海 201804;
2. 南昌航空大学,南昌 330063;
3.上海渲图信息科技有限公司,上海 201804;
4.电子科技大学,成都 610054

收稿日期:2018-07-31 修回日期:2018-10-31 发布日期:2019-12-12
作者简介:刘畅(1983-),男,江西南昌,博士,研究方向为虚拟现实、计算机图形学。
基金资助:
同济大学中央高校基本科研业务费专项资金(2100219066),中央高校基本科研业务费 (0200219153),江西省教育厅科技项目(GJJ160697)

GI-Map Tree: Global Illumination Collaborative Real-Time Rendering in Web3D Dynamic Scene

Liu Chang^1,2, Jia Jinyuan¹, Lu Yifan², Zhang Qian³, Zhao Lei⁴

1. Tongji University, Shanghai 201804, China;
2. Nanchang Aviation University, Nanchang 330063, China;
3. Shinegraph Information and Technology Co., Ltd, Shanghai 201804, China;
4. University of Electronic Science and Technology, Chengdu 610054, China

Received:2018-07-31 Revised:2018-10-31 Published:2019-12-12

摘要/Abstract

摘要： 针对于网页虚拟现实环境下的动态光照,在协同式实时渲染系统的基础上提出了一套集预存储、调度及优化为一体的协同实时渲染机制。该机制协助渲染系统在云端构建了基于视点信息的八叉树预存储结构“光图树”以保存和组织光照渲染信息。借助“光图树”以及用户的输入行为,机制引入了基于热度信息的光图组调度算法以提升渲染系统的传输效率。Web3D应用的测试结果表明本机制不但能够高效梳理数以千记的全局光照贴图,而且可以协助协同式实时渲染系统对动态场景光照加速重建。

关键词: 协同式实时渲染, 动态光照, 网页虚拟现实, 光图树, 三维图像变换

Abstract: For the dynamic illumination in web-based virtual reality environment, an interactive real-time rendering mechanism that integrates pre-storage, scheduling and optimization based on a collaborative real-time rendering system. The mechanism helps the rendering system to construct a viewpoint-based pre-storage structure, “GI map tree”, to save and organize illumination rendering information on cloud server. With the assist of “GI map tree” and the user's input behavior, a “heat”-based GI map group scheduling algorithm is proposed to improve the transmission efficiency of the rendering system in this mechanism. The experiment results of Web3D application in the Web environment show that the mechanism can not only effectively organize thousands of GI maps, but also help the collaborative real-time rendering system to accelerate the reconstruction of dynamic scene illumination.

Key words: collaborative real-time rendering, dynamic illumination, web-based virtual reality, GI map tree, 3D image warping

中图分类号:

TP391.9

刘畅, 贾金原, 陆一凡, 张乾, 赵磊. 光图树：Web3D动态场景全局光照的协同实时渲染[J]. 系统仿真学报, 2019, 31(8): 1591-1604.

Liu Chang, Jia Jinyuan, Lu Yifan, Zhang Qian, Zhao Lei. GI-Map Tree: Global Illumination Collaborative Real-Time Rendering in Web3D Dynamic Scene[J]. Journal of System Simulation, 2019, 31(8): 1591-1604.

参考文献

[1] Liu C, Ooi W T, Jia J, et al.Cloud Baking: Collaborative Scene Illumination for Dynamic Web3D Scenes[J]. ACM Transactions on Multimedia Computing, Communications, and Applications (S1551-6857), 2018, 14(3S): 59.
[2] Liu C, Jia J, Zhang Q, et al.Lightweight WebSIM Rendering Framework Based on Cloud-Baking[C]. Proceedings of the 2017 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. Singapore: ACM, 2017: 221-229.
[3] Hu Q, Yu D, Wang S, et al.Hybrid three-dimensional representation based on panoramic images and three-dimensional models for a virtual museum: Data collection, model, and visualization[J]. Information Visualization(S1473-8716), 2017, 16(2): 126-138.
[4] Shi S, Hsu C H.A survey of interactive remote rendering systems[J]. ACM Computing Surveys (S0360-0300), 2015, 47(4): 57.
[5] Cai W, Shea R, Huang C Y, et al.A Survey on Cloud Gaming: Future of Computer Games[J]. IEEE Access (S2169-3536), 2016, 4: 7605-7620.
[6] Chen Y, Liu E S.A path-assisted dead reckoning algorithm for distributed virtual environments[C]. IEEE/ACM 19th International Symposium on Distributed Simulation and Real Time Applications (DS-RT). Cosenza, Italy: IEEE, 2015: 108-111.
[7] Pharr M, Jakob W, Humphreys G.Physically based rendering: From theory to implementation[M]. London, UK: Morgan Kaufmann, 2016.
[8] Guthe S, Schardt P, Goesele M, et al.Ghosting and popping detection for image-based rendering[C]. 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), 2016. Hamburg, Germany: IEEE, 2016: 1-4.
[9] Shi L, Huang F C, Lopes W, et al.Near-eye light field holographic rendering with spherical waves for wide field of view interactive 3d computer graphics[J]. ACM Transactions on Graphics (S0730-0301), 2017, 36(6): 236.
[10] Cohen M F, Szeliski R.Lumigraph[M]. Computer Vision. Boston, MA: Springer, 2014: 462-467.
[11] Pujades S, Devernay F, Goldluecke B.Bayesian view synthesis and image-based rendering principles[C]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus, Ohio: IEEE, 2014: 3906-3913.
[12] Zhang Y X, Zhu Z Q, Ma P F.Walk through a Museum with Binocular Stereo Effect and Spherical Panorama Views[C]. Culture and Computing (Culture and Computing), 2017 International Conference. Kyoto, Japan: IEEE, 2017: 20-23.
[13] Cao C, Wu H, Weng Y, et al.Real-time facial animation with image-based dynamic avatars[J]. ACM Transactions on Graphics (S0730-0301), 2016, 35(4): 126.
[14] Jin J, Wang A, Zhao Y, et al.A fast region-level 3D-warping method for depth-image-based rendering[C]. Multimedia Signal Processing (MMSP), 2015 IEEE 17^th International Workshop. Xiamen, China: IEEE, 2015: 1-6.
[15] Daribo I, Saito H.A novel inpainting-based layered depth video for 3DTV[J]. IEEE Transactions on Broadcasting (S0018-9316), 2011, 57(2): 533-541.
[16] Smolic A, Muller K, Dix K, et al.Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems[C]. 2008 15th IEEE International Conference on Image Processing (Icip 2008). San Diego, California: IEEE, 2008: 2448-2451.
[17] Fehn C.Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV[C]. Stereoscopic Displays and Virtual Reality Systems XI. California, USA: SPIE, 2004, 5291: 93-105.
[18] Shi S, Nahrstedt K, Campbell R.A real-time remote rendering system for interactive mobile graphics[J]. ACM Transactions on Multimedia Computing, Communications, and Applications (S1551-6857), 2012, 8(3S): 46.
[19] Zhu M, Morin G, Carville V, et al.Sprite tree: an efficient image-based representation for networked virtual environments[J]. The Visual Computer(S0178-2789), 2017, 33(11): 1385-1402.
[20] Bao P, Gourlay D.Remote walkthrough over mobile networks using 3-D image warping and streaming[J]. IEE Proceedings-Vision, Image and Signal Processing (S1359-7108), 2004, 151(4): 329-336.
[21] Xu H, Gossett N, Chen B.Knowledge and heuristic-based modeling of laser-scanned trees[J]. ACM Transactions on Graphics (S0730-0301), 2007, 26(4): 19.
[22] Zhang Q L, Pang M Y.A survey of modeling and rendering trees[C]. International Conference on Technologies for E-Learning and Digital Entertainment. Berlin, Heidelberg: Springer, 2008: 757-764.
[23] Zinner T, Hohlfeld O, Abboud O, et al.Impact of frame rate and resolution on objective QoE metrics[C]. The second international workshop on quality of multimedia experience (QoMEX) . Trondheim, Norway: IEEE, 2010: 29-34.

光图树：Web3D动态场景全局光照的协同实时渲染

GI-Map Tree: Global Illumination Collaborative Real-Time Rendering in Web3D Dynamic Scene

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	李智杰, 石昊琦, 李昌华, 张颉. 基于改进遗传算法的影像中心布局优化方法[J]. 系统仿真学报, 2022, 34(6): 1173-1184.
[2]	陈斌, 刘悦, 杨亚磊. 基于STN的机场航班过站保障时间协同规划建模[J]. 系统仿真学报, 2022, 34(6): 1196-1207.
[3]	杨凯, 陈纯毅, 胡小娟, 于海洋. 蒙卡渲染画面多特征非局部均值滤波降噪算法[J]. 系统仿真学报, 2022, 34(6): 1259-1266.
[4]	陈麒, 崔昊杨. 基于改进鸽群层级的无人机集群视觉巡检模型[J]. 系统仿真学报, 2022, 34(6): 1275-1285.
[5]	王沐晴, 张磊, 范秀敏, 骆晓萌, 朱文敏. VR外设驱动的虚拟人姿态优化仿真方法[J]. 系统仿真学报, 2022, 34(6): 1296-1303.
[6]	陆承, 靳学胜. 基于Steam VR的交互仿真水枪灭火训练系统设计[J]. 系统仿真学报, 2022, 34(6): 1312-1319.
[7]	高宏鼐, 付丽疆, 夏倩, 郭亚. 可观测度在光合作用模型性能评估中的应用[J]. 系统仿真学报, 2022, 34(6): 1330-1342.
[8]	倪凌佳, 黄晓霞, 李红旮, 张子博. 基于协作式深度强化学习的火灾应急疏散仿真研究[J]. 系统仿真学报, 2022, 34(6): 1353-1366.
[9]	蒙盾, 胡卓, 张华军. 基于改进A^*算法的多层邮轮疏散系统仿真[J]. 系统仿真学报, 2022, 34(6): 1375-1382.
[10]	郭宇飞, 赵康, 海永清. 面向有限元分析的三角网格布尔运算方法[J]. 系统仿真学报, 2022, 34(5): 1003-1014.
[11]	吴桐, 王清辉, 徐志佳. 三周期极小曲面多孔材料渗透率尺度特性研究[J]. 系统仿真学报, 2022, 34(5): 1015-1024.
[12]	蒋阳升, 王思琛, 高宽, 刘梦, 姚志洪. 混入智能网联车队的混合交通流元胞自动机模型[J]. 系统仿真学报, 2022, 34(5): 1025-1032.
[13]	梁江涛, 王慧琴. 基于改进蚁群算法的建筑火灾疏散路径规划研究[J]. 系统仿真学报, 2022, 34(5): 1044-1053.
[14]	张其文, 张斌. 基于教学优化算法求解置换流水车间调度问题[J]. 系统仿真学报, 2022, 34(5): 1054-1063.
[15]	邢根上, 鲁芳, 李书山, 罗定提. 基于产品体验性的供应链交货模型与仿真研究[J]. 系统仿真学报, 2022, 34(5): 1064-1075.