光图树：Web3D动态场景全局光照的协同实时渲染

doi:10.16182/j.issn1004731x.joss.18-VR0731

系统仿真学报 ›› 2019, Vol. 31 ›› Issue (8): 1591-1604.doi: 10.16182/j.issn1004731x.joss.18-VR0731

光图树：Web3D动态场景全局光照的协同实时渲染

刘畅^1,2, 贾金原¹, 陆一凡², 张乾³, 赵磊⁴

1. 同济大学,上海 201804;
2. 南昌航空大学,南昌 330063;
3.上海渲图信息科技有限公司,上海 201804;
4.电子科技大学,成都 610054

收稿日期:2018-07-31 修回日期:2018-10-31 发布日期:2019-12-12
第一作者简介:刘畅(1983-),男,江西南昌,博士,研究方向为虚拟现实、计算机图形学。
基金资助:
同济大学中央高校基本科研业务费专项资金(2100219066),中央高校基本科研业务费 (0200219153),江西省教育厅科技项目(GJJ160697)

GI-Map Tree: Global Illumination Collaborative Real-Time Rendering in Web3D Dynamic Scene

Liu Chang^1,2, Jia Jinyuan¹, Lu Yifan², Zhang Qian³, Zhao Lei⁴

1. Tongji University, Shanghai 201804, China;
2. Nanchang Aviation University, Nanchang 330063, China;
3. Shinegraph Information and Technology Co., Ltd, Shanghai 201804, China;
4. University of Electronic Science and Technology, Chengdu 610054, China

Received:2018-07-31 Revised:2018-10-31 Published:2019-12-12

摘要/Abstract

摘要： 针对于网页虚拟现实环境下的动态光照,在协同式实时渲染系统的基础上提出了一套集预存储、调度及优化为一体的协同实时渲染机制。该机制协助渲染系统在云端构建了基于视点信息的八叉树预存储结构“光图树”以保存和组织光照渲染信息。借助“光图树”以及用户的输入行为,机制引入了基于热度信息的光图组调度算法以提升渲染系统的传输效率。Web3D应用的测试结果表明本机制不但能够高效梳理数以千记的全局光照贴图,而且可以协助协同式实时渲染系统对动态场景光照加速重建。

关键词: 协同式实时渲染, 动态光照, 网页虚拟现实, 光图树, 三维图像变换

Abstract: For the dynamic illumination in web-based virtual reality environment, an interactive real-time rendering mechanism that integrates pre-storage, scheduling and optimization based on a collaborative real-time rendering system. The mechanism helps the rendering system to construct a viewpoint-based pre-storage structure, “GI map tree”, to save and organize illumination rendering information on cloud server. With the assist of “GI map tree” and the user's input behavior, a “heat”-based GI map group scheduling algorithm is proposed to improve the transmission efficiency of the rendering system in this mechanism. The experiment results of Web3D application in the Web environment show that the mechanism can not only effectively organize thousands of GI maps, but also help the collaborative real-time rendering system to accelerate the reconstruction of dynamic scene illumination.

Key words: collaborative real-time rendering, dynamic illumination, web-based virtual reality, GI map tree, 3D image warping

中图分类号:

TP391.9

刘畅,贾金原,陆一凡等 . 光图树：Web3D动态场景全局光照的协同实时渲染[J]. 系统仿真学报, 2019, 31(8): 1591-1604.

Liu Chang,Jia Jinyuan,Lu Yifan,et al . GI-Map Tree: Global Illumination Collaborative Real-Time Rendering in Web3D Dynamic Scene[J]. Journal of System Simulation, 2019, 31(8): 1591-1604.

参考文献

[1] Liu C, Ooi W T, Jia J, et al.Cloud Baking: Collaborative Scene Illumination for Dynamic Web3D Scenes[J]. ACM Transactions on Multimedia Computing, Communications, and Applications (S1551-6857), 2018, 14(3S): 59.
[2] Liu C, Jia J, Zhang Q, et al.Lightweight WebSIM Rendering Framework Based on Cloud-Baking[C]. Proceedings of the 2017 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. Singapore: ACM, 2017: 221-229.
[3] Hu Q, Yu D, Wang S, et al.Hybrid three-dimensional representation based on panoramic images and three-dimensional models for a virtual museum: Data collection, model, and visualization[J]. Information Visualization(S1473-8716), 2017, 16(2): 126-138.
[4] Shi S, Hsu C H.A survey of interactive remote rendering systems[J]. ACM Computing Surveys (S0360-0300), 2015, 47(4): 57.
[5] Cai W, Shea R, Huang C Y, et al.A Survey on Cloud Gaming: Future of Computer Games[J]. IEEE Access (S2169-3536), 2016, 4: 7605-7620.
[6] Chen Y, Liu E S.A path-assisted dead reckoning algorithm for distributed virtual environments[C]. IEEE/ACM 19th International Symposium on Distributed Simulation and Real Time Applications (DS-RT). Cosenza, Italy: IEEE, 2015: 108-111.
[7] Pharr M, Jakob W, Humphreys G.Physically based rendering: From theory to implementation[M]. London, UK: Morgan Kaufmann, 2016.
[8] Guthe S, Schardt P, Goesele M, et al.Ghosting and popping detection for image-based rendering[C]. 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), 2016. Hamburg, Germany: IEEE, 2016: 1-4.
[9] Shi L, Huang F C, Lopes W, et al.Near-eye light field holographic rendering with spherical waves for wide field of view interactive 3d computer graphics[J]. ACM Transactions on Graphics (S0730-0301), 2017, 36(6): 236.
[10] Cohen M F, Szeliski R.Lumigraph[M]. Computer Vision. Boston, MA: Springer, 2014: 462-467.
[11] Pujades S, Devernay F, Goldluecke B.Bayesian view synthesis and image-based rendering principles[C]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus, Ohio: IEEE, 2014: 3906-3913.
[12] Zhang Y X, Zhu Z Q, Ma P F.Walk through a Museum with Binocular Stereo Effect and Spherical Panorama Views[C]. Culture and Computing (Culture and Computing), 2017 International Conference. Kyoto, Japan: IEEE, 2017: 20-23.
[13] Cao C, Wu H, Weng Y, et al.Real-time facial animation with image-based dynamic avatars[J]. ACM Transactions on Graphics (S0730-0301), 2016, 35(4): 126.
[14] Jin J, Wang A, Zhao Y, et al.A fast region-level 3D-warping method for depth-image-based rendering[C]. Multimedia Signal Processing (MMSP), 2015 IEEE 17^th International Workshop. Xiamen, China: IEEE, 2015: 1-6.
[15] Daribo I, Saito H.A novel inpainting-based layered depth video for 3DTV[J]. IEEE Transactions on Broadcasting (S0018-9316), 2011, 57(2): 533-541.
[16] Smolic A, Muller K, Dix K, et al.Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems[C]. 2008 15th IEEE International Conference on Image Processing (Icip 2008). San Diego, California: IEEE, 2008: 2448-2451.
[17] Fehn C.Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV[C]. Stereoscopic Displays and Virtual Reality Systems XI. California, USA: SPIE, 2004, 5291: 93-105.
[18] Shi S, Nahrstedt K, Campbell R.A real-time remote rendering system for interactive mobile graphics[J]. ACM Transactions on Multimedia Computing, Communications, and Applications (S1551-6857), 2012, 8(3S): 46.
[19] Zhu M, Morin G, Carville V, et al.Sprite tree: an efficient image-based representation for networked virtual environments[J]. The Visual Computer(S0178-2789), 2017, 33(11): 1385-1402.
[20] Bao P, Gourlay D.Remote walkthrough over mobile networks using 3-D image warping and streaming[J]. IEE Proceedings-Vision, Image and Signal Processing (S1359-7108), 2004, 151(4): 329-336.
[21] Xu H, Gossett N, Chen B.Knowledge and heuristic-based modeling of laser-scanned trees[J]. ACM Transactions on Graphics (S0730-0301), 2007, 26(4): 19.
[22] Zhang Q L, Pang M Y.A survey of modeling and rendering trees[C]. International Conference on Technologies for E-Learning and Digital Entertainment. Berlin, Heidelberg: Springer, 2008: 757-764.
[23] Zinner T, Hohlfeld O, Abboud O, et al.Impact of frame rate and resolution on objective QoE metrics[C]. The second international workshop on quality of multimedia experience (QoMEX) . Trondheim, Norway: IEEE, 2010: 29-34.

光图树：Web3D动态场景全局光照的协同实时渲染

GI-Map Tree: Global Illumination Collaborative Real-Time Rendering in Web3D Dynamic Scene

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	董志明, 胡忠奇, 戴浩然, 高建成. 基于大语言模型的作战仿真想定自动化生成方法[J]. 系统仿真学报, 2026, 38(5): 1129-1145.
[2]	李校男, 晁涛, 马萍, 杨明, 王玉轩. 基于期望最大化方法的非线性SSM黑箱鲁棒辨识[J]. 系统仿真学报, 2026, 38(5): 1146-1158.
[3]	刘银钢, 马明, 张荣华. 基于大语言模型的兵棋推演动态任务规划[J]. 系统仿真学报, 2026, 38(5): 1187-1204.
[4]	苏泓嘉, 张成, 刘飞. 基于模糊功能依赖网分析的体系效能评估方法[J]. 系统仿真学报, 2026, 38(5): 1224-1238.
[5]	梅华威, 杨鹏慧, 余洋. 计及数据漂移改进PatchTST的超短期光伏功率预测[J]. 系统仿真学报, 2026, 38(5): 1239-1254.
[6]	李权, 苏鹏, 万海英, 张承玺, 何志坚, 倪艺洋, 赵忠盖, 刘飞. 基于多阶段LHS-EPRCC方法的青霉素发酵过程建模[J]. 系统仿真学报, 2026, 38(5): 1255-1276.
[7]	周子聪, 曾俊杰, 胡越, 朱正秋, 尹全军. 基于次优示例引导的兵棋推演多智能体强化学习方法[J]. 系统仿真学报, 2026, 38(5): 1277-1289.
[8]	石敏, 郭诗盛, 王素琴, 李兆歆, 朱登明. 融合物理与几何先验的无抓取标注6-DoF抓取检测方法[J]. 系统仿真学报, 2026, 38(5): 1290-1302.
[9]	姜彦吉, 肖星佚, 董浩, 于淼, 黄金山, 刘大千, 费博雯. 融合点线特征的图关系优化3D车道线检测方法[J]. 系统仿真学报, 2026, 38(5): 1303-1319.
[10]	张鑫, 张平, 张琛, 刘威, 韩博阳. 非均质土壤条件下挖掘阻力计算模型研究[J]. 系统仿真学报, 2026, 38(5): 1320-1332.
[11]	王伟, 刘东, 崔新豪, 李博, 肖依永, 任羿. 复杂项目多级动态挣值管理数字化模型及应用[J]. 系统仿真学报, 2026, 38(5): 1350-1364.
[12]	彭莉峻, 苏庭琪, 刘沛津, 何林, 周协武, 张闽心. 融合人体关键点的实验室PPE规范穿戴检测方法[J]. 系统仿真学报, 2026, 38(5): 1365-1382.
[13]	滕靖, 童文聪, 张中杰, 姚幸, 李君羡. 有轨电车交叉口速度自动引导方法及仿真评价[J]. 系统仿真学报, 2026, 38(5): 1426-1439.
[14]	蒋圣超, 裴云庆, 翟宏营, 吴国键, 高放. 基于块编码绝热量子牛顿‒拉夫逊法的潮流计算[J]. 系统仿真学报, 2026, 38(5): 1453-1465.
[15]	秦浪, 谢嘉成, 乔晓军, 王学文, 肖智杰. 执行器位姿异常的机器人轨迹规划调整方法[J]. 系统仿真学报, 2026, 38(5): 1466-1483.