GI-Map Tree: Global Illumination Collaborative Real-Time Rendering in Web3D Dynamic Scene

doi:10.16182/j.issn1004731x.joss.18-VR0731

Abstract

Abstract: For the dynamic illumination in web-based virtual reality environment, an interactive real-time rendering mechanism that integrates pre-storage, scheduling and optimization based on a collaborative real-time rendering system. The mechanism helps the rendering system to construct a viewpoint-based pre-storage structure, “GI map tree”, to save and organize illumination rendering information on cloud server. With the assist of “GI map tree” and the user's input behavior, a “heat”-based GI map group scheduling algorithm is proposed to improve the transmission efficiency of the rendering system in this mechanism. The experiment results of Web3D application in the Web environment show that the mechanism can not only effectively organize thousands of GI maps, but also help the collaborative real-time rendering system to accelerate the reconstruction of dynamic scene illumination.

Key words: collaborative real-time rendering, dynamic illumination, web-based virtual reality, GI map tree, 3D image warping

CLC Number:

TP391.9

Liu Chang, Jia Jinyuan, Lu Yifan, Zhang Qian, Zhao Lei. GI-Map Tree: Global Illumination Collaborative Real-Time Rendering in Web3D Dynamic Scene[J]. Journal of System Simulation, 2019, 31(8): 1591-1604.

References

[1] Liu C, Ooi W T, Jia J, et al.Cloud Baking: Collaborative Scene Illumination for Dynamic Web3D Scenes[J]. ACM Transactions on Multimedia Computing, Communications, and Applications (S1551-6857), 2018, 14(3S): 59.
[2] Liu C, Jia J, Zhang Q, et al.Lightweight WebSIM Rendering Framework Based on Cloud-Baking[C]. Proceedings of the 2017 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. Singapore: ACM, 2017: 221-229.
[3] Hu Q, Yu D, Wang S, et al.Hybrid three-dimensional representation based on panoramic images and three-dimensional models for a virtual museum: Data collection, model, and visualization[J]. Information Visualization(S1473-8716), 2017, 16(2): 126-138.
[4] Shi S, Hsu C H.A survey of interactive remote rendering systems[J]. ACM Computing Surveys (S0360-0300), 2015, 47(4): 57.
[5] Cai W, Shea R, Huang C Y, et al.A Survey on Cloud Gaming: Future of Computer Games[J]. IEEE Access (S2169-3536), 2016, 4: 7605-7620.
[6] Chen Y, Liu E S.A path-assisted dead reckoning algorithm for distributed virtual environments[C]. IEEE/ACM 19th International Symposium on Distributed Simulation and Real Time Applications (DS-RT). Cosenza, Italy: IEEE, 2015: 108-111.
[7] Pharr M, Jakob W, Humphreys G.Physically based rendering: From theory to implementation[M]. London, UK: Morgan Kaufmann, 2016.
[8] Guthe S, Schardt P, Goesele M, et al.Ghosting and popping detection for image-based rendering[C]. 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), 2016. Hamburg, Germany: IEEE, 2016: 1-4.
[9] Shi L, Huang F C, Lopes W, et al.Near-eye light field holographic rendering with spherical waves for wide field of view interactive 3d computer graphics[J]. ACM Transactions on Graphics (S0730-0301), 2017, 36(6): 236.
[10] Cohen M F, Szeliski R.Lumigraph[M]. Computer Vision. Boston, MA: Springer, 2014: 462-467.
[11] Pujades S, Devernay F, Goldluecke B.Bayesian view synthesis and image-based rendering principles[C]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus, Ohio: IEEE, 2014: 3906-3913.
[12] Zhang Y X, Zhu Z Q, Ma P F.Walk through a Museum with Binocular Stereo Effect and Spherical Panorama Views[C]. Culture and Computing (Culture and Computing), 2017 International Conference. Kyoto, Japan: IEEE, 2017: 20-23.
[13] Cao C, Wu H, Weng Y, et al.Real-time facial animation with image-based dynamic avatars[J]. ACM Transactions on Graphics (S0730-0301), 2016, 35(4): 126.
[14] Jin J, Wang A, Zhao Y, et al.A fast region-level 3D-warping method for depth-image-based rendering[C]. Multimedia Signal Processing (MMSP), 2015 IEEE 17^th International Workshop. Xiamen, China: IEEE, 2015: 1-6.
[15] Daribo I, Saito H.A novel inpainting-based layered depth video for 3DTV[J]. IEEE Transactions on Broadcasting (S0018-9316), 2011, 57(2): 533-541.
[16] Smolic A, Muller K, Dix K, et al.Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems[C]. 2008 15th IEEE International Conference on Image Processing (Icip 2008). San Diego, California: IEEE, 2008: 2448-2451.
[17] Fehn C.Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV[C]. Stereoscopic Displays and Virtual Reality Systems XI. California, USA: SPIE, 2004, 5291: 93-105.
[18] Shi S, Nahrstedt K, Campbell R.A real-time remote rendering system for interactive mobile graphics[J]. ACM Transactions on Multimedia Computing, Communications, and Applications (S1551-6857), 2012, 8(3S): 46.
[19] Zhu M, Morin G, Carville V, et al.Sprite tree: an efficient image-based representation for networked virtual environments[J]. The Visual Computer(S0178-2789), 2017, 33(11): 1385-1402.
[20] Bao P, Gourlay D.Remote walkthrough over mobile networks using 3-D image warping and streaming[J]. IEE Proceedings-Vision, Image and Signal Processing (S1359-7108), 2004, 151(4): 329-336.
[21] Xu H, Gossett N, Chen B.Knowledge and heuristic-based modeling of laser-scanned trees[J]. ACM Transactions on Graphics (S0730-0301), 2007, 26(4): 19.
[22] Zhang Q L, Pang M Y.A survey of modeling and rendering trees[C]. International Conference on Technologies for E-Learning and Digital Entertainment. Berlin, Heidelberg: Springer, 2008: 757-764.
[23] Zinner T, Hohlfeld O, Abboud O, et al.Impact of frame rate and resolution on objective QoE metrics[C]. The second international workshop on quality of multimedia experience (QoMEX) . Trondheim, Norway: IEEE, 2010: 29-34.