Real-time Simulation Method of Ultra-high-definition Video Texture

doi:10.16182/j.issn1004731x.joss.22-0452

Abstract

Yangyang Liu, Gangyi Ding, Dapeng Yan, Tong Xue. Real-time Simulation Method of Ultra-high-definition Video Texture[J]. Journal of System Simulation, 2023, 35(8): 1748-1756.

Figures/Tables 12

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Table 1

Table 2

Table 3

Table 4

Fig. 5

Fig. 6

Fig. 7

Table 5

References 20

1	Chi C C, Alvarez-Mesa M, Bross B, et al. SIMD Acceleration for HEVC Decoding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2015, 25(5): 841-855.
2	Shnain H W, Abdullah M N, Jeiad H A. Video Compression Based on FPGA Using SIMD Architecture[J]. Iraqi Journal of Computers, Communications, Control and Systems Engineering, 2021, 21(1): 62-72.
3	Wieckowski A, Hege G, Bartnik C, et al. Towards a Live Software Decoder Implementation for the Upcoming Versatile Video Coding(VVC) Codec[C]//2020 IEEE International Conference on Image Processing(ICIP). Piscataway, NJ, USA: IEEE, 2020: 3124-3128.
4	Jiang Bo, Xu Han, Luo Falei, et al. GPU-based Intra Decompression for 8k Real-time AVS3 Decoder[C]//2020 IEEE Conference on Multimedia Information Processing and Retrieval(MIPR). [S.l.]: IEEE, 2020: 263-266.
5	Jiang Bo, Luo Falei, Wang Shanshe, et al. Efficient GPU-based Inter Prediction for Video Decoder[C]//2019 IEEE International Conference on Image Processing (ICIP). Piscataway, NJ, USA: IEEE, 2019: 1109-1113.
6	Han Xu, Wang Shanshe, Ma Siwei, et al. Optimization of Motion Compensation Based on GPU And CPU For VVC Decoding[C]//2020 IEEE International Conference on Image Processing (ICIP). Piscataway, NJ, USA: IEEE, 2020: 1196-1200.
7	Pratapa S, Krajcevski P, Manocha D. MPTC: Video Rendering for Virtual Screens Using Compressed Textures[C]//Proceedings of the 21st ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. New York, NY, USA: Association for Computing Machinery, 2017: 14.
8	Zhang A, Chen Kan, Johan H, et al. High-performance Adaptive Texture Streaming and Rendering of Large 3D Cities[J]. The Visual Computer, 2022, 38(4): 1245-1262.
9	Wanghai Qing, Liang Tanhuai. Texture Transmission Optimization and Prefetching in GPU Hard Accelerated Rendering[C]//2013 IEEE 4th International Conference on Software Engineering and Service Science. Piscataway, NJ, USA: IEEE, 2013: 401-404.
10	钱谦, 裴以建. DirectShow在三维视频纹理中的应用[J]. 计算机仿真, 2007, 24(10): 180-183, 191.
	Qian Qian, Pei Yijian. Application of DirectShow in 3D Video Texture[J]. Computer Simulation, 2007, 24(10): 180-183, 191.
11	成效, 万旺根, 余小清, 等. GPU视频纹理技术在三维电影播放中的应用[J]. 计算机工程与设计, 2010, 31(18): 4020-4023.
	Cheng Xiao, Wan Wanggen, Yu Xiaoqing, et al. GPU-based Video Texture for 3D Movie Play[J]. Computer Engineering and Design, 2010, 31(18): 4020-4023.
12	Diego F de Souza, Ilic A, Roma N, et al. GHEVC: An Efficient HEVC Decoder for Graphics Processing Units[J]. IEEE Transactions on Multimedia, 2017, 19(3): 459-474.
13	郑波, 顿子振. 基于8k超高清视频转码的技术验证[J]. 现代电视技术, 2021(5): 111-114.
	Zheng Bo, Zizhen Dun. Technology Verification Based on 8k Ultra-high-definition Video Transcoding[J]. Advanced Television Engineering, 2021(5): 111-114.
14	蒲方. 国内4k/8k超高清电视发展的思考与实践[J]. 中国传媒科技, 2021(7): 143-145.
	Pu Fang. Thinking and Practice of the Development of 4k/8k UHD TV in China[J]. Science & Technology for China's Mass Media, 2021(7): 143-145.
15	胡宁, 孙庭. 4k、8k视频H.266编码性能测试与研究[J]. 广播电视网络, 2021, 28(3): 86-89.
	Hu Ning, Sun Ting. 4k, 8k Video H.266 Encoding Performance Test and Research[J]. Radio & Television Network, 2021, 28(3): 86-89.
16	蔡国鑫. 视频编解码技术由面向通用场景向专注定制场景发展演进[J]. 现代电影技术, 2022(2): 64.
	Cai Guoxin. The Evolution of Video Encoding and Decoding Technology From General-purpose Scenarios to Customized Scenarios[J]. Advanced Motion Picture Technology, 2022(2): 64.
17	袁帅, 张静. VR技术下多投影视频纹理合成方法仿真[J]. 计算机仿真, 2021, 38(4): 151-154, 163.
	Yuan Shuai, Zhang Jing. Simulation of Multi Projection Video Texture Synthesis Method Based on VR Technology[J]. Computer Simulation, 2021, 38(4): 151-154, 163.
18	贾克斌, 刘畅, 刘鹏宇, 等. 基于3 D-HEVC的三维视频编码方法综述[J]. 北京工业大学学报, 2019, 45(11): 1082-1094.
	Jia Kebin, Liu Chang, Liu Pengyu, et al. Three-dimensional Video Coding Based on 3D-HEVC: A Survey[J]. Journal of Beijing University of Technology, 2019, 45(11): 1082-1094.
19	叶松, 陈喆, 阚红涛. 海量视频流与三维场景实时集成技术[J]. 长江科学院院报, 2019, 36(11): 162-166.
	Ye Song, Chen Zhe, Kan Hongtao. Real-time Integration of Massive Video Stream and 3D Scene[J]. Journal of Yangtze River Scientific Research Institute, 2019, 36(11): 162-166.
20	龚枭. 软硬结合解码方式的4k视频播放系统[J]. 电声技术, 2018, 42(7): 58-60.
	Gong Xiao. Combination of Hard and Soft Decoding Way of 4k Video Broadcast System[J]. Audio Engineering, 2018, 42(7): 58-60.

仿真阶段	4k	8k
总计	55.263	242.654
解码	17.830	115.541
转码	29.126	94.665
数据传输	8.284	32.425
渲染	0.023	0.023

方法	4k	8k
单线程解码	17.830	115.541
OpenCL并行解码	6.542	11.574
QSV并行解码	7.694	15.453
CUVID并行解码	5.359	9.740
本文并行解码	4.903	8.661

方法	4k	8k
单线程转码	26.126	8.661
多线程并行转码	0.045	0.043

方法	4k	8k
总线传输	33.036	94.357
共享纹理	0.395	0.438

实时渲染指标	无视频纹理	含视频纹理	优化后视频纹理
CPU线程/ms	15.983	58.926	17.540
DrawCall/ms	4.793	55.847	5.251
GPU线程/ms	15.526	57.181	17.638
平均帧率/(帧/s)	65.831	15.314	53.727

Real-time Simulation Method of Ultra-high-definition Video Texture

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 12

References 20

Related Articles 12

Recommended Articles

Metrics

Comments

[1]	Jianlei Liu, Xuejian Jiao, Huaiqian Wang. Development of Vehicle Dynamics Virtual Simulation System Based on CarSim [J]. Journal of System Simulation, 2022, 34(8): 1847-1854.
[2]	Xunyun Liu, Xinhai Xu, Chengzhang Zhu, Hao Li, Lei Zeng. Ultra-Real-Time Visual Simulation System for Multi-View Rendering Tasks [J]. Journal of System Simulation, 2022, 34(7): 1619-1628.
[3]	Fan Yu, Dongqi Luo, Binqiang Si, Jihong Zhu. Phased Array Radar DOA Estimation Simulation System Designed with Interactive Control [J]. Journal of System Simulation, 2022, 34(5): 964-977.
[4]	Xiong Juntao, Li Zhonghang, Lin Guomao, Wu Shengwei, Lin Dongting, Li Qiafeng, Xiao Wenchun. Research on AGV Simulation System Based on Interactive Control [J]. Journal of System Simulation, 2021, 33(3): 657-668.
[5]	Liu Yunqin, Li Ni, Zhao Luming, Bai Jinpeng, Li Tingjun, Wang Chenguang. Real-time Simulation Technology of Fluid-thermo-solid Coupling of Hypersonic Vehicle [J]. Journal of System Simulation, 2021, 33(12): 2820-2827.
[6]	Diao Guijie, Ni Hong, Liu Zhe, Li Yang. Research on Real-time Simulation Method of Bi-SAR Echo in Time-varying Sea Scene [J]. Journal of System Simulation, 2020, 32(11): 2176-2184.
[7]	Wang Mengru, Zhou Shan, Wang Jinbo, Xue Panpan. MATLAB-based physical real-time simulation platform of PMSM in Intelligent Test System [J]. Journal of System Simulation, 2018, 30(6): 2225-2236.
[8]	Zhang Bingda, Chen Ming, Wang Xiao, Wang Lanyu. Multi-rate Simulation Based on Explicit-implicit Hybrid Integration [J]. Journal of System Simulation, 2017, 29(8): 1641-1646.
[9]	Yan Cheng, Huo Decong, Xie Song. Design of Real-time Communication on Bus Using dSPACE System [J]. Journal of System Simulation, 2017, 29(6): 1297-1303.
[10]	Shao Xuqiang, Song Yu. Real-time Simulation of Realistic Melting in Fluid-solid Interaction [J]. Journal of System Simulation, 2017, 29(3): 502-508.
[11]	Zhang Yunyin, Liu Chunguang, Ma Xiaojun, Liao Zili. Real-time Simulation Research on Electric Drive System of Armored Vehicle [J]. Journal of System Simulation, 2017, 29(1): 107-114.
[12]	Zhang Zhaoyan, Wang Bingshu, Wang Xingwu. Research on Real-time Simulation and Simulation Algorithm Optimization of IGBT’s Switching Characteristics Based on FPGA [J]. Journal of System Simulation, 2015, 27(1): 209-216.