Real-time Non-photorealistic Rendering Method for Black and White Comic Style in Games and Animation

doi:10.16182/j.issn1004731x.joss.23-0458

Abstract

Abstract:

To address the issues of high resource consumption and lengthy workflow in general non-photorealistic, this paper proposes a real-time non-photorealistic rendering method for black and white comic style in games and animation. A specialized lighting model is designed to highlight the main environmental light and the grayscale grading of diffuse reflection based on the analysis of the lighting model effect. The pre-processing of the scene is achieved by merging the various components of the lighting model. A screen space three-phase edge detection method is proposed to sequentially perform depth edge detection, normal edge detection, and color edge detection on the pre-processed scene lighting results, and the edge detection results are combined. The scene lighting results are rendered by screen space partitioning, utilizing dot shading and line shading respectively based on the grayscale value of the lighting results, with interpolation applied to shading boundaries. The results are merged by designing a segmented function based on the grayscale value of the lighting model results, combining the screen space three-phase edge detection results with the screen space partition rendering results to obtain the final rendered output. Experimental results demonstrate that the proposed method can achieve non-photorealistic rendering of black and white comic style with relatively low resource consumption and reduced error rate, showcasing a distinctive black and white comic style.

Key words: black and white comic style, non-photorealistic rendering, real-time rendering, specialized lighting model, edge detection

CLC Number:

TP391.9

Hu Yan, Chen Lizhe, Xie Hanna, Ge Yuyao, Zhou Shun, Cai Xingquan. Real-time Non-photorealistic Rendering Method for Black and White Comic Style in Games and Animation[J]. Journal of System Simulation, 2024, 36(7): 1699-1712.

Figures/Tables 19

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Table 1

Table 2

Table 3

Table 4

Fig. 6

Table 5

Table 6

Table 7

Fig. 7

Table 8

Fig. 8

Fig. 9

Fig. 10

Fig. 11

References 18

1	Kumar M P P, Poornima B, Nagendraswamy H S, et al. A Comprehensive Survey on Non-photorealistic Rendering and Benchmark Developments for Image Abstraction and Stylization[J]. Iran Journal of Computer Science, 2019, 2(3): 131-165.
2	Ouazaa Sofiane, Burguete Javier, Pilar Paniagua M, et al. Simulating Water Distribution Patterns for Fixed Spray Plate Sprinkler Using the Ballistic Theory[J]. Spanish Journal of Agricultural Research, 2014, 12(3): 850-863.
3	钱文华, 曹进德, 徐丹, 等. 非真实感绘制技术研究现状与展望[J]. 中国图象图形学报, 2020, 25(7): 1283-1295.
	Qian Wenhua, Cao Jinde, Xu Dan, et al. Research Status and Progress of Non-photorealistic Rendering Technology[J]. Journal of Image and Graphics, 2020, 25(7): 1283-1295.
4	Gooch A, Gooch B, Shirley P, et al. A Non-photorealistic Lighting Model for Automatic Technical Illustration[C]//Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques. New York, NY, USA: Association for Computing Machinery, 1998: 447-452.
5	康丽锋, 唐棣. 基于彩色形态学的水彩画模拟[J]. 计算机工程与应用, 2010, 46(5): 157-159, 242.
	Kang Lifeng, Tang Di. Watercolor Simulation Based on Color Morphology[J]. Computer Engineering and Applications, 2010, 46(5): 157-159, 242.
6	钱文华, 徐丹, 官铮, 等. 粉笔画艺术风格模拟[J]. 中国图象图形学报, 2017, 22(5): 622-630.
	Qian Wenhua, Xu Dan, Guan Zheng, et al. Simulating Chalk Art Style Painting[J]. Journal of Image and Graphics, 2017, 22(5): 622-630.
7	王浩田, 戴立玲. 机械零件的非真实感渲染研究[J]. 计算机工程与设计, 2012, 33(11): 4377-4381.
	Wang Haotian, Dai Liling. Research on Rendering Mechanical Parts in Non-photorealistic Style[J]. Computer Engineering and Design, 2012, 33(11): 4377-4381.
8	陈颖, 荆树旭, 石剑, 等. 基于多尺度笔刷的分层油画风格化[J]. 计算机辅助设计与图形学学报, 2020, 32(4): 575-581.
	Chen Ying, Jing Shuxu, Shi Jian, et al. Layered Oil Painting Stylization with Multi-scale Brushes[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(4): 575-581.
9	唐翔, 王伟鹏, 罗欢, 等. 面向高分辨率激光扫描点云的三维建筑物风格化渲染方法[J]. 福州大学学报(自然科学版), 2021, 49(6): 761-766.
	Tang Xiang, Wang Weipeng, Luo Huan, et al. A Method on Stylized Rendering of 3-D Building via High-resolution Laser Scanning Point Clouds[J]. Journal of Fuzhou University(Natural Science Edition), 2021, 49(6): 761-766.
10	王一凡, 赵乐义, 李毅. 基于生成对抗网络的图像动漫风格化[J]. 计算机工程与应用, 2022, 58(18): 104-110.
	Wang Yifan, Zhao Leyi, Li Yi. Image Animation Stylization Based on Generative Adversarial Network[J]. Computer Engineering and Applications, 2022, 58(18): 104-110.
11	王少荣, 敖知琪, 要曙丽, 等. 自适应的线条画绘制[J]. 中国图象图形学报, 2018, 23(5): 730-739.
	Wang Shaorong, Ao Zhiqi, Yao Shuli, et al. Adaptive Line Drawing[J]. Journal of Image and Graphics, 2018, 23(5): 730-739.
12	杜玺伦, 谭家万. 真实感图形学的光照模型研究综述[J]. 电子技术与软件工程, 2014(1): 112-113.
13	孟祥艳, 任郁苗, 潘海仙. 真实感体绘制中的光照与阴影模型算法研究[J]. 激光杂志, 2016, 37(8): 141-144.
	Meng Xiangyan, Ren Yumiao, Pan Haixian. Algorithm for Illumination and Shadow Model in Realistic Volume Rendering[J]. Laser Journal, 2016, 37(8): 141-144.
14	Zhang Yuechen, He Zexin, Xing Jinbo, et al. Ref-NPR: Reference-based Non-photorealistic Radiance Fields for Controllable Scene Stylization[C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway, NJ, USA: IEEE, 2023: 4242-4251.
15	蒋宝吉, 唐棣. 基于三维模型的风格化线条渲染方法[J]. 计算机科学, 2013, 40(10): 289-291, 308.
	Jiang Baoji, Tang Di. Research on Stylized Lines Rendering of 3D Models[J]. Computer Science, 2013, 40(10): 289-291, 308.
16	Scalera Lorenzo, Seriani Stefano, Gasparetto Alessandro, et al. Non-photorealistic Rendering Techniques for Artistic Robotic Painting[J]. Robotics, 2019, 8(1): 10.
17	Hyun Kim Jong, Jung Lee. Layered Non-photorealistic Rendering with Anisotropic Depth-of-field Filtering[J]. Multimedia Tools and Applications, 2020, 79(1): 1291-1309.
18	Schumann Jutta, Strothotte Thomas, Laser Stefan, et al. Assessing the Effect of Non-photorealistic Rendered Images in CAD[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, NY, USA: Association for Computing Machinery, 1996: 35-41.

模型名称	模型顶点数	模型面数	类型
Cornell Box	56	42	场景
Utah Teapot	3 644	6 320	物体
Chess Set	26 464	53 072	物体
Stanford Bunny	35 947	69 451	动物角色
Zuo Ling	46 548	109 169	人物角色
You Ling	61 823	128 472	人物角色
Stanford Dragon	871 414	1 742 368	动物角色

顶点数量	平均CPU时间开销/ms	平均GPU时间开销/ms
10	21.47	6.26
100	10.16	17.85
1 000	6.60	2.32
10 000 50 000	49.64 33.57	17.81 14.92
100 000	25.83	13.72
1 000 000	43.27	27.55
10 000 000	23.41	8.83

三角面数量	平均CPU时间开销/ms	平均GPU时间开销/ms
10	12.56	2.32
100	24.42	5.54
1 000	24.91	4.94
10 000	38.91	9.98
50 000	42.33	14.06
100 000	32.14	8.64
1 000 000	33.65	11.58
10 000 000	42.53	22.23

光源数量	平均CPU时间开销/ms	平均GPU时间开销/ms
10	1.94	0.63
50	5.39	2.42
100	13.94	6.18
200	19.38	8.56
300	29.98	13.77
400	43.63	19.84
500	59.13	29.38

渲染方法	手绘纹理贴图数量	平均渲染空间开销/MB	CPU平均渲染时间开销/ms	GPU平均渲染时间开销/ms
纹理贴图方法	4	11.23	32.14	9.13
	8	17.19	48.32	16.32
	16	30.06	78.49	28.97
本文方法	0	3.18	8.01	1.69