Automatic Target Recognition of Substation 3D Scene for Digital Twin

doi:10.16182/j.issn1004731x.joss.22-0867

Abstract

Abstract:

In order to improve the accuracy of automatic target recognition and promote the effect on substation operation and maintenance, automatic target recognition of substation 3D scene for digital twin is proposed. The automatic target recognition model for the three-dimensional scene of the substation is constructed. The perception module of the model is used to collect the real-time status data of substation, and the communication module is used to transmit the data to digital twin modules. This module, based on the received data information, realizes the deep fusion and panoramic mapping of substation information through the knowledge base constructed by the knowledge map and the virtual and real data processing unit of the service module. Non-uniform rational b-splines(NURBS) surface reconstruction method is used to create a three-dimensional scene model of substation. The forward looking automatic target recognition unit uses the forward looking template matching technology to accurately recognize the single target and multiple targets in the three-dimensional scene model of the substation according to the knowledge base. The experimental results show that the model has excellent 3D modeling effect in both simple and complex scenes. In cloudy and foggy days, the model can still accurately identify all the targets in substation.

Key words: digital twin, substation, 3D scene, forward looking automatic target, identification model, forward looking template matching

CLC Number:

TP311

Tu Qian, Li Jun, Fan Dongliang, Kong Qi, Shen Jie. Automatic Target Recognition of Substation 3D Scene for Digital Twin[J]. Journal of System Simulation, 2023, 35(12): 2594-2601.

Figures/Tables 6

Fig. 1

Fig. 2

Fig. 3

Table 1

Fig. 4

Fig. 5

References 17

1	郭政, 吴武清, 邱倬, 等. 无人值守变电站三维实景目标协同识别模型构建[J]. 水电能源科学, 2021, 39(7): 163-166, 170.
	Guo Zheng, Wu Wuqing, Qiu Zhuo, et al. Construction of Collaborative Identification Model for 3D Real Object of Unattended Substation[J]. Water Resources and Power, 2021, 39(7): 163-166, 170.
2	陈斌, 牛津文, 万红, 等. 变电站辅助设备监控系统三维建模及展示技术研究[J]. 电力系统保护与控制, 2020, 48(13): 180-186.
	Chen Bin, Niu Jinwen, Wan Hong, et al. Research on Three-dimensional Modeling and Display Technology of a Substation Auxiliary Equipment Monitoring System[J]. Power System Protection and Control, 2020, 48(13): 180-186.
3	周圣栋, 解蕾, 宋若晨, 等. 基于BIM的变电站数字化建设管控平台构建及应用[J]. 中国电力, 2019, 52(5): 142-147.
	Zhou Shengdong, Xie Lei, Song Ruochen, et al. Building and Application of Substation Digital Construction Management Platform Based on BIM[J]. Electric Power, 2019, 52(5): 142-147.
4	牛辰庚, 刘玉杰, 李宗民, 等. 基于点云数据的三维目标识别和模型分割方法[J]. 图学学报, 2019, 40(2): 274-281.
	Niu Chengeng, Liu Yujie, Li Zongmin, et al. 3D Object Recognition and Model Segmentation Based on Point Cloud Data[J]. Journal of Graphics, 2019, 40(2): 274-281.
5	贺丰收, 何友, 刘准钆, 等. 卷积神经网络在雷达自动目标识别中的研究进展[J]. 电子与信息学报, 2020, 42(1): 119-131.
	He Fengshou, He You, Liu Zhunga, et al. Research and Development on Applications of Convolutional Neural Networks of Radar Automatic Target Recognition[J]. Journal of Electronics & Information Technology, 2020, 42(1): 119-131.
6	李晨阳, 李立钢, 杨震, 等. 基于三维场景的红外成像仿真框架及实现[J]. 计算机仿真, 2020, 37(7): 248-252.
	Li Chenyang, Li Ligang, Yang Zhen, et al. Framework and Implementation of Infrared Image Simulation Based on 3D Scene[J]. Computer Simulation, 2020, 37(7): 248-252.
7	刁桂杰, 倪虹, 杨亮. 三维场景SAR射频仿真技术研究[J]. 系统仿真学报, 2020, 32(1): 78-86.
	Diao Guijie, Ni Hong, Yang Liang. Study on Three-dimensional Scene SAR Radio Frequency Simulation Technology[J]. Journal of System Simulation, 2020, 32(1): 78-86.
8	王妤, 陈秀新, 袁和金. 基于改进Faster RCNN的变电站红外图像多目标识别[J]. 传感技术学报, 2021, 34(4): 522-530.
	Wang Yu, Chen Xiuxin, Yuan Hejin. Multi-target Recognition of Substation Infrared Image Based on Improved Faster RCNN[J]. Chinese Journal of Sensors and Actuators, 2021, 34(4): 522-530.
9	刘胜书, 顾国华, 王俊舟, 等. 基于机器视觉的协作式机器人Baxter目标识别算法[J]. 电光与控制, 2019, 26(4): 95-99, 105.
	Liu Shengshu, Gu Guohua, Wang Junzhou, et al. An Object Recognition Algorithm Based on Machine Vision of Collaborative Robot Baxter[J]. Electronics Optics & Control, 2019, 26(4): 95-99, 105.
10	孙小虎, 韩文军, 潘娟, 等. 基于聚合与动态调度的变电站三维可视化研究[J]. 计算机工程, 2019, 45(12): 300-307.
	Sun Xiaohu, Han Wenjun, Pan Juan, et al. Research on Three-dimensional Visualization of Substation Based on Aggregation and Dynamic Scheduling[J]. Computer Engineering, 2019, 45(12): 300-307.
11	龙丽娟, 夏永华, 黄德. 一种基于三维激光扫描点云数据的变电站快速建模方法[J]. 激光与光电子学进展, 2020, 57(20): 353-362.
	Long Lijuan, Xia Yonghua, Huang De. Fast Modeling Method for Substation Based on 3D Laser Scanning Point Cloud Data[J]. Laser & Optoelectronics Progress, 2020, 57(20): 353-362.
12	王运达, 张钢, 于泓, 等. 基于数字孪生的城轨供电系统高保真建模方法[J]. 高电压技术, 2021, 47(5): 1576-1583.
	Wang Yunda, Zhang Gang, Yu Hong, et al. High Fidelity Modeling Method of Urban Rail Power Supply System Based on Digital Twin[J]. High Voltage Engineering, 2021, 47(5): 1576-1583.
13	王鹏, 杨妹, 祝建成, 等. 面向数字孪生的动态数据驱动建模与仿真方法[J]. 系统工程与电子技术, 2020, 42(12): 2779-2786.
	Wang Peng, Yang Mei, Zhu Jiancheng, et al. Dynamic Data Driven Modeling and Simulation Method for Digital Twin[J]. Systems Engineering and Electronics, 2020, 42(12): 2779-2786.
14	田小强, 孔令富, 孔德明, 等. 利用离散平稳小波变换改进NURBS二次曲面拟合方法[J]. 计量学报, 2020, 41(6): 662-668.
	Tian Xiaoqiang, Kong Lingfu, Kong Deming, et al. An Improved Method for NURBS Quadric Surface Based on Discrete Stationary Wavelet Transform[J]. Acta Metrologica Sinica, 2020, 41(6): 662-668.
15	张翠芳, 李成文利, 邹应全, 等. 基于DST融合多视图模糊推理赋值的三维目标检测[J]. 控制与决策, 2021, 36(4): 867-875.
	Zhang Cuifang, Li Chengwenli, Zou Yingquan, et al. 3D Object Detection Based on DST Fusion Multi-view Fuzzy Reasoning Assignment[J]. Control and Decision, 2021, 36(4): 867-875.
16	朱克凡, 王杰贵, 叶文强. 不均衡样本下的低分辨雷达目标识别算法[J]. 计算机仿真, 2021, 38(3): 10-14, 185.
	Zhu Kefan, Wang Jiegui, Ye Wenqiang. Low-resolution Radar Target Recognition Algorithm with Unbalanced Samples[J]. Computer Simulation, 2021, 38(3): 10-14, 185.
17	苗晟, 董亮, 董建娥, 等. 基于蜂窝网结构的多目标自动辨识定位方法[J]. 计算机应用, 2019, 39(11): 3343-3348.
	Miao Sheng, Dong Liang, Dong Jiane, et al. Multi-objective Automatic Identification and Localization System in Mobile Cellular Networks[J]. Journal of Computer Applications, 2019, 39(11): 3343-3348.

图像编号	边缘像素数	4连同域数	8连同域数	O/M	O/N
Q1	12 368	49 467	1 484	0.12	0.03
Q2	15 469	18 282	2 011	0.13	0.11
Q3	17 521	9 347	1 402	0.08	0.15
Q4	12 359	5 088	865	0.07	0.17
Q5	14 552	20 013	1 601	0.11	0.08
P1	13 456	22 433	1 346	0.10	0.06
P2	17 568	17 567	2 108	0.12	0.12
P3	13 267	4 420	663	0.05	0.15
P4	11 029	11 033	993	0.09	0.09
P5	12 314	13 436	1 478	0.12	0.11

[1]	Qin Lang, Xie Jiacheng, Qiao Xiaojun, Wang Xuewen, Xiao Zhijie. Robot Trajectory Planning and Adjustment Method for Abnormal Pose of Actuator [J]. Journal of System Simulation, 2026, 38(5): 1466-1483.
[2]	Nan Yandong, Zhu Jinda, Lu Xinbin, Qin Zhiying, Qi Dandan, Ding Zhiheng. State Monitoring of Nuclear Power Connection Sleeve Quality Inspection Equipment Driven by Digital Twin [J]. Journal of System Simulation, 2026, 38(4): 1004-1017.
[3]	Yan Dong, Yang Hanzhe, Jiang Fangfang, Liu Chengbao, Zhang Peng. Design and Application of Collaborative Simulation System for Satellite Constellation Flight Missions [J]. Journal of System Simulation, 2026, 38(4): 1067-1079.
[4]	Wang Ziying, Sun Congjun, Li Guihu, Zhang Tianhao. Virtual Train Operation Platform Based on Digital Twin [J]. Journal of System Simulation, 2026, 38(3): 736-745.
[5]	Lu Houjun, Zhu Yifei, Rong Yanping, Zhang Wanghui. Digital Twin Modeling Method for Bulk Cargo Stacks Based on 2D LiDAR [J]. Journal of System Simulation, 2025, 37(9): 2269-2286.
[6]	Liu Yongkui, Yang Kang, Tuo Benben, Pan Yaduo, Wang Xinyu, Wang Yihan, Gong Yongqian, Zhang Lin, Wang Lihui, Lin Tingyu, Zi Bin, Li Yuan, You Wei, Xu Xun. Digital Twinned Industrial Robot: Conceptual Framework, Key Technologies, and Case Study [J]. Journal of System Simulation, 2025, 37(7): 1723-1752.
[7]	Liu Tao, Li Hanxi, Yin Yong, Liu Jialun. Research Review of Intelligent Navigation Simulation Technology and Its Applications [J]. Journal of System Simulation, 2025, 37(7): 1684-1709.
[8]	Chen Qinghua, Liang Zuoyou, Guan Weijuan, Ji Jiadong, Liu Ping. Construction Method of Digital Twin System for High-low Temperature Test Chamber [J]. Journal of System Simulation, 2025, 37(6): 1400-1411.
[9]	Cheng Chong, Wang Lixia, Duan Songtao, Xiong Xiaoguang, Ge Xianjun. Research on Obstacle Avoidance of Substation Robot Based on Spatiotemporal Networks [J]. Journal of System Simulation, 2025, 37(6): 1522-1530.
[10]	Zhang Wenjia, Zhang Heming. Research on Grey-box Modeling Method of Digital Twins for Cantilever Structure [J]. Journal of System Simulation, 2025, 37(5): 1158-1168.
[11]	Zhang Huimai, Hu Xiaoya, Zhou Chunjie. Digital Twin Framework for the Generation and Optimization of Security Policies for TSN Industrial Control Systems [J]. Journal of System Simulation, 2025, 37(4): 861-874.
[12]	Jiang Lun, Wang Dajiang, Sun Wenlei, Bao Shenghui, Liu Han, Chang Saike. Research on Transformer Fault Diagnosis Method Based on Digital Twin [J]. Journal of System Simulation, 2025, 37(3): 775-790.
[13]	Hu Tianxiang, Ye Hui, Yang Xiaofei. Construction of a Digital Twin-based Ship Manufacturing Workshop Monitoring System [J]. Journal of System Simulation, 2025, 37(2): 517-528.
[14]	Zheng Jiayu, Mai Zhuxue, Chen Zheyi. Optimization of Service Caching and Computation Offloading in Digital Twin Cloud-edge Networks [J]. Journal of System Simulation, 2025, 37(11): 2741-2753.
[15]	Zhang Xiyang, Lin Xusheng, Zhou Rui, Hu Yi. Research on the Digital Twin Architecture and Application of CNC System [J]. Journal of System Simulation, 2025, 37(1): 183-198.