一种多源海量局部放电信号脉冲的并行提取方法

doi:10.16182/j.issn1004731x.joss.201701009

摘要/Abstract

摘要： 针对多源、海量局部放电(Partial Discharge,PD)信号的放电脉冲提取问题,提出了一种基于消息传递接口(Message Passing Interface,MPI)的并行化方法。该方法采用管理者-工人-写者模式,由管理者动态分配任务,工人负责业务计算并由写者回收计算结果,将数据管理和任务执行分离。此外,由管理者辨别信号来源并发送给工人作为数据文件解析和算法参数设置的依据,能够解决多源异构信号处理问题。实验结果表明所提方法高效可行,且具有良好的加速比,脉冲提取准确率达90%以上,满足工程应用需求。

关键词: 局部放电, 消息传递接口, 并行计算, 大数据, 脉冲提取, 数据处理

Abstract: Aiming at the issue of discharge pulse extraction for multi-source and massive PD signals, a novel parallel method based on Message Passing Interface was proposed. The proposed method applied a parallel mode called manager-worker-writer. In this method, a manager dynamically assigned task to several workers, and these workers executed tasks in parallel and a writer received results from workers in real time, so data management was separated from task execution. In addition, the manager identified sources of PD signals and sent them to workers as the keys for analyzing different data files and setting algorithm parameters, so multi-source and heterogeneous PD signals can be processed in parallel. Experimental results show that the proposed parallel method is efficient, feasible and possesses good speed-up ratio. It achieves total extraction accuracy of above 90%, which can satisfy most engineering applications.

Key words: partial discharge, message passing interface(MPI), parallel computing, big data, pulses extraction, data processing

中图分类号:

TP391.9

王刘旺, 朱永利, 贾亚飞. 一种多源海量局部放电信号脉冲的并行提取方法[J]. 系统仿真学报, 2017, 29(1): 57-66.

Wang Liuwang, Zhu Yongli, Jia Yafei. Parallel Method for Extracting Pulses from Multi-source Massive Partial Discharge Signals[J]. Journal of System Simulation, 2017, 29(1): 57-66.

参考文献

[1] 宋亚奇, 周国亮, 朱永利. 智能电网大数据处理技术现状与挑战[J]. 电网技术, 2013, 37(4): 927-935.
(Song Yaqi, Zhou Guoliang, Zhu Yongli.Present Status and Challenges of Big Data Processing in Smart Grid[J]. Power System Technology, 2013, 37(4): 927-935.)
[2] Williams J W, Aggour K S, Interrante J, et al.Bridging High Velocity and High Volume Industrial Big Data through Distributed In-Memory Storage & Analytics[C]//Big Data (Big Data), 2014 IEEE International Conference on. Washington, DC, USA: IEEE, 2014: 932-941.
[3] 姜芸, 周韫捷. 分布式局部放电在线监测技术在上海500kV交联聚乙烯电力电缆线路中的应用[J]. 高电压技术, 2015, 41(4): 1249-1256.
(Jiang Yun, Zhou Yunjie.Application of Distributed Partial Discharge On-line Monitoring Technology in Shanghai 500 kV XLPE Power Cable Line[J]. High Voltage Engineering, 2015, 41(4): 1249-1256(in Chinese).)
[4] Majidi M, Oskuoee M.Improving Pattern Recognition Accuracy of Partial Discharges by New Data Preprocessing Methods[J]. Electric Power Systems Research (S0378-7796), 2015, 119: 100-110.
[5] Raymond W J K, Illias H A, Abu Bakar A H, et al. Partial Discharge Classifications: Review of Recent Progress[J]. Measurement (S0263-2241), 2015, 68: 164-181.
[6] 张晓星, 舒娜, 徐晓刚, 等. 基于三维谱图混沌特征的GIS局部放电识别[J]. 电工技术学报, 2015, 30(1): 249-254.
(Zhang Xiaoxing, Shu Na, Xu Xiaogang, et al.GIS Partial Discharge Recognition Based on Chaos Features of the Three-Dimensional Spectra[J]. Transactions of China Electrotechnical Society, 2015, 30(1): 249-254(in Chinese).)
[7] Wei G, Tang J, Zhang X, et al.Gray Intensity Image Feature Extraction of Partial Discharge in High-Voltage Cross-Linked Polyethylene Power Cable Joint[J]. International Transactions on Electrical Energy Systems (S2050-7038), 2014, 24(2): 215-226.
[8] IEC. High-Voltage Test Techniques–Partial Discharge Measurements[S]. Commission IET, 2000.
[9] Nagesh V, Gururaj B I.Automatic Detection and Elimination of Periodic Pulse Shaped Interferences in Partial Discharge Measurements[J]. IEE Proceedings of Science, Measurement and Technology (S1350-2344), 1994, 141(5): 335-342.
[10] 张士宝, 董旭柱, 林渡, 等. 局部放电监测中现场干扰的分析与抑制[J]. 清华大学学报(自然科学版), 1997, 37(8): 109-112.
(Zhang Shibao, Dong Xuzhu, Lin Du, et al.Analysis and rejection of interference in on-line partial discharge monitoring[J]. Journal of Tsinghua University (Science and Technology), 1997, 37(8): 109-112.)
[11] 万元, 李朝晖, 薛松, 等. 水轮发电机局部放电在线监测中的脉冲识别方法[J]. 高电压技术, 2009, 35(9): 2169-2175.
(Wan Yuan, Li Zhaohui, Xue Song, et al.Pulses Recognition Method in Partial Discharge Online Monitoring of Hydro-generators[J]. High Voltage Engineering, 2009, 35(9): 2169-2175(in Chinese).)
[12] Ashtiani M B, Shahrtash S M.Partial Discharge Pulse Localization in Excessive Noisy Data Window[J]. IEEE Transactions on Dielectrics and Electrical Insulation (S1070-9878), 2015, 22(1): 428-435.
[13] Shahsavarian T, Shahrtash S M.Online Partial Discharge Signal Conditioning for Phi-Q-N Representation Under Noisy Condition in Cable Systems[J]. IET Science Measurement & Technology (S1751-8822), 2015, 9(1): 20-27.
[14] 杨来, 史忠植, 梁帆, 等. 基于Hadoop云平台的并行数据挖掘方法[J]. 系统仿真学报, 2013, 25(5): 936-944.
(Yang Lai, Shi Zhongzhi, Liang Fan, et al.Parallel Approach in Data Mining Based on Hadoop Cloud Platform[J]. Journal of System Simulation (S1004-731X), 2013, 25(5): 936-944(in Chinese).)
[15] 宫夏屹, 李伯虎, 柴旭东, 等. 大数据平台技术综述[J]. 系统仿真学报, 2014, 26(3): 489-496.
(Gong Xiayi, Li Bohu, Chai Xudong, et al.Survey on Big Data Platform Technology[J]. Journal of System Simulation (S1004-731X), 2014, 26(3): 489-496(in Chinese).)
[16] 李贵兵, 金炜东, 蒋鹏, 等. 面向大规模监测数据的高铁故障诊断技术研究[J]. 系统仿真学报, 2014, 26(10): 2458-2464.
(Li Guibing, Jin Weidong, Jiang Peng, et al.Research on Fault Diagnosis Technology of High-speed Rail for Large Scale Monitoring Data[J]. Journal of System Simulation (S1004-731X), 2014, 26(10): 2458-2464(in Chinese).)
[17] 宋亚奇, 周国亮, 朱永利, 等. 云平台下并行总体经验模态分解局部放电信号去噪方法[J]. 电工技术学报, 2015, 30(18): 213-222.
(Song Yaqi, Zhou Guoliang, Zhu Yongli, et al.Research on parallel ensemble empirical mode decomposition denoising method for partial discharge signals based on cloud platform[J]. Transactions of China Electrotechnical Society, 2015, 30(18): 213-222(in Chinese).)
[18] 宋亚奇, 周国亮, 朱永利, 等. 云平台下输变电设备状态监测大数据存储优化与并行处理[J]. 中国电机工程学报, 2015, 35(2): 255-267.
(Song Yaqi, Zhou Guoliang, Zhu Yongli, et al.Storage Optimization and Parallel Processing of Condition Monitoring Big Data of Transmission and Transforming Equipment Based on Cloud Platform[J]. Proceedings of the CSEE, 2015, 35(2): 255-267(in Chinese).)
[19] 赵春晖, 吴志力, 姜欣, 等. 跨平台电网规划数据融合与存储模式[J]. 电力建设, 2015, 36(3): 119-122.
(Zhao Chunhui, Wu Zhili, Jiang Xin, et al.Cross-Platform Data Fusion and Storage Pattern of Power Grid Planning[J]. Electric Power Construction, 2015, 36(3): 119-122(in Chinese).)
[20] 徐田华, 杨连报, 胡红利, 等. 高速铁路信号系统异构数据融合和智能维护决策[J]. 西安交通大学学报, 2015, 49(1): 72-78.
(Xu Tianhua, Yang Lianbao, Hu Hongli, et al.Heterogeneous Data Fusion and Intelligent Maintenance Decision for High Speed Railway Signaling Systems[J]. Journal of Xi'an Jiaotong University, 2015, 49(1): 72-78(in Chinese).)
[21] 吴烨, 陈荦, 熊伟, 等. 面向高效检索的多源地理空间数据关联模型[J]. 计算机学报, 2014, 37(9): 1999-2010.
(Wu Ye, Chen Luo, Xiong Wei, et al.Multi-Source Geospatial Data Correlation Model for Efficient Retrieval[J]. Chinese Journal of Computers, 2014, 37(9): 1999-2010(in Chinese).)
[22] Liang F, Lu X.Accelerating Iterative Big Data Computing through MPI[J]. Journal of Computer Science and Technology (S1000-9000), 2015, 30(2): 283-294.
[23] 何飞, 方金云. 基于自适应的并行空间插值算法及仿真实现[J]. 系统仿真学报, 2014, 26(4): 761-768.
(He Fei, Fang Jinyun.Algorithm for Spatial Interpolation Based on Self-Adaptive Parallel Programming[J]. Journal of System Simulation (S1004-731X), 2014, 26(4): 761-768 (in Chinese).)
[24] 王石, 郭建文, 江务学, 等. 微细电火花加工中材料蚀除机理的仿真研究[J]. 系统仿真学报, 2015, 27(12): 2891-2897.
(Wang Shi, Guo Jianwen, Jiang Wuxue, et al.Simulative Study of Machining Mechanism of Material in Micro-EDM[J]. Journal of System Simulation (S1004-731X), 2015, 27(12): 2891-2897(in Chinese).)
[25] Luo G, Zhang D.Efficiency Improvement for Data-Processing of Partial Discharge Signals Using Parallel Computing[C]// Solid Dielectrics (ICSD), 2010 10th IEEE International Conference on. Potsdam, Germany: IEEE, 2010: 1-4.