Design and Implementation of Maritime Unmanned Cross-Domain Collaborative Effectiveness Evaluation System Based on MLP

doi:10.16182/j.issn1004731x.joss.23-0866

Abstract

Abstract:

In the face of the problem of evaluating the detection capability effectiveness of the maritime unmanned cross-domain collaborative system, it is necessary to study the evaluation indexes and evaluation algorithm. In this paper, the robot's own parameters and environmental parameters are combined to build a calculation model for evaluation indexes, such as detection coverage rate, repeated detection rate, the number of pixels per unit area, and energy as well as an evaluation system for detection capability of the maritime unmanned cross-domain collaborative system. The subjectivity in the evaluation process is reduced, and training data is generated by the availability dependability capability (ADC) method combined with analytic hierarchy process. The multilayer perceptron (MLP) neural network method was used to objectively measure the effectiveness of the system. The results showed that the size of the generated data set reached 20,000, and the evaluation error of the model was less than 3%, which verified its effectiveness and applicability. Meanwhile, the PyQt5 framework was used to build the evaluation system interface, realizing the functions of environment modeling, data entry, and effectiveness evaluation.

Key words: effectiveness evaluation, multilayer perceptron(MLP), maritime unmanned cross-domain collaborative system, ADC model, analytic hierarchy process

CLC Number:

TP391.9

Hu Hongyu, Gao Tianzhu, Gu Haitao. Design and Implementation of Maritime Unmanned Cross-Domain Collaborative Effectiveness Evaluation System Based on MLP[J]. Journal of System Simulation, 2024, 36(11): 2542-2551.

Figures/Tables 11

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Fig. 9

Fig. 10

Fig. 11

References 15

1	李鹏, 张华涛, 闫代维, 等. 无人机载导弹武器系统作战效能评估研究[J]. 弹箭与制导学报, 2022, 42(3): 116-120.
	Li Peng, Zhang Huatao, Yan Daiwei, et al. Research on Combat Effectiveness Evaluation of UAV-borne Missile Weapon System[J]. Journal of Projectiles, Rockets, Missiles and Guidance, 2022, 42(3): 116-120.
2	Hongyan Ou, Liu Qian, Wu Di, et al. Research on Operational Effectiveness Evaluation of a Certain Type of Equipment[C]//Man-Machine-Environment System Engineering. Singapore: Springer Nature Singapore, 2023: 632-637.
3	Qu Shi, Liu Hui. Combat Effectiveness Evaluation of C2BMC Based on AHP[C]//2022 International Conference on Data Analytics, Computing and Artificial Intelligence (ICDACAI). Piscataway: IEEE, 2022: 89-92.
4	胡杰, 陈化良, 刘亮, 等. 无人机蜂群作战效能评估研究[J]. 火力与指挥控制, 2022, 47(4): 164-168.
	Hu Jie, Chen Hualiang, Liu Liang, et al. Research on Operational Effectiveness Evaluation of UAV Swarm[J]. Fire Control & Command Control, 2022, 47(4): 164-168.
5	孙兴龙, 李亚雄, 董浩. 基于改进模糊评判的常规导弹火力打击作战效能分析[J]. 舰船电子工程, 2021, 41(7): 152-155.
	Sun Xinglong, Li Yaxiong, Dong Hao. Effectiveness Analysis of Conventional Missile Fire Attacking Based on Improved Fuzzy Evaluation[J]. Ship Electronic Engineering, 2021, 41(7): 152-155.
6	罗杰, 苏兵, 贾志刚. 基于AHP-模糊评价的空中无人通信平台作战效能评估[C]//第九届中国指挥控制大会论文集. 北京: 中国指挥与控制学会, 2021: 564-569.
7	Li Zheng, Zhou Jiawei, Hu Haibao, et al. Operational Effectiveness Analysis of Cluster Submarine Formation Torpedo Weapon System Based on Fuzzy AHP Comprehensive Evaluation[C]//Proceedings of the 1st World Symposium on Software Engineering. New York: ACM, 2019: 17-21.
8	武文亮, 拓明福. 无人集群作战效能评估研究进展[C]//2022年无人系统高峰论坛(USS2022)论文集. 西安: 中国工程院, 西北工业大学, 中国航天科工集团有限公司, 国防科技大学, 2022: 207-214.
9	Gui Chunmei. Evaluation of Unmanned Equipment Operational Effectiveness Based on ADC Model[C]//2018 10th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC). Piscataway: IEEE, 2018: 299-303.
10	罗杰, 苏兵, 迟铭, 等. 改进ADC模型的空中无人通信平台作战效能评估[J]. 火力与指挥控制, 2022, 47(5): 124-129.
	Luo Jie, Su Bing, Chi Ming, et al. Operational Effectiveness Evaluation of Unmanned Aerial Communication Platform Based on Improved ADC Model[J]. Fire Control & Command Control, 2022, 47(5): 124-129.
11	李正阳, 于旭东, 周全. 水下自主导航装备作战效能评估技术[J]. 舰船电子工程, 2021, 41(7): 156-159, 182.
	Li Zhengyang, Yu Xudong, Zhou Quan. Operational Effectiveness Evaluation Technology for Autonomous Underwater Navigation Equipment[J]. Ship Electronic Engineering, 2021, 41(7): 156-159, 182.
12	方勇. 基于ADC和AHP的UUV装备作战效能分析[J]. 兵工自动化, 2022, 41(10): 84-87.
	Fang Yong. Operational Effectiveness Analysis of UUV Equipment Based on ADC and AHP[J]. Ordnance Industry Automation, 2022, 41(10): 84-87.
13	李妮, 李玉红, 龚光红, 等. 基于深度学习的体系作战效能智能评估及优化[J]. 系统仿真学报, 2020, 32(8): 1425-1435.
	Li Ni, Li Yuhong, Gong Guanghong, et al. Intelligent Effectiveness Evaluation and Optimization on Weapon System of Systems Based on Deep Learning[J]. Journal of System Simulation, 2020, 32(8): 1425-1435.
14	Ding Yuanming, Zhu Min, Lu Qian. Effectiveness Evaluation of Underwater Swarm Combat Based on FAHP and GA-elman Neural Network[C]//2019 Chinese Automation Congress (CAC). Piscataway: IEEE, 2019: 106-110.
15	Chen Xia, Hu Naikuan. Effectiveness Evaluation for UAV Air-to-ground Attack Based on PSO-BP Neural Network[C]//2017 36th Chinese Control Conference (CCC). Piscataway: IEEE, 2017: 3864-3869.

[1]	Zhang Guohui, Gao Ang, Zhang Ya'nan. Combat Effectiveness Evaluation Method of Homogeneous Cluster Equipment System Based on RLoMAG+EAS [J]. Journal of System Simulation, 2024, 36(1): 160-169.
[2]	Yu Xiaolan, Xiong Wei, Han Chi, Wu Zhenwei. Research on Operational Effectiveness Evaluation Method of Space-based Information Support Equipment System [J]. Journal of System Simulation, 2023, 35(11): 2429-2444.
[3]	Liu Lu, Li Wenxin, Song Xiao, Sun Bingli, Gong Guanghong. A Fuzzy Group Decision-making-based Method for Green Supplier Selection and Order Allocation [J]. Journal of System Simulation, 2023, 35(10): 2133-2149.
[4]	Gaofeng Zhang, Liang Wu. Effectiveness Evaluation of Surface Ship Air Defense and Antimissile Combat in Complex Electromagnetic Environment [J]. Journal of System Simulation, 2022, 34(3): 640-650.
[5]	Ziwei Zhang, Qisheng Guo, Zhiming Dong, Ang Gao, Yifei Wang. Review of System of Systems Combat Effectiveness Evaluation and Optimization Methods [J]. Journal of System Simulation, 2022, 34(2): 303-313.
[6]	Guochen Wang. Simulation and Effectiveness Evaluation System for Joint Delivery Mission Planning of Airlift Fleets [J]. Journal of System Simulation, 2022, 34(11): 2497-2506.
[7]	Luo Zhangzhen, Jiang Haifan, Fu Jianlin, Ding Guofu. Combination Weighting-based Comprehensive Evaluation for Discrete Workshop Production Plan [J]. Journal of System Simulation, 2021, 33(8): 1856-1865.
[8]	Lei Yonglin, Zhu Zhi, Gan bin, Lei Sen, Chen Yong. Combat Effectiveness Simulation Evaluation Framework of Complex Weapon System [J]. Journal of System Simulation, 2020, 32(9): 1654-1663.
[9]	Zhou Yuchen, Lin Shengling, Ma Ping, Li Wei, Yang Ming. Research Progress on Weapon and Equipment Effectiveness Evaluation [J]. Journal of System Simulation, 2020, 32(8): 1413-1424.
[10]	Shao Songshi, Ruan Minzhi, Zhang Zhihua. Model of Initial Spare Parts Configuration and Ordering Policy Optimization Based on Inventory State [J]. Journal of System Simulation, 2020, 32(3): 509-517.
[11]	Xiao Yanjun, Yang Huan, Kang Yanping. Study on Infrared Radiation of NMP Recovery System in Lithium Battery Pole Piece [J]. Journal of System Simulation, 2020, 32(1): 96-104.
[12]	Zhao Yueqiang, An Shi, Mai Qiang, Lin Yinyin. Research on Cost-Effectiveness Analysis and Modeling of Equipment [J]. Journal of System Simulation, 2019, 31(8): 1521-1540.
[13]	Si Guangya, Wang Fei, Liu Yang. System Analysis Method Based on Simulation Big Data [J]. Journal of System Simulation, 2019, 31(3): 511-519.
[14]	Pan Wenwen, An Bingyu, Chi Zangbo, Zhang Mingmin, Hu Zhuxin. Research on Open Cell Effect Based on Vacation Queueing Model [J]. Journal of System Simulation, 2018, 30(7): 2533-2539.
[15]	Lu Yingbo, Qian Xiaochao, Chen Wei, He Shu, Lu Zhifeng. Research on Construction Method of Data-Driven Equipment Effectiveness Evaluation Model [J]. Journal of System Simulation, 2018, 30(12): 4587-4595.