系统仿真学报 ›› 2024, Vol. 36 ›› Issue (1): 160-169.doi: 10.16182/j.issn1004731x.joss.22-1034

• 论文 • 上一篇    

基于RLoMAG+EAS的同构集群装备体系作战效能评估方法

张国辉1(), 高昂2(), 张雅楠1   

  1. 1.陆军装甲兵学院 信息通信系,北京 100072
    2.国防大学 联合作战学院,北京 100091
  • 收稿日期:2022-09-01 修回日期:2023-05-14 出版日期:2024-01-20 发布日期:2024-01-19
  • 通讯作者: 高昂 E-mail:zgh8002@126.com;15689783388@163.com
  • 第一作者简介:张国辉(1980-),男,副教授,博士,研究方向为智能指挥决策。E-mail:zgh8002@126.com

Combat Effectiveness Evaluation Method of Homogeneous Cluster Equipment System Based on RLoMAG+EAS

Zhang Guohui1(), Gao Ang2(), Zhang Ya'nan1   

  1. 1.Department of Information and Communication, Academy of Army Armored Force, Beijing 100072, China
    2.Joint Operations College, National Defence University, Beijing 100091, China
  • Received:2022-09-01 Revised:2023-05-14 Online:2024-01-20 Published:2024-01-19
  • Contact: Gao Ang E-mail:zgh8002@126.com;15689783388@163.com

摘要:

装备体系是作战体系在装备视角的反映,研究装备体系作战效能评估问题,对装备体系优化、建设发展具有重要现实意义。集群装备作战体系对抗,具有大规模、高动态、强对抗特点,传统方法难以对其作战效能直接进行评估,针对单一任务同构集群装备体系(如无人机侦察蜂群、地面无人平台火力突击集群等),从多智能体博弈理论的视角,将装备体系对抗过程看作为多智能体系统马尔可夫博弈过程,提出一种基于多智能体博弈强化学习(reinforcement learning of multi-agent game,RLoMAG)的装备体系作战效能评估方法。分析了评估方法原理,建立了装备体系对抗模型。给出了装备体系作战效能评估方法框架,包括智能体建模、博弈算法设计、装备体系作战效能指标设计,开展探索性体系对抗仿真,求解装备体系博弈最优策略,分析最优策略下的装备体系作战效能指标等步骤。以基地防御作战场景为背景,给出了无人机蜂群装备体系作战效能评估方法应用示例,验证了方法的有效性。

关键词: 装备体系, 作战效能评估, 多智能体博弈强化学习, 最优策略

Abstract:

The equipment system is the reflection of the combat system from the perspective of equipment. The research on the combat effectiveness evaluation of the equipment system is of great practical significance for the optimization, construction, and development of the equipment system. Cluster equipment combat system confrontation is characterized by large-scale, highly dynamic and strong confrontation, and it is difficult to directly evaluate combat effectiveness with traditional methods. Aiming at the single task homogeneous cluster equipment system (such as UAV reconnaissance swarm and ground unmanned platform fire assault cluster), this paper regards the confrontation process of equipment system as the Markov game process of multi-agent system from the perspective of multi-agent game theory. The combat effectiveness evaluation method of equipment system based on reinforcement learning of multi-agent game (RLoMAG) is proposed. Firstly, the principle of evaluation method is analyzed and the model of equipment system confrontation is built. Secondly, the framework of the combat effectiveness evaluation method of the equipment system is given, including conducting the agent modeling, game algorithm design and combat effectiveness index design of the equipment system, carrying out exploratory system confrontation simulation, solving the game optimal strategy of the equipment system, and analyzing the combat effectiveness index of the equipment system under the optimal strategy. Finally, based on the base defense combat scenario, an application example of the combat effectiveness evaluation method of the UAV swarm equipment system is given to verify the effectiveness of the method.

Key words: equipment system, combat effectiveness evaluation, reinforcement learning of multi-agent game, optimum strategy

中图分类号: