基于多分辨率的multi-Agent武器装备体系作战仿真研究

doi:10.16182/j.issn1004731x.joss.201701019

系统仿真学报 ›› 2017, Vol. 29 ›› Issue (1): 136-143.doi: 10.16182/j.issn1004731x.joss.201701019

基于多分辨率的multi-Agent武器装备体系作战仿真研究

闫雪飞, 李新明, 刘东, 李亢

装备学院复杂电子系统仿真实验室,北京 101416

收稿日期:2015-04-24 修回日期:2015-06-15 出版日期:2017-01-08 发布日期:2020-06-01
作者简介:闫雪飞(1989-), 男, 内蒙赤峰, 博士生, 研究方向为作战仿真与体系评估; 李新明(1965-), 男, 湖南益阳, 博士, 研究员, 研究方向为体系评估。
基金资助:
“核高基”重大专项支持课题(2013ZX010 45-004-002)

Battle Simulation Study on Multi-Agent Weapon System-of-Systems Based on Multi-Resolution

Yan Xuefei, Li Xinming, Liu Dong, Li Kang

Science and Technology on Complex Electronic System Simulation Laboratory of Equipment Academy, Beijing 101416, China

Received:2015-04-24 Revised:2015-06-15 Online:2017-01-08 Published:2020-06-01

摘要/Abstract

摘要： 针对基于multi-Agent的武器装备体系作战仿真应用中,multi-Agent的决策与协作行为异常复杂而现有模型不能很好应对的问题,提出一种基于多分辨率建模与multi-Agent理论相结合的作战仿真模型。将战术级协作任务交给高分辨率Agent,将战略级决策任务交给具有宏观决策优势的低分辨率聚合Agent,其中,高层指挥Agent基于强化学习进行决策,底层作战Agent基于OA环(observe-action）进行协作,进而大幅降低了计算复杂度,并提高了决策收益。此外,基于面向Agent编程思想分别设计了高分辨率Agent和聚合Agent。基于JAVA语言进行了体系仿真验证。

关键词: Agent, 武器装备体系, 作战仿真, 多分辨率, Q-learning

Abstract: A model based on Multi-Resolution modeling technology with multi-Agent theory was put forward since the problem of the decision and cooperation of traditional multi-Agent system is too complicated in the field of battle simulation of weapon SOS. The tactic-level cooperation missions based on OA circle(observation-Action )was given to the high-Resolution Agents and the strategy-level decision missions based on reinforcement learning was given to the low-Resolution Agents. Besides, the class structure of high-Resolution Agent and Aggregation Agent based on the Agent oriented programming(AOP) was designed. At last, the ideas were validated through battle simulation for Weapon SOS based on Java language.

Key words: Agent, weapon system-of-systems, battle simulation, Multi-Resolution technology, Q-learning

中图分类号:

TP391

闫雪飞, 李新明, 刘东, 李亢. 基于多分辨率的multi-Agent武器装备体系作战仿真研究[J]. 系统仿真学报, 2017, 29(1): 136-143.

Yan Xuefei, Li Xinming, Liu Dong, Li Kang. Battle Simulation Study on Multi-Agent Weapon System-of-Systems Based on Multi-Resolution[J]. Journal of System Simulation, 2017, 29(1): 136-143.

参考文献

[1] 余文广, 王维平, 柏永斌, 等. 基于多进程的Agent行为描述及其仿真调度研究[J]. 系统仿真学报, 2012, 24(3): 509-520.
(YU W G, Wang W P, PAI Y B, et al.Process-based Description and Simulation Scheduling for Agent Behavior[J]. Journal of System Simulation, 2012, 24(3): 509-520.)
[2] Tomonari Honda, Hiroshi Sato, Akira Namatame.Evolutionary Learning in Agent-Based Combat Simulation[M]. Germany Berlin Springer-Verlag Heidelberg, 2006: 582-587.
[3] Richard B HenckeAN. Agent-Based Approach to Analyzing Information and Coordination in Combatnaval [D]. USA: Postgraduate School Monterey California, 1998.
[4] 陆铭华, 吴金平, 董汉权. 基于多Agent仿真的编队协同反潜作战效能分析方法研究[J]. 系统仿真学报, 2011, 23(3): 446-450.
(LU M H, WU J P, DONG H Q.Effective Analysis Method Research of Formation Cooperative Acti-submarine Warfare Based on Multi-Agent Simulation[J]. Journal of System Simulation, 2011, 23(3): 446-450.)
[5] 李云芳. 战场环境下基于HLA的BDI Agent仿真研究与实现 [D]. 南京: 南京航空航天大学, 2012.
(Li Y F.HLA-based Research and Implementation on BDI Agent Simulation in Battlefield Environment [D]. Nanjing, China: Nanjing University of Aeronautics and Astronautics, 2012.)
[6] Ibrahim C, Murat M.A multi-agent architecture for modelling and simulation of small military unit combat in asymmetric warfare[J]. Expert Systems with Applications (S0957-4174), 2010, 37: 1331-1343.
[7] 陈建华, 李刚强, 傅调平. 基于多分辨率的海军作战仿真建模研究[J]. 系统仿真学报, 2009, 21(22): 7316-7319.
(CHEN J H, Li G Q, FU T P.Research of Multi-Distinguish Modeling on Warship Formation Operation Simulation[J]. Journal of System Simulation, 2009, 21(22): 7316-7319.)
[8] 杜燕波, 杨建军, 吕伟, 等. 多分辨率建模与仿真相关概念研究[J]. 系统仿真学报, 2008, 20(6): 1386-1389.
(DU Y B, YANG J J, LV W, et al.Study of Relevant Conceptions about Multi-resoluation Modeling and Simulation[J]. Journal of System Simulation,2008, 20(6): 1386-1389.)
[9] 李京伟. 多分辨率建模在航母战斗群作战仿真中的应用研究[J]. 系统仿真学报, 2013, 25(8): 1924-1929.
(Li J W.Research on Application of Multi-resolution Modeling in carrier combat Group Operation Simulation[J]. Journal of System Simulation, 2013, 25(8): 1924-1929.)
[10] 华玉光, 徐浩军. 多分辨率建模航空武器装备体系对抗效能评估[J]. 火力与指挥控制, 2009, 34(1): 8-14.
(HUA Y G, XU H J.System Conflict based on Multi-resolution Modeling[J]. Fire Control & Command Control, 2009, 34(1): 8-14.)
[11] 郭强, 毕义明. 多分辨率建模在联合作战仿真中的应用研究[J]. 指挥控制与仿真, 2007, 29(6): 86-89.
(GUO Q, BI Y M.Study on Application of Multi-Resolution Modeling in joint Operations Simulation[J]. Command Control & Simulation, 2007, 29(6): 86-89.)
[12] 李明忠, 毕长剑, 刘小荷. 基于多分辨率的空军作战仿真建模研究[J]. 指挥控制与仿真, 2007, 29(5): 63-66.
(Li M Z, BI C J, LIU X H.A research on Air Force Combat Simulation Modeling Based on Multi- Resolution[J]. Command Control & Simulation, 2007, 29(5): 63-66.)
[13] 杨克魏. 半自治作战agent模型及其应用研究 [D]. 长沙: 国防科学技术大学, 2004.
(YANG K W.Research and Application of Semi-Autonomous Combat Agent Model [D]. Chang Sha: Graduate School of National University of Defense Technology, 2004.)
[14] Wooldridge M.多Agent系统引论 [M]. 石纯一, 等译. 北京: 电子工业出版社, 2003.
(Wooldridge M.An Introduction to MultiAgent Systems [M]. SHI C Y, et al Translation. Beijing, China: Publishing House of Electronics Industry, 2003.)
[15] 杨峰. 面向效能评估的平台级体系对抗仿真跨层次建模方法研究 [D]. 长沙: 国防科学技术大学, 2003.
(YANG F.Study on Inter-hierarchy Modeling Approach in Weapon-Platform Level System-of-systems Combat Simulation For Operational Effectiveness Evaluation [D]. Changsha, China: Graduate School of National University of Defense Technology, 2003.)
[16] 黄建明, 高大鹏. 基于OODA环的作战对抗系统动力性模型[J]. 系统仿真学报, 2012, 24(3): 561-574.
(HUANG J M, GAO D P.Combat Systems Dynamics Model with OODA Loop[J]. Journal of System Simulation, 2012, 24(3): 561-574.)
[17] 张昱, 张明智, 杨镜宇, 等. 一种基于OODA环的武器装备体系建模方法[J]. 系统仿真学报, 2013, 25(增1): 6-11.
(ZHANG Y, ZHANG M Z, YANG J Y, et al.Modeling Method for Weapon System of Systems Based on OODA Loop[J]. Journal of System Simulation, 2013, 25(S1): 6-11.)
[18] Tony Allard, Slava Shekh.Hierarchical Multi-agent Distribution Planning[M]//M Thielscher, D Zhang (Eds.), AI 2012, LNCS 7691. Germany: Springer-Verlag Berlin Heidelberg, 2012: 755-766.
[19] Jun Hu, Chun Guan, Maoguang, et al. Wang2Model of Emotional Agent[M]// Z Shi, R Sadananda (Eds.), PRIMA 2006, LNAI 4088. Germany: Springer-Verlag Berlin Heidelberg, 2006: 534-539.
[20] 杜坚. 多Agent强化学习及其应用研究 [D]. 西安: 西安电子科技大学, 2011.
(DU J.Research of Multi-Agent Reinforcement Learning and its Application [D]. Xi'an: Xidian University, 2011. )
[21] 阿卜杜拉. 基于加权经验共享的多Agent强化学习的应用研究 [D]. 长沙: 中南大学, 2012.
(Abdulai I.Multi-Agent Reinforcement Learning Through Weighted Experience Sharing [D]. Changsha, China: Central South University, 2012.)

基于多分辨率的multi-Agent武器装备体系作战仿真研究

Battle Simulation Study on Multi-Agent Weapon System-of-Systems Based on Multi-Resolution

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	李玮, 张文嘉, 张和明. 复杂产品多分辨率模型跨层次切换技术[J]. 系统仿真学报, 2022, 34(5): 944-953.
[2]	林清泉, 杨佳然, 张和明. 一种基于离散事件系统规范的复杂产品行为模型描述方法[J]. 系统仿真学报, 2022, 34(4): 661-669.
[3]	周鑫, 王维平, 朱一凡, 王涛, 井田. 基于人机协作的无人集群搜索方法研究[J]. 系统仿真学报, 2022, 34(4): 735-744.
[4]	赵征, 胡莉, 钱媛媛, 金辉, 贾爱萍. 基于多Agent的航空器拖曳规则优化配置方法研究[J]. 系统仿真学报, 2022, 34(1): 113-125.
[5]	唐宇波, 沈弼龙, 师磊, 易星. 下一代兵棋系统模型引擎设计问题研究[J]. 系统仿真学报, 2021, 33(9): 2025-2036.
[6]	丛继平, 崔利杰, 丁刚, 任博. 基于目标驱动的航空维修保障体系仿真研究[J]. 系统仿真学报, 2021, 33(9): 2157-2165.
[7]	闫飞, 甘斌, 陈招迪, 马文娟, 李路遥, 张柯. 离散事件仿真中实体被动式空间感知交互机制设计[J]. 系统仿真学报, 2021, 33(9): 2234-2242.
[8]	谢旭, 邱晓刚, 段红, 黄柯棣. 作战仿真知识体系的初步探索[J]. 系统仿真学报, 2021, 33(4): 773-780.
[9]	马骏, 杨镜宇, 吴曦. 基于人机混合智能的联合作战仿真实验方法研究[J]. 系统仿真学报, 2021, 33(10): 2323-2334.
[10]	雷永林, 朱智, 甘斌, 雷森, 陈永. 基于仿真的复杂武器系统作战效能评估框架研究[J]. 系统仿真学报, 2020, 32(9): 1654-1663.
[11]	李妮, 李玉红, 龚光红, 黄晓冬. 基于深度学习的体系作战效能智能评估及优化[J]. 系统仿真学报, 2020, 32(8): 1425-1435.
[12]	吴畏. 作战仿真模型组合流程动态可编辑方法研究[J]. 系统仿真学报, 2020, 32(5): 967-974.
[13]	司光亚, 王飞, 刘洋. 基于仿真大数据的体系分析方法研究[J]. 系统仿真学报, 2019, 31(3): 511-519.
[14]	于盈, 梁伟栋, 朱秀娟, 王建林, 王玲. 临近空间飞行器作战对抗仿真与推演系统设计[J]. 系统仿真学报, 2019, 31(12): 2584-2590.
[15]	刘闻, 王晓路, 汪宏昇, 张恒, 王长庆. 基于Agent的低轨预警卫星星座探测仿真分析[J]. 系统仿真学报, 2019, 31(11): 2413-2421.