An Intelligent Adversaries Behavior Simulation Technology Based on Improved Behavior Trees

doi:10.16182/j.issn1004731x.joss.24-0364

Abstract

Abstract:

Intelligent algorithm/intelligent platform/intelligent system intelligence capability testing and evaluation need to solve high-level intelligent opponent simulation problems, an intelligent opponent behavior simulation technology based on improved behavior tree is proposed. Four types of behavior tress nodes are designed, including behavior control, combat tasks, behavior actions, and execution condition node. Five atomic behavior actions and parameters are established, including maneuver, reconnaissance and early warning, command and decision-making, firepower strike, and electronic interference node. Five atomic condition nodes are provided, including target selection, weapon launch,and incoming weapon judgment node. The intelligent adversarial behavior simulation system is designed, including a behavior rule editor and a behavior rule engine. The adversaries behavior simulation execution process is established. Considering the typical application scenarios of air ground collaborative confrontation in border areas, the simulation results indicate that the simulated intelligent opponent behavior can support the evaluation of intelligent capabilities.

Key words: intelligent adversarial, behavior tree, adversaries behavior simulation, rule engine, intelligence experiment

CLC Number:

TP391.9

Zhou Fang, Fan Bo, Liu Xiaoyi, DingYishan , Zhang Ningxin, Shao Yachao, Zhai Xiaoyu. An Intelligent Adversaries Behavior Simulation Technology Based on Improved Behavior Trees[J]. Journal of System Simulation, 2024, 36(9): 1995-2003.

Figures/Tables 11

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Fig. 9

Fig. 10

Table 1

References 18

1	Toubman A, Poppinga G, Roessingh J J, et al. Modeling CGF Behavior with Machine Learning Techniques: Requirements and Future Directions[C]//2015 Interservice/Industry Training, Simulation, and Education Conference. Orlando: I/ITSEC, 2015: 2637-2647.
2	Li Ni, Hou Yancheng, Gong Guanghong. A Study on the Behavior Modeling Method of Helicopter Force[C]//Modeling, Design and Simulation of Systems. Singapore: Springer Singapore, 2017: 405-416.
3	Zhang Qi, Sun Lin, Jiao Peng, et al. Combining Behavior Trees with MAXQ Learning to Facilitate CGFs Behavior Modeling[C]//2017 4th International Conference on Systems and Informatics (ICSAI). Piscataway: IEEE, 2017: 525-531.
4	Fang Jun, Yan Wenjun, Fang Wei. Air Combat Strategies of CGF Based on Q-learning and Behavior Tree[C]//2017 International Conference on Electrical Engineering and Automation Control (ICEEAC 2017). Lancaster: DEStech Publications, Inc., 2017: 187-192.
5	Iovino Matteo, Scukins Edvards, Styrud Jonathan, et al. A Survey of Behavior Trees in Robotics and AI[J]. Robotics and Autonomous Systems, 2022, 154: 104096.
6	Zhu Xianwen. Behavior Tree Design of Intelligent Behavior of Non-player Character (NPC) Based on Unity3D[J]. Journal of Intelligent & Fuzzy Systems, 2019, 37(5): 6071-6079.
7	Kamrani Farzad, Luotsinen Linus J, Rikke Amilde Løvlid. Learning Objective Agent Behavior Using a Data-driven Modeling Approach[C]//2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Piscataway: IEEE, 2016: 2175-2181.
8	Anon. Constructive Machine-learning Battles with Adversary Tactics(COMBAT)[EB/OL]. (2021-12-14) [2022-09-01]. .
9	Toubman A. Calculated Moves: Generating Air Combat Behaviour[D]. Leiden: Leiden University, 2020.
10	Berthling-Hansen Gabriel, Morch Eivind, Rikke Amilde Løvlid, et al. Automating Behaviour Tree Generation for Simulating Troop Movements (Poster)[C]//2018 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA). Piscataway: IEEE, 2018: 147-153.
11	董倩, 纪梦琪, 朱一凡, 等. 空中作战决策行为树建模与仿真[J]. 指挥控制与仿真, 2019, 41(1): 12-19.
	Dong Qian, Ji Mengqi, Zhu Yifan, et al. Behavioral Tree Modeling and Simulation for Air Operations Decision[J]. Command Control & Simulation, 2019, 41(1): 12-19.
12	方君, 闫文君, 邓向阳, 等. 基于Q-学习和行为树的CGF空战行为决策[J]. 计算机与现代化, 2017(5): 37-39, 44.
	Fang Jun, Yan Wenjun, Deng Xiangyang, et al. Air Bat Strategies of CGF Based on Q-learning and Behavior Tree[J]. Computer and Modernization, 2017(5): 37-39, 44.
13	付延昌. 基于行为树的CGF行为建模研究[D]. 长沙: 国防科学技术大学, 2016.
	Fu Yanchang. Research on CGF Behavior Model Based on Behavior Tree[D]. Changsha: National University of Defense Technology, 2016.
14	王成飞, 董亚卓, 苏千叶, 等. 海战仿真中的智能对抗行为建模方法研究[J]. 指挥控制与仿真, 2022, 44(1): 79-85.
	Wang Chengfei, Dong Yazhuo, Su Qianye, et al. Research on Modeling Method of Intelligent Confrontation Behavior in Naval Battle Simulation[J]. Command Control & Simulation, 2022, 44(1): 79-85.
15	张俊峰, 薛青, 张扬, 等. 融合行为树和势力图的作战决策建模方法[J]. 计算机仿真, 2021, 38(10): 5-8, 77.
	Zhang Junfeng, Xue Qing, Zhang Yang, et al. Combat Decision-making Modeling Method Based on Behavior Tree and Influence Map[J]. Computer Simulation, 2021, 38(10): 5-8, 77.
16	吴云超, 傅琛, 张宁馨. 面向数字孪生战场的智能体建模框架构建[J]. 指挥信息系统与技术, 2022, 13(4): 19-25, 31.
	Wu Yunchao, Fu Chen, Zhang Ningxin. Construction of Agent Modeling Framework for Digital Twin Battlefield[J]. Command Information System and Technology, 2022, 13(4): 19-25, 31.
17	陈希亮, 李清伟, 孙彧. 基于博弈对抗的空战智能决策关键技术[J]. 指挥信息系统与技术, 2021, 12(2): 1-6.
	Chen Xiliang, Li Qingwei, Sun Yu. Key Technologies for Air Combat Intelligent Decision Based on Game Confrontation[J]. Command Information System and Technology, 2021, 12(2): 1-6.
18	张阳, 司光亚, 王艳正, 等. 无人蜂群电磁作战行动建模与仿真[J]. 系统工程与电子技术, 2023, 45(7): 2121-2130.
	Zhang Yang, Si Guangya, Wang Yanzheng, et al. Modeling and Simulation of UAVs Swarm Electromagnetic Operation[J]. Systems Engineering and Electronics, 2023, 45(7): 2121-2130.

参数	红方	蓝方
空中兵力总数	1 606	8
空中毁伤兵力数	179	0
地面兵力总数	45	130
地面毁伤兵力数	0	105
战损率	0.117	0.807

[1]	Yue Ma, Lin Wu, Shengming Guo. Research on Modeling and Solution Method of Operational Tasks Assignment [J]. Journal of System Simulation, 2023, 35(4): 887-898.
[2]	Zhaopeng Liu, Xinhai Xu, Bowen Yuan, Jinlu Zhang. A Multi-resolution Simulation Modeling Method [J]. Journal of System Simulation, 2023, 35(1): 202-211.
[3]	Yang Jie, Zhang Qi, Zeng Junjie, Yin Quanjun. Survey of Evolutionary Behavior Tree Algorithm [J]. Journal of System Simulation, 2021, 33(10): 2315-2322.
[4]	Xu Wensheng, Wu Bo, Jiang Jianhong. Design and Realization of Behavior Tree in Weapon Equipment Virtual Maintenance Training System [J]. Journal of System Simulation, 2018, 30(7): 2722-2728.