Journal of System Simulation ›› 2026, Vol. 38 ›› Issue (7): 1849-1869.doi: 10.16182/j.issn1004731x.joss.26-0001
• Papers • Previous Articles Next Articles
Zhu Yelei, Shen Shoulin, Zhu Jiang, Wen Chuanhua
Received:2026-01-03
Revised:2026-03-15
Online:2026-07-28
Published:2026-07-31
Contact:
Shen Shoulin
CLC Number:
Zhu Yelei, Shen Shoulin, Zhu Jiang, Wen Chuanhua. Multi-scale Modeling Method for Intelligent Unmanned Aerial Vehicle Swarm Combat[J]. Journal of System Simulation, 2026, 38(7): 1849-1869.
Table 6
Analysis of differences in emergence mechanisms
| 战术类型 | 方案E (MA-DRL) | 方案F (MS-DRL) |
|---|---|---|
| 迂回攻击 | 微观层奖励驱动,2方案均能涌现 | 微观层奖励驱动,稳定性相当 |
| 诱骗攻击 | 缺中观资源约束反馈,无法学到分散策略;缺宏观协同奖励,分散部署无正反馈 | 中观库存约束激励分散策略;宏观协同奖励支持分组协同 |
| 聚合攻击 | 仅源于微观火力集中考虑,稳定性低 | 宏观层直接激励聚集行为,稳定性高 |
| 饱和攻击 | 微观奖励驱动,但易产生无效消耗 | 中观约束防止无效消耗,稳定性更高 |
| 编波攻击 | 无补给周期约束,无法学到波次间隔;缺能力约束系数动态调节 | 中观补给时延诱导波次间隔;能力系数χi 动态变化形成强弱强模式 |
| 对峙试探 | 缺库存预警机制,无法学到侦察优先策略;缺网络连通度约束 | 中观库存预警激励侦察优先;宏观网络约束限制全面进攻 |
| [1] | 范张勋, 罗金亮. 无人机集群智能任务规划综述[C]//2025第九届全国集群与协同控制大会论文集. 北京: 中国指挥与控制学会, 2025: 46-50. |
| Fan Zhangxun, Luo Jinliang. A Review of Intelligent Mission Planning for Unmanned Aerial Vehicle Swarms[C]//Proceedings of the 9th National Conference on Swarm and Cooperative Control 2025. Beijing: Chinese Institute of Command and Control, 2025: 46-50. | |
| [2] | 黄琳雅. 基于复杂网络的无人机集群智能协同策略研究[D]. 成都: 四川师范大学, 2025. |
| Huang Linya. Study on Collaborative Strategies for UAV Swarms on Complex Networks[D]. Chengdu: Sichuan Normal University, 2025. | |
| [3] | 宫远强, 张业鹏, 马万鹏, 等. 无人机蜂群中的群体智能涌现机理[J]. 兵工学报, 2023, 44(9): 2661-2671. |
| Gong Yuanqiang, Zhang Yepeng, Ma Wanpeng, et al. Mechanisms of Group Intelligence Emergence in UAV Swarms[J]. Acta Armamentarii, 2023, 44(9): 2661-2671. | |
| [4] | 王星. 面向无人机集群对抗的多智能体深度强化学习策略研究[D]. 西安: 西安工业大学, 2025. |
| Wang Xing. Research on Multi-agent Deep Reinforcement Learning Strategies for Unmanned Aerial Vehicle Swarm Confrontation[D]. Xi'an: Xi'an Technological University, 2025. | |
| [5] | 龚德超. 基于分层多智能体深度强化学习的无人机集群协同对抗研究[D]. 南京: 东南大学, 2024. |
| Gong Dechao. Research on Collaborative Confrontation of UAV Swarm Based on Hierarchical Multi-agent Deep Reinforcement Learning[D]. Nanjing: Southeast University, 2024. | |
| [6] | 关智慧. 基于深度强化学习的无人机集群追击自主决策方法研究[D]. 沈阳: 沈阳航空航天大学, 2024. |
| Guan Zhihui. Research on Autonomous Decision Making Method for UAV Cluster Pursuit Based on Deep Reinforcement Learning[D]. Shenyang: Shenyang Aerospace University, 2024. | |
| [7] | 陈宇轩, 张灏龙, 付馨, 等. 基于复杂网络的无人机集群健壮性评估研究[J]. 计算机仿真, 2024, 41(4): 37-42, 128. |
| Chen Yuxuan, Zhang Haolong, Fu Xin, et al. Research on UAV Cluster Robustness Evaluation Based on Complex Network[J]. Computer Simulation, 2024, 41(4): 37-42, 128. | |
| [8] | 吉祥. 基于复杂网络和上校博弈的无人机集群对抗方法研究[D]. 长沙: 国防科技大学, 2022. |
| Ji Xiang. Research on UAV Swarm Confrontation Based on Complex Network and Colonel Blotto Game[D]. Changsha: National University of Defense Technology, 2022. | |
| [9] | Coyle R G. System Dynamics Modelling: A Practical Approach[M]. London: CRC Press, 1996. |
| [10] | 姜永超, 史宪铭, 周大星. 基于系统动力学的阶段性弹药消耗预计方法[J]. 火力与指挥控制, 2024, 49(10): 34-40, 48. |
| Jiang Yongchao, Shi Xianming, Zhou Daxing. Prediction Method of Phased Ammunition Consumption Based on System Dynamics[J]. Fire Control & Command Control, 2024, 49(10): 34-40, 48. | |
| [11] | 徐磊, 汪文峰, 杨建军. 基于系统动力学的防空装备战时维修保障系统仿真[J]. 空军工程大学学报(自然科学版), 2009, 10(4): 43-47. |
| Xu Lei, Wang Wenfeng, Yang Jianjun. Research on Simulation of Aerial Defense Equipment Maintenance Support System in War Based on System Dynamics[J]. Journal of Air Force Engineering University(Natural Science Edition), 2009, 10(4): 43-47. | |
| [12] | Figueredo G P, Siebers P O, Aickelin U, et al. Juxtaposition of System Dynamics and Agent-based Simulation for a Case Study in Immunosenescence[J]. PLoS One, 2015, 10(3): e0118359. |
| [13] | 李育苗. 无标度网络上传染病传播动力学分析及控制策略研究[D]. 荆州: 长江大学, 2023. |
| Li Yumiao. Research of Epidemic Spreading Dynamics and Control Strategies on Scale-free Networks[D]. Jingzhou: Yangtze University, 2023. | |
| [14] | 张国宁, 沈寿林, 朱江, 等. 联合战斗的复杂网络多Agent建模与仿真研究[J]. 计算机仿真, 2010, 27(3): 16-18, 22. |
| Zhang Guoning, Shen Shoulin, Zhu Jiang, et al. Research on Complex Network Multi-agent Modeling and Simulation of Joint Combat[J]. Computer Simulation, 2010, 27(3): 16-18, 22. | |
| [15] | 朱江, 刘大伟, 李翼鹏. 作战超网络多Agent模型[J]. 计算机科学, 2012, 39(7): 44-47. |
| Zhu Jiang, Liu Dawei, Li Yipeng. Combat Super Network Multi Agent Model[J]. Computer Science, 2012, 39(7): 44-47. | |
| [16] | 云朝明, 杨雪榕, 廖庆林, 等. 基于杀伤链驱动的多尺度融合网络效能评估方法[J/OL]. 复杂系统与复杂性科学.(2025-07-02) [2025-12-13]. . |
| Yun Chaoming, Yang Xuerong, Liao Qinglin, et al. Kill Chain-driven Effectiveness Evaluation Method for Multi-Scale Fusion Networks[J/OL]. Complex Systems and Complexity Science. (2025-07-02) [2025-12-13]. . | |
| [17] | 刘嵩, 武志强, 游雄, 等. 基于兵棋推演的综合战场态势多尺度表达[J]. 测绘科学技术学报, 2012, 29(5): 382-385, 390. |
| Liu Song, Wu Zhiqiang, You Xiong, et al. Multi-scale Expression of Integrated Battlefield Situation Based on Wargaming[J]. Journal of Geomatics Science and Technology, 2012, 29(5): 382-385, 390. | |
| [18] | 黄亚锋, 李旭东, 张航峰. 战场态势多尺度表达研究[J]. 系统仿真学报, 2018, 30(2): 452-458, 464. |
| Huang Yafeng, Li Xudong, Zhang Hangfeng. Research on Multi-scale Representation of Battlefield Situation[J]. Journal of System Simulation, 2018, 30(2): 452-458, 464. | |
| [19] | Guo Qiangqiang, Ban Xuegang. A Multi-scale Control Framework for Urban Traffic Control with Connected and Automated Vehicles[J]. Transportation Research Part B: Methodological, 2023, 175: 102787. |
| [20] | Guo Qiangqiang, Ban Xuegang. Network Multiscale Urban Traffic Control with Mixed Traffic Flow[J]. Transportation Research Part B: Methodological, 2024, 185: 102963. |
| [21] | Guo Feng, Ma Ling, Wu Junhao, et al. A Systematic Review of Multi-scale Digital Modelling in Sustainable Urban Design and Management[J]. Sustainable Cities and Society, 2025, 119: 106103. |
| [22] | Serena Luca, Marzolla Moreno, D'Angelo Gabriele, et al. A Review of Multilevel Modeling and Simulation for Human Mobility and Behavior[J]. Simulation Modelling Practice and Theory, 2023, 127: 102780. |
| [23] | 张博渊. 无人机集群编队自主规划与控制技术研究[D]. 天津: 天津大学, 2018. |
| Zhang Boyuan. Research on Autonomous Planning and Control Technology of UAVs Cluster Formation[D]. Tianjin: Tianjin University, 2018. | |
| [24] | Zhu Changxi, Dastani Mehdi, Wang Shihan. A Survey of Multi-agent Deep Reinforcement Learning with Communication[J]. Autonomous Agents and Multi-agent Systems, 2024, 38(1): 4. |
| [25] | Liebeherr Jörg, Fidler Markus, Valaee Shahrokh. A System-theoretic Approach to Bandwidth Estimation[J]. IEEE/ACM Transactions on Networking, 2010, 18(4): 1040-1053. |
| [1] | Zhang Jinbao, Mao Jianlin, Qian Chengze, Sun Guimi, Tong Kaixin. Improved PBS Algorithm for Multi-agent Path Planning Based on Conflict Guidance and Punishment Mechanism [J]. Journal of System Simulation, 2026, 38(7): 1950-1963. |
| [2] | Li Xiaonan, Chao Tao, Ma Ping, Yang Ming, Wang Yuxuan. Robust Identification of Black-box Nonlinear SSM Using Expectation-maximization [J]. Journal of System Simulation, 2026, 38(5): 1146-1158. |
| [3] | Zhou Zicong, Zeng Junjie, Hu Yue, Zhu Zhengqiu, Yin Quanjun. Multi-agent Reinforcement Learning Method for Wargame Simulation Based on Suboptimal Demonstration Guidance [J]. Journal of System Simulation, 2026, 38(5): 1277-1289. |
| [4] | Li Jiting, Sun Yi, Wang Yirong, Lin Yiqin, Jia Jun, Ding Gangsong. LLM-driven Multi-agent Social Network Simulation: Interdisciplinary Integration and Cutting-edge Development [J]. Journal of System Simulation, 2026, 38(2): 235-260. |
| [5] | Tao Caixia, Chen Naikun, Gao Fengyang, Zhang Jiangang. Distributed Optimization for Integrated Energy Based on Multi-agent Reinforcement Learning [J]. Journal of System Simulation, 2026, 38(2): 476-487. |
| [6] | Wang Yifan, Yang Bin, Wang Congjun. Simulation Method for Multi-crew Construction Processes Based on Large Language Model-powered Agent [J]. Journal of System Simulation, 2026, 38(2): 488-500. |
| [7] | Lü Jinhu, Jiang Hongyi, Liu Deyuan, Tan Shaolin. Modeling and Simulation of Complex Systems Based on Graph Neural Networks [J]. Journal of System Simulation, 2025, 37(7): 1624-1638. |
| [8] | Zhang Yue, Zhang Wenliang, Feng Qiang, Guo Xing, Ren Yi, Wang Zili. Combat-oriented Comprehensive Simulation and Verification Technology for Equipment System RMS [J]. Journal of System Simulation, 2025, 37(7): 1823-1835. |
| [9] | Wang Ziyi, Zhang Kai, Qian Dianwei, Liu Yuzhen. A DRL⁃based Approach for Distributed Equipment Nodes Selection [J]. Journal of System Simulation, 2025, 37(6): 1565-1573. |
| [10] | Gu Xueqiang, Luo Junren, Zhou Yanzhong, Zhang Wanpeng. Survey on Large Language Agent Technologies for Intelligent Game Theoretic Decision-making [J]. Journal of System Simulation, 2025, 37(5): 1142-1157. |
| [11] | Yao Changhua, Bi Shanning, Ma Rufei, Yu Xiaohan, Li Jiaqiang, Chen Jinli. Method for Dynamic Coalition Formation of Wargame Agent for Force Cooperation [J]. Journal of System Simulation, 2025, 37(5): 1188-1196. |
| [12] | Nie Shida, Li Chengbing, He Bowei, Li Xintao. Research on the Resilience of Integrated Urban Passenger Transport Network in Urban Agglomerations Considering the Intra-urban Service Network [J]. Journal of System Simulation, 2025, 37(4): 933-942. |
| [13] | Xiong Jun, Zhang Wenbo, Xiong Zhi, Zhou Feng, Yang Bo. Survey of Cooperative Multi-Agent Path Finding [J]. Journal of System Simulation, 2025, 37(12): 3033-3049. |
| [14] | Huang Zhiqin, Lu Tianying, Chen Zheyi. Multi-UAV Deployment and Collaborative Offloading for Large-scale IoT Systems [J]. Journal of System Simulation, 2025, 37(1): 25-39. |
| [15] | Jiang Quan, Wei Jingxuan. Real-time Scheduling Method for Dynamic Flexible Job Shop Scheduling [J]. Journal of System Simulation, 2024, 36(7): 1609-1620. |
| Viewed | ||||||
|
Full text |
|
|||||
|
Abstract |
|
|||||