Overview of Multi-agents Modeling and Simulation for Underwater Unmanned Combat Systems

doi:10.16182/j.issn1004731x.joss.201811003

Abstract

Abstract: Military UUV is developing toward the direction of intellectualization and coordination of multi-UUV system. It is composed of complex underwater unmanned system (UUS) with changeable underwater environment and complex combat mission. Multi-agents (MAS) modeling technology has become the mainstream method to study this kind of complex system. The development and characteristics of UUS are briefly and comprehensively reviewed. The latest developments of MAS theory are systematically summarized, and MAS modeling and simulation technology for multi-UUV cooperative combat system (MUCCS) are analyzed. A novel MAS theory method, that is immune agent interactive network (IAIN), is proposed, which combines the modeling advantages of MAS and biological immune mechanism to solve the bottlenecks of intelligence and collaborative modeling for MUCCS. The proposed IAIN not only enriches and develops MAS theory, but also provides a new perspective for modeling study of heterogeneous unmanned combat systems in different fields.

Key words: underwater unmanned system, multi-agents, biological immune mechanism

CLC Number:

TP391.9

Liang Hongtao, Kang Fengju, Fu Yanfang. Overview of Multi-agents Modeling and Simulation for Underwater Unmanned Combat Systems[J]. Journal of System Simulation, 2018, 30(11): 4053-4066.

References

[1] Tao Z Q, Li C S, Zhang H W, et al.Current trends in the development of intelligent unmanned autonomous systems[J]. Frontiers of Information Technology & Electronic Engineering(S2095-9184), 2017, 18(1): 68-85.
[2] 潘光, 宋保维, 黄桥高, 等. 水下无人系统发展现状及其关键技术[J]. 水下无人系统学报, 2017, 25(1): 44-51.
Pan G, Song B W, Huang Q G, et al.Development and Key Techniques of Unmanned Undersea System[J]. Journal of Unmaned Undersea System, 2017, 25(1): 44-51.
[3] 李经. 水下无人作战系统装备现状及发展趋势[J]. 舰船科学技术, 2017, 39(1): 1-5, 36.
Li J.Existence and development trend of navy autonomous underwater combat system[J]. Ship Science and Technology, 2017, 39(1): 1-5, 36.
[4] 司广宇, 苗艳, 李关防. 水下立体攻防体系构建技术[J]. 指挥控制与仿真, 2018, 40(1): 1-8.
Si G Y, Miao Y, Li G F.Underwater Tridimensional Attack-Defense System Technology[J]. Command Control & Simulation, 2018, 40(1): 1-8.
[5] 康凤举, 谢攀. 智能仿真在军用UUV装备体系研究中的应用[J]. 鱼雷技术, 2011, 19(2): 151-155.
Kang F J, Xie P.Application of Intelligence Simulation in Military UUV Equipment System Research[J]. Torpedo Technology, 2011, 19(2): 151-155.
[6] Liang H T, Kang F J, Li H H.UUV formation system modeling and simulation research based on multi-agent interaction chain[J]. International Journal of Modeling, Simulation, and Scientific Computing(S1793-9615), 2015, 6(2): 1-23.
[7] 郑士芹. 基于免疫系统优化算法、模型及其应用研究[M]. 北京: 知识产权出版社, 2012.
Zheng S Q.Research on immune system optimization algorithm, model and application[M]. Beijing: Intellectual Property Press, 2012.
[8] Liang H T, Kang F J.Artificial Immune Intelligent Modeling for UUV Underwater Navigation System Using Immune Multi-Agents Network[J]. International Journal of Innovative Computing, Information and Control (S1349-4198), 2015, 11(5): 1525-1537.
[9] 杨海东, 郭建华, 邓飞其. 人工免疫系统集成与应用[M]. 北京: 科学出版社, 2010.
Yang H D, Guo J H, Deng F Q.Integration and application of artificial immune system[M]. Beijing, China: Science Press, 2010.
[10] Raza A, Fernandez B R.Immuno-inspired robotic applications: A review[J]. Applied Soft Computing Journal (S1568-4946), 2015, 37(12): 490-505.
[11] Meahmed A, Duan W Y.Overview on the Development of Autonomous Underwater Vehicles (AUVs)[J]. Journal of Ship Mechanics(S1007-7294), 2016, 20(6): 768-787.
[12] Liang Q W, Sun T Y, Shi L.Reliability analysis for mutative topology structure multi-AUV cooperative system based on interactive Markov chains model[J]. Robotica(S0263-5747), 2017, 35(8): 1761-1772.
[13] 肖坤, 由光鑫, 姜大鹏, 等. 多AUVS协作分布式控制[J]. 哈尔滨工程大学学报, 2007, 28(5): 491-495.
Xiao K, You G X, Jiang D P, et al.Distributed cooperation control for a multiple AUVS[J]. Journal of Harbin Engineering University, 2007, 28(5): 491-495.
[14] 许真珍, 李一平, 封锡盛. 一个面向异构多 UUV协作任务的分层式控制系统[J]. 机器人, 2008, 30(2): 155-159.
Xu Z Z, Li Y P, Feng X S.A Hierarchical Control System for Heterogeneous Multiple UUV Cooperation Task[J]. Robot, 2008, 30(2): 155-159.
[15] Kwok Y K, Ahmad I.Static scheduling algorithms of allocating directed task graphs to multiprocessors[J]. ACM Computing Surveys(S0360-0300), 1999, 31(4): 78-96.
[16] Zhang Y, Parker L E.IQ-ASyMTRe: Forming Executable Coalitions for Tightly Coupled Multirobot Tasks[J]. IEEE Transactions on Robotics(S1552-3098), 2013, 29(2): 400-416.
[17] Zhu D Q, Huan H, Yang S X.Dynamic task assignment and path planning of Multi-AUV system based on an improved self-organizing map and velocity synthesis method in three-dimensional underwater workspace[J]. IEEE Tran saction on Cybernetics(S2168-2267), 2013, 43(2): 504-514.
[18] 姜丽梅. 弱通信条件下多AUV编队控制及协作机制研究[M]. 哈尔滨: 哈尔滨工程大学, 2012.
Jiang L M.Study on multi - AUV formation control and cooperative mechanism under weak communication[M]. Harbin, China: Harbin Engineering University, 2012.
[19] Liang H T, Kang F J.Distributed task allocation modeling based on agent topology and protocol for collaborative system[J]. Optik (S0030-4026), 2016, 127(19): 7776-7781.
[20] Wu X G, Zeng G Z.Goals description and application in migrating workflow system[J]. Expert Systems with Applications(S0957-4174), 2010, 37(12): 8027-8035.
[21] Lumb L I, Freemantle J R, Lederman J I, et al.Annotation modeling with formal ontologies: Implications for informal ontologies[J]. Computers and Geosciences (S0098-3004), 2009, 35(4): 855-861.
[22] Osterloh J P, Bracker H, Muller H, et al.DCoS-XML: A modelling language for dynamic distributed cooperative systems[C]//2013 IEEE International Conference on Industrial Informatics, USA: IEEE, 2013: 774-779.
[23] 李雄. 基于Meta-Agent交互链的作战系统建模研究[D]. 北京: 装甲兵工程学院, 2009.
Li X.Research on operational system modeling based on Meta-Agent interaction chain[D]. Beijing, China: Armored Force Engineering Institute, 2009.
[24] Yuan Q D, Guan Y, Hong B R, et al.Multi-robot task allocation using CNP combines with neural network[J]. Neural Computing and Applications(S0941-0643), 2013, 23(7): 1909-1914.
[25] 王茜竹, 赵春江, 汪霞, 等. 基于心智与扩展合同网的半自治多智能体任务分配[J]. 计算机集成制造系统, 2015, 21(11): 2885-2892.
Wang Q Z, Zhao C J, Wang X, et al.Semi-autonomous multi-Agent task allocation method based on extended contract net and mental model[J]. Computer Integrated Manufacturing Systems, 2015, 21(11): 2885-2892.
[26] 张方于, 陈学广, 迟嘉昱. 一种改进的GPGP协调机制[J]. 华中科技大学学报(自然科学版), 2004, 32(7): 34-36.
Zhang F Y, Chen X G, Chi J Y.An improved mechanism of GPGP coordination[J]. Journal of Huazhong University of Science and Technology(Nature Science), 2004, 32(7): 34-36.
[27] Das S, Ascano R.Distributed Belief Propagation in Multi-agent Environment[C]. Proceedings of 13th ICPAAMASS, 2015: 53-65.
[28] Toubman A, Roessingh J J, Spronck P, et al.Dynamic Scripting with Team Coordination in Air Combat Simulation[C]. Proceedings of 27th International Conference on IEOAAIS, 2014: 440-449.
[29] 冯磊, 查亚兵, 胡记文, 等. 基于复杂网络的作战模拟组织建模研究[J]. 系统仿真学报, 2012, 24(4): 882-886.
Feng L, Zha Y B, Hu J W, et al.Research of Combat Simulation Organization Modeling Based on Complex Networks[J]. Journal of System Simulation, 2012, 24(4): 882-886.
[30] 张杰, 王宁, 朱江. 基于仿真技术的两栖装甲装备作战效能评估方法[J]. 指挥控制与仿真, 2013, 35(1): 74-77.
Zhang J, Wang N, Zhu J.Evaluation of Operational Effectiveness of Amphibious Armored Equipment Based on Simulation Technology[J]. Command Control & Simulation, 2013, 35(1): 74-77.
[31] 刁兴华, 方洋旺, 肖冰松, 等. 基于多智能体联盟的多机协同空战任务分配[J]. 北京航空航天大学学报, 2014, 40(9):1268-1275.
Diao X H, Fang Y W, Xiao B S, et al.Task allocation in cooperative air combat based on multi-agent coalition[J]. Journal of Beijing University of Aeronautics and Astronautics, 2014, 40(9):1268-1275.
[32] 王辉, 王坤福, 刘淑芬. 多Agent的作战模拟体仿真体系结构[J]. 吉林大学学报(理学版), 2015, 53(1): 101-106.
Wang H, Wang K F, Liu S F.Multi-Agent System Structure of Combat Simulation[J]. Journal of Jilin University (Science Edition), 2015, 53(1): 101-106.
[33] 杨飞, 王青, 吴振东. 资源约束条件下舰艇编队多智能体协作规划[J]. 北京航空航天大学学报, 2011, 37(2): 210-215.
Yang F, Wang Q, Wu Z D.Formation cooperative planning method based on multi-agent with resource constraints[J]. Journal of Beijing University of Aeronautics and Astronautics, 2011, 37(2): 210-215.
[34] Paull L, Seto M, Leonard J J.Decentralized cooperative trajectory estimation for autonomous underwater vehicles[C]. 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2014: 184-191.
[35] Deng Y U, Beaujean P P, Edgar A, et al.Task allocation and path planning for collaborative AUVs operating through an underwater acoustic network[C]. MTS/IEEE Seattle, OCEANS, 2010.
[36] Bruzzone A G, Merani D, Massei M, et al.Modeling cyber warfare in heterogeneous networks for protection of infrastructures and operations[C]. 2013 European Modeling and Simulation Symposium, 2013: 685-694.
[37] Frost G, Maurelli F, Lane D M.Reinforcement learning in a behaviour-based control architecture for marine archaeology[C]. MTS/IEEE OCEANS, 2015.
[38] Watanabe K.Design and fabrication of a small test-bed aimed for basin experiment of underwater multi-agent system. International Symposium on Underwater Technology[C]. International Workshop on Scientific Use of Submarine Cables and Related Technologies 2007: 574-580.
[39] Bharamagoudra M R, Manvi S S, Gonen B.Event driven energy depth and channel aware routing for underwater acoustic sensor networks: Agent oriented clustering based approach[J]. Computers and Electrical Engineering (S0045-7906), 2017, 58: 1-19.
[40] 许真珍, 闫志斌, 胡志强, 等. 基于B/S模式的AUV协同设计平台设计与实现[J]. 计算机应用与软件, 2013, 30(10): 26-29.
Xu Z Z, Yan Z B, Hu Z Q, et al.Design and Realisation of B/S Mode-based Cooperative Design Platform For AUV[J]. Computer Applications and Software, 2013, 30(10): 26-29.
[41] 严浙平, 赵玉飞, 陈涛. 海洋勘测水下无人航行器的自主控制技术研究[J]. 哈尔滨工程大学学报, 2013, 34(9): 1152-1158.
Yan Z P, Zhao Y F, Chen T.Research on autonomous control of unmanned underwater vehicle for oceanographic survey[J]. Journal of Harbin Engineering University, 2013, 34(9): 1152-1158.
[42] Liu H B, Gu G C, Shen J, et al.AUV fuzzy neural BDI[J]. Journal of Marine Science & Application(S1671-9433), 2005, 4(3): 37-41.
[43] 梁洪涛, 康凤举. 面向多智能体 UUV 协同系统的任务分配建模[J]. 系统仿真学报, 2015, 27(9): 2075-2082.
Liang H T, Kang F J.Task Allocation Modeling for Agent-oriented UUV Collaborative System[J]. Journal of System Simulation, 2015, 27(9): 2075-2082.
[44] 杨海东, 郭建华, 邓飞其. 人工免疫系统集成与应用[M]. 北京: 科学出版社, 2010.
Yang H D, Guo J H, Deng F Q.Integration and application of artificial immune system[M]. Beijing: Science Press, 2010.
[45] 马笑潇, 黄席樾, 柴毅, 等. 一种新的领域智能体: 免疫智能体[J]. 高技术通讯, 2003, 13(1): 72-75.
Ma X X, Huang X Y, Chai Y, et al.A New Domain Agen:Immune Agent[J]. High Technology Letters, 2003, 13(1): 72-75.