基于深度时空循环神经网络的协同作战行动识别

doi:10.16182/j.issn1004731x.joss.201803004

系统仿真学报 ›› 2018, Vol. 30 ›› Issue (3): 793-800.doi: 10.16182/j.issn1004731x.joss.201803004

• 专栏：态势智能认知仿真 • 上一篇下一篇

基于深度时空循环神经网络的协同作战行动识别

易卓¹, 廖鹰^1,2, 胡晓峰², 杜学绘¹, 朱丰²

1.信息工程大学,河南郑州 450001;
2.国防大学联合作战学院,北京 100091

收稿日期:2018-01-07 出版日期:2018-03-08 发布日期:2019-01-02
作者简介:易卓(1989-),男,湖北京山,博士生,研究方向为人工智能,作战指挥,网络安全。
基金资助:
国家自然科学基金(61773399, 61374179, 61703412),军民共用重大研究计划联合基金(U1435218)

A deep spatio-temporal RNNs based coordinated operational action recognition

Yi Zhuo¹, Liao Ying^1,2, Hu Xiaofeng², Du Xuehui¹, Zhu Feng²

1.Information Engineering University, Zhengzhou 450001, China;
2.Department of Information Operation & Command Training, NDU, Beijing 100091, China

Received:2018-01-07 Online:2018-03-08 Published:2019-01-02

摘要/Abstract

摘要： 针对协同作战行动识别面临的行为特征空间大、模型参数多、训练速度慢等问题,将时空图模型和时序建模有机结合,提出基于深度时空循环神经网络的协同作战行动识别方法,建立战场协同作战行动识别架构,引入建议窗口生成机制划分战场空间为局部战场集,利用时空图设计层次循环神经网络模型以识别局部战场协同作战行动,并结合局部战场协同关系传递性实现整个战场的协同行动识别。实验分析表明,该方法具有较高的协同作战行动识别准确率。

关键词: 协同作战, 层次循环神经网络, 协同作战行为识别, 时空图, 态势理解

Abstract: To address the issues of large feature space, numerous model parameters and slow training speed in coordinated operation action recognition, a coordinated operational action recognition method based on a deep spatio-temporal recurrent neural network is proposed. In this method, a warped region generation mechanism is introduced to divide the whole battlefield into sub-battlefield. Meanwhile, a hierarchical recurrent neural network is constructed using spatio-temporal graph model, which is applied to the generated sub-battlefield to recognize coordinated operational action. Additionally, the recognized coordinated operational actions of sub-battlefields are merged to find out all coordinated operational actions based on the principle of transitivity of coordinated operational actions in local battlefield. Experiment results suggest that the proposed method possesses higher accuracy.

Key words: coordinated operation, hierarchical recurrent neural network, coordinated operation action recognition, spatio-temporal graph, situation comprehension

中图分类号:

TP183
E919

易卓, 廖鹰, 胡晓峰, 杜学绘, 朱丰. 基于深度时空循环神经网络的协同作战行动识别[J]. 系统仿真学报, 2018, 30(3): 793-800.

Yi Zhuo, Liao Ying, Hu Xiaofeng, Du Xuehui, Zhu Feng. A deep spatio-temporal RNNs based coordinated operational action recognition[J]. Journal of System Simulation, 2018, 30(3): 793-800.

参考文献 21

[1]	宋元, 王永春. 海上防空作战态势估计理论及应用[M]. 北京: 国防工业出版社, 2014. Song Yuan, Wang Yongchun. The theory and application of sea air defense combat situation estimation[M]. Beijing: National Defense Industry Press, 2014.
[2]	Peng P, Wen Y, Yang Y, et al.Multiagent Bidirectionally- Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Games[J]. 2017.
[3]	Blunsden S, Fisher R, Andrade E.Recognition of coordinated multi agent activities, the individual vs the group[J]. Language Culture & Curriculum (S0790-8318), 2006, 22(2): 157-174.
[4]	Min F, Groen F C A, Hao L. Dynamic Partition of Collaborative Multiagent Based on Coordination Trees[C]. Intelligent autonomous systems 12: proceedings of the 12th International Conference IAS-12, held June 26-29, 2012 Jeju Island, Korea. Springer, 2013, 2: 503-510.
[5]	Fang M, Groen F C A, Li H, et al. Collaborative multi-agent reinforcement learning based on a novel coordination tree frame with dynamic partition[J]. Engineering Applications of Artificial Intelligence (S0952-1976), 2014, 27(1): 191-198.
[6]	Liu L, Wang S, Su G, et al.Towards complex activity recognition using a Bayesian network-based probabilistic generative framework[J]. Pattern Recognition (S0031-3203), 2017, 68(C): 295-309.
[7]	Swears E, Hoogs A, Ji Q, et al.Complex Activity Recognition Using Granger Constrained DBN (GCDBN) in Sports and Surveillance Video[C]. IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, 2014: 788-795.
[8]	Diks C, Panchenko V.A new statistic and practical guidelines for nonparametric Granger causality testing[J]. Journal of Economic Dynamics & Control (S0165-1889), 2006, 30(9): 1647-1669.
[9]	Liu L, Yang Y, Govindarajan L N, et al. An Interval-Based Bayesian Generative Model for Human Complex Activity Recognition[J]. arXiv:1701.00903, 2017.
[10]	Zhu W, Lan C, Xing J, et al.Co-occurrence feature learning for skeleton based action recognition using regularized deep LSTM networks[C]. Thirtieth AAAI Conference on Artificial Intelligence. AAAI Press, 2016: 3697-3703.
[11]	Taylor G W, Fergus R, Lecun Y, et al.Convolutional learning of spatio-temporal features[C]. European Conference on Computer Vision. Springer-Verlag, 2010: 140-153.
[12]	Le Q V, Zou W Y, Yeung S Y, et al.Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis[C]. Computer Vision and Pattern Recognition. IEEE, 2011: 3361-3368.
[13]	Ji S, Xu W, Yang M, et al.3D Convolutional Neural Networks for Human Action Recognition[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence (S0162-8828), 2013, 35(1): 221.
[14]	Wang Keze, Wang Xiaolong, Lin Liang, et al.3D Human Activity Recognition with Reconfigurable Convolutional Neural Networks[C]. Proceedings of the 2014 ACM Conference on Multimedia, 2014: 97-106.
[15]	Chen B.Deep Learning of Invariant Spatio-Temporal Features from Video[J]. University of British Columbia, 2010.
[16]	Jain A, Zamir A R, Savarese S, et al.Structural-RNN: Deep Learning on Spatio-Temporal Graphs[C]. Computer Vision and Pattern Recognition. IEEE, 2016: 5308-5317.
[17]	Von L T, Brodkorb F, Roskosch P, et al.MobilityGraphs: Visual Analysis of Mass Mobility Dynamics via Spatio-Temporal Graphs and Clustering[J]. IEEE Transactions on Visualization & Computer Graphics (S1077-2626), 2016, 22(1): 11-20.
[18]	Mondo G D, Rodríguez M A, Claramunt C, et al.Modeling consistency of spatio-temporal graphs[J]. Data & Knowledge Engineering (S0169-023X), 2013, 84(3): 59-80.
[19]	Yu B, Yin H, Zhu Z. Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting[J]. arXiv:1709.04875, 2017.
[20]	Uijlings J R, Sande K E, Gevers T, et al.Selective Search for Object Recognition[J]. International Journal of Computer Vision (S0920-5691), 2013, 104(2): 154-171.
[21]	欧微, 柳少军, 贺筱媛, 等. 基于时序特征编码的目标战术意图识别算法[J]. 指挥控制与仿真, 2016, 38(6): 36-41. OU Wei, Liu Shaojun, He Xiaoyuan, et al. Tactical intention recognition algorithm based on encoded temporal features[J]. Command Control & Simulation, 2016, 38(6): 36-41.

基于深度时空循环神经网络的协同作战行动识别

A deep spatio-temporal RNNs based coordinated operational action recognition

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献 21

相关文章 4

编辑推荐

Metrics

本文评价

[1]	万佳庆, 王鹏飞, 唐俊林, 张栋, 李新国. 基于多武器平台的要地防空混合部署策略与模型研究[J]. 系统仿真学报, 2021, 33(8): 1754-1765.
[2]	李景, 韩健, 张卿. 多飞行器协同制导仿真技术研究[J]. 系统仿真学报, 2019, 31(12): 2775-2780.
[3]	廖鹰, 易卓, 胡晓峰, 田园, 陶九阳. 基于三维卷积神经网络的战场聚集行为预测[J]. 系统仿真学报, 2018, 30(3): 801-808.
[4]	王圣洁, 康凤举, 韩翃. 一种改进CMMS描述法的研究及应用[J]. 系统仿真学报, 2015, 27(10): 2252-2257.