Research on Nested Named Entity Recognition in Missile Field Text

doi:10.16182/j.issn1004731x.joss.22-0456

Abstract

Jingwen Guan, Xiao Song, Xiaoqing Li, Tong Yang, Junhua Zhou. Research on Nested Named Entity Recognition in Missile Field Text[J]. Journal of System Simulation, 2023, 35(8): 1757-1767.

Figures/Tables 11

Fig. 1

Table 1

Fig. 2

Fig. 4

Fig. 3

Fig. 5

Table 2

Table 3

Table 4

Fig. 6

Table 5

References 19

1	杨伟凯, 王艳, 纪志成. 面向知识图谱的智能生产系统工艺知识推理方法[J]. 系统仿真学报, 2023, 35(4): 773-785.
	Yang Weikai, Wang Yan, Ji Zhicheng. Knowledge Graph-based Process Knowledge Reasoning Method for Intelligent Production System[J]. Journal of System Simulation, 2023, 35(4): 773-785.
2	顾丹阳, 李明倩, 权冀川, 等. 基于本体的主战武器装备知识图谱构建[J]. 指挥控制与仿真, 2021, 43(6): 14-20.
	Gu Danyang, Li Mingqian, Quan Jichuan, et al. Ontology Based Knowledge Graph Construction for Combat Weapon Equipment[J]. Command Control & Simulation, 2021, 43(6): 14-20.
3	焦凯楠, 李欣, 朱容辰. 中文领域命名实体识别综述[J]. 计算机工程与应用, 2021, 57(16): 1-15.
	Jiao Kainan, Li Xin, Zhu Rongchen. Overview of Chinese Domain Named Entity Recognition[J]. Computer Engineering and Applications, 2021, 57(16): 1-15.
4	刘浏, 王东波. 命名实体识别研究综述[J]. 情报学报, 2018, 37(3): 329-340.
	Liu Liu, Wang Dongbo. A Review on Named Entity Recognition[J]. Journal of the China Society for Scientific and Technical Information, 2018, 37(3): 329-340.
5	陈曙东, 欧阳小叶. 命名实体识别技术综述[J]. 无线电通信技术, 2020, 46(3): 251-260.
	Chen Shudong, Ouyang Xiaoye. Overview of Named Entity Recognition Technology[J]. Radio Communications Technology, 2020, 46(3): 251-260.
6	Huang Zhiheng, Xu Wei, Yu Kai. Bidirectional LSTM-CRF Models for Sequence Tagging[EB/OL]. (2015-08-09)[2022-04-27].
7	Devlin J, Chang Mingwei, Lee K, et al. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding[EB/OL]. (2019-05-24)[2022-04-27].
8	Sohrab M G, Miwa M. Deep Exhaustive Model for Nested Named Entity Recognition[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: ACL, 2018: 2843-2849.
9	Zheng Changmeng, Cai Yi, Xu Jingyun, et al. A Boundary-aware Neural Model for Nested Named Entity Recognition[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Stroudsburg, PA, USA: ACL, 2019: 357-366.
10	Fisher J, Vlachos A. Merge and Label: A Novel Neural Network Architecture for Nested NER[EB/OL]. (2019-06-30)[2022-04-27].
11	Lin Hongyu, Lu Yaojie, Han Xianpei, et al. Sequence-to-nuggets: Nested Entity Mention Detection via Anchor-region Networks[EB/OL]. (2019-06-10)[2022-04-27].
12	Wang Bailin, Lu Wei, Wang Yu, et al. A Neural Transition-based Model for Nested Mention Recognition[EB/OL]. (2018-10-03)[2022-04-27].
13	Ju Meizhi, Miwa M, Ananiadou S. A Neural Layered Model for Nested Named Entity Recognition[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). Stroudsburg, PA, USA: ACL, 2018: 1446-1459.
14	Sohrab M G, Miwa M. Deep Exhaustive Model for Nested Named Entity Recognition[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: ACL, 2018: 2843-2849.
15	Shibuya T, Hovy E. Nested Named Entity Recognition via Second-best Sequence Learning and Decoding[J]. Transactions of the Association for Computational Linguistics, 2020, 8: 605-620.
16	Li Xiaoya, Feng Jingrong, Meng Yuxian, et al. A Unified MRC Framework for Named Entity Recognition[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA, USA: ACL, 2020: 5849-5859.
17	黄昌宁, 李玉梅, 朱晓丹. 中文文本标注规范(5.0版)[EB/OL]. (2006-03-27)[2022-04-27].
	Huang Changning, Li Yumei, Zhu Xiaodan. Tokenization Guidelines of Chinese Text (V 5.0)[EB/OL]. (2006-03-27)[2022-04-27].
18	Liu Yinhan, Ott M, Goyal N, et al. RoBERTa: A Robustly Optimized BERT Pretraining Approach[EB/OL]. (2019-07-26)[2022-04-27].
19	Dai Zhenjin, Wang Xutao, Ni Pin, et al. Named Entity Recognition Using BERT BiLSTM CRF for Chinese Electronic Health Records[C]//2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI). Piscataway, NJ, USA: IEEE, 2019: 1-5.

统计量	值
总字数	409 224
总句数	3 581
总实体数	6 021
嵌套实体数	1 840
嵌套实体占比/%	30.56

	B-Model	I-Model	B-Object	I-Object	O
B-Model	0.43	0.81	0.04	0.07	0.36
I-Model	0.52	0.71	0.35	0.12	0.44
B-Object	0.45	0.21	0.63	0.73	0.50
I-Object	0.62	0.18	0.46	0.65	0.54
O	0.42	0.12	0.40	0.13	0.61
…	…	…	…	…	…

参数	值
学习率	3×10^-5
学习衰减率	0.01
学习算法	Adam
训练轮次	20
Batch size	8
Dropout值	0.1

实验方法	精确率	召回率	F1值
BiLSTM-CRF^[6]	0.503 4	0.501 9	0.502 6
Bert-BiLSTM-CRF^[7,19]	0.653 5	0.692 3	0.672 3
BERT-MRC^[16]	0.695 4	0.723 1	0.709 0
Roberta-BiLSTM-CRF^[18-19]	0.699 3	0.723 8	0.711 3
MRC-NER-LF	0.703 5	0.742 3	0.722 4

实体类型	精确率	召回率	F1值
Object	0.678 6	0.950 0	0.791 7
Model	0.688 9	0.584 9	0.632 7
Method	0.600 0	0.486 5	0.537 3
Parameter	0.605 3	0.500 0	0.547 6
Function	0.500 0	0.375 0	0.428 6
Behavior	0.500 0	0.277 8	0.357 1

Research on Nested Named Entity Recognition in Missile Field Text

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 11

References 19

Related Articles 15

Recommended Articles

Metrics

Comments

实验方法	精确率	召回率	F1值
BERT-BiLSTM-CRF	0.573 4	0.351 5	0.435 8
Layered-BiLSTM-CRF	0.553 4	0.541 0	0.547 1
BERT-MRC	0.600 3	0.602 2	0.598 4
MRC-NER-LF	0.617 2	0.621 2	0.613 2

[1]	Zhang Bin, Lei Yonglin, Li Qun, Gao Yuan, Chen Yong, Zhu Jiajun, Bao Chenlong. Reinforcement Learning Modeling of Missile Penetration Decision Based on Combat Simulation [J]. Journal of System Simulation, 2025, 37(3): 763-774.
[2]	Zhang Xu, Zeng Peng, Li Xu, Zheng Xuehe, Xue Jianheng, Wang Chao. Design and Simulation Analysis of Guidance Law for Boost Phase Interceptor Missile [J]. Journal of System Simulation, 2025, 37(2): 335-344.
[3]	Fei Shuaidi, Cai Changlong, Liu Fei, Chen Minghui, Liu Xiaoming. Research on the Target Allocation Method for Air Defense and Anti-missile Defense of Naval Ships [J]. Journal of System Simulation, 2025, 37(2): 508-516.
[4]	Zhang Peng, Feng Ke, Gong Jiancheng, Yang Xiaoqiang, Shen Jinxing. Combat Effectiveness Evaluation of Air Defense Missile Weapon System Based on RBF Neural Network [J]. Journal of System Simulation, 2025, 37(2): 529-540.
[5]	Sun Xin, Xing Lining, Wang Rui, Wang Ling, Shi Jianmai, Luo Tianyu. Air Defense Missile Weapon Target Assignment Based on Multi-objective Evolutionary Algorithm [J]. Journal of System Simulation, 2024, 36(6): 1298-1308.
[6]	Dou Jianbin, Wang Xiaobing, Yang Hongjian, Gao Yulong. Design and application of Hardware-in-the-loop Simulation System for Infrared Imaging Guide Missile Test and Evaluation [J]. Journal of System Simulation, 2024, 36(2): 522-532.
[7]	Luo Yucheng, Zhang Ming'en, Liu Fei, Lu Yingbo, Ye Feng. Result Validation Method of Simulation Models Based on Piecewise Feature Extraction [J]. Journal of System Simulation, 2024, 36(1): 272-281.
[8]	Yexin Zhang, Yu Cheng, Hongyan Yan, Xuwei Fan, Xu Zhang, Yi Tian. Design And Simulation of TS Fuzzy Based Cooperative Control of Missile Formation [J]. Journal of System Simulation, 2022, 34(7): 1559-1567.
[9]	Gaofeng Zhang, Liang Wu. Effectiveness Evaluation of Surface Ship Air Defense and Antimissile Combat in Complex Electromagnetic Environment [J]. Journal of System Simulation, 2022, 34(3): 640-650.
[10]	Shao Cheng, Sun Hongyuan, Zhang Lin. Simulation of Anti-ship Missile Automatic Control Section Trajectory Based on PSO-LSSVM [J]. Journal of System Simulation, 2021, 33(4): 918-926.
[11]	Ruan Kaizhi, Yuan Qingqing, Zhai Wenhua, Zhang Zhiqiang. Design of Air Defense Missile Weapon System Simulation Platform Based on Xsim Platform [J]. Journal of System Simulation, 2020, 32(1): 142-148.
[12]	Shi Yan, Zhang Lihua, Dong Shouquan, Wang Jue. Cruise Missile Path Planning Based on ACO Algorithm and Bezier Curve Optimization [J]. Journal of System Simulation, 2020, 32(1): 122-129.
[13]	Wu Shuai, Zhou Xiaohua, Wang Lili, Yao Xingzhong. Modeling and Simulation of Missile Trajectory Based on Practical Sampling [J]. Journal of System Simulation, 2019, 31(4): 811-817.
[14]	Liu Wen, Wang Xiaolu, Wang Hongsheng, Zhang Heng, Wang Changqing. Agent Based Modeling and Simulation Analysis of Low-Orbit Early-Warning Satellites [J]. Journal of System Simulation, 2019, 31(11): 2413-2421.
[15]	Liao Ying, Ji Haiyu, Xue Gaoxiong. Optimal Closed-Loop Guidance for Cruise Missiles Based on Pseudospectral Method [J]. Journal of System Simulation, 2018, 30(9): 3464-3471.