An Online Evaluation Framework of Complex Simulation System Based on Acceptability Criteria

doi:10.16182/j.issn1004731x.joss.20-FZ0429

Journal of System Simulation ›› 2020, Vol. 32 ›› Issue (12): 2324-2331.doi: 10.16182/j.issn1004731x.joss.20-FZ0429

Previous Articles Next Articles

An Online Evaluation Framework of Complex Simulation System Based on Acceptability Criteria

Sun Zhenglin, Yuan Weiqiang, Li Weiqing^*

Computer Science and Engineering,Nanjing University of Science and Technology,Nanjing 210094,China

Received:2020-03-28 Revised:2020-06-30 Online:2020-12-18 Published:2020-12-16

Abstract

Abstract: An online simulation evaluation method based on Acceptability Criteria (AC) for the lag of current complex simulation systems is proposed.A qualitative and quantitative AC to index mapping model is used to establish an evaluation index system.Based on index sets and evaluation functions,a seven-tuple model of a simulation process finite automaton is proposed,and a mapping of the simulation process to automata and a data-driven state transfer mechanism are given.Based on the above results,an online evaluation tool is designed and the effectiveness is verified through a case.The result that the method can effectively solve lag in the evaluation of the simulation system.

Key words: acceptability criteria, online evaluation, finite automaton, evaluation tool

CLC Number:

TP391.9

Sun Zhenglin, Yuan Weiqiang, Li Weiqing. An Online Evaluation Framework of Complex Simulation System Based on Acceptability Criteria[J]. Journal of System Simulation, 2020, 32(12): 2324-2331.

References 10

[1]	李伟,林圣琳,周玉臣,等.复杂仿真系统可信度评估研究进展[J].中国科学:信息科学,2018,48(7):767-782.Li Wei,Lin Shenglin,Zhou Yuchen,et al.Research Progress on Credibility Assessment of a Complex Simulation System[J].SCIENCE CHINA:Information Sciences,2018,48(7):767-782.
[2]	焦鹏,张琪,魏翔宇,等.仿真可信性评估中的若干问题及对策研究[J].系统仿真学报,2019,31(7):1257-1262.Jiao Peng,Zhang Qi,Wei Xiangyu,et al.Some Problems and Countermeasures in Simulation Credibility Evaluation[J].Journal of System Simulation,2019,31(7):1257-1262.
[3]	杨丽娜,吴晓燕.建模与仿真VV&A工具设计与实现[J].现代防御技术,2008(4):148-152.Yang Lina,Wu Xiaoyan.Design and Actualization of VV&A Tools Used for Modeling and Simulation[J].Modern Defense Technology,2008(4):148-152.
[4]	Polat F,Guvenir H A.UVT:A Unification-based Tool for Knowledge Base Verification[J].IEEE Exper (S0885-9000),1993,8(3):69-75.
[5]	Balci O,Adams R J,Myers D S,et al.A Collaborative Evaluation Environment for Credibility Assessment of Modeling and Simulation Applications[C]//Proceedings of the 2002 Winter Simulation Conference.San Diego,CA,USA:IEEE,2002.
[6]	王达.多武器平台仿真系统数据VV&C技术研究[D].哈尔滨:哈尔滨工业大学,2006.Wang Da.The Research of Multiple Armament Platform Simulation Data VV&C[D].Harbin:Harbin Institute of Technology,2006.
[7]	杨明,方可.仿真可信度评估辅助工具研究[J].计算机仿真,2010,27(6):118-121,154.Yang Ming,Fang Ke.Research on the Simulation Credibility Evaluation Assistant Tool Based on Hierarchical Evaluation[J].Computer Simulation,2010,27(6):118-121,154.
[8]	DoD M&SCO.M&S VV&A RPG Special Topic:Acceptability Criteria[EB/OL].[2019-05-05].http://www.msco.mil.
[9]	DoD M&SCO.M&S VV&A RPG Special Topic:Requirements[EB/OL].[2019-05-05].http://www.msco.mil.
[10]	DoD M&SCO.M&S VV&A RPG Special Topic:Measures[EB/OL].[2019-05-05].http://www.msco.mil.

An Online Evaluation Framework of Complex Simulation System Based on Acceptability Criteria

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

References 10

Related Articles 2

Recommended Articles

Metrics

Comments

[1]	Sun Yifei, Cai Liangliang, Zhou Yi, Zhou Zhong. MRMark: A Machine Performance Evaluation Method for Three-dimensional Video Fusion [J]. Journal of System Simulation, 2020, 32(7): 1375-1384.
[2]	Jiao Peng, Zhang Qi, Wei Xiangyu, Zha Yabing. Some Problems and Countermeasures in Simulation Credibility Evaluation [J]. Journal of System Simulation, 2019, 31(7): 1257-1262.