Research on a Credibility Information Management Method of Simulation Modeling

doi:10.16182/j.issn1004731x.joss.24-0053

Abstract

Abstract:

A proposed method for managing credibility information in simulation modeling draws insights from the NASA-STD-7009 standard for modeling and simulation. From the perspective of credibility information recording, definition, and assessment, this method aims to address the core issue of whether the credibility requirements are met in simulation modeling research. A simulation system credibility information extraction tool is designed to extract three types of information including modeling credibility information, data credibility information, and development process credibility information, enabling recording, definition, and traceability of credibility information in simulation models. Taking a servo system credibility evaluation as an example, a simulation system credibility information management tool is developed based on the proposed credibility management method. The feasibility and effectiveness of the simulation system credibility information management method are verified. This work is expected to provide a theoretical basis and engineering ideas for intelligent analysis of credibility.

Key words: modeling and simulation, credibility analyze, credibility information management, NASA-STD-7009 standard, Modedlica

CLC Number:

TP391.9

Gu Qiming, Chen Jiazhi, Cao Guoyan, Zhou Chenchu, Yu Dengxiu, Hu Haifeng. Research on a Credibility Information Management Method of Simulation Modeling[J]. Journal of System Simulation, 2025, 37(5): 1314-1328.

Figures/Tables 18

Fig. 1

Fig. 2

Table 1

Table 2

Fig. 3

Fig. 4

Fig. 5

Table 3

Table 4

Fig. 6

Fig. 7

Fig. 8

Fig. 9

Fig. 10

Fig. 11

Table 5

Table 6

Fig. 12

References 27

1	焦鹏, 张琪, 魏翔宇, 等. 仿真可信性评估中的若干问题及对策研究[J]. 系统仿真学报, 2019, 31(7): 1257-1262.
	Jiao Peng, Zhang Qi, Wei Xiangyu, et al. Some Problems and Countermeasures in Simulation Credibility Evaluation[J]. Journal of System Simulation, 2019, 31(7): 1257-1262.
2	McKenney J L. Simulation Gaming for Management Development[M]. Boston: Division of Research, Graduate School of Business Administration, Harvard University, 1967.
3	Fishman G S, Kiviat P J. The Analysis of Simulation-generated Time Series[J]. Management Science, 1967, 13(7): 525-557.
4	Mehta U B, Eklund D R, Romero V J, et al. Simulation Credibility: Advances in Verification, Validation, and Uncertainty Quantification[EB/OL]. (2016-11-01) [2023-10-06]. .
5	Law A M. How to Build Valid and Credible Simulation Models[C]//2022 Winter Simulation Conference (WSC). Piscataway: IEEE, 2022: 1283-1295.
6	Sanders P. DoD Modeling and Simulation (M&S) Verification, Validation, and Accreditation (VV&A)[J]. Office of the Under Secretary of Defense (Acquisition and Technology), Washington, DC, Standard, 1996 (5000.61).
7	Cain L, Hartway B, Thomas D, et al. An overview of NASA Constellation's Recommended Practices Guide for Verification, Validation and Accreditation[C]//Proceedings of the 2008 Summer Computer Simulation Conference. Vista: Society for Modeling & Simulation International, 2008: 51.
8	李伟, 杨明, 王子才. 仿真精度问题探讨[J]. 计算机仿真, 2009, 26(1): 118-121, 184.
	Li Wei, Yang Ming, Wang zi Cai. Research on Simulation Accuracy[J]. Computer Simulation, 2009, 26(1): 118-121, 184.
9	Oberkampf W L, Trucano T G. Verification and Validation in Computational Fluid Dynamics[J]. Progress in Aerospace Sciences, 2002, 38(3): 209-272.
10	Gall L, Otter M, Reiner M, et al. Continuous Development and Management of Credible Modelica Models[C]//14th International Modelica Conference. [S.l]:[s.n.], 2021: 359-372.
11	Otter Martin, Reiner Matthias, Tobolář Jakub, et al. Towards Modelica Models with Credibility Information[J]. Electronics, 2022, 11(17): 2728.
12	Steele M J. NASA Handbook for Models and Simulations: An Implementation Guide for NASA-STD-7009[EB/OL]. (2013-01-01) [2023-10-06]. .
13	叶梓珩. 复杂仿真系统的仿真可信度评估方法与系统研发[D]. 南京: 南京理工大学, 2019.
14	Hu Wei, Ardeshiricham A, Kastner R. Hardware Information Flow Tracking[J]. ACM Computing Surveys, 2021, 54(4): 83.
15	林圣琳. 面向复杂仿真的评估与优化方法研究[D]. 哈尔滨: 哈尔滨工业大学, 2020.
	Lin Shenglin. Complex Simulation-oriented Assessment and Optimization Methods[D]. Harbin: Harbin Institute of Technology, 2020.
16	魏华梁, 王肇敏, 刘藻珍, 等. 系统仿真置信度研究中的若干问题与准则[J]. 系统仿真学报, 2000, 12(1): 39-42.
	Wei Hualiang, Wang Zhaomin, Liu Zaozhen, et al. Problems and Principles of Simulation Fidelity Evaluation[J]. Journal of System Simulation, 2000, 12(1): 39-42.
17	Lehmann Axel, Wang Zhongshi . Verification, Validation, and (VV&A)-requirements Accreditation, Standards, and Trends[M]//Zhang Lin, Zeigler B P, Laili Yuanjun. Model Engineering for Simulation. London: Academic Press, 2019: 101-121.
18	Steele M J. Standard for Models and Simulations[EB/OL]. (2016-09-01) [2023-10-06]. .
19	Babula M, Bertch W, Green L, et al. NASA Standard for Models and Simulations: Credibility Assessment Scale[C]//47th AIAA Aerospace Sciences Meeting Including the New Horizons Forum and Aerospace Exposition. Reston: AIAA, 2009: AIAA 2009-1011.
20	Gass S I, Joel L S. Concepts of Model Confidence[J]. Computers & Operations Research, 1981, 8(4): 341-346.
21	田星雨, 曾广迅, 高云博, 等. 基于语义匹配与组合的模型重用技术研究[J]. 系统仿真学报, 2021, 33(12): 2901-2910.
	Tian Xingyu, Zeng Guangxun, Gao Yunbo, et al. Research on Model Reuse Technology Based on Semantic Matching and Composition[J]. Journal of System Simulation, 2021, 33(12): 2901-2910.
22	Jacek Jan Krzywy, Hell Marko. Classification of Process from the Simulation Modeling Aspect-system Dynamics and Discrete Event Simulation[C]//Innovations in Mechatronics Engineering II. Cham: Springer International Publishing, 2022: 86-97.
23	Cheng Yao, Liao Haitao, Elsayed E A. From Reliability to Resilience: More Than Just Taking One Step Further[J]. IEEE Transactions on Reliability, 2024, 73(1): 42-46.
24	张忠. 仿真系统可信度评估方法研究[D]. 哈尔滨: 哈尔滨工业大学, 2014.
	Zhang Zhong. Research on Evaluation Method for Credibility of Simulation System[D]. Harbin: Harbin Institute of Technology, 2014.
25	杨小军, 徐忠富, 张星, 等. 仿真模型可信度评估研究综述及难点分析[J]. 计算机科学, 2019, 46(增1): 23-29.
	Yang Xiaojun, Xu Zhongfu, Zhang Xing, et al. Overview and Difficulties Analysis on Credibility Assessment of Simulation Models[J]. Computer Science, 2019, 46(S1): 23-29.
26	Kalogirou Soteris A. Use of TRNSYS for Modelling and Simulation of a Hybrid Pv-thermal Solar System for Cyprus[J]. Renewable Energy, 2001, 23(2): 247-260.
27	徐永坤, 陈立平, 刘伟, 等. 基于Modelica的潜液泵系统建模与仿真分析[J]. 机床与液压, 2021, 49(14): 142-147.
	Xu Yongkun, Chen Liping, Liu Wei, et al. Modeling and Simulation Analysis of Submersible Pump System Based on Modelica[J]. Machine Tool & Hydraulics, 2021, 49(14): 142-147.

类型	描述
Unknown	该值的来源未知
Estimated	该值是经验估计得到的
Provided	数据表、供应商提供的值
Computed	从计算机辅助中得到的值，如计算流体学，有限元方法等
Measured	通过实际物理实验测量所得
Calibrated	根据分析模型数据，模型校准之后得到值

不确定性分布类型	不确定性参数	不确定性类型
Interval(区间)	nominal(标称)，lower(最小值)，upper(最大值)	认知不确定性
Uniform(均匀分布)	nominal(标称)，lower(最小值)，upper(最大值)	均匀分布不确定性
Truncated Normal(截断正态分布)	nominal(标称)，lower(最小值)，upper(最大值)，stdDev(标准差)	截断正态分布不确定性
Interval Tolerance(区间容差)	nominal(标称)，reTol(相对容差)，absTol(绝对容差)	认知不确定性
Uniform Tolerance(均匀容差)	nominal(标称)，reTol(相对容差)，absTol(绝对容差)	均匀分布不确定性
Truncated Normal Tolerance (截断正态容差)	nominal(标称)，reTol(相对容差)，absTol(绝对容差)， stdDevFactor(标准差倍数)	截断正态分布不确定性

组件类别	组件参数	参数值	不确定性类别
齿轮箱	齿轮阻尼/(N·m/rad)	100	截断正态容差
	弹簧阻尼/(N·m/rad)	500	截断正态容差
	弹簧常数/(N·m/rad)	5.8×10⁵	截断正态容差
受控电机	时间常数/s	0.001	区间容差
	电阻/Ω	13.8	截断正态容差
	线圈电感/H	0.016	区间容差
	变换系数/(N·m/A)	1.016	区间容差
	转动惯量/(Kg·m²)	0.002 5	区间容差

键	描述
Author	仿真模型开发人员
Organization	仿真模型开发组织
Contact	联系方式
Creation Date	仿真模型创建日期
Modified Date	仿真模型修改日期
Created In Project	仿真模型针对的项目
MSL Version	Modelica标准库版本
Copied From Model	仿真模型继承的父类模型
Copied From Model Version	继承的父类模型的版本号
Cerdibility Level	置信度水平
Checked	是否基于VV&A方法检查
Checked By	检查人员
Modelica Tool	Modelica工程软件
Modelica Version	Modelica工程软件版本
Modelica Language Version	Modelica语言版本

变量信息	类别
变异性	tunable
变异性	constant
因果关系	parameter
因果关系	calculatedParameter
初始值	exact
初始值	calculated
输入输出信息	Input
输入输出信息	Output