Journal of System Simulation ›› 2026, Vol. 38 ›› Issue (9): 2464-2485.doi: 10.16182/j.issn1004731x.joss.25-1067

• Special Column : System Simulation for Autonomous Driving and Intelligent Transportation • Previous Articles    

Review of Evaluation Metrics for the Credibility of Autonomous Driving Test Scenarios

Li Jiwei1, Wang Runmin1,2, Zhu Yu1, Cheng Jingjun1,2, Zhao Xiangmo1,2   

  1. 1.School of Information Engineering, Chang'an University, Xi'an 710018, China
    2.Collaborative Innovation Center for Western Traffic Safety and Intelligent Control by Province and Ministry, Chang'an University, Xi'an 710018, China
  • Received:2025-11-03 Revised:2026-01-06 Online:2026-09-30 Published:2026-10-02
  • Contact: Wang Runmin

Abstract:

Currently, scenario-based simulation testing has become a core technical approach for verifying autonomous driving system functionality. However, due to the absence of unified evaluation standards for simulation scenarios, significant differences exist among the metrics constructed and adopted by different studies, each with its own limitations. This hinders mutual recognition of research outcomes and prevents scientific measurement of scenario quality. This study systematically reviews relevant research from the past five years, categorizing autonomous driving test scenarios into four types: parameter-descriptive, trajectory-driven, environment-simulation, and perception-data-driven. It clarifies the core characteristics, application objectives, and generation mechanisms of each scenario type. Subsequently, focusing on credibility as the core criterion, it systematically organizes existing evaluation metrics developed in various studies across five dimensions: challenge, realism, coverage, human-likeness, and acceleration. Third, through systematic integration of existing research, a unified credibility evaluation framework for multi-type scenarios is established. Finally, current challenges in this field are summarized, and future research directions are explored. This study provides a theoretical foundation for credibility verification of autonomous driving simulation scenarios and offers guidance for advancing simulation testing standardization and credibility evaluation system development.

Key words: autonomous driving, simulation testing, credibility, scenario construction, scenario evaluation

CLC Number: