Submitted:
28 August 2025
Posted:
28 August 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Foundations of Autonomous Driving Testing
2.1. Testing Categories: Simulation, Closed-Track, and On-Road
2.2. Definitions: Scenario, Scene, and Test Case
- Scene: A static snapshot of the driving environment at a specific point in time. It includes information about road layout, infrastructure, traffic participants, weather, lighting conditions, and the dynamic states (e.g., position, velocity, heading) of agents. Scenes represent the spatial and contextual setup without temporal evolution.
- Scenario: A temporal sequence of scenes that models the unfolding of events involving multiple actors over time. Scenarios define interactions (e.g., overtaking, braking, merging) and enable evaluation of system responses under specific conditions. They are central to behavior modeling and safety testing [63].
- Test Case: A parameterized instantiation of a scenario, specifying initial configurations (e.g., object positions, speeds, traffic density) and measurable success criteria. Test cases are typically linked with verification outcomes such as pass/fail labels or safety margins.
2.3. Common Testing Frameworks and Standards
- OpenSCENARIO: Defines dynamic scenario logic, including traffic agents, maneuvers, triggers, and actions.
- OpenDRIVE: Describes road network geometry, lanes, signs, and topology for accurate map modeling.
- OpenXOntology: Introduces a shared vocabulary for consistent toolchain integration and semantic interoperability.
2.4. Rule-based Scenario Generation
2.5. Data-driven Scenario Generation
2.6. Learning-based Scenario Generation
3. Scenario Quality and Evaluation Metrics
Evaluation Criteria
- Realism: Measures how closely a generated scenario resembles those observed in real-world driving. This includes plausible agent behavior, realistic motion dynamics, and compliance with traffic rules. Realism ensures external validity and is often evaluated using human annotation or statistical comparison to naturalistic datasets [79,80,81].
4. Simulation Platforms and Scenario Description Languages
4.1. Key Simulation Environments
- CARLA (Car Learning to Act): An open-source simulator designed for AV research, CARLA supports sensor simulation (RGB, LiDAR, radar), weather variation, and custom traffic scenarios. It integrates well with reinforcement learning agents and scenario definitions via Python APIs. CARLA supports OpenDRIVE for map import and OpenSCENARIO (experimental) for scenario control.
- LGSVL (now SVL Simulator): Built on Unity3D, LGSVL offers photorealistic environments and detailed physics, supporting multiple AV stacks such as Apollo and Autoware. It provides APIs for ego-vehicle control and external scenario integration.
- Apollo Simulation Platform: As part of Baidu’s Apollo open-source AV stack, this platform provides integration-ready tools for sensor simulation, cyber modules, and scenario playback. It is particularly well-suited for closed-loop system validation.
4.2. Scenario Languages and Tools
- OpenSCENARIO: A widely adopted standard developed by ASAM, OpenSCENARIO defines scenarios in an XML format including actors, events, triggers, and environment settings. It supports both deterministic and stochastic scenario execution and is interoperable with tools such as OpenDRIVE and VTD.
- Scenic: A probabilistic programming language for scenario specification, Scenic allows concise descriptions of scenes using constraints and distributions. It is well-suited for generating diverse and controlled scenes for simulation, especially in platforms like CARLA.
- SceneDSL: A domain-specific language developed for modular and reusable scenario design. It allows hierarchical definitions of behaviors, goals, and events, facilitating large-scale scenario generation with abstraction and code reuse.
5. Challenges and Research Gaps
Limited Data Diversity and Generalization
Reality Gap in Synthetic Scenarios
Scalability of Scenario Space
Modeling Safety-Critical but Rare Events
Standardization and Regulatory Alignment
6. Emerging Trends and Future Directions
Semantic and Language-Driven Scenario Generation
Multi-modal and Multi-agent Scene Synthesis
Hybrid Data-Driven and Rule-Based Approaches
Towards Standardized Scenario Repositories and Benchmarks
7. Conclusion
References
- Zhang, Q.; Hua, K.; Zhang, Z.; Zhao, Y.; Chen, P. ACNet: An Attention–Convolution Collaborative Semantic Segmentation Network on Sensor-Derived Datasets for Autonomous Driving. Sensors 2025, 25, 4776. [Google Scholar] [CrossRef]
- Wei, Z.; Gutierrez, C.A.; Rodr, J.; Wang, J. 6G-enabled Vehicle-to-Everything Communications: Current Research Trends and Open Challenges. IEEE Open Journal of Vehicular Technology 2025. [Google Scholar]
- Kumar, H.; Mamoria, P.; Dewangan, D.K. Vision technologies in autonomous vehicles: progress, methodologies, and key challenges. International Journal of System Assurance Engineering and Management 2025. [Google Scholar] [CrossRef]
- Liu, X.; Huang, H.; Bian, J.; Zhou, R.; Wei, Z. Generating intersection pre-crash trajectories for autonomous driving safety testing using Transformer Time-Series GANs. Engineering Applications of Artificial Intelligence 2025. [Google Scholar] [CrossRef]
- Zhao, M.; Liang, C.; Wang, T.; Guan, J.; Wan, L. Scenario Hazard Prevention for Autonomous Driving Based on Improved STPA. In Safety, Reliability, and Security; Springer, 2025.
- Zhou, R.; Huang, H.; Lee, J.; Huang, X.; Chen, J.; Zhou, H. Identifying typical pre-crash scenarios based on in-depth crash data with deep embedded clustering for autonomous vehicle safety testing. Accident Analysis & Prevention 2023, 191, 107218. [Google Scholar]
- Huang, H.; Huang, X.; Zhou, R.; Zhou, H.; Lee, J.J.; Cen, X. Pre-crash scenarios for safety testing of autonomous vehicles: A clustering method for in-depth crash data. Accident Analysis & Prevention 2024, 203, 107616. [Google Scholar]
- da Costa, A.A.B.; Irvine, P.; Dodoiu, T.; Khastgir, S. Building a Robust Scenario Library for Safety Assurance of Automated Driving Systems: A Review. IEEE Transactions on Intelligent Transportation Systems 2025. [Google Scholar] [CrossRef]
- Lahikainen, J. AI-Driven Inverse Method for Identifying Mechanical Properties From Small Punch Tests. PhD thesis, Aalto University, 2025.
- Zhou, R.; Zhang, G.; Huang, H.; Wei, Z.; Zhou, H.; Jin, J.; Chang, F.; Chen, J. How would autonomous vehicles behave in real-world crash scenarios? Accident Analysis & Prevention 2024, 202, 107572. [Google Scholar] [CrossRef]
- Gu, J.; Bellone, M.; Lind, A. Camera-LiDAR Fusion based Object Segmentation in Adverse Weather Conditions for Autonomous Driving. In Proceedings of the 2024 19th Biennial Baltic Electronics Conference (BEC). IEEE; 2024. [Google Scholar]
- Feng, S.; Sun, H.; Yan, X.; Zhu, H.; Zou, Z.; Shen, S.; Liu, H.X. Dense reinforcement learning for safety validation of autonomous vehicles. Nature 2023, 615, 620–627. [Google Scholar] [CrossRef] [PubMed]
- Feng, S.; Yan, X.; Sun, H.; Feng, Y.; Liu, H.X. Intelligent driving intelligence test for autonomous vehicles with naturalistic and adversarial environment. Nature communications 2021, 12, 748. [Google Scholar] [CrossRef]
- Huang, X.; Cen, X.; Cai, M.; Zhou, R. A framework to analyze function domains of autonomous transportation systems based on text analysis. Mathematics 2022, 11, 158. [Google Scholar] [CrossRef]
- Scanlon, J.M.; Kusano, K.D.; Daniel, T.; Alderson, C.; Ogle, A.; Victor, T. Waymo simulated driving behavior in reconstructed fatal crashes within an autonomous vehicle operating domain. Accident Analysis & Prevention 2021, 163, 106454. [Google Scholar] [CrossRef]
- Huang, W.; Wang, K.; Lv, Y.; Zhu, F. Autonomous vehicles testing methods review. In Proceedings of the 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC). IEEE; 2016; pp. 163–168. [Google Scholar]
- Hungar, H. Scenario-based validation of automated driving systems. In Proceedings of the International Symposium on Leveraging Applications of Formal Methods. Springer; 2018; pp. 449–460. [Google Scholar]
- Deldari, N. Scenario Annotation in Autonomous Driving: An Outlier Detection Framework. PhD thesis, Uppsala University, 2025.
- Kalra, N.; Paddock, S.M. Driving to Safety: How Many Miles of Driving Would It Take to Demonstrate Autonomous Vehicle Reliability? Transportation Research Part A 2016. [Google Scholar]
- Ding, W.; Lin, H.; Li, B.; Zhao, D. Causalaf: Causal autoregressive flow for safety-critical driving scenario generation. In Proceedings of the Conference on robot learning. PMLR; 2023; pp. 812–823. [Google Scholar]
- Li, C.; Sifakis, J.; Wang, Q.; Yan, R.; Zhang, J. Simulation-based validation for autonomous driving systems. In Proceedings of the Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis, 2023, pp. 842–853.
- Nalic, D.; Mihalj, T.; Bäumler, M.; Lehmann, M.; Eichberger, A.; Bernsteiner, S. Scenario based testing of automated driving systems: A literature survey. In Proceedings of the FISITA web Congress, 2020, Vol. 10.
- Sahu, N.; Bhat, A.; Rajkumar, R. SafeRoute: Risk-Minimizing Cooperative Real-Time Route and Behavioral Planning for Autonomous Vehicles. In Proceedings of the 2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC). IEEE, 2024.
- Nagy, R.; Szalai, I. Development of an unsupervised learning-based annotation method for road quality assessment. Transportation Engineering 2025. [Google Scholar] [CrossRef]
- Menzel, T.; Bagschik, G.; Maurer, M. Scenarios for development, test and validation of automated vehicles. In Proceedings of the 2018 IEEE intelligent vehicles symposium (IV). IEEE; 2018; pp. 1821–1827. [Google Scholar]
- Menzel, T.; Bagschik, M.; Maurer, M. Scenarios for Safety Validation of Highly Automated Vehicles. Transportation Research Part F 2020. [Google Scholar]
- Sun, J.; Zhang, H.; Zhou, H.; Yu, R.; Tian, Y. Scenario-based test automation for highly automated vehicles: A review and paving the way for systematic safety assurance. IEEE transactions on intelligent transportation systems 2021, 23, 14088–14103. [Google Scholar] [CrossRef]
- Fiorino, M.; Naeem, M.; Ciampi, M.; Coronato, A. Defining a metric-driven approach for learning hazardous situations. Technologies 2024, 12, 103. [Google Scholar] [CrossRef]
- Mammen, M.; Kayatas, Z.; Bestle, D. Evaluation of Different Generative Models to Support the Validation of Advanced Driver Assistance Systems. Applied Mechanics 2025. [Google Scholar] [CrossRef]
- Zhang, X.; Xiong, L.; Zhang, P.; Huang, J.; Ma, Y. Real-world Troublemaker: A 5G Cloud-controlled Track Testing Framework for Automated Driving Systems in Safety-critical Interaction Scenarios. arXiv preprint arXiv:2502.14574, arXiv:2502.14574 2025.
- Wang, J.; Wang, X. Safety-Critical Scenario Generation for Self-Driving Systems Based on Domain Models. In Proceedings of the 2nd International Conference on Intelligent Robotics and Control Engineering; 2025. [Google Scholar]
- Zhou, R.; Huang, H.; Lee, J.; Huang, X.; Chen, J.; Zhou, H. Identifying typical pre-crash scenarios based on in-depth crash data with deep embedded clustering for autonomous vehicle safety testing. Accident Analysis & Prevention 2023, 191, 107218. [Google Scholar]
- Xu, C.; Ding, Z.; Wang, C.; Li, Z. Statistical analysis of the patterns and characteristics of connected and autonomous vehicle involved crashes. Journal of Safety Research 2019, 71, 41–47. [Google Scholar] [CrossRef]
- Lenard, J. Typical pedestrian accident scenarios for the development of autonomous emergency braking test protocols. Accident Analysis & Prevention, 2014; 8. [Google Scholar]
- Cai, J.; Zhou, R.; Lei, D. Dynamic shuffled frog-leaping algorithm for distributed hybrid flow shop scheduling with multiprocessor tasks. Engineering Applications of Artificial Intelligence 2020, 90, 103540. [Google Scholar] [CrossRef]
- Zhou, R.; Liu, Y.; Zhang, K.; Yang, O. Genetic algorithm-based challenging scenarios generation for autonomous vehicle testing. IEEE Journal of Radio Frequency Identification 2022, 6, 928–933. [Google Scholar] [CrossRef]
- Zhu, B.; Sun, Y.; Zhao, J.; Han, J.; Zhang, P.; Fan, T. A critical scenario search method for intelligent vehicle testing based on the social cognitive optimization algorithm. IEEE Transactions on Intelligent Transportation Systems 2023, 24, 7974–7986. [Google Scholar] [CrossRef]
- Zhou, R. Efficient Safety Testing of Autonomous Vehicles via Adaptive Search over Crash-Derived Scenarios. arXiv preprint arXiv:2508.06575, arXiv:2508.06575 2025.
- Zhou, R.; Lei, D.; Zhou, X. Multi-objective energy-efficient interval scheduling in hybrid flow shop using imperialist competitive algorithm. IEEE access 2019, 7, 85029–85041. [Google Scholar] [CrossRef]
- Bian, J.; Huang, H.; Yu, Q.; Zhou, R. Search-to-Crash: Generating safety-critical scenarios from in-depth crash data for testing autonomous vehicles. Energy, 2025; 137174. [Google Scholar]
- Sun, J.; Zhang, H.; Zhou, H.; Yu, R.; Tian, Y. Scenario-Based Test Automation for Highly Automated Vehicles: A Review and Paving the Way for Systematic Safety Assurance. IEEE Transactions on Intelligent Transportation Systems 2022, 23, 14088–14103. [Google Scholar] [CrossRef]
- Tian, Y.; Zheng, W.; Shao, Y.; Zhang, H.; Sun, J. MJTG: A Multi-vehicle Joint Trajectory Generator for Complex and Rare Scenarios. IEEE Transactions on Vehicular Technology 2025. [Google Scholar] [CrossRef]
- Mondelli, A.; Li, Y.; Zanardi, A.; Frazzoli, E. Test Automation for Interactive Scenarios via Promptable Traffic Simulation. arXiv preprint arXiv:2506.01199, arXiv:2506.01199 2025.
- Mei, Y.; Nie, T.; Sun, J.; Tian, Y. Llm-attacker: Enhancing closed-loop adversarial scenario generation for autonomous driving with large language models. arXiv preprint arXiv:2501.15850, arXiv:2501.15850 2025.
- Zeng, Z.; Shi, Q.; Zhuang, W.; Wang, X.; Fan, X. Adversarial Generation for Autonomous Vehicles in Safety-Critical Ramp Merging Scenarios. In Proceedings of the International Conference on Electric Vehicle and Vehicle Engineering. Springer; 2024; pp. 427–434. [Google Scholar]
- Feng, S.; Feng, Y.; Sun, H.; Zhang, Y.; Liu, H.X. Testing scenario library generation for connected and automated vehicles: An adaptive framework. IEEE Transactions on Intelligent Transportation Systems 2020, 23, 1213–1222. [Google Scholar] [CrossRef]
- Tang, S.; Zhang, Z.; Zhou, J.; Lei, L.; Zhou, Y.; Xue, Y. Legend: A top-down approach to scenario generation of autonomous driving systems assisted by large language models. In Proceedings of the Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering, 2024, pp. 1497–1508.
- Arnav, M. Scenario generation methods for functional safety testing of automated driving systems 2025.
- Huai, Y.; Almanee, S.; Chen, Y.; Wu, X.; Chen, Q.A.; Garcia, J. scenoRITA: Generating Diverse, Fully-Mutable, Test Scenarios for Autonomous Vehicle Planning. IEEE Transactions on Software Engineering, 2023; 1–21. [Google Scholar]
- Ding, W.; Lin, H.; Li, B.; Zhao, D. Generalizing goal-conditioned reinforcement learning with variational causal reasoning. Advances in Neural Information Processing Systems 2022, 35, 26532–26548. [Google Scholar]
- Cai, X.; Bai, X.; Cui, Z.; Xie, D.; Fu, D.; Yu, H.; Ren, Y. Text2scenario: Text-driven scenario generation for autonomous driving test. arXiv preprint arXiv:2503.02911, arXiv:2503.02911 2025.
- Ricotta, C.; Khzym, S.; Faron, A.; Emadi, A. Property Optimized GNN: Improving Data Association Performance Using Cost Function Optimization for Sensor Fusion In High Density Environments. In Proceedings of the 2024 IEEE Smart World Congress (SWC). IEEE; 2024; pp. 1871–1877. [Google Scholar]
- Dosovitskiy, A.; Ros, G.; Codevilla, F.; Lopez, A.; Koltun, V. CARLA: An open urban driving simulator. In Proceedings of the Conference on robot learning. PMLR; 2017; pp. 1–16. [Google Scholar]
- Rong, G.; Shin, B.H.; Tabatabaee, H.; Lu, Q.; Lemke, S.; Možeiko, M.; Boise, E.; Uhm, G.; Gerow, M.; Mehta, S.; et al. Lgsvl simulator: A high fidelity simulator for autonomous driving. In Proceedings of the 2020 IEEE 23rd International conference on intelligent transportation systems (ITSC). IEEE; 2020; pp. 1–6. [Google Scholar]
- Maier, R.; Grabinger, L.; Urlhart, D.; Mottok, J. Causal models to support scenario-based testing of adas. IEEE Transactions on Intelligent Transportation Systems 2023, 25, 1815–1831. [Google Scholar] [CrossRef]
- Fremont, D.J.; Kim, E.; Pant, Y.V.; Seshia, S.A.; Acharya, A.; Bruso, X.; Wells, P.; Lemke, S.; Lu, Q.; Mehta, S. Formal scenario-based testing of autonomous vehicles: From simulation to the real world. In Proceedings of the 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC). IEEE; 2020; pp. 1–8. [Google Scholar]
- Sonetta, H.Y. Bridging the simulation-to-reality gap: Adapting simulation environment for object recognition. Master’s thesis, University of Windsor (Canada), 2021.
- Dong, Y.; Zhong, Y.; Yu, W.; Zhu, M.; Lu, P.; Fang, Y.; Hong, J.; Peng, H. Mcity data collection for automated vehicles study. arXiv preprint arXiv:1912.06258, arXiv:1912.06258 2019.
- Jacobson, J.; Janevik, P.; Wallin, P. Challenges in creating AstaZero, the active safety test area. In Proceedings of the Transport Research Arena (TRA) 5th Conference: Transport Solutions from Research to DeploymentEuropean CommissionConference of European Directors of Roads (CEDR) European Road Transport Research Advisory Council (ERTRAC); 2014. [Google Scholar]
- Ma, Y.; Sun, C.; Chen, J.; Cao, D.; Xiong, L. Verification and validation methods for decision-making and planning of automated vehicles: A review. IEEE Transactions on Intelligent Vehicles 2022, 7, 480–498. [Google Scholar] [CrossRef]
- Mariani, R. An overview of autonomous vehicles safety. In Proceedings of the 2018 IEEE International Reliability Physics Symposium (IRPS). IEEE; 2018; p. 6A–1. [Google Scholar]
- International Organization for Standardization. ISO 34501:2022 - Road vehicles — Test scenarios for automated driving systems — Vocabulary, 2022.
- Batsch, F.; Kanarachos, S.; Cheah, M.; Ponticelli, R.; Blundell, M. A taxonomy of validation strategies to ensure the safe operation of highly automated vehicles. Journal of Intelligent Transportation Systems 2021, 26, 14–33. [Google Scholar] [CrossRef]
- Wang, C.; Storms, K.; Zhang, N.; Winner, H. Runtime unknown unsafe scenarios identification for SOTIF of autonomous vehicles. Accident Analysis & Prevention 2024, 195, 107410. [Google Scholar]
- Klischat, M.; Althoff, M. Generating critical test scenarios for automated vehicles with evolutionary algorithms. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV); 2019. [Google Scholar]
- Althoff, M.; Lutz, S. Automatic generation of safety-critical test scenarios for collision avoidance of road vehicles. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV); 2018. [Google Scholar]
- Feng, S.; Feng, Y.; Sun, H.; Zhang, Y.; Liu, H.X. Testing scenario library generation for connected and automated vehicles: An adaptive framework. IEEE Transactions on Intelligent Transportation Systems 2020. [Google Scholar] [CrossRef]
- Gao, F.; Duan, J.; He, Y.; Wang, Z. A test scenario automatic generation strategy for intelligent driving systems. Mathematical Problems in Engineering 2019. [Google Scholar] [CrossRef]
- Zhang, J.; Xu, C.; Li, B. Chatscene: Knowledge-enabled safety-critical scenario generation for autonomous vehicles. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2024. [Google Scholar]
- Zhang, J.; Huang, Q.; Huang, Y. DP-TrajGAN: A privacy-aware trajectory generation model with differential privacy. Future Generation Computer Systems 2023. [Google Scholar] [CrossRef]
- Krajewski, R.; Moers, T.; Nerger, D. Data-driven maneuver modeling using generative adversarial networks and variational autoencoders for safety validation of highly automated vehicles. In Proceedings of the 21st International Conference on Intelligent Transportation Systems (ITSC); 2018. [Google Scholar]
- Wang, J.; Pun, A.; Tu, J. Advsim: Generating safety-critical scenarios for self-driving vehicles. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2021. [Google Scholar]
- Westhofen, L.; Neurohr, C.; Koopmann, T. Criticality metrics for automated driving: A review and suitability analysis of the state of the art. Archives of Computational Methods in Engineering 2023. [Google Scholar] [CrossRef]
- Kang, M.; Seo, J.; Hwang, K. Critical voxel learning with vision transformer and derivation of logical AV safety assessment scenarios. Accident Analysis & Prevention, 2024. [Google Scholar]
- Arvin, R.; Kamrani, M.; Khattak, A.J. The role of pre-crash driving instability in contributing to crash intensity using naturalistic driving data. Accident Analysis & Prevention, 2019. [Google Scholar]
- Bolte, J.A.; Bar, A.; Lipinski, D. Towards corner case detection for autonomous driving. In Proceedings of the IEEE Intelligent Vehicles Symposium; 2019. [Google Scholar]
- Muslim, H.; Endo, S.; Imanaga, H. Cut-out scenario generation with reasonability foreseeable parameter range from real highway dataset for autonomous vehicle assessment. IEEE Access 2023. [Google Scholar] [CrossRef]
- Huang, P.; Ding, W.; Francis, J. CaDRE: Controllable and Diverse Generation of Safety-Critical Driving Scenarios using Real-World Trajectories. arXiv preprint arXiv:2401.XXXX, arXiv:2401.XXXX 2024.
- Zhou, R.; Lin, Z.; Zhang, G.; Huang, H.; Zhou, H.; Chen, J. Evaluating autonomous vehicle safety performance through analysis of pre-crash trajectories of powered two-wheelers. IEEE Transactions on Intelligent Transportation Systems 2024, 25, 13560–13572. [Google Scholar] [CrossRef]
- Zhou, R.; Gui, W.; Huang, H.; Liu, X.; Wei, Z.; Bian, J. DiffCrash: Leveraging Denoising Diffusion Probabilistic Models to Expand High-Risk Testing Scenarios Using In-Depth Crash Data. Expert Systems with Applications, 2025; 128140. [Google Scholar]
- Zhang, G.; Huang, H.; Zhou, R.; Li, S.; Bian, J. High-Risk Trajectories Generation for Safety Testing of Autonomous Vehicles Based on In-Depth Crash Data. IEEE Transactions on Intelligent Transportation Systems 2025. [Google Scholar] [CrossRef]
- Oliveira, B.B.; Carravilla, M.A.; Oliveira, J.F. A diversity-based genetic algorithm for scenario generation. European journal of operational research 2022, 299, 1128–1141. [Google Scholar] [CrossRef]
- Chu, Q.; Yue, Y.; Yao, D.; Pei, H. DiCriTest: Testing Scenario Generation for Decision-Making Agents Considering Diversity and Criticality. arXiv preprint arXiv:2508.11514, arXiv:2508.11514 2025.
- Ding, W.; Xu, C.; Arief, M.; Lin, H.; Li, B.; Zhao, D. A survey on safety-critical driving scenario generation—a methodological perspective. IEEE Transactions on Intelligent Transportation Systems 2023, 24, 6971–6988. [Google Scholar] [CrossRef]
- Zhou, R.; Huang, H.; Zhang, G.; Zhou, H.; Bian, J. Crash-Based Safety Testing of Autonomous Vehicles: Insights From Generating Safety-Critical Scenarios Based on In-Depth Crash Data. IEEE Transactions on Intelligent Transportation Systems 2025. [Google Scholar] [CrossRef]
- Zhou, R.; Lin, Z.; Huang, X.; Peng, J.; Huang, H. Testing scenarios construction for connected and automated vehicles based on dynamic trajectory clustering method. In Proceedings of the 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC). IEEE; 2022; pp. 3304–3308. [Google Scholar]
- Li, S.; Zhou, R.; Huang, H. Multidimensional Evaluation of Autonomous Driving Test Scenarios Based on AHP-EWN-TOPSIS Models. Automotive Innovation, 2025; 1–15. [Google Scholar]
- Wei, Z.; Huang, H.; Zhang, G.; Zhou, R.; Luo, X.; Li, S.; Zhou, H. Interactive critical scenario generation for autonomous vehicles testing based on in-depth crash data using reinforcement learning. IEEE Transactions on Intelligent Vehicles 2024. [Google Scholar] [CrossRef]
- Luo, X.; Wei, Z.; Zhang, G.; Huang, H.; Zhou, R. High-risk powered two-wheelers scenarios generation for autonomous vehicle testing using WGAN. Traffic Injury Prevention 2025, 26, 243–251. [Google Scholar] [CrossRef]
- Wei, Z.; Zhou, H.; Zhou, R. Risk and Complexity Assessment of Autonomous Vehicle Testing Scenarios. Applied Sciences 2024, 14, 9866. [Google Scholar] [CrossRef]
- Wei, Z.; Bian, J.; Huang, H.; Zhou, R.; Zhou, H. Generating risky and realistic scenarios for autonomous vehicle tests involving powered two-wheelers: A novel reinforcement learning framework. Accident Analysis & Prevention 2025, 218, 108038. [Google Scholar] [CrossRef]

| Category | Advantages | Limitations |
|---|---|---|
| Simulation-Based | - Scalable and cost-effective - Safe for humans and vehicles - Enables rare or critical event testing - Fast iteration and automation | - Reality gap in sensor and dynamics fidelity - Synthetic agents oversimplified - Limited realism in weather and edge behaviors |
| Closed-Track | - Real-world vehicle dynamics - High safety in controlled environments - Repeatable and measurable - Ideal for specific system feature validation | - Infrastructure cost is high - Less diverse scenarios - Not suitable for unstructured environments |
| On-Road | - Full exposure to real-world traffic - Necessary for regulatory certification - Captures unexpected corner cases | - Safety and liability concerns - Long duration to encounter rare events - Public and legal constraints |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).