
Simulation validation for autonomous vehicles
Ensure your autonomous vehicle simulation software accurately and reliably predicts AV behaviour in the real world to support safe and effective deployment.What is simulation validation for autonomous vehicles?
Simulation validation ensures the reliability and accuracy of simulation tools for ADS virtual testing. But standards require proof that a virtual test platform (VTP) is fit for purpose for testing ADS. This includes ISO 34502, which outlines requirements for road vehicles, as well as UNECE VMAD (Vehicle Manufacturer Approval and Conformity of Production), NATM (New Assessment/Test Method), UNECE R157 (regulating Automated Lane Keeping Systems), and regulation (EU) 2022/1426, which covers safety requirements for AVs.
TÜV SÜD’s innovative certification procedure, the virtual validation readiness Index (VIVALDI), provides simulation tool providers with a solution to ensure their platform is fit for purpose as required by existing standards and regulations. We validate that your virtual test platforms can predict how AVs will behave in the real world accurately and reliably, thereby supporting safe and effective AV deployment.
Why virtual testing using validated scenario simulation software is important for ADS safety
As traditional physical testing approaches cannot cope with the increasing complexity of automated driving systems (ADS) and the infinite number of possible traffic scenarios, virtual testing platforms are needed.
The high degree of interaction between software, hardware, sensors, and the environment in ADS systems requires new virtual testing approaches to handle the huge number of scenarios. Today, new regulations allow the use of autonomous vehicle simulation software as a test method for type approval. (EU) 2022/1426 lays down rules for uniform procedures and technical specifications for the type-approval of ADS for AVs. This means that simulation has become an essential part of the well-established multi-pillar approach proposed by UNECE. Virtual simulation therefore plays a critical role in the AV development lifecycle. But the tools themselves must be rigorously validated for simulation results to be trusted.
In addition, real-world testing of AVs can be time-consuming, costly, and potentially dangerous. A combination of physical and virtual testing is therefore required. The challenge is to find the optimal balance between the two so that a robust safety argumentation, based on the multi-pillar approach, can be built.
How TÜV SÜD can help you with simulation tool certification
We have developed an innovative certification procedure, the Virtual Validation Readiness Index (VIVALDI) validates scenario simulation software, tools, and methods. VIVALDI ensures that virtual test platforms are fit for purpose as required by standards and regulations.
Using VIVALDI, TÜV SÜD provided the world’s first-ever successful certification of an ADS simulation test platform as fit for purpose. This proved that replica, the virtual test platform of automotive artificial intelligence, is fit for virtual validation of ADS.
We are also closely involved with a range of global highly autonomous driving projects. This includes the VVM (Verification and Validation Methods) project. The project is developing test procedures, frameworks, and methods for the safety verification of automated vehicles.
TÜV SÜD is the only independent technical inspection company in the VVM project. We are leading the group developing the virtual test methods. This includes ensuring simulation is accepted as a trustworthy test method, defining type approval requirements for AVs, and coordinating open pass development as a simulation tool for criticality analysis and verification.
We are always up to date as we are part of global standards development committees, including the association for standardisation of automation and measuring systems (ASAM) and the International organization for standardization (ISO).
TÜV SÜD’s Virtual Validation Readiness Index (VIVALDI) certification procedure to validate virtual test platforms
The VIVALDI checklist for ADS test simulation tools includes:
- Scenario generation – All steps, from data sources for scenarios to the input of a scenario into a simulation environment. Checks for if scenario definitions are continuous, consistent and comprehensive.
- Test management – Evaluation of test plan, test specification, and test report. Identification of incompatibility causes and weak spots.
- Data management – Assessment of data flow and handling throughout the VTP product lifecycle. Checks for reliability and traceability of VTP results.
- Simulation execution – Assessment of capabilities and limitations of simulation software. Assess performance and readiness for automated and mass simulation.
What our simulation validation services for autonomous vehicles include
We support our clients through the whole lifecycle of virtual testing for AVs, from the introduction of the simulation method to certification of the autonomous vehicle simulation software tool.
- Advisory/enablement – It’s not always clear how simulation tools can be implemented into the vehicle type approval process. We provide thorough gap analysis, so you achieve conformity with existing regulations.
- Assessment – To ensure credibility of your simulation tools, TÜV SÜD assesses your scenario simulation software according to relevant regulations e.g. UNECE R157 (ALKS), (EU) 2022/1426, UNECE R 171 DCAS.
- Certification/homologation – All regulations request evidence of the scope of simulation tools. We certify your simulation tools using our inhouse VIVALDI process. Our TÜV SÜD mark demonstrates that your simulation tool is fit for purpose.
- Training – Our dedicated training and workshops support you to understand the current regulatory requirements and upcoming standards.
Frequently asked questions (FAQs)
What are the scenarios which need to be tested?
We have already worked with ADSCENE to validate its development process for test scenarios that are used in simulations for the safety evaluation of ADS and ADAS according to ISO/DIS 34502 and the PEGASUS method. We also inspected the database regarding the breadth of relevant scenarios for homologation against UN R157 and UNECE VMAD NATM MD.
How do you demonstrate the scope of a simulation tool according to UNECE R157?
TÜV SÜD’s certification mark enables simulation tool providers to successfully market their software as it assures OEMs and their suppliers that the VTP is fit for purpose. These fosters trust in its reliability, enabling ADS functions and components to be tested in a virtual environment at an early stage, thereby minimising cost and optimising efficiency.
Are there any guidelines how I need to create my simulation process?
1. Process dimension – ASPICE processes are explicitly designed for applications in the automotive industry.
2. Capability dimension – six process capability levels (according to ISO/IEC 330xx series definitions) which specify how each level is achieved.
Automotive SPICE® is a registered trademark of the verband der automobilindustrie e.V. (VDA).