Automated vehicles assessment using scenario-based testing

Scenario-based testing plays a vital role in the development of AD/ADAS systems. By simulating real-world conditions to test various critical scenarios in a controlled environment it helps ensure safety and reliability. This comprehensive scenario-based testing approach helps to create robust and trustworthy ADAS technology. With more and more new regulations being introduced, increased testing efforts with specific capabilities are required to thoroughly test ADAS technology.
 
TÜV SÜD is well prepared for the increased complexity of technology in future vehicles and can also provide various driving robots with the required specialists. Our team of experts has gained extensive experience in scenario-based testing from global projects such as PEGASUS, V&V Methods and ATLAS  L4. We are familiar with all the methodologies and latest regulations for implementing scenario-based testing methods applicable to the latest automotive and ADAS technologies.

Whether you are developing vehicles with AV functions; integrating your camera, LIDAR or radar-based platform, or need to verify your sensor models, autonomous vehicle testing in a real-world environment is necessary.

Scenario-based ADAS testing enables a comprehensive system performance evaluation across a wide range of real-world driving conditions and scenarios in a controlled environment. This helps to identify and address potential safety and functionality issues early in the development process that may not be apparent in standard test environments. By considering existing and upcoming standards and regulations for international homologation and type approval of SAE L2+ to L5 like DCAS (Driver Controlled Assistance Systems), you gain a competitive edge by staying ahead of the curve and ensuring quick market access.

Not only does scenario-based testing enhance ADAS technology the safety, but it also helps to develop more robust and efficient autonomous driving technologies. Consequently, it instils end-user trust and acceptance that self-driving cars are safe to use on public roads.

Scenario-based testing is complex as it requires a safe, synchronised, and controlled proving ground test environment. Tests simulate diverse situations to ensure that ADAS can handle various driving conditions. 

Testing scenarios are executed multiple times to collect comprehensive test data. This includes sensor inputs and video footage, which enable performance metrics like obstacle detection and reaction times to be evaluated.

The autonomous vehicle testing toolchain must be at the same technological level as the AV functions to ensure consistent results. This requires an AV test regime like TÜV SÜD’s that is smart, efficient, reliable, repeatable, accurate, and precise. 

During scenario-based testing, multiple dynamic objects in a precisely controlled and repeatable testing environment are used. All dynamic and static objects are connected by a low latency data connection. This includes the autonomous vehicle under test and surrounding vehicles that represent the criticality of a defined scenario. As AV functions might display non-deterministic behaviour, the surrounding vehicles must be able to dynamically adjust their trajectory according to the applied strategy of the vehicle under test.

As your autonomous vehicle testing partner TÜV SÜD ensures your AV technologies are thoroughly tested and proven.

TÜV SÜD is one of the leading experts in the field of autonomous vehicle testing. Our AV testing approach was developed and verified during the German government-funded project PEGASUS, a consortium of industry stakeholders focused on the assessment, verification, and validation of highly automated driving systems on highways. 

We offer turnkey scenario-based testing services on proving grounds to verify AV function and performance. We also confirm that your tests are conducted correctly, and the results are reliable, representative, and trustworthy. One of our strengths is to deliver test conformity and strict adherence to deadlines.

Our mobile toolchains and global partner network, such as our status as a founding member of IAMTS, enables us to offer scenario-based testing on a range of global proving grounds that are more convenient for you.

With our latest testing equipment for L3/4 we can provide you with customised solutions - from eye-witnessing to turn-key services.   

We are actively engaged in a number of global autonomous driving projects and contribute to various working groups. Our experts are heavily involved in reworking international standards that address the homologation and type approval of AV-functions, such as UNECE regulation UN R157 (ALKS) and UN regulation R171 (DCAS). Therefore, we are well-informed and up to date on the latest developments in the field of autonomous driving testing. Our international expert network and industry know-how provides you with comprehensive support in the safe development and global roll-out of your automated technologies.

TÜV SÜD provides comprehensive scenario-based testing services that help you verify automated driving functions with proving ground tests:

• Testing for type approval  –  We cover all current ADAS regulations and are prepared for future ones. Our full testing service includes scenario definition, KPI definition and evaluation, safety concept definition and test preparation, test execution, data postprocessing and reporting. Our integrated, flexible and transportable toolchain allows testing on all international proving grounds and customer facilities.
• Performance testing  –  We support you with performance testing against regulatory requirements at every stage of the development process. This helps you to bring safe and reliable systems on to the roads. 
• Benchmark testing – We use our extensive expertise as an independent third-party service provider to test your system in the market environment.
• User experience – The customer experience is difficult to predict during the vehicle development phase, as vehicles must pass numerous tests to get to the production line.  We use innovative methods to assess vehicle function through the eyes of the future customer and provide valuable results back to the development team.
• Advisory services – We support you in realising or optimising your testing workflow, while building-up your scenario-based testing knowledge, sustainability, and efficiency.