Automated vehicles assessment using scenario-based testing

What is the role of scenario-based testing in ensuring the safety and reliability of ADAS technology?

Scenario-based testing plays a vital role in the development of AD/ADAS systems. By simulating real-world conditions to test various critical scenarios in a controlled environment it helps ensure safety and reliability. This comprehensive scenario-based testing approach helps to create robust and trustworthy ADAS technology. With more and more new regulations being introduced, increased testing efforts with specific capabilities are required to thoroughly test ADAS technology.

TÜV SÜD is well prepared for the increased complexity of technology in future vehicles and can also provide various driving robots with the required specialists. Our team of experts has gained extensive experience in scenario-based testing from global projects such as PEGASUS, V&V Methods and ATLAS L4. We are familiar with all the methodologies and latest regulations for implementing scenario-based testing methods applicable to the latest automotive and ADAS technologies.

Why scenario-based testing for ADAS is important?

Whether you are developing vehicles with AV functions; integrating your camera, LIDAR or radar-based platform, or need to verify your sensor models, autonomous vehicle testing in a real-world environment is necessary.

Scenario-based ADAS testing enables a comprehensive system performance evaluation across a wide range of real-world driving conditions and scenarios in a controlled environment. This helps to identify and address potential safety and functionality issues early in the development process that may not be apparent in standard test environments. By considering existing and upcoming standards and regulations for international homologation and type approval of SAE L2+ to L5 like DCAS (Driver Controlled Assistance Systems), you gain a competitive edge by staying ahead of the curve and ensuring quick market access.

Not only does scenario-based testing enhance ADAS technology the safety, but it also helps to develop more robust and efficient autonomous driving technologies. Consequently, it instils end-user trust and acceptance that self-driving cars are safe to use on public roads.

What a comprehensive scenario-based test for ADAS involves?

Scenario-based testing is complex as it requires a safe, synchronised, and controlled proving ground test environment. Tests simulate diverse situations to ensure that ADAS can handle various driving conditions.

Testing scenarios are executed multiple times to collect comprehensive test data. This includes sensor inputs and video footage, which enable performance metrics like obstacle detection and reaction times to be evaluated.

The autonomous vehicle testing toolchain must be at the same technological level as the AV functions to ensure consistent results. This requires an AV test regime like TÜV SÜD’s that is smart, efficient, reliable, repeatable, accurate, and precise.

During scenario-based testing, multiple dynamic objects in a precisely controlled and repeatable testing environment are used. All dynamic and static objects are connected by a low latency data connection. This includes the autonomous vehicle under test and surrounding vehicles that represent the criticality of a defined scenario. As AV functions might display non-deterministic behaviour, the surrounding vehicles must be able to dynamically adjust their trajectory according to the applied strategy of the vehicle under test.

As your autonomous vehicle testing partner TÜV SÜD ensures your AV technologies are thoroughly tested and proven.

How TÜV SÜD can help you with scenario-based testing services?

TÜV SÜD is one of the leading experts in the field of autonomous vehicle testing. Our AV testing approach was developed and verified during the German government-funded project PEGASUS, a consortium of industry stakeholders focused on the assessment, verification, and validation of highly automated driving systems on highways.

We offer turnkey scenario-based testing services on proving grounds to verify AV function and performance. We also confirm that your tests are conducted correctly, and the results are reliable, representative, and trustworthy. One of our strengths is to deliver test conformity and strict adherence to deadlines.

Our mobile toolchains and global partner network, such as our status as a founding member of IAMTS, enables us to offer scenario-based testing on a range of global proving grounds that are more convenient for you.

With our latest testing equipment for L3/4 we can provide you with customised solutions - from eye-witnessing to turn-key services.   

We are actively engaged in a number of global autonomous driving projects and contribute to various working groups. Our experts are heavily involved in reworking international standards that address the homologation and type approval of AV-functions, such as UNECE regulation UN R157 (ALKS) and UN regulation R171 (DCAS). Therefore, we are well-informed and up to date on the latest developments in the field of autonomous driving testing. Our international expert network and industry know-how provides you with comprehensive support in the safe development and global roll-out of your automated technologies. 

Get started with TÜV SÜD

Partner with us to verify your ADAS technology with scenario-based testing

Request a reachout

What our scenario-based testing services for ADAS include?

TÜV SÜD provides comprehensive scenario-based testing services that help you verify automated driving functions with proving ground tests: 

• Testing for type approval – We cover all current ADAS regulations and are prepared for future ones. Our full testing service includes scenario definition, KPI definition and evaluation, safety concept definition and test preparation, test execution, data postprocessing and reporting. Our integrated, flexible and transportable toolchain allows testing on all international proving grounds and customer facilities. 
• Performance testing – We support you with performance testing against regulatory requirements at every stage of the development process. This helps you to bring safe and reliable systems on to the roads.
• Benchmark testing – We use our extensive expertise as an independent third-party service provider to test your system in the market environment.
• User experience – The customer experience is difficult to predict during the vehicle development phase, as vehicles must pass numerous tests to get to the production line. We use innovative methods to assess vehicle function through the eyes of the future customer and provide valuable results back to the development team.
• Advisory services – We support you in realising or optimising your testing workflow, while building-up your scenario-based testing knowledge, sustainability, and efficiency. 

The challenges of scenario-based testing

New regulatory requirements and test procedures

ADAS systems are becoming more complicated and diverse. This is also reflected in regulations. TÜV SÜD helps you to navigate through this complex environment.

Safety concerns

ADAS testing introduces risks to drivers, test engineers, and equipment. TÜV SÜD ensures safety while maintaining realistic test conditions.

Testing expertise

Physical testing requires specialised test tracks, complex testing equipment, and skilled personnel. We have the expertise to deliver large-scale testing.

Compliance with regulationS

Type approval testing requires exact execution, repeatability, documentation, and expertise. We ensure the highest quality standards and minimise risks.

Increasing complexity of tests

Our ADAS tests use robotics to simulate complex interactions with vehicles, pedestrians, and objects, ensuring accurate results in controlled environments.

Data collection and analysis

To ensure data validity from physical tests, TÜV SÜD’s sensors and data logging equipment is accurately calibrated and synchronised.