The growing complexity of automated driving systems such as Lane Keep Assist, Lane Centering and Adaptive Cruise Control challenge existing verification and validation (V&V) methodologies used in the automotive industry. As these systems become more prevalent, bugs surface and failures occur. A collision example took place earlier this month, on June 2nd. A Tesla Model 3 using an automated driving function collided with a stationary truck on a Taiwanese highway.
Video 1 shows a simulated reproduction of the Tesla accident, based on released footage and using Foretify™ and Carla Simulator
While reproducing failures after they have occurred is useful for verifying a fix, the real need is to eliminate as many failures as possible in advance. The number of possible circumstances and risk dimensions is infinite and many of these are unknowns. The upcoming SOTIF standard (ISO 21448) recognizes the challenge and gravity of the unknowns, as illustrated in Figure 1 below.
While you may be able to enumerate vehicle maneuver and risk dimension categories such as sensor and camera faults or stationary objects such as cones, puddles or even faded road markings, the possible combinations of these are infinite and cannot be predicted up front. As shown above, existing technologies such as residual risk calculation provide a data-driven grade for the knowns but no formula can calculate the risk of unknown and unpredictable scenarios. The verification plan enumerates all the thought-out scenarios, but what about the unexpected and unpredicted?
As demonstrated in the Tesla incident, the result of the unpredictable nature of a scenario’s space is expensive recalls and compromised safety.
This leads to two frequently asked questions that the automotive industry is busy with in terms of V&V:
Foretellix’s Foretify platform combines use of controlled-random test generation to scale up and search for the unknowns, easy mixing of scenarios and risk dimensions, and powerful data analytics to address this challenge:
Video 2 shows a few automatically generated variations of the same Tesla Model 3 incident. Note that the map location has changed along with other attributes.
Per user request, Foretify can generate hundreds of thousands of scenarios in which a truck or a random stationary object resides in random locations, orientations, lanes, color, and so on.
Figure 2 shows an automatically generated metrics report, including both coverage metrics and KPIs.
Foretify introduces an innovative approach with scalable random scenario creations, scenario combinations and mixing, cross combination values, and data-analytics to meet the ADAS and AV industry challenge of identifying the unknown unknowns.
At Foretellix, we continue evolving M-SDL to meet industry needs, with the intention of converging Open M-SDL with OpenSCENARIO 2.0. As in previous versions, updates were made in response to customer needs, partner feedback, and inputs we get through our participation in ASAM’s OpenSCENARIO 2.0 development project. We want to thank them all.
Foretellix and Mobileye demo the new package with RSS and show safety regulation compliance
We’ll get back to you as soon as possible.