AVSC announced the availability of a new best practice titled, Evaluation of Behavioral Competencies for Automated Driving System Dedicated Vehicles (ADS-DVs). The new guidelines integrate the AVSC’s Metrics and Methods for Assessing Safety Performance of Automated Driving Systems (ADS) and best practice for Operational Design Domain (ODD) to provide a framework for manufacturers to evaluate the behavioral competency of automated vehicles.
Also read: Elbit Systems and Roboteam Introduce ROOK: New Multi-payload 6X6 Unmanned Ground Vehicle
“As automated driving system testing advances, it is important that manufacturers communicate information about the safety of their vehicles in a consistent way, while still using testing protocols specific to their systems and ODDs,” said Amy Chu, director of the AVSC. “With the framework in our new best practice, manufacturers can evaluate the safety performance of their vehicles based on an elemental set of behavioral competencies such as maintaining proper lane position or responding appropriately in work zones. Linking behavioral competencies to a key set of scenarios for a given ODD provides relevant evidence for ADS safety performance and increases confidence in the safety performance of an AV.”
The new best practice provides an approach to specify testable AV behavior by:
- Clarifying a lexicon surrounding automated vehicle behaviors,
- Enumerating an elemental set of behaviors, and
- Demonstrating how to derive metrics to evaluate AV behavioral competence. Real-world driving involves complex interactions among numerous systems. In order to evaluate as many ADS subtasks within the DDT as possible, developers align them to a generalized set of behaviors. Developers then use system engineering techniques to map these behaviors to an elemental set of behavioral competencies. In other words, competence is considered as a collection of behaviors that cover a context-relevant and predictable part of the broader driving task. Proficiency across a set of behavioral competencies provides directional indication of the ADS-DV safety performance. For example, in the context of driving on a highway while maintaining a lane and approaching another vehicle, the ADS-DV would be expected to keep a safe distance, maintain the speed limit, and monitor the behavior of the vehicle in front of it while preparing to react if the scenario changes.