Asynchrony of Directional Auditory Warnings and Visual Information in Hands-on SAE Level 2 Automated Vehicles: Analysis of Driver Responses

As automated driving technology advances, the development of an efficient human-machine interface (HMI) for delivering hazard warnings becomes increasingly critical for maintaining driving safety. One example is the use of directional auditory warnings in vehicles, which are used to direct drivers’ attention, either towards a free lane to move into, or towards the location of hazards. These warnings have the potential to reduce the time it takes for drivers to take over from automation, improving overall takeover quality. In addition, studies have shown that the asynchrony between auditory stimuli and visual information can improve the effectiveness of auditory warnings by reducing reaction times. However, little is known about the temporal separation of these warnings and how this affects takeover response time and quality. Forty-eight drivers were recruited for an experiment investigating how directional auditory warnings and asynchronous presentation of auditory warnings and visual information affect takeover performance from a hands-on SAE L2 automated vehicle. Results showed that directional auditory warnings reduced first steering reaction times, enhanced the accuracy of the first steering response, and resulted in smaller maximum lateral acceleration, relative to non-directional warnings. Notably, warnings that indicated the location of a free lane, and therefore a safe direction for drivers to steer towards for avoiding an obstacle, were associated with improved takeover performance and lower subjective workload. Additionally, longer stimulus onset asynchronies (SOA) reduced the dominance of visual information, resulting in faster first steering response times and slight improvements in takeover quality. These findings provide evidence that directional warnings can facilitate faster and higher-quality takeover performance. Furthermore, attenuation of the visual dominance effect provides insight into how the temporal separation of auditory and visual components of audiovisual directional warnings may facilitate improved takeover performance.