Seeing and Hearing the Turn: Multimodal AR-HUD Navigation in Multi-Branch Road Scenarios

초록

Although AR-HUD navigation has demonstrated potential in improving driving performance, most existing studies have focused on single-modality visual cues and have not sufficiently examined the integration of auditory and visual information, the influence of different visual presentation formats, or the optimal timing for delivering navigation prompts. These gaps are particularly evident in complex driving environments such as multi-branch intersections. This study addresses these issues by conducting a controlled driving simulation experiment to investigate the interactive effects of cue type and cue timing in a multimodal AR-HUD system. Two visual presentation formats, gradient navigation and boomerang-shaped icons, were synchronously paired with continuous auditory prompts and delivered at three timing conditions: 2000 m, 1500 m, and 1000 m before the intersection. Thirty participants completed driving tasks in a simulated multi-branch intersection scenario. Dependent variables included reaction time, eye-tracking metrics such as fixation count and average fixation duration, and subjective evaluations of situational awareness using the SART scale and cognitive load using the DALI scale. The results indicate that a prompt timing of 1500 m combined with gradient navigation achieved the highest situational awareness, the lowest cognitive load, the shortest reaction time, and the most efficient attention allocation. These findings provide empirical evidence for optimizing prompt design in multimodal AR-HUD systems, particularly in high-complexity intersections, and contribute to the refinement of human–machine interaction strategies to enhance driving safety.

키워드