Auditory neural correlates and neuroergonomics of driving assistance in a simulated virtual environment

Abstract

Abstract Objective. Driver assistance systems play an increasingly important role in modern vehicles. In the current level of technology, the driver must continuously supervise the driving and intervene whenever necessary when using driving assistance systems. The driver’s attentiveness plays an important role in this human–machine interaction. Our aim was to design a simplistic technical framework for studying neural correlates of driving situations in a functional magnetic resonance imaging (fMRI) setting. In this work we assessed the feasibility of our proposed platform. Methods. We proposed a virtual environment (VE) simulation of driver assistance as a framework to investigate brain states related to partially automated driving. We focused on the processing of auditory signals during different driving scenarios as they have been shown to be advantageous as warning stimuli in driving situations. This provided the necessary groundwork to study brain auditory attentional networks under varying environmental demands in an fMRI setting. To this end, we conducted a study with 20 healthy participants to assess the feasibility of the VE simulation. Results. We demonstrated that the proposed VE can elicit driving related brain activation patterns. Relevant driving events evoked, in particular, responses in the bilateral auditory, sensory-motor, visual and insular cortices, which are related to perceptual and behavioral processes during driving assistance. Conceivably, attentional mechanisms increased somatosensory integration and reduced interoception, which are relevant for requesting interactions during partially automated driving. Significance. In modern vehicles, driver assistance technologies are playing an increasingly prevalent role. It is important to study the interaction between these systems and drivers’ attentional responses to aid in future optimizations of the assistance systems. The proposed VE provides a foundational first step in this endeavor. Such simulated VEs provide a safe setting for experimentation with driving behaviors in a semi-naturalistic environment.