Tracking gaze position from EEG: Exploring the possibility of an EEG‐based virtual eye‐tracker

Abstract

AbstractIntroductionOcular artifact has long been viewed as an impediment to the interpretation of electroencephalogram (EEG) signals in basic and applied research. Today, the use of blind source separation (BSS) methods, including independent component analysis (ICA) and second‐order blind identification (SOBI), is considered an essential step in improving the quality of neural signals. Recently, we introduced a method consisting of SOBI and a discriminant and similarity (DANS)‐based identification method, capable of identifying and extracting eye movement–related components. These recovered components can be localized within ocular structures with a high goodness of fit (>95%). This raised the possibility that such EEG‐derived SOBI components may be used to build predictive models for tracking gaze position.MethodsAs proof of this new concept, we designed an EEG‐based virtual eye‐tracker (EEG‐VET) for tracking eye movement from EEG alone. The EEG‐VET is composed of a SOBI algorithm for separating EEG signals into different components, a DANS algorithm for automatically identifying ocular components, and a linear model to transfer ocular components into gaze positions.ResultsThe prototype of EEG‐VET achieved an accuracy of 0.920° and precision of 1.510° of a visual angle in the best participant, whereas an average accuracy of 1.008° ± 0.357° and a precision of 2.348° ± 0.580° of a visual angle across all participants (N = 18).ConclusionThis work offers a novel approach that readily co‐registers eye movement and neural signals from a single‐EEG recording, thus increasing the ease of studying neural mechanisms underlying natural cognition in the context of free eye movement.