Investigating saccade-onset locked EEG signatures of face perception during free-viewing in a naturalistic virtual environment

Current research strives to investigate cognitive processes under natural conditions. Virtual reality and EEG are promising techniques combining naturalistic settings with close experimental control. However, many questions and technical challenges remain, e.g., are fixation or saccade onsets a suitable replacement as key events in continuous gaze trajectories (Amme et al., 2024), and can VR effectively capture differences across experimental conditions (Rossion & Jacques, 2008)? To address both questions, we investigate the N170 face effect in a free-viewing immersive VR study that contained houses, various background stimuli, and, notably, static and moving pedestrians to study face perception under naturalistic conditions. Our results show that aligning trials to saccade-onset leads to more well-defined ERPs, especially for the P100 component, and support that saccade-onset ERPs are the better-suited analysis method than fixation-onset ERPs for this type of experiment. Further, we observe an evolution of condition-based differences, i.e., face vs. background fixations, compatible with previous reports but extending in a large temporal window and including all electrode sites at different points in time. In summary, experiments combining VR, EEG, and eye-tracking provide further insights into the processing of faces and the relevance of saccadic onsets as event triggers under natural conditions.