A novel end-to-end dual-camera system for eye gaze synchrony assessment in face-to-face interaction

Quantification of face-to-face interaction can provide highly relevant information in cognitive and psychological science research. Current commercial glint-dependent solutions suffer from several disadvantages and limitations when applied in face-to-face interaction, including data loss, parallax errors, the inconvenience and distracting effect of wearables, and/or the need for several cameras to capture each person. Here we present a novel eye-tracking solution, consisting of a dual-camera system used in conjunction with an individually optimized deep learning approach that aims to overcome some of these limitations. Our data show that this system can accurately classify gaze location within different areas of the face of two interlocutors, and capture subtle differences in interpersonal gaze synchrony between two individuals during a (semi-)naturalistic face-to-face interaction.

Automated summary

Quantification of face-to-face interaction can provide relevant information in cognitive and psychological science research. Current glint-dependent solutions have limitations such as data loss and the inconvenience of wearables. We propose a novel eye-tracking solution using a dual-camera system and deep learning to overcome these limitations. Our data demonstrate accurate gaze classification and capture of subtle differences in interpersonal gaze synchrony during face-to-face interaction.