Quantifying the Predictability of Visual Scanpaths Using Active Information Storage

• Main Authors: Patricia Wollstadt, Martina Hasenjäger, Christiane B. Wiebel-Herboth
• Format: Article
• Language: English
• Published: MDPI AG 2021-01-01
• Series: Entropy
• Subjects: eye tracking; information theory; active information storage; scanpath
• Online Access: https://www.mdpi.com/1099-4300/23/2/167

Entropy-based measures are an important tool for studying human gaze behavior under various conditions. In particular, gaze transition entropy (GTE) is a popular method to quantify the predictability of a visual scanpath as the entropy of transitions between fixations and has been shown to correlate with changes in task demand or changes in observer state. Measuring scanpath predictability is thus a promising approach to identifying viewers’ cognitive states in behavioral experiments or gaze-based applications. However, GTE does not account for temporal dependencies beyond two consecutive fixations and may thus underestimate the actual predictability of the current fixation given past gaze behavior. Instead, we propose to quantify scanpath predictability by estimating the active information storage (AIS), which can account for dependencies spanning multiple fixations. AIS is calculated as the mutual information between a processes’ multivariate past state and its next value. It is thus able to measure how much information a sequence of past fixations provides about the next fixation, hence covering a longer temporal horizon. Applying the proposed approach, we were able to distinguish between induced observer states based on estimated AIS, providing first evidence that AIS may be used in the inference of user states to improve human–machine interaction.