Investigating non-visual eye movements non-intrusively: Comparing manual and automatic annotation styles

Non-visual eye-movements (NVEMs) are eye movements that do not serve the provision of visual information. As of yet, their cognitive origins and meaning remain under-explored in eye-movement research. The first problem presenting itself in pursuit of their study is one of annotation: in virtue of t...

Full description

Saved in:
Bibliographic Details
Main Authors: Jeremias Stüber, Lina Junctorius, Annette Hohenberger
Format: Article
Language:English
Published: MDPI AG 2022-04-01
Series:Journal of Eye Movement Research
Subjects:
Online Access:https://bop.unibe.ch/JEMR/article/view/8231
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Non-visual eye-movements (NVEMs) are eye movements that do not serve the provision of visual information. As of yet, their cognitive origins and meaning remain under-explored in eye-movement research. The first problem presenting itself in pursuit of their study is one of annotation: in virtue of their being non-visual, they are not necessarily bound to a specific surface or object of interest, rendering conventional eye-trackers nonideal for their study. This, however, makes it potentially viable to investigate them without requiring high resolution data. In this report, we present two approaches to annotating NVEM data – one of them grid-based, involving manual annotation in ELAN (Max Planck Institute for Psycholinguistics: The Language Archive, 2019), the other one Cartesian coordinate-based, derived algorithmically through OpenFace (Baltrušaitis et al., 2018). We evaluated a) the two approaches in themselves, e.g. in terms of consistency, as well as b) their compatibility, i.e. the possibilities of mapping one to the other. In the case of a), we found good overall consistency in both approaches, in the case of b), there is evidence for the eventual possibility of mapping the OpenFace gaze estimations onto the manual coding grid.
ISSN:1995-8692