Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaning

IntroductionGesture-based interactions provide control over a system without the need for physical contact. Mid-air haptic technology allows a user to not visually engage with the interface while receiving system information and is readily manipulable, which has positive implications for automotive...

Full description

Saved in:
Bibliographic Details
Main Authors: George Evangelou, Orestis Georgiou, Eddie Brown, James W. Moore
Format: Article
Language:English
Published: Frontiers Media S.A. 2025-01-01
Series:Frontiers in Computer Science
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fcomp.2025.1511928/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832584994702229504
author George Evangelou
Orestis Georgiou
Eddie Brown
James W. Moore
author_facet George Evangelou
Orestis Georgiou
Eddie Brown
James W. Moore
author_sort George Evangelou
collection DOAJ
description IntroductionGesture-based interactions provide control over a system without the need for physical contact. Mid-air haptic technology allows a user to not visually engage with the interface while receiving system information and is readily manipulable, which has positive implications for automotive environments. It is important, however, that the user still feels a sense of agency, which here refers to perceiving system changes as caused by their gesture.MethodsIn the current study, 36 participants engaged in an experimental time perception task with an automotive-themed infotainment menu, serving as an implicit quantitative measure of agency. This was supplemented with additional self-reported measures. They selected different icons via gesture poses, with sensory feedback either visually or haptically. In addition, (sensory) feedback was also the same for each icon, arbitrarily different or carried semantic information.ResultsMid-air haptics increased agency compared to visual, and this did not vary as a function of feedback meaning. Agency was also associated with general measures of trust and usability.DiscussionOur findings demonstrate positive implications for mid-air haptics in automotive contexts and highlight the general importance of user agency.
format Article
id doaj-art-61d2d320423c4a009e173c353df41302
institution Kabale University
issn 2624-9898
language English
publishDate 2025-01-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Computer Science
spelling doaj-art-61d2d320423c4a009e173c353df413022025-01-27T06:41:06ZengFrontiers Media S.A.Frontiers in Computer Science2624-98982025-01-01710.3389/fcomp.2025.15119281511928Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaningGeorge Evangelou0Orestis Georgiou1Eddie Brown2James W. Moore3Department of Psychology, Goldsmiths, University of London, London, United KingdomResearch and Development, Ultraleap Ltd., Bristol, United KingdomResearch and Development, Ultraleap Ltd., Bristol, United KingdomDepartment of Psychology, Goldsmiths, University of London, London, United KingdomIntroductionGesture-based interactions provide control over a system without the need for physical contact. Mid-air haptic technology allows a user to not visually engage with the interface while receiving system information and is readily manipulable, which has positive implications for automotive environments. It is important, however, that the user still feels a sense of agency, which here refers to perceiving system changes as caused by their gesture.MethodsIn the current study, 36 participants engaged in an experimental time perception task with an automotive-themed infotainment menu, serving as an implicit quantitative measure of agency. This was supplemented with additional self-reported measures. They selected different icons via gesture poses, with sensory feedback either visually or haptically. In addition, (sensory) feedback was also the same for each icon, arbitrarily different or carried semantic information.ResultsMid-air haptics increased agency compared to visual, and this did not vary as a function of feedback meaning. Agency was also associated with general measures of trust and usability.DiscussionOur findings demonstrate positive implications for mid-air haptics in automotive contexts and highlight the general importance of user agency.https://www.frontiersin.org/articles/10.3389/fcomp.2025.1511928/fullagencygesturesensorymodalityhapticsvisual
spellingShingle George Evangelou
Orestis Georgiou
Eddie Brown
James W. Moore
Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaning
Frontiers in Computer Science
agency
gesture
sensory
modality
haptics
visual
title Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaning
title_full Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaning
title_fullStr Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaning
title_full_unstemmed Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaning
title_short Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaning
title_sort sense of agency in gesture based interactions modulated by sensory modality but not feedback meaning
topic agency
gesture
sensory
modality
haptics
visual
url https://www.frontiersin.org/articles/10.3389/fcomp.2025.1511928/full
work_keys_str_mv AT georgeevangelou senseofagencyingesturebasedinteractionsmodulatedbysensorymodalitybutnotfeedbackmeaning
AT orestisgeorgiou senseofagencyingesturebasedinteractionsmodulatedbysensorymodalitybutnotfeedbackmeaning
AT eddiebrown senseofagencyingesturebasedinteractionsmodulatedbysensorymodalitybutnotfeedbackmeaning
AT jameswmoore senseofagencyingesturebasedinteractionsmodulatedbysensorymodalitybutnotfeedbackmeaning