I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated Vehicles

Automated vehicles (AVs) are able to detect pedestrians reliably but still have difficulty in predicting pedestrians’ intentions from their implicit body language. This study examined the effects of using explicit hand gestures and receptive external human-machine interfaces (eHMIs) in the interacti...

Full description

Saved in:
Bibliographic Details
Main Authors: Michael R. Epke, Lars Kooijman, Joost C. F. de Winter
Format: Article
Language:English
Published: Wiley 2021-01-01
Series:Journal of Advanced Transportation
Online Access:http://dx.doi.org/10.1155/2021/5573560
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832565971020152832
author Michael R. Epke
Lars Kooijman
Joost C. F. de Winter
author_facet Michael R. Epke
Lars Kooijman
Joost C. F. de Winter
author_sort Michael R. Epke
collection DOAJ
description Automated vehicles (AVs) are able to detect pedestrians reliably but still have difficulty in predicting pedestrians’ intentions from their implicit body language. This study examined the effects of using explicit hand gestures and receptive external human-machine interfaces (eHMIs) in the interaction between pedestrians and AVs. Twenty-six participants interacted with AVs in a virtual environment while wearing a head-mounted display. The participants’ movements in the virtual environment were visualized using a motion-tracking suit. The first independent variable was the participants’ opportunity to use a hand gesture to increase the probability that the AV would stop for them. The second independent variable was the AV’s response “I SEE YOU,” displayed on an eHMI when the vehicle yielded. Accordingly, one-way communication (gesture or eHMI) and two-way communication (gesture and eHMI combined) were investigated. The results showed that the participants decided to use hand gestures in 70% of the trials. Furthermore, the eHMI improved the predictability of the AV’s behavior compared to no eHMI, as inferred from self-reports and hand-use behavior. A postexperiment questionnaire indicated that two-way communication was the most preferred condition and that the eHMI alone was more preferred than the gesture alone. The results further indicate limitations of hand gestures regarding false-positive detection and confusion if the AV decides not to yield. It is concluded that bidirectional human-robot communication has considerable potential.
format Article
id doaj-art-09080561d4924645b8c86fcb68907a65
institution Kabale University
issn 0197-6729
2042-3195
language English
publishDate 2021-01-01
publisher Wiley
record_format Article
series Journal of Advanced Transportation
spelling doaj-art-09080561d4924645b8c86fcb68907a652025-02-03T01:05:27ZengWileyJournal of Advanced Transportation0197-67292042-31952021-01-01202110.1155/2021/55735605573560I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated VehiclesMichael R. Epke0Lars Kooijman1Joost C. F. de Winter2Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, NetherlandsFaculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, NetherlandsFaculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, NetherlandsAutomated vehicles (AVs) are able to detect pedestrians reliably but still have difficulty in predicting pedestrians’ intentions from their implicit body language. This study examined the effects of using explicit hand gestures and receptive external human-machine interfaces (eHMIs) in the interaction between pedestrians and AVs. Twenty-six participants interacted with AVs in a virtual environment while wearing a head-mounted display. The participants’ movements in the virtual environment were visualized using a motion-tracking suit. The first independent variable was the participants’ opportunity to use a hand gesture to increase the probability that the AV would stop for them. The second independent variable was the AV’s response “I SEE YOU,” displayed on an eHMI when the vehicle yielded. Accordingly, one-way communication (gesture or eHMI) and two-way communication (gesture and eHMI combined) were investigated. The results showed that the participants decided to use hand gestures in 70% of the trials. Furthermore, the eHMI improved the predictability of the AV’s behavior compared to no eHMI, as inferred from self-reports and hand-use behavior. A postexperiment questionnaire indicated that two-way communication was the most preferred condition and that the eHMI alone was more preferred than the gesture alone. The results further indicate limitations of hand gestures regarding false-positive detection and confusion if the AV decides not to yield. It is concluded that bidirectional human-robot communication has considerable potential.http://dx.doi.org/10.1155/2021/5573560
spellingShingle Michael R. Epke
Lars Kooijman
Joost C. F. de Winter
I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated Vehicles
Journal of Advanced Transportation
title I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated Vehicles
title_full I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated Vehicles
title_fullStr I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated Vehicles
title_full_unstemmed I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated Vehicles
title_short I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated Vehicles
title_sort i see your gesture a vr based study of bidirectional communication between pedestrians and automated vehicles
url http://dx.doi.org/10.1155/2021/5573560
work_keys_str_mv AT michaelrepke iseeyourgestureavrbasedstudyofbidirectionalcommunicationbetweenpedestriansandautomatedvehicles
AT larskooijman iseeyourgestureavrbasedstudyofbidirectionalcommunicationbetweenpedestriansandautomatedvehicles
AT joostcfdewinter iseeyourgestureavrbasedstudyofbidirectionalcommunicationbetweenpedestriansandautomatedvehicles