Design, Implementation and Evaluation of an Immersive Teleoperation Interface for Human-Centered Autonomous Driving

As autonomous driving technologies advance, the need for human-in-the-loop systems becomes increasingly critical to ensure safety, adaptability, and public confidence. This paper presents the design and evaluation of a context-aware immersive teleoperation interface that integrates real-time simulat...

Full description

Saved in:
Bibliographic Details
Main Authors: Irene Bouzón, Jimena Pascual, Cayetana Costales, Aser Crespo, Covadonga Cima, David Melendi
Format: Article
Language:English
Published: MDPI AG 2025-07-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/25/15/4679
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849406409571041280
author Irene Bouzón
Jimena Pascual
Cayetana Costales
Aser Crespo
Covadonga Cima
David Melendi
author_facet Irene Bouzón
Jimena Pascual
Cayetana Costales
Aser Crespo
Covadonga Cima
David Melendi
author_sort Irene Bouzón
collection DOAJ
description As autonomous driving technologies advance, the need for human-in-the-loop systems becomes increasingly critical to ensure safety, adaptability, and public confidence. This paper presents the design and evaluation of a context-aware immersive teleoperation interface that integrates real-time simulation, virtual reality, and multimodal feedback to support remote interventions in emergency scenarios. Built on a modular ROS2 architecture, the system allows seamless transition between simulated and physical platforms, enabling safe and reproducible testing. The experimental results show a high task success rate and user satisfaction, highlighting the importance of intuitive controls, gesture recognition accuracy, and low-latency feedback. Our findings contribute to the understanding of human-robot interaction (HRI) in immersive teleoperation contexts and provide insights into the role of multisensory feedback and control modalities in building trust and situational awareness for remote operators. Ultimately, this approach is intended to support the broader acceptability of autonomous driving technologies by enhancing human supervision, control, and confidence.
format Article
id doaj-art-f04530859d83473ca84fb9cbecf4e73f
institution Kabale University
issn 1424-8220
language English
publishDate 2025-07-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj-art-f04530859d83473ca84fb9cbecf4e73f2025-08-20T03:36:23ZengMDPI AGSensors1424-82202025-07-012515467910.3390/s25154679Design, Implementation and Evaluation of an Immersive Teleoperation Interface for Human-Centered Autonomous DrivingIrene Bouzón0Jimena Pascual1Cayetana Costales2Aser Crespo3Covadonga Cima4David Melendi5CTIC Foundation, 33203 Gijón, Asturias, SpainCTIC Foundation, 33203 Gijón, Asturias, SpainCTIC Foundation, 33203 Gijón, Asturias, SpainCTIC Foundation, 33203 Gijón, Asturias, SpainCTIC Foundation, 33203 Gijón, Asturias, SpainDepartment of Informatics, University of Oviedo, 33203 Gijón, Asturias, SpainAs autonomous driving technologies advance, the need for human-in-the-loop systems becomes increasingly critical to ensure safety, adaptability, and public confidence. This paper presents the design and evaluation of a context-aware immersive teleoperation interface that integrates real-time simulation, virtual reality, and multimodal feedback to support remote interventions in emergency scenarios. Built on a modular ROS2 architecture, the system allows seamless transition between simulated and physical platforms, enabling safe and reproducible testing. The experimental results show a high task success rate and user satisfaction, highlighting the importance of intuitive controls, gesture recognition accuracy, and low-latency feedback. Our findings contribute to the understanding of human-robot interaction (HRI) in immersive teleoperation contexts and provide insights into the role of multisensory feedback and control modalities in building trust and situational awareness for remote operators. Ultimately, this approach is intended to support the broader acceptability of autonomous driving technologies by enhancing human supervision, control, and confidence.https://www.mdpi.com/1424-8220/25/15/4679teleoperationautonomous vehiclesvirtual realitysituational awarenessimmersive interfacemultimodal feedback
spellingShingle Irene Bouzón
Jimena Pascual
Cayetana Costales
Aser Crespo
Covadonga Cima
David Melendi
Design, Implementation and Evaluation of an Immersive Teleoperation Interface for Human-Centered Autonomous Driving
Sensors
teleoperation
autonomous vehicles
virtual reality
situational awareness
immersive interface
multimodal feedback
title Design, Implementation and Evaluation of an Immersive Teleoperation Interface for Human-Centered Autonomous Driving
title_full Design, Implementation and Evaluation of an Immersive Teleoperation Interface for Human-Centered Autonomous Driving
title_fullStr Design, Implementation and Evaluation of an Immersive Teleoperation Interface for Human-Centered Autonomous Driving
title_full_unstemmed Design, Implementation and Evaluation of an Immersive Teleoperation Interface for Human-Centered Autonomous Driving
title_short Design, Implementation and Evaluation of an Immersive Teleoperation Interface for Human-Centered Autonomous Driving
title_sort design implementation and evaluation of an immersive teleoperation interface for human centered autonomous driving
topic teleoperation
autonomous vehicles
virtual reality
situational awareness
immersive interface
multimodal feedback
url https://www.mdpi.com/1424-8220/25/15/4679
work_keys_str_mv AT irenebouzon designimplementationandevaluationofanimmersiveteleoperationinterfaceforhumancenteredautonomousdriving
AT jimenapascual designimplementationandevaluationofanimmersiveteleoperationinterfaceforhumancenteredautonomousdriving
AT cayetanacostales designimplementationandevaluationofanimmersiveteleoperationinterfaceforhumancenteredautonomousdriving
AT asercrespo designimplementationandevaluationofanimmersiveteleoperationinterfaceforhumancenteredautonomousdriving
AT covadongacima designimplementationandevaluationofanimmersiveteleoperationinterfaceforhumancenteredautonomousdriving
AT davidmelendi designimplementationandevaluationofanimmersiveteleoperationinterfaceforhumancenteredautonomousdriving