Embodied Conversational Agents in Extended Reality: A Systematic Review

Embodied conversational agents (ECAs) that can interact with users in a human-like manner have demonstrated promising potential in various endeavors. With the ongoing advancement in extended reality (XR) and artificial intelligence (AI), ECAs are becoming increasingly sophisticated. Although previou...

Full description

Saved in:
Bibliographic Details
Main Authors: Fu-Chia Yang, Pedro Acevedo, Siqi Guo, Minsoo Choi, Christos Mousas
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10985757/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850035265299546112
author Fu-Chia Yang
Pedro Acevedo
Siqi Guo
Minsoo Choi
Christos Mousas
author_facet Fu-Chia Yang
Pedro Acevedo
Siqi Guo
Minsoo Choi
Christos Mousas
author_sort Fu-Chia Yang
collection DOAJ
description Embodied conversational agents (ECAs) that can interact with users in a human-like manner have demonstrated promising potential in various endeavors. With the ongoing advancement in extended reality (XR) and artificial intelligence (AI), ECAs are becoming increasingly sophisticated. Although previous reviews have predominantly focused on ECAs for non-XR applications, a growing number of research papers are exploring the capabilities of ECAs that utilize XR technologies. However, no prior systematic review has focused explicitly on XR ECAs, leading to a gap in understanding how ECAs are designed, implemented, and evaluated within immersive environments. Our work identified the gap between the existing reviews and the current trends in XR ECAs. We began with 1,717 related papers from January 2014 to June 2024. We narrowed down the selection to 23 papers using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework, which employed an iterative screening procedure and criteria defined by our research team. The resulting papers were analyzed and discussed in terms of the features of the ECA application, its design and implementation, and use cases. Our analysis highlights key trends in XR ECA design, including the dominance of VR-based implementations using head-mounted displays, the prevalence of human-like and female-presenting agents, the move from rule-based to neural-based conversational systems, and the primary use cases in training, therapy, and social interaction. We also summarize the evaluation methods employed across studies and discuss future research directions for developing more adaptive and human-like ECAs in XR environments.
format Article
id doaj-art-e9b8cc8f59864d61b77a7b64cd7730e1
institution DOAJ
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-e9b8cc8f59864d61b77a7b64cd7730e12025-08-20T02:57:32ZengIEEEIEEE Access2169-35362025-01-0113798057982410.1109/ACCESS.2025.356669810985757Embodied Conversational Agents in Extended Reality: A Systematic ReviewFu-Chia Yang0https://orcid.org/0000-0003-2041-4836Pedro Acevedo1https://orcid.org/0000-0003-0814-7675Siqi Guo2https://orcid.org/0009-0001-3574-788XMinsoo Choi3https://orcid.org/0000-0001-9459-4070Christos Mousas4https://orcid.org/0000-0003-0955-7959Department of Computer Graphics Technology, Purdue University, West Lafayette, IN, USADepartment of Computer Graphics Technology, Purdue University, West Lafayette, IN, USADepartment of Computer Graphics Technology, Purdue University, West Lafayette, IN, USADepartment of Computer Graphics Technology, Purdue University, West Lafayette, IN, USADepartment of Computer Graphics Technology, Purdue University, West Lafayette, IN, USAEmbodied conversational agents (ECAs) that can interact with users in a human-like manner have demonstrated promising potential in various endeavors. With the ongoing advancement in extended reality (XR) and artificial intelligence (AI), ECAs are becoming increasingly sophisticated. Although previous reviews have predominantly focused on ECAs for non-XR applications, a growing number of research papers are exploring the capabilities of ECAs that utilize XR technologies. However, no prior systematic review has focused explicitly on XR ECAs, leading to a gap in understanding how ECAs are designed, implemented, and evaluated within immersive environments. Our work identified the gap between the existing reviews and the current trends in XR ECAs. We began with 1,717 related papers from January 2014 to June 2024. We narrowed down the selection to 23 papers using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework, which employed an iterative screening procedure and criteria defined by our research team. The resulting papers were analyzed and discussed in terms of the features of the ECA application, its design and implementation, and use cases. Our analysis highlights key trends in XR ECA design, including the dominance of VR-based implementations using head-mounted displays, the prevalence of human-like and female-presenting agents, the move from rule-based to neural-based conversational systems, and the primary use cases in training, therapy, and social interaction. We also summarize the evaluation methods employed across studies and discuss future research directions for developing more adaptive and human-like ECAs in XR environments.https://ieeexplore.ieee.org/document/10985757/Embodied conversational agentsextended realityconversational interactionuse casesevaluation methods
spellingShingle Fu-Chia Yang
Pedro Acevedo
Siqi Guo
Minsoo Choi
Christos Mousas
Embodied Conversational Agents in Extended Reality: A Systematic Review
IEEE Access
Embodied conversational agents
extended reality
conversational interaction
use cases
evaluation methods
title Embodied Conversational Agents in Extended Reality: A Systematic Review
title_full Embodied Conversational Agents in Extended Reality: A Systematic Review
title_fullStr Embodied Conversational Agents in Extended Reality: A Systematic Review
title_full_unstemmed Embodied Conversational Agents in Extended Reality: A Systematic Review
title_short Embodied Conversational Agents in Extended Reality: A Systematic Review
title_sort embodied conversational agents in extended reality a systematic review
topic Embodied conversational agents
extended reality
conversational interaction
use cases
evaluation methods
url https://ieeexplore.ieee.org/document/10985757/
work_keys_str_mv AT fuchiayang embodiedconversationalagentsinextendedrealityasystematicreview
AT pedroacevedo embodiedconversationalagentsinextendedrealityasystematicreview
AT siqiguo embodiedconversationalagentsinextendedrealityasystematicreview
AT minsoochoi embodiedconversationalagentsinextendedrealityasystematicreview
AT christosmousas embodiedconversationalagentsinextendedrealityasystematicreview