Audio technology for improving social interaction in extended reality

In recent years, extended reality (XR) has gained interest as a platform for human communication, with the emergence of the “Metaverse” promising to reshape social interactions. At the same time, concerns about harmful behavior and criminal activities in virtual environments have increased. This pap...

Full description

Saved in:
Bibliographic Details
Main Authors: Joanna Luberadzka, Enric Gusó Muñoz, Umut Sayin, Adan Garriga
Format: Article
Language:English
Published: Frontiers Media S.A. 2025-01-01
Series:Frontiers in Virtual Reality
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frvir.2024.1442774/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832590804696170496
author Joanna Luberadzka
Enric Gusó Muñoz
Enric Gusó Muñoz
Umut Sayin
Adan Garriga
author_facet Joanna Luberadzka
Enric Gusó Muñoz
Enric Gusó Muñoz
Umut Sayin
Adan Garriga
author_sort Joanna Luberadzka
collection DOAJ
description In recent years, extended reality (XR) has gained interest as a platform for human communication, with the emergence of the “Metaverse” promising to reshape social interactions. At the same time, concerns about harmful behavior and criminal activities in virtual environments have increased. This paper explores the potential of technology to support social harmony within XR, focusing specifically on audio aspects. We introduce the concept of acoustic coherence and discuss why it is crucial for smooth interaction. We further explain the challenges of speech communication in XR, including noise and reverberation, and review sound processing methods to enhance the auditory experience. We also comment on the potential of using virtual reality as a tool for the development and evaluation of audio algorithms aimed at enhancing communication. Finally, we present the results of a pilot study comparing several audio enhancement techniques inside a virtual environment.
format Article
id doaj-art-37ec46d6814542ca8d2dad616621ec40
institution Kabale University
issn 2673-4192
language English
publishDate 2025-01-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Virtual Reality
spelling doaj-art-37ec46d6814542ca8d2dad616621ec402025-01-23T06:56:29ZengFrontiers Media S.A.Frontiers in Virtual Reality2673-41922025-01-01510.3389/frvir.2024.14427741442774Audio technology for improving social interaction in extended realityJoanna Luberadzka0Enric Gusó Muñoz1Enric Gusó Muñoz2Umut Sayin3Adan Garriga4Eurecat, Centre Tecnològic de Catalunya, Tecnologies Multimèdia, Barcelona, SpainEurecat, Centre Tecnològic de Catalunya, Tecnologies Multimèdia, Barcelona, SpainUniversitat Pompeu Fabra, Music Technology Group, Barcelona, SpainEurecat, Centre Tecnològic de Catalunya, Tecnologies Multimèdia, Barcelona, SpainEurecat, Centre Tecnològic de Catalunya, Tecnologies Multimèdia, Barcelona, SpainIn recent years, extended reality (XR) has gained interest as a platform for human communication, with the emergence of the “Metaverse” promising to reshape social interactions. At the same time, concerns about harmful behavior and criminal activities in virtual environments have increased. This paper explores the potential of technology to support social harmony within XR, focusing specifically on audio aspects. We introduce the concept of acoustic coherence and discuss why it is crucial for smooth interaction. We further explain the challenges of speech communication in XR, including noise and reverberation, and review sound processing methods to enhance the auditory experience. We also comment on the potential of using virtual reality as a tool for the development and evaluation of audio algorithms aimed at enhancing communication. Finally, we present the results of a pilot study comparing several audio enhancement techniques inside a virtual environment.https://www.frontiersin.org/articles/10.3389/frvir.2024.1442774/fullsocial interactionextended realityvirtual acoustic simulationacoustic matchingspeech enhancement
spellingShingle Joanna Luberadzka
Enric Gusó Muñoz
Enric Gusó Muñoz
Umut Sayin
Adan Garriga
Audio technology for improving social interaction in extended reality
Frontiers in Virtual Reality
social interaction
extended reality
virtual acoustic simulation
acoustic matching
speech enhancement
title Audio technology for improving social interaction in extended reality
title_full Audio technology for improving social interaction in extended reality
title_fullStr Audio technology for improving social interaction in extended reality
title_full_unstemmed Audio technology for improving social interaction in extended reality
title_short Audio technology for improving social interaction in extended reality
title_sort audio technology for improving social interaction in extended reality
topic social interaction
extended reality
virtual acoustic simulation
acoustic matching
speech enhancement
url https://www.frontiersin.org/articles/10.3389/frvir.2024.1442774/full
work_keys_str_mv AT joannaluberadzka audiotechnologyforimprovingsocialinteractioninextendedreality
AT enricgusomunoz audiotechnologyforimprovingsocialinteractioninextendedreality
AT enricgusomunoz audiotechnologyforimprovingsocialinteractioninextendedreality
AT umutsayin audiotechnologyforimprovingsocialinteractioninextendedreality
AT adangarriga audiotechnologyforimprovingsocialinteractioninextendedreality