Spatial audio signal processing for augmented telepresence applications
During the COVID-19 pandemic, the shift to remote communication, particularly through video calls, led to both opportunities and challenges. While initially a welcome alternative to in-person meetings, virtual gatherings became increasingly overwhelming, culminating in the term “zoom fatigue.” Howev...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-03-01
|
| Series: | Science Talks |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2772569325000039 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832585066643980288 |
|---|---|
| author | Thomas Deppisch |
| author_facet | Thomas Deppisch |
| author_sort | Thomas Deppisch |
| collection | DOAJ |
| description | During the COVID-19 pandemic, the shift to remote communication, particularly through video calls, led to both opportunities and challenges. While initially a welcome alternative to in-person meetings, virtual gatherings became increasingly overwhelming, culminating in the term “zoom fatigue.” However, reduced travel highlighted the potential environmental benefits of online meetings. My PhD research focuses on improving the naturalness of remote communication to enhance the appeal of virtual meetings. Specifically, I develop signal processing techniques that preserve spatial and acoustic cues important for natural speech perception, such as the cocktail party effect. By modeling microphone array signals, particularly those integrated into smart glasses or augmented reality headsets, I estimate and apply spatial room transfer functions to create natural binaural audio experiences. My work also addresses challenges posed by head movement, using continuous-space domain estimation to update room transfer functions during head rotations. First results show the effectiveness of the method under controlled conditions. Future work will investigate the approach in more realistic scenarios. |
| format | Article |
| id | doaj-art-593a80687d274dbf90ecef09940a326e |
| institution | Kabale University |
| issn | 2772-5693 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Science Talks |
| spelling | doaj-art-593a80687d274dbf90ecef09940a326e2025-01-27T04:22:39ZengElsevierScience Talks2772-56932025-03-0113100421Spatial audio signal processing for augmented telepresence applicationsThomas Deppisch0Division of Applied Acoustics, Chalmers University of Technology, Gothenburg, SwedenDuring the COVID-19 pandemic, the shift to remote communication, particularly through video calls, led to both opportunities and challenges. While initially a welcome alternative to in-person meetings, virtual gatherings became increasingly overwhelming, culminating in the term “zoom fatigue.” However, reduced travel highlighted the potential environmental benefits of online meetings. My PhD research focuses on improving the naturalness of remote communication to enhance the appeal of virtual meetings. Specifically, I develop signal processing techniques that preserve spatial and acoustic cues important for natural speech perception, such as the cocktail party effect. By modeling microphone array signals, particularly those integrated into smart glasses or augmented reality headsets, I estimate and apply spatial room transfer functions to create natural binaural audio experiences. My work also addresses challenges posed by head movement, using continuous-space domain estimation to update room transfer functions during head rotations. First results show the effectiveness of the method under controlled conditions. Future work will investigate the approach in more realistic scenarios.http://www.sciencedirect.com/science/article/pii/S2772569325000039Augmented realityRoom impulse responseSpatial audioTelepresenceVirtual acoustics |
| spellingShingle | Thomas Deppisch Spatial audio signal processing for augmented telepresence applications Science Talks Augmented reality Room impulse response Spatial audio Telepresence Virtual acoustics |
| title | Spatial audio signal processing for augmented telepresence applications |
| title_full | Spatial audio signal processing for augmented telepresence applications |
| title_fullStr | Spatial audio signal processing for augmented telepresence applications |
| title_full_unstemmed | Spatial audio signal processing for augmented telepresence applications |
| title_short | Spatial audio signal processing for augmented telepresence applications |
| title_sort | spatial audio signal processing for augmented telepresence applications |
| topic | Augmented reality Room impulse response Spatial audio Telepresence Virtual acoustics |
| url | http://www.sciencedirect.com/science/article/pii/S2772569325000039 |
| work_keys_str_mv | AT thomasdeppisch spatialaudiosignalprocessingforaugmentedtelepresenceapplications |