Multimodal Interaction, Interfaces, and Communication: A Survey
Multimodal interaction is a transformative human-computer interaction (HCI) approach that allows users to interact with systems through various communication channels such as speech, gesture, touch, and gaze. With advancements in sensor technology and machine learning (ML), multimodal systems are be...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Multimodal Technologies and Interaction |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2414-4088/9/1/6 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832587817605136384 |
|---|---|
| author | Elias Dritsas Maria Trigka Christos Troussas Phivos Mylonas |
| author_facet | Elias Dritsas Maria Trigka Christos Troussas Phivos Mylonas |
| author_sort | Elias Dritsas |
| collection | DOAJ |
| description | Multimodal interaction is a transformative human-computer interaction (HCI) approach that allows users to interact with systems through various communication channels such as speech, gesture, touch, and gaze. With advancements in sensor technology and machine learning (ML), multimodal systems are becoming increasingly important in various applications, including virtual assistants, intelligent environments, healthcare, and accessibility technologies. This survey concisely overviews recent advancements in multimodal interaction, interfaces, and communication. It delves into integrating different input and output modalities, focusing on critical technologies and essential considerations in multimodal fusion, including temporal synchronization and decision-level integration. Furthermore, the survey explores the challenges of developing context-aware, adaptive systems that provide seamless and intuitive user experiences. Lastly, by examining current methodologies and trends, this study underscores the potential of multimodal systems and sheds light on future research directions. |
| format | Article |
| id | doaj-art-d6f39285307f43f0b120eda94ed90413 |
| institution | Kabale University |
| issn | 2414-4088 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Multimodal Technologies and Interaction |
| spelling | doaj-art-d6f39285307f43f0b120eda94ed904132025-01-24T13:44:02ZengMDPI AGMultimodal Technologies and Interaction2414-40882025-01-0191610.3390/mti9010006Multimodal Interaction, Interfaces, and Communication: A SurveyElias Dritsas0Maria Trigka1Christos Troussas2Phivos Mylonas3Industrial Systems Institute (ISI), Athena Research and Innovation Center, 26504 Patras, GreeceIndustrial Systems Institute (ISI), Athena Research and Innovation Center, 26504 Patras, GreeceDepartment of Informatics and Computer Engineering, University of West Attica, Egaleo Park Campus, 12243 Athens, GreeceDepartment of Informatics and Computer Engineering, University of West Attica, Egaleo Park Campus, 12243 Athens, GreeceMultimodal interaction is a transformative human-computer interaction (HCI) approach that allows users to interact with systems through various communication channels such as speech, gesture, touch, and gaze. With advancements in sensor technology and machine learning (ML), multimodal systems are becoming increasingly important in various applications, including virtual assistants, intelligent environments, healthcare, and accessibility technologies. This survey concisely overviews recent advancements in multimodal interaction, interfaces, and communication. It delves into integrating different input and output modalities, focusing on critical technologies and essential considerations in multimodal fusion, including temporal synchronization and decision-level integration. Furthermore, the survey explores the challenges of developing context-aware, adaptive systems that provide seamless and intuitive user experiences. Lastly, by examining current methodologies and trends, this study underscores the potential of multimodal systems and sheds light on future research directions.https://www.mdpi.com/2414-4088/9/1/6multimodal interactionhuman-computer interactionadaptive systemsmultimodal fusion |
| spellingShingle | Elias Dritsas Maria Trigka Christos Troussas Phivos Mylonas Multimodal Interaction, Interfaces, and Communication: A Survey Multimodal Technologies and Interaction multimodal interaction human-computer interaction adaptive systems multimodal fusion |
| title | Multimodal Interaction, Interfaces, and Communication: A Survey |
| title_full | Multimodal Interaction, Interfaces, and Communication: A Survey |
| title_fullStr | Multimodal Interaction, Interfaces, and Communication: A Survey |
| title_full_unstemmed | Multimodal Interaction, Interfaces, and Communication: A Survey |
| title_short | Multimodal Interaction, Interfaces, and Communication: A Survey |
| title_sort | multimodal interaction interfaces and communication a survey |
| topic | multimodal interaction human-computer interaction adaptive systems multimodal fusion |
| url | https://www.mdpi.com/2414-4088/9/1/6 |
| work_keys_str_mv | AT eliasdritsas multimodalinteractioninterfacesandcommunicationasurvey AT mariatrigka multimodalinteractioninterfacesandcommunicationasurvey AT christostroussas multimodalinteractioninterfacesandcommunicationasurvey AT phivosmylonas multimodalinteractioninterfacesandcommunicationasurvey |