Initiating language engagement with multimodal learning tasks by Aránzazu García-Pinar

Get full text

Anatomy-Informed Multimodal Learning for Myocardial Infarction Prediction by Ivan-Daniel Sievering, Ortal Senouf, Thabo Mahendiran, David Nanchen, Stephane Fournier, Olivier Muller, Pascal Frossard, Emmanuel Abbe, Dorina Thanou

“…<italic>Results:</italic> The results of our framework on a clinical study of 445 patients admitted with acute coronary syndromes confirms that multimodal learning increases the predictive power and achieves good performance (AUC: <inline-formula><tex-math notation="LaTeX">$0.67\pm 0.04$</tex-math></inline-formula> &amp; F1-Score: <inline-formula><tex-math notation="LaTeX">$0.36\pm 0.12$</tex-math></inline-formula>), which outperforms the prediction obtained by each modality independently as well as that of interventional cardiologists (AUC: 0.54 &amp; F1-Score: 0.18). …”
Get full text

Incorporating Multimodal Directional Interpersonal Synchrony into Empathetic Response Generation by Jingyu Quan, Yoshihiro Miyake, Takayuki Nozawa

Subjects: Get full text

CausMatch: Causal Matching Learning With Counterfactual Preference Framework for Cross-Modal Retrieval by Chen Chen, Dan Wang

Subjects: “…Multimodal learning…”
Get full text

Efficient Multi-Task Training with Adaptive Feature Alignment for Universal Image Segmentation by Yipeng Qu, Joohee Kim

Subjects: Get full text

NavBLIP: a visual-language model for enhancing unmanned aerial vehicles navigation and object detection by Ye Li, Li Yang, Meifang Yang, Fei Yan, Tonghua Liu, Chensi Guo, Rufeng Chen

Subjects: Get full text

Open-world disaster information identification from multimodal social media by Chen Yu, Bin Hu, Zhiguo Wang

Subjects: Get full text

Visual Question Answering in Robotic Surgery: A Comprehensive Review by Di Ding, Tianliang Yao, Rong Luo, Xusen Sun

Subjects: Get full text

Efficient Moving Object Segmentation in LiDAR Point Clouds Using Minimal Number of Sweeps by Zoltan Rozsa, Akos Madaras, Tamas Sziranyi

“…Our approach is based on a multimodal learning model with single-modal inference. The model is trained on a dataset of LiDAR point clouds and related camera images. …”
Get full text

Exploring the Multimodal Approach in Pre-Service Chemistry Teacher Education: Perspective from Students and Lecturers by Marfuatun Marfuatun, Nahadi Nahadi, Galuh Yuliani, Hernani Hernani

“…The results show that most pre-service chemistry teachers have a multimodal learning style. However, the application of the multimodal approach in chemistry courses has not been extensively implemented due to several challenges. …”
Get full text

Learning Analytics and Educational Data Mining in Augmented Reality, Virtual Reality, and the Metaverse: A Systematic Literature Review, Content Analysis, and Bibliometric Analysis by Georgios Lampropoulos, Georgios Evangelidis

“…The real-time identification, tracking, monitoring, analysis, and visualization of multimodal learning data of students’ behavior, emotions, cognitive and affective states and the overall learning and teaching processes emerged as a significant benefit that contributes greatly to the realization of adaptive and personalized learning. …”
Get full text

Developing a Machine Learning–Based Automated Patient Engagement Estimator for Telehealth: Algorithm Development and Validation Study by Pooja Guhan, Naman Awasthi, Kathryn McDonald, Kristin Bussell, Gloria Reeves, Dinesh Manocha, Aniket Bera

“…MethodsWe proposed a multimodal learning-based approach. We uniquely leveraged latent vectors corresponding to affective and cognitive features frequently used in psychology literature to understand a person’s level of engagement. …”
Get full text