Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches

We report current findings when considering video recordings of facial expressions and body movements to provide affective personalized support in an educational context from an enriched multimodal emotion detection approach. In particular, we describe an annotation methodology to tag facial express...

Full description

Saved in:
Bibliographic Details
Main Authors: Mar Saneiro, Olga C. Santos, Sergio Salmeron-Majadas, Jesus G. Boticario
Format: Article
Language:English
Published: Wiley 2014-01-01
Series:The Scientific World Journal
Online Access:http://dx.doi.org/10.1155/2014/484873
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832564295935721472
author Mar Saneiro
Olga C. Santos
Sergio Salmeron-Majadas
Jesus G. Boticario
author_facet Mar Saneiro
Olga C. Santos
Sergio Salmeron-Majadas
Jesus G. Boticario
author_sort Mar Saneiro
collection DOAJ
description We report current findings when considering video recordings of facial expressions and body movements to provide affective personalized support in an educational context from an enriched multimodal emotion detection approach. In particular, we describe an annotation methodology to tag facial expression and body movements that conform to changes in the affective states of learners while dealing with cognitive tasks in a learning process. The ultimate goal is to combine these annotations with additional affective information collected during experimental learning sessions from different sources such as qualitative, self-reported, physiological, and behavioral information. These data altogether are to train data mining algorithms that serve to automatically identify changes in the learners’ affective states when dealing with cognitive tasks which help to provide emotional personalized support.
format Article
id doaj-art-d3fb2ec7a1b94c56ae17f599fbd08e1e
institution Kabale University
issn 2356-6140
1537-744X
language English
publishDate 2014-01-01
publisher Wiley
record_format Article
series The Scientific World Journal
spelling doaj-art-d3fb2ec7a1b94c56ae17f599fbd08e1e2025-02-03T01:11:26ZengWileyThe Scientific World Journal2356-61401537-744X2014-01-01201410.1155/2014/484873484873Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal ApproachesMar Saneiro0Olga C. Santos1Sergio Salmeron-Majadas2Jesus G. Boticario3aDeNu Research Group, Artificial Intelligence Department, UNED, Calle Juan del Rosal 16, 28040 Madrid, SpainaDeNu Research Group, Artificial Intelligence Department, UNED, Calle Juan del Rosal 16, 28040 Madrid, SpainaDeNu Research Group, Artificial Intelligence Department, UNED, Calle Juan del Rosal 16, 28040 Madrid, SpainaDeNu Research Group, Artificial Intelligence Department, UNED, Calle Juan del Rosal 16, 28040 Madrid, SpainWe report current findings when considering video recordings of facial expressions and body movements to provide affective personalized support in an educational context from an enriched multimodal emotion detection approach. In particular, we describe an annotation methodology to tag facial expression and body movements that conform to changes in the affective states of learners while dealing with cognitive tasks in a learning process. The ultimate goal is to combine these annotations with additional affective information collected during experimental learning sessions from different sources such as qualitative, self-reported, physiological, and behavioral information. These data altogether are to train data mining algorithms that serve to automatically identify changes in the learners’ affective states when dealing with cognitive tasks which help to provide emotional personalized support.http://dx.doi.org/10.1155/2014/484873
spellingShingle Mar Saneiro
Olga C. Santos
Sergio Salmeron-Majadas
Jesus G. Boticario
Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches
The Scientific World Journal
title Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches
title_full Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches
title_fullStr Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches
title_full_unstemmed Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches
title_short Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches
title_sort towards emotion detection in educational scenarios from facial expressions and body movements through multimodal approaches
url http://dx.doi.org/10.1155/2014/484873
work_keys_str_mv AT marsaneiro towardsemotiondetectionineducationalscenariosfromfacialexpressionsandbodymovementsthroughmultimodalapproaches
AT olgacsantos towardsemotiondetectionineducationalscenariosfromfacialexpressionsandbodymovementsthroughmultimodalapproaches
AT sergiosalmeronmajadas towardsemotiondetectionineducationalscenariosfromfacialexpressionsandbodymovementsthroughmultimodalapproaches
AT jesusgboticario towardsemotiondetectionineducationalscenariosfromfacialexpressionsandbodymovementsthroughmultimodalapproaches