A visual-physiology multimodal system for detecting outlier behavior of participants in a reality TV show
This study proposes an outlier detection system based on the visual-physiology multimodal data system for a Korean reality TV show, “Perfect on Paper.” The goal of this system is to provide the program production team and the master of ceremonies with real-time facial expressions and bio-signal anal...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2019-07-01
|
| Series: | International Journal of Distributed Sensor Networks |
| Online Access: | https://doi.org/10.1177/1550147719864886 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832547285343404032 |
|---|---|
| author | Shinjin Kang Donggyun Kim Youngbin Kim |
| author_facet | Shinjin Kang Donggyun Kim Youngbin Kim |
| author_sort | Shinjin Kang |
| collection | DOAJ |
| description | This study proposes an outlier detection system based on the visual-physiology multimodal data system for a Korean reality TV show, “Perfect on Paper.” The goal of this system is to provide the program production team and the master of ceremonies with real-time facial expressions and bio-signal analysis results of program participants. Using this information, the program production team and master of ceremonies can easily identify the participants with unusual behavior. We propose an insole-type hardware that measures the wearer’s skin conductivity, temperature, and motion. We also suggest a dynamic time warp-based clustering algorithm for the outlier and micro-expression detection technique. The system was developed starting from the program planning phase through a 6-month period in collaboration with the production team. The developed system analyzed the biometric information and facial expressions of 88 participants in 11 episodes and provided rapid feedback to the production team at the shooting spot in real time. Finally, we present a case where a visual-physiology multimodal system can be useful for a real TV broadcasting production. |
| format | Article |
| id | doaj-art-591dc1dbd17d4b91a3113bf07cdc2059 |
| institution | Kabale University |
| issn | 1550-1477 |
| language | English |
| publishDate | 2019-07-01 |
| publisher | Wiley |
| record_format | Article |
| series | International Journal of Distributed Sensor Networks |
| spelling | doaj-art-591dc1dbd17d4b91a3113bf07cdc20592025-02-03T06:45:23ZengWileyInternational Journal of Distributed Sensor Networks1550-14772019-07-011510.1177/1550147719864886A visual-physiology multimodal system for detecting outlier behavior of participants in a reality TV showShinjin Kang0Donggyun Kim1Youngbin Kim2School of Games, Hongik University, KoreaSchool of Games, Hongik University, KoreaThe Graduate School of Advanced Imaging Science, Multimedia & Film, Chung-Ang University, Seoul, KoreaThis study proposes an outlier detection system based on the visual-physiology multimodal data system for a Korean reality TV show, “Perfect on Paper.” The goal of this system is to provide the program production team and the master of ceremonies with real-time facial expressions and bio-signal analysis results of program participants. Using this information, the program production team and master of ceremonies can easily identify the participants with unusual behavior. We propose an insole-type hardware that measures the wearer’s skin conductivity, temperature, and motion. We also suggest a dynamic time warp-based clustering algorithm for the outlier and micro-expression detection technique. The system was developed starting from the program planning phase through a 6-month period in collaboration with the production team. The developed system analyzed the biometric information and facial expressions of 88 participants in 11 episodes and provided rapid feedback to the production team at the shooting spot in real time. Finally, we present a case where a visual-physiology multimodal system can be useful for a real TV broadcasting production.https://doi.org/10.1177/1550147719864886 |
| spellingShingle | Shinjin Kang Donggyun Kim Youngbin Kim A visual-physiology multimodal system for detecting outlier behavior of participants in a reality TV show International Journal of Distributed Sensor Networks |
| title | A visual-physiology multimodal system for detecting outlier behavior of participants in a reality TV show |
| title_full | A visual-physiology multimodal system for detecting outlier behavior of participants in a reality TV show |
| title_fullStr | A visual-physiology multimodal system for detecting outlier behavior of participants in a reality TV show |
| title_full_unstemmed | A visual-physiology multimodal system for detecting outlier behavior of participants in a reality TV show |
| title_short | A visual-physiology multimodal system for detecting outlier behavior of participants in a reality TV show |
| title_sort | visual physiology multimodal system for detecting outlier behavior of participants in a reality tv show |
| url | https://doi.org/10.1177/1550147719864886 |
| work_keys_str_mv | AT shinjinkang avisualphysiologymultimodalsystemfordetectingoutlierbehaviorofparticipantsinarealitytvshow AT donggyunkim avisualphysiologymultimodalsystemfordetectingoutlierbehaviorofparticipantsinarealitytvshow AT youngbinkim avisualphysiologymultimodalsystemfordetectingoutlierbehaviorofparticipantsinarealitytvshow AT shinjinkang visualphysiologymultimodalsystemfordetectingoutlierbehaviorofparticipantsinarealitytvshow AT donggyunkim visualphysiologymultimodalsystemfordetectingoutlierbehaviorofparticipantsinarealitytvshow AT youngbinkim visualphysiologymultimodalsystemfordetectingoutlierbehaviorofparticipantsinarealitytvshow |