Proposing a Recognition System of Gestures Using MobilenetV2 Combining Single Shot Detector Network for Smart-Home Applications

The paper proposes a system for identifying gestures and actions in smart homes. The proposed method is based on MobilenetV2 feature extraction combining with single shot detector (SSD) network. We used eleven types of gestures of walking, sitting down, falling back, wearing shoes, waving hands, fal...

Full description

Saved in:
Bibliographic Details
Main Authors: Phat Nguyen Huu, Huong Nguyen Thi Thu, Quang Tran Minh
Format: Article
Language:English
Published: Wiley 2021-01-01
Series:Journal of Electrical and Computer Engineering
Online Access:http://dx.doi.org/10.1155/2021/6610461
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832566029805420544
author Phat Nguyen Huu
Huong Nguyen Thi Thu
Quang Tran Minh
author_facet Phat Nguyen Huu
Huong Nguyen Thi Thu
Quang Tran Minh
author_sort Phat Nguyen Huu
collection DOAJ
description The paper proposes a system for identifying gestures and actions in smart homes. The proposed method is based on MobilenetV2 feature extraction combining with single shot detector (SSD) network. We used eleven types of gestures of walking, sitting down, falling back, wearing shoes, waving hands, falling down, smoking, baby crawling, standing up, reading, and typing for recognizing the gestures. In this system, the data are captured from the camera of mobile devices that are used to detect the object. The results are obtained objects on the frame by a bounding box. The results show that the system meets the requirements with an accuracy of over 90% that is suitable for real application.
format Article
id doaj-art-e0179080b66f4cc3b8d64f6b091234f5
institution Kabale University
issn 2090-0147
2090-0155
language English
publishDate 2021-01-01
publisher Wiley
record_format Article
series Journal of Electrical and Computer Engineering
spelling doaj-art-e0179080b66f4cc3b8d64f6b091234f52025-02-03T01:05:26ZengWileyJournal of Electrical and Computer Engineering2090-01472090-01552021-01-01202110.1155/2021/66104616610461Proposing a Recognition System of Gestures Using MobilenetV2 Combining Single Shot Detector Network for Smart-Home ApplicationsPhat Nguyen Huu0Huong Nguyen Thi Thu1Quang Tran Minh2School of Electronics and Telecommunications, Hanoi University of Science and Technology, Hanoi, VietnamSchool of Electronics and Telecommunications, Hanoi University of Science and Technology, Hanoi, VietnamDepartment of Information Systems, Faculty of Computer Science and Engineering, Ho Chi Minh City University of Technology (HCMUT), 268 Ly Thuong Kiet, District 10, Ho Chi Minh, VietnamThe paper proposes a system for identifying gestures and actions in smart homes. The proposed method is based on MobilenetV2 feature extraction combining with single shot detector (SSD) network. We used eleven types of gestures of walking, sitting down, falling back, wearing shoes, waving hands, falling down, smoking, baby crawling, standing up, reading, and typing for recognizing the gestures. In this system, the data are captured from the camera of mobile devices that are used to detect the object. The results are obtained objects on the frame by a bounding box. The results show that the system meets the requirements with an accuracy of over 90% that is suitable for real application.http://dx.doi.org/10.1155/2021/6610461
spellingShingle Phat Nguyen Huu
Huong Nguyen Thi Thu
Quang Tran Minh
Proposing a Recognition System of Gestures Using MobilenetV2 Combining Single Shot Detector Network for Smart-Home Applications
Journal of Electrical and Computer Engineering
title Proposing a Recognition System of Gestures Using MobilenetV2 Combining Single Shot Detector Network for Smart-Home Applications
title_full Proposing a Recognition System of Gestures Using MobilenetV2 Combining Single Shot Detector Network for Smart-Home Applications
title_fullStr Proposing a Recognition System of Gestures Using MobilenetV2 Combining Single Shot Detector Network for Smart-Home Applications
title_full_unstemmed Proposing a Recognition System of Gestures Using MobilenetV2 Combining Single Shot Detector Network for Smart-Home Applications
title_short Proposing a Recognition System of Gestures Using MobilenetV2 Combining Single Shot Detector Network for Smart-Home Applications
title_sort proposing a recognition system of gestures using mobilenetv2 combining single shot detector network for smart home applications
url http://dx.doi.org/10.1155/2021/6610461
work_keys_str_mv AT phatnguyenhuu proposingarecognitionsystemofgesturesusingmobilenetv2combiningsingleshotdetectornetworkforsmarthomeapplications
AT huongnguyenthithu proposingarecognitionsystemofgesturesusingmobilenetv2combiningsingleshotdetectornetworkforsmarthomeapplications
AT quangtranminh proposingarecognitionsystemofgesturesusingmobilenetv2combiningsingleshotdetectornetworkforsmarthomeapplications