A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy

Research studies on machine vision-based driver fatigue detection algorithm have improved traffic safety significantly. Generally, many algorithms asses the driving state according to limited video frames, thus resulting in some inaccuracy. We propose a real-time detection algorithm involved in info...

Full description

Saved in:
Bibliographic Details
Main Authors: Feng You, Yunbo Gong, Haiqing Tu, Jianzhong Liang, Haiwei Wang
Format: Article
Language:English
Published: Wiley 2020-01-01
Series:Journal of Advanced Transportation
Online Access:http://dx.doi.org/10.1155/2020/8851485
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832550833091248128
author Feng You
Yunbo Gong
Haiqing Tu
Jianzhong Liang
Haiwei Wang
author_facet Feng You
Yunbo Gong
Haiqing Tu
Jianzhong Liang
Haiwei Wang
author_sort Feng You
collection DOAJ
description Research studies on machine vision-based driver fatigue detection algorithm have improved traffic safety significantly. Generally, many algorithms asses the driving state according to limited video frames, thus resulting in some inaccuracy. We propose a real-time detection algorithm involved in information entropy. Particularly, this algorithm relies on the analysis of sufficient consecutive video frames. First, we introduce an improved YOLOv3-tiny convolutional neural network to capture the facial regions under complex driving conditions, eliminating the inaccuracy and affections caused by artificial feature extraction. Second, we construct a geometric area called Face Feature Triangle (FFT) based on the application of the Dlib toolkit as well as the landmarks and the coordinates of the facial regions; then we create a Face Feature Vector (FFV), which contains all the information of the area and centroid of each FFT. We use FFV as an indicator to determine whether the driver is in fatigue state. Finally, we design a sliding window to get the facial information entropy. Comparative experiments show that our algorithm performs better than the current ones on both accuracy and real-time performance. In simulated driving applications, the proposed algorithm detects the fatigue state at a speed of over 20 fps with an accuracy of 94.32%.
format Article
id doaj-art-5e5cdda93e1b421fa1efaa9218e06f6f
institution Kabale University
issn 0197-6729
2042-3195
language English
publishDate 2020-01-01
publisher Wiley
record_format Article
series Journal of Advanced Transportation
spelling doaj-art-5e5cdda93e1b421fa1efaa9218e06f6f2025-02-03T06:05:41ZengWileyJournal of Advanced Transportation0197-67292042-31952020-01-01202010.1155/2020/88514858851485A Fatigue Driving Detection Algorithm Based on Facial Motion Information EntropyFeng You0Yunbo Gong1Haiqing Tu2Jianzhong Liang3Haiwei Wang4School of Civil Engineering and Transportation, South China University of Technology, Guangzhou 510640, ChinaSchool of Civil Engineering and Transportation, South China University of Technology, Guangzhou 510640, ChinaSchool of Civil Engineering and Transportation, South China University of Technology, Guangzhou 510640, ChinaSchool of Civil Engineering and Transportation, South China University of Technology, Guangzhou 510640, ChinaSchool of Transportation and Economic Management, Guangdong Communication Polytechnic, Guangzhou 510650, ChinaResearch studies on machine vision-based driver fatigue detection algorithm have improved traffic safety significantly. Generally, many algorithms asses the driving state according to limited video frames, thus resulting in some inaccuracy. We propose a real-time detection algorithm involved in information entropy. Particularly, this algorithm relies on the analysis of sufficient consecutive video frames. First, we introduce an improved YOLOv3-tiny convolutional neural network to capture the facial regions under complex driving conditions, eliminating the inaccuracy and affections caused by artificial feature extraction. Second, we construct a geometric area called Face Feature Triangle (FFT) based on the application of the Dlib toolkit as well as the landmarks and the coordinates of the facial regions; then we create a Face Feature Vector (FFV), which contains all the information of the area and centroid of each FFT. We use FFV as an indicator to determine whether the driver is in fatigue state. Finally, we design a sliding window to get the facial information entropy. Comparative experiments show that our algorithm performs better than the current ones on both accuracy and real-time performance. In simulated driving applications, the proposed algorithm detects the fatigue state at a speed of over 20 fps with an accuracy of 94.32%.http://dx.doi.org/10.1155/2020/8851485
spellingShingle Feng You
Yunbo Gong
Haiqing Tu
Jianzhong Liang
Haiwei Wang
A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy
Journal of Advanced Transportation
title A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy
title_full A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy
title_fullStr A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy
title_full_unstemmed A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy
title_short A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy
title_sort fatigue driving detection algorithm based on facial motion information entropy
url http://dx.doi.org/10.1155/2020/8851485
work_keys_str_mv AT fengyou afatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy
AT yunbogong afatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy
AT haiqingtu afatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy
AT jianzhongliang afatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy
AT haiweiwang afatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy
AT fengyou fatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy
AT yunbogong fatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy
AT haiqingtu fatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy
AT jianzhongliang fatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy
AT haiweiwang fatiguedrivingdetectionalgorithmbasedonfacialmotioninformationentropy