Integrating lightweight YOLOv5s and facial 3D keypoints for enhanced fatigued-driving detection
Several factors cause vehicle accidents during driving, such as driver negligence, drowsiness, and fatigue. These accidents can be prevented if drivers receive timely warnings. Additionally, recent advancements in computer vision and artificial intelligence (AI) have enabled the monitoring of driver...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
PeerJ Inc.
2024-12-01
|
| Series: | PeerJ Computer Science |
| Subjects: | |
| Online Access: | https://peerj.com/articles/cs-2447.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850136157419995136 |
|---|---|
| author | Mohan Arava Divya Meena Sundaram |
| author_facet | Mohan Arava Divya Meena Sundaram |
| author_sort | Mohan Arava |
| collection | DOAJ |
| description | Several factors cause vehicle accidents during driving, such as driver negligence, drowsiness, and fatigue. These accidents can be prevented if drivers receive timely warnings. Additionally, recent advancements in computer vision and artificial intelligence (AI) have enabled the monitoring of drivers and the ability to alert them when they are not focused on driving. AI techniques can analyse key facial features, such as eye closure, yawning, and head movements, to assess the driver’s level of sleepiness. In response to the growing concerns surrounding drowsy driving and its potential safety hazards, this study presents a comprehensive approach for detecting a driver’s attention state using an enhanced version of the You Only Look Once (YOLOv5) algorithm. By leveraging critical facial landmarks and calculating the eye and mouth aspect ratios, the method effectively identifies signs of fatigue by establishing threshold values indicative of closed eyes and yawning. This work introduces an advanced YOLOv5 model integrated with Swin Transformer modules in the feature fusion network and refined backbone network feature extraction to detect driver drowsiness. Additionally, a real-time fatigued-driving detection model, built on an improved YOLOv5s architecture and incorporating Attention Mesh 3D key points, demonstrates superior effectiveness over conventional models. The proposed method achieves a notable 2.4% enhancement in mean average precision (mAP) compared to the baseline model through extensive experimentation on benchmark datasets. By combining YOLOv5 with facial 3D landmarks, the system benefits from the complementary strengths of both techniques, leading to more accurate and robust detection of fatigue-related cues and ultimately mitigating accidents caused by drowsy driving. |
| format | Article |
| id | doaj-art-7e110b2a18cc4300aeb7b7ab76a2eec0 |
| institution | OA Journals |
| issn | 2376-5992 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | PeerJ Inc. |
| record_format | Article |
| series | PeerJ Computer Science |
| spelling | doaj-art-7e110b2a18cc4300aeb7b7ab76a2eec02025-08-20T02:31:12ZengPeerJ Inc.PeerJ Computer Science2376-59922024-12-0110e244710.7717/peerj-cs.2447Integrating lightweight YOLOv5s and facial 3D keypoints for enhanced fatigued-driving detectionMohan AravaDivya Meena SundaramSeveral factors cause vehicle accidents during driving, such as driver negligence, drowsiness, and fatigue. These accidents can be prevented if drivers receive timely warnings. Additionally, recent advancements in computer vision and artificial intelligence (AI) have enabled the monitoring of drivers and the ability to alert them when they are not focused on driving. AI techniques can analyse key facial features, such as eye closure, yawning, and head movements, to assess the driver’s level of sleepiness. In response to the growing concerns surrounding drowsy driving and its potential safety hazards, this study presents a comprehensive approach for detecting a driver’s attention state using an enhanced version of the You Only Look Once (YOLOv5) algorithm. By leveraging critical facial landmarks and calculating the eye and mouth aspect ratios, the method effectively identifies signs of fatigue by establishing threshold values indicative of closed eyes and yawning. This work introduces an advanced YOLOv5 model integrated with Swin Transformer modules in the feature fusion network and refined backbone network feature extraction to detect driver drowsiness. Additionally, a real-time fatigued-driving detection model, built on an improved YOLOv5s architecture and incorporating Attention Mesh 3D key points, demonstrates superior effectiveness over conventional models. The proposed method achieves a notable 2.4% enhancement in mean average precision (mAP) compared to the baseline model through extensive experimentation on benchmark datasets. By combining YOLOv5 with facial 3D landmarks, the system benefits from the complementary strengths of both techniques, leading to more accurate and robust detection of fatigue-related cues and ultimately mitigating accidents caused by drowsy driving.https://peerj.com/articles/cs-2447.pdfDriver drowsinessImproved YOLOv5sAttention Mesh3D keypointSWIN Transformer |
| spellingShingle | Mohan Arava Divya Meena Sundaram Integrating lightweight YOLOv5s and facial 3D keypoints for enhanced fatigued-driving detection PeerJ Computer Science Driver drowsiness Improved YOLOv5s Attention Mesh 3D keypoint SWIN Transformer |
| title | Integrating lightweight YOLOv5s and facial 3D keypoints for enhanced fatigued-driving detection |
| title_full | Integrating lightweight YOLOv5s and facial 3D keypoints for enhanced fatigued-driving detection |
| title_fullStr | Integrating lightweight YOLOv5s and facial 3D keypoints for enhanced fatigued-driving detection |
| title_full_unstemmed | Integrating lightweight YOLOv5s and facial 3D keypoints for enhanced fatigued-driving detection |
| title_short | Integrating lightweight YOLOv5s and facial 3D keypoints for enhanced fatigued-driving detection |
| title_sort | integrating lightweight yolov5s and facial 3d keypoints for enhanced fatigued driving detection |
| topic | Driver drowsiness Improved YOLOv5s Attention Mesh 3D keypoint SWIN Transformer |
| url | https://peerj.com/articles/cs-2447.pdf |
| work_keys_str_mv | AT mohanarava integratinglightweightyolov5sandfacial3dkeypointsforenhancedfatigueddrivingdetection AT divyameenasundaram integratinglightweightyolov5sandfacial3dkeypointsforenhancedfatigueddrivingdetection |