Bringing Intelligence to SAR Missions: A Comprehensive Dataset and Evaluation of YOLO for Human Detection in TIR Images

Effective search and rescue (SAR) missions are critical for locating and assisting injured or missing individuals while optimizing resource allocation and minimizing costs. This work aims to enhance the efficiency of these missions by exploring advanced deep learning techniques for precise and effic...

Full description

Saved in:
Bibliographic Details
Main Authors: Mostafa Rizk, Israa Bayad
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10840181/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832576782173208576
author Mostafa Rizk
Israa Bayad
author_facet Mostafa Rizk
Israa Bayad
author_sort Mostafa Rizk
collection DOAJ
description Effective search and rescue (SAR) missions are critical for locating and assisting injured or missing individuals while optimizing resource allocation and minimizing costs. This work aims to enhance the efficiency of these missions by exploring advanced deep learning techniques for precise and efficient human detection in thermal images. The primary focus of this work is on YOLOv8, the latest version of the You Only Look Once (YOLO) object detection method. The paper also evaluates YOLOv7-Tiny, which is the most streamlined variant derived from YOLOv7. To support the investigation, a novel dataset comprising 17,148 thermal images with 90,882 instances of human subjects representing various conditions and scenarios has been carefully curated. This dataset is used for training and evaluating different variants of YOLOv8 and YOLOv7. The evaluation of the trained models reveals the efficacy of YOLOv8 in detecting humans in thermal images, achieving an average precision rate of 95% with the largest model, YOLOv8x, and an average precision rate of 91% with the smallest model, YOLOv8n. The evaluation of YOLOv7-Tiny shows that it achieves an average precision similar to YOLOv8n, which is 48% lighter in size and more practical choice for real-world deployment. Also, the trained models are deployed on graphical processing units. The tiniest trained model, YOLOv8n, achieves an inference rate of 273.6 frames per second (FPS) while the largest model, YOLOv8, achieves an inference rate of 100.29 FPS. The achieved inference rates along with the achieved detection performances meet with the requirement of fast detection of humans in SAR missions.
format Article
id doaj-art-c29e237f25894c469a4b449210e9a404
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-c29e237f25894c469a4b449210e9a4042025-01-31T00:01:29ZengIEEEIEEE Access2169-35362025-01-0113172081723510.1109/ACCESS.2025.352948410840181Bringing Intelligence to SAR Missions: A Comprehensive Dataset and Evaluation of YOLO for Human Detection in TIR ImagesMostafa Rizk0https://orcid.org/0000-0003-3827-7534Israa Bayad1School of Engineering, Lebanese International University, Beirut, LebanonFaculty of Sciences, Lebanese University, Beirut, LebanonEffective search and rescue (SAR) missions are critical for locating and assisting injured or missing individuals while optimizing resource allocation and minimizing costs. This work aims to enhance the efficiency of these missions by exploring advanced deep learning techniques for precise and efficient human detection in thermal images. The primary focus of this work is on YOLOv8, the latest version of the You Only Look Once (YOLO) object detection method. The paper also evaluates YOLOv7-Tiny, which is the most streamlined variant derived from YOLOv7. To support the investigation, a novel dataset comprising 17,148 thermal images with 90,882 instances of human subjects representing various conditions and scenarios has been carefully curated. This dataset is used for training and evaluating different variants of YOLOv8 and YOLOv7. The evaluation of the trained models reveals the efficacy of YOLOv8 in detecting humans in thermal images, achieving an average precision rate of 95% with the largest model, YOLOv8x, and an average precision rate of 91% with the smallest model, YOLOv8n. The evaluation of YOLOv7-Tiny shows that it achieves an average precision similar to YOLOv8n, which is 48% lighter in size and more practical choice for real-world deployment. Also, the trained models are deployed on graphical processing units. The tiniest trained model, YOLOv8n, achieves an inference rate of 273.6 frames per second (FPS) while the largest model, YOLOv8, achieves an inference rate of 100.29 FPS. The achieved inference rates along with the achieved detection performances meet with the requirement of fast detection of humans in SAR missions.https://ieeexplore.ieee.org/document/10840181/Thermal imagesobject detectiondeep learningconvolutional neural networksYOLOhuman detection
spellingShingle Mostafa Rizk
Israa Bayad
Bringing Intelligence to SAR Missions: A Comprehensive Dataset and Evaluation of YOLO for Human Detection in TIR Images
IEEE Access
Thermal images
object detection
deep learning
convolutional neural networks
YOLO
human detection
title Bringing Intelligence to SAR Missions: A Comprehensive Dataset and Evaluation of YOLO for Human Detection in TIR Images
title_full Bringing Intelligence to SAR Missions: A Comprehensive Dataset and Evaluation of YOLO for Human Detection in TIR Images
title_fullStr Bringing Intelligence to SAR Missions: A Comprehensive Dataset and Evaluation of YOLO for Human Detection in TIR Images
title_full_unstemmed Bringing Intelligence to SAR Missions: A Comprehensive Dataset and Evaluation of YOLO for Human Detection in TIR Images
title_short Bringing Intelligence to SAR Missions: A Comprehensive Dataset and Evaluation of YOLO for Human Detection in TIR Images
title_sort bringing intelligence to sar missions a comprehensive dataset and evaluation of yolo for human detection in tir images
topic Thermal images
object detection
deep learning
convolutional neural networks
YOLO
human detection
url https://ieeexplore.ieee.org/document/10840181/
work_keys_str_mv AT mostafarizk bringingintelligencetosarmissionsacomprehensivedatasetandevaluationofyoloforhumandetectionintirimages
AT israabayad bringingintelligencetosarmissionsacomprehensivedatasetandevaluationofyoloforhumandetectionintirimages