Automated strabismus detection and classification using deep learning analysis of facial images

Abstract Strabismus, or eye misalignment, is a common condition affecting individuals of all ages. Early detection and accurate classification are essential for proper treatment and avoiding long-term complications. This research presents a new deep-learning-based approach for automatically identify...

Full description

Saved in:
Bibliographic Details
Main Authors: Mahsa Yarkheir, Motahhareh Sadeghi, Hamed Azarnoush, Mohammad Reza Akbari, Elias Khalili Pour
Format: Article
Language:English
Published: Nature Portfolio 2025-01-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-025-88154-6
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832571847305068544
author Mahsa Yarkheir
Motahhareh Sadeghi
Hamed Azarnoush
Mohammad Reza Akbari
Elias Khalili Pour
author_facet Mahsa Yarkheir
Motahhareh Sadeghi
Hamed Azarnoush
Mohammad Reza Akbari
Elias Khalili Pour
author_sort Mahsa Yarkheir
collection DOAJ
description Abstract Strabismus, or eye misalignment, is a common condition affecting individuals of all ages. Early detection and accurate classification are essential for proper treatment and avoiding long-term complications. This research presents a new deep-learning-based approach for automatically identifying and classifying strabismus from facial images. The proposed methodology leverages Convolutional Neural Networks (CNNs) to achieve high accuracy in both binary (strabismus vs. normal) and multi-class (eight-class deviation angle for esotropia and exotropia) classification tasks. The dataset for binary classification consisted of 4,257 facial images, including 1,599 normal cases and 2,658 strabismus cases, while the multi-class classification involved 480 strabismic and 142 non-strabismic images. These images were labeled based on ophthalmologist measurements using the Alternate Prism Cover Test (APCT) or the Modified Krimsky Test (MK). Five-fold cross-validation was employed, and performance was evaluated using sensitivity, accuracy, F1-score, and recall metrics. The proposed deep learning model achieved an accuracy of 86.38% for binary classification and 92.7% for multi-class classification. These results demonstrate the potential of our approach to assist healthcare professionals in early strabismus detection and treatment planning, ultimately improving patient outcomes.
format Article
id doaj-art-331c2eeaea8f452781762cb1a43f2240
institution Kabale University
issn 2045-2322
language English
publishDate 2025-01-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj-art-331c2eeaea8f452781762cb1a43f22402025-02-02T12:15:42ZengNature PortfolioScientific Reports2045-23222025-01-0115111010.1038/s41598-025-88154-6Automated strabismus detection and classification using deep learning analysis of facial imagesMahsa Yarkheir0Motahhareh Sadeghi1Hamed Azarnoush2Mohammad Reza Akbari3Elias Khalili Pour4Biomedical Engineering Department, Amirkabir University of Technology (Tehran Polytechnic)Farabi Eye Hospital, Tehran University of Medical SciencesBiomedical Engineering Department, Amirkabir University of Technology (Tehran Polytechnic)Farabi Eye Hospital, Tehran University of Medical SciencesFarabi Eye Hospital, Tehran University of Medical SciencesAbstract Strabismus, or eye misalignment, is a common condition affecting individuals of all ages. Early detection and accurate classification are essential for proper treatment and avoiding long-term complications. This research presents a new deep-learning-based approach for automatically identifying and classifying strabismus from facial images. The proposed methodology leverages Convolutional Neural Networks (CNNs) to achieve high accuracy in both binary (strabismus vs. normal) and multi-class (eight-class deviation angle for esotropia and exotropia) classification tasks. The dataset for binary classification consisted of 4,257 facial images, including 1,599 normal cases and 2,658 strabismus cases, while the multi-class classification involved 480 strabismic and 142 non-strabismic images. These images were labeled based on ophthalmologist measurements using the Alternate Prism Cover Test (APCT) or the Modified Krimsky Test (MK). Five-fold cross-validation was employed, and performance was evaluated using sensitivity, accuracy, F1-score, and recall metrics. The proposed deep learning model achieved an accuracy of 86.38% for binary classification and 92.7% for multi-class classification. These results demonstrate the potential of our approach to assist healthcare professionals in early strabismus detection and treatment planning, ultimately improving patient outcomes.https://doi.org/10.1038/s41598-025-88154-6
spellingShingle Mahsa Yarkheir
Motahhareh Sadeghi
Hamed Azarnoush
Mohammad Reza Akbari
Elias Khalili Pour
Automated strabismus detection and classification using deep learning analysis of facial images
Scientific Reports
title Automated strabismus detection and classification using deep learning analysis of facial images
title_full Automated strabismus detection and classification using deep learning analysis of facial images
title_fullStr Automated strabismus detection and classification using deep learning analysis of facial images
title_full_unstemmed Automated strabismus detection and classification using deep learning analysis of facial images
title_short Automated strabismus detection and classification using deep learning analysis of facial images
title_sort automated strabismus detection and classification using deep learning analysis of facial images
url https://doi.org/10.1038/s41598-025-88154-6
work_keys_str_mv AT mahsayarkheir automatedstrabismusdetectionandclassificationusingdeeplearninganalysisoffacialimages
AT motahharehsadeghi automatedstrabismusdetectionandclassificationusingdeeplearninganalysisoffacialimages
AT hamedazarnoush automatedstrabismusdetectionandclassificationusingdeeplearninganalysisoffacialimages
AT mohammadrezaakbari automatedstrabismusdetectionandclassificationusingdeeplearninganalysisoffacialimages
AT eliaskhalilipour automatedstrabismusdetectionandclassificationusingdeeplearninganalysisoffacialimages