Cross-Camera External Validation for Artificial Intelligence Software in Diagnosis of Diabetic Retinopathy

Aims. To investigate the applicability of deep learning image assessment software VeriSee DR to different color fundus cameras for the screening of diabetic retinopathy (DR). Methods. Color fundus images of diabetes patients taken with three different nonmydriatic fundus cameras, including 477 Topco...

Full description

Saved in:
Bibliographic Details
Main Authors: Meng-Ju Tsai, Yi-Ting Hsieh, Chin-Han Tsai, Mingke Chen, An-Tsz Hsieh, Chung-Wen Tsai, Min-Ling Chen
Format: Article
Language:English
Published: Wiley 2022-01-01
Series:Journal of Diabetes Research
Online Access:http://dx.doi.org/10.1155/2022/5779276
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832563925048098816
author Meng-Ju Tsai
Yi-Ting Hsieh
Chin-Han Tsai
Mingke Chen
An-Tsz Hsieh
Chung-Wen Tsai
Min-Ling Chen
author_facet Meng-Ju Tsai
Yi-Ting Hsieh
Chin-Han Tsai
Mingke Chen
An-Tsz Hsieh
Chung-Wen Tsai
Min-Ling Chen
author_sort Meng-Ju Tsai
collection DOAJ
description Aims. To investigate the applicability of deep learning image assessment software VeriSee DR to different color fundus cameras for the screening of diabetic retinopathy (DR). Methods. Color fundus images of diabetes patients taken with three different nonmydriatic fundus cameras, including 477 Topcon TRC-NW400, 459 Topcon TRC-NW8 series, and 471 Kowa nonmyd 8 series that were judged as “gradable” by one ophthalmologist were enrolled for validation. VeriSee DR was then used for the diagnosis of referable DR according to the International Clinical Diabetic Retinopathy Disease Severity Scale. Gradability, sensitivity, and specificity were calculated for each camera model. Results. All images (100%) from the three camera models were gradable for VeriSee DR. The sensitivity for diagnosing referable DR in the TRC-NW400, TRC-NW8, and non-myd 8 series was 89.3%, 94.6%, and 95.7%, respectively, while the specificity was 94.2%, 90.4%, and 89.3%, respectively. Neither the sensitivity nor the specificity differed significantly between these camera models and the original camera model used for VeriSee DR development (p=0.40, p=0.065, respectively). Conclusions. VeriSee DR was applicable to a variety of color fundus cameras with 100% agreement with ophthalmologists in terms of gradability and good sensitivity and specificity for the diagnosis of referable DR.
format Article
id doaj-art-80988dd7a1ee4bdd99255947a637eae7
institution Kabale University
issn 2314-6753
language English
publishDate 2022-01-01
publisher Wiley
record_format Article
series Journal of Diabetes Research
spelling doaj-art-80988dd7a1ee4bdd99255947a637eae72025-02-03T01:12:14ZengWileyJournal of Diabetes Research2314-67532022-01-01202210.1155/2022/5779276Cross-Camera External Validation for Artificial Intelligence Software in Diagnosis of Diabetic RetinopathyMeng-Ju Tsai0Yi-Ting Hsieh1Chin-Han Tsai2Mingke Chen3An-Tsz Hsieh4Chung-Wen Tsai5Min-Ling Chen6Department of OphthalmologyDepartment of OphthalmologyAcer Medical Inc.Acer Medical Inc.Hsieh’s Endocrinologic ClinicJoy ClinicChen Min Ling Medical ClinicAims. To investigate the applicability of deep learning image assessment software VeriSee DR to different color fundus cameras for the screening of diabetic retinopathy (DR). Methods. Color fundus images of diabetes patients taken with three different nonmydriatic fundus cameras, including 477 Topcon TRC-NW400, 459 Topcon TRC-NW8 series, and 471 Kowa nonmyd 8 series that were judged as “gradable” by one ophthalmologist were enrolled for validation. VeriSee DR was then used for the diagnosis of referable DR according to the International Clinical Diabetic Retinopathy Disease Severity Scale. Gradability, sensitivity, and specificity were calculated for each camera model. Results. All images (100%) from the three camera models were gradable for VeriSee DR. The sensitivity for diagnosing referable DR in the TRC-NW400, TRC-NW8, and non-myd 8 series was 89.3%, 94.6%, and 95.7%, respectively, while the specificity was 94.2%, 90.4%, and 89.3%, respectively. Neither the sensitivity nor the specificity differed significantly between these camera models and the original camera model used for VeriSee DR development (p=0.40, p=0.065, respectively). Conclusions. VeriSee DR was applicable to a variety of color fundus cameras with 100% agreement with ophthalmologists in terms of gradability and good sensitivity and specificity for the diagnosis of referable DR.http://dx.doi.org/10.1155/2022/5779276
spellingShingle Meng-Ju Tsai
Yi-Ting Hsieh
Chin-Han Tsai
Mingke Chen
An-Tsz Hsieh
Chung-Wen Tsai
Min-Ling Chen
Cross-Camera External Validation for Artificial Intelligence Software in Diagnosis of Diabetic Retinopathy
Journal of Diabetes Research
title Cross-Camera External Validation for Artificial Intelligence Software in Diagnosis of Diabetic Retinopathy
title_full Cross-Camera External Validation for Artificial Intelligence Software in Diagnosis of Diabetic Retinopathy
title_fullStr Cross-Camera External Validation for Artificial Intelligence Software in Diagnosis of Diabetic Retinopathy
title_full_unstemmed Cross-Camera External Validation for Artificial Intelligence Software in Diagnosis of Diabetic Retinopathy
title_short Cross-Camera External Validation for Artificial Intelligence Software in Diagnosis of Diabetic Retinopathy
title_sort cross camera external validation for artificial intelligence software in diagnosis of diabetic retinopathy
url http://dx.doi.org/10.1155/2022/5779276
work_keys_str_mv AT mengjutsai crosscameraexternalvalidationforartificialintelligencesoftwareindiagnosisofdiabeticretinopathy
AT yitinghsieh crosscameraexternalvalidationforartificialintelligencesoftwareindiagnosisofdiabeticretinopathy
AT chinhantsai crosscameraexternalvalidationforartificialintelligencesoftwareindiagnosisofdiabeticretinopathy
AT mingkechen crosscameraexternalvalidationforartificialintelligencesoftwareindiagnosisofdiabeticretinopathy
AT antszhsieh crosscameraexternalvalidationforartificialintelligencesoftwareindiagnosisofdiabeticretinopathy
AT chungwentsai crosscameraexternalvalidationforartificialintelligencesoftwareindiagnosisofdiabeticretinopathy
AT minlingchen crosscameraexternalvalidationforartificialintelligencesoftwareindiagnosisofdiabeticretinopathy