Machine Learning for the Early Prediction of Delayed Cerebral Ischemia in Patients With Subarachnoid Hemorrhage: Systematic Review and Meta-Analysis

BackgroundDelayed cerebral ischemia (DCI) is a primary contributor to death after subarachnoid hemorrhage (SAH), with significant incidence. Therefore, early determination of the risk of DCI is an urgent need. Machine learning (ML) has received much attention in clinical prac...

Full description

Saved in:
Bibliographic Details
Main Authors: Haofuzi Zhang, Peng Zou, Peng Luo, Xiaofan Jiang
Format: Article
Language:English
Published: JMIR Publications 2025-01-01
Series:Journal of Medical Internet Research
Online Access:https://www.jmir.org/2025/1/e54121
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832593417198108672
author Haofuzi Zhang
Peng Zou
Peng Luo
Xiaofan Jiang
author_facet Haofuzi Zhang
Peng Zou
Peng Luo
Xiaofan Jiang
author_sort Haofuzi Zhang
collection DOAJ
description BackgroundDelayed cerebral ischemia (DCI) is a primary contributor to death after subarachnoid hemorrhage (SAH), with significant incidence. Therefore, early determination of the risk of DCI is an urgent need. Machine learning (ML) has received much attention in clinical practice. Recently, some studies have attempted to apply ML models for early noninvasive prediction of DCI. However, systematic evidence for its predictive accuracy is still lacking. ObjectiveThe aim of this study was to synthesize the prediction accuracy of ML models for DCI to provide evidence for the development or updating of intelligent detection tools. MethodsPubMed, Cochrane, Embase, and Web of Science databases were systematically searched up to May 18, 2023. The risk of bias in the included studies was assessed using PROBAST (Prediction Model Risk of Bias Assessment Tool). During the analysis, we discussed the performance of different models in the training and validation sets. ResultsWe finally included 48 studies containing 16,294 patients with SAH and 71 ML models with logistic regression as the main model type. In the training set, the pooled concordance index (C index), sensitivity, and specificity of all the models were 0.786 (95% CI 0.737-0.835), 0.77 (95% CI 0.69-0.84), and 0.83 (95% CI 0.75-0.89), respectively, while those of the logistic regression models were 0.770 (95% CI 0.724-0.817), 0.75 (95% CI 0.67-0.82), and 0.71 (95% CI 0.63-0.78), respectively. In the validation set, the pooled C index, sensitivity, and specificity of all the models were 0.767 (95% CI 0.741-0.793), 0.66 (95% CI 0.53-0.77), and 0.78 (95% CI 0.71-0.84), respectively, while those of the logistic regression models were 0.757 (95% CI 0.715-0.800), 0.59 (95% CI 0.57-0.80), and 0.80 (95% CI 0.71-0.87), respectively. ConclusionsML models appear to have relatively desirable power for early noninvasive prediction of DCI after SAH. However, enhancing the prediction sensitivity of these models is challenging. Therefore, efficient, noninvasive, or minimally invasive low-cost predictors should be further explored in future studies to improve the prediction accuracy of ML models. Trial RegistrationPROSPERO (CRD42023438399); https://tinyurl.com/yfuuudde
format Article
id doaj-art-71a00257310f428a9d38911937e19a97
institution Kabale University
issn 1438-8871
language English
publishDate 2025-01-01
publisher JMIR Publications
record_format Article
series Journal of Medical Internet Research
spelling doaj-art-71a00257310f428a9d38911937e19a972025-01-20T17:00:36ZengJMIR PublicationsJournal of Medical Internet Research1438-88712025-01-0127e5412110.2196/54121Machine Learning for the Early Prediction of Delayed Cerebral Ischemia in Patients With Subarachnoid Hemorrhage: Systematic Review and Meta-AnalysisHaofuzi Zhanghttps://orcid.org/0000-0003-0831-2714Peng Zouhttps://orcid.org/0000-0002-1051-3278Peng Luohttps://orcid.org/0000-0003-0746-939XXiaofan Jianghttps://orcid.org/0000-0001-5507-083X BackgroundDelayed cerebral ischemia (DCI) is a primary contributor to death after subarachnoid hemorrhage (SAH), with significant incidence. Therefore, early determination of the risk of DCI is an urgent need. Machine learning (ML) has received much attention in clinical practice. Recently, some studies have attempted to apply ML models for early noninvasive prediction of DCI. However, systematic evidence for its predictive accuracy is still lacking. ObjectiveThe aim of this study was to synthesize the prediction accuracy of ML models for DCI to provide evidence for the development or updating of intelligent detection tools. MethodsPubMed, Cochrane, Embase, and Web of Science databases were systematically searched up to May 18, 2023. The risk of bias in the included studies was assessed using PROBAST (Prediction Model Risk of Bias Assessment Tool). During the analysis, we discussed the performance of different models in the training and validation sets. ResultsWe finally included 48 studies containing 16,294 patients with SAH and 71 ML models with logistic regression as the main model type. In the training set, the pooled concordance index (C index), sensitivity, and specificity of all the models were 0.786 (95% CI 0.737-0.835), 0.77 (95% CI 0.69-0.84), and 0.83 (95% CI 0.75-0.89), respectively, while those of the logistic regression models were 0.770 (95% CI 0.724-0.817), 0.75 (95% CI 0.67-0.82), and 0.71 (95% CI 0.63-0.78), respectively. In the validation set, the pooled C index, sensitivity, and specificity of all the models were 0.767 (95% CI 0.741-0.793), 0.66 (95% CI 0.53-0.77), and 0.78 (95% CI 0.71-0.84), respectively, while those of the logistic regression models were 0.757 (95% CI 0.715-0.800), 0.59 (95% CI 0.57-0.80), and 0.80 (95% CI 0.71-0.87), respectively. ConclusionsML models appear to have relatively desirable power for early noninvasive prediction of DCI after SAH. However, enhancing the prediction sensitivity of these models is challenging. Therefore, efficient, noninvasive, or minimally invasive low-cost predictors should be further explored in future studies to improve the prediction accuracy of ML models. Trial RegistrationPROSPERO (CRD42023438399); https://tinyurl.com/yfuuuddehttps://www.jmir.org/2025/1/e54121
spellingShingle Haofuzi Zhang
Peng Zou
Peng Luo
Xiaofan Jiang
Machine Learning for the Early Prediction of Delayed Cerebral Ischemia in Patients With Subarachnoid Hemorrhage: Systematic Review and Meta-Analysis
Journal of Medical Internet Research
title Machine Learning for the Early Prediction of Delayed Cerebral Ischemia in Patients With Subarachnoid Hemorrhage: Systematic Review and Meta-Analysis
title_full Machine Learning for the Early Prediction of Delayed Cerebral Ischemia in Patients With Subarachnoid Hemorrhage: Systematic Review and Meta-Analysis
title_fullStr Machine Learning for the Early Prediction of Delayed Cerebral Ischemia in Patients With Subarachnoid Hemorrhage: Systematic Review and Meta-Analysis
title_full_unstemmed Machine Learning for the Early Prediction of Delayed Cerebral Ischemia in Patients With Subarachnoid Hemorrhage: Systematic Review and Meta-Analysis
title_short Machine Learning for the Early Prediction of Delayed Cerebral Ischemia in Patients With Subarachnoid Hemorrhage: Systematic Review and Meta-Analysis
title_sort machine learning for the early prediction of delayed cerebral ischemia in patients with subarachnoid hemorrhage systematic review and meta analysis
url https://www.jmir.org/2025/1/e54121
work_keys_str_mv AT haofuzizhang machinelearningfortheearlypredictionofdelayedcerebralischemiainpatientswithsubarachnoidhemorrhagesystematicreviewandmetaanalysis
AT pengzou machinelearningfortheearlypredictionofdelayedcerebralischemiainpatientswithsubarachnoidhemorrhagesystematicreviewandmetaanalysis
AT pengluo machinelearningfortheearlypredictionofdelayedcerebralischemiainpatientswithsubarachnoidhemorrhagesystematicreviewandmetaanalysis
AT xiaofanjiang machinelearningfortheearlypredictionofdelayedcerebralischemiainpatientswithsubarachnoidhemorrhagesystematicreviewandmetaanalysis