A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation Study
BackgroundThe prompt and accurate identification of mild cognitive impairment (MCI) is crucial for preventing its progression into more severe neurodegenerative diseases. However, current diagnostic solutions, such as biomarkers and cognitive screening tests, prove costly, ti...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-01-01
|
| Series: | JMIR Medical Informatics |
| Online Access: | https://medinform.jmir.org/2025/1/e60250 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832593498016055296 |
|---|---|
| author | Aoyu Li Jingwen Li Yishan Hu Yan Geng Yan Qiang Juanjuan Zhao |
| author_facet | Aoyu Li Jingwen Li Yishan Hu Yan Geng Yan Qiang Juanjuan Zhao |
| author_sort | Aoyu Li |
| collection | DOAJ |
| description |
BackgroundThe prompt and accurate identification of mild cognitive impairment (MCI) is crucial for preventing its progression into more severe neurodegenerative diseases. However, current diagnostic solutions, such as biomarkers and cognitive screening tests, prove costly, time-consuming, and invasive, hindering patient compliance and the accessibility of these tests. Therefore, exploring a more cost-effective, efficient, and noninvasive method to aid clinicians in detecting MCI is necessary.
ObjectiveThis study aims to develop an ensemble learning framework that adaptively integrates multimodal physiological data collected from wearable wristbands and digital cognitive metrics recorded on tablets, thereby improving the accuracy and practicality of MCI detection.
MethodsWe recruited 843 participants aged 60 years and older from the geriatrics and neurology departments of our collaborating hospitals, who were randomly divided into a development dataset (674/843 participants) and an internal test dataset (169/843 participants) at a 4:1 ratio. In addition, 226 older adults were recruited from 3 external centers to form an external test dataset. We measured their physiological signals (eg, electrodermal activity and photoplethysmography) and digital cognitive parameters (eg, reaction time and test scores) using the clinically certified Empatica 4 wristband and a tablet cognitive screening tool. The collected data underwent rigorous preprocessing, during which features in the time, frequency, and nonlinear domains were extracted from individual physiological signals. To address the challenges (eg, the curse of dimensionality and increased model complexity) posed by high-dimensional features, we developed a dynamic adaptive feature selection optimization algorithm to identify the most impactful subset of features for classification performance. Finally, the accuracy and efficiency of the classification model were improved by optimizing the combination of base learners.
ResultsThe experimental results indicate that the proposed MCI detection framework achieved classification accuracies of 88.4%, 85.5%, and 84.5% on the development, internal test, and external test datasets, respectively. The area under the curve for the binary classification task was 0.945 (95% CI 0.903-0.986), 0.912 (95% CI 0.859-0.965), and 0.904 (95% CI 0.846-0.962) on these datasets. Furthermore, a statistical analysis of feature subsets during the iterative modeling process revealed that the decay time of skin conductance response, the percentage of continuous normal-to-normal intervals exceeding 50 milliseconds, the ratio of low-frequency to high-frequency (LF/HF) components in heart rate variability, and cognitive time features emerged as the most prevalent and effective indicators. Specifically, compared with healthy individuals, patients with MCI exhibited a longer skin conductance response decay time during cognitive testing (P<.001), a lower percentage of continuous normal-to-normal intervals exceeding 50 milliseconds (P<.001), and higher LF/HF (P<.001), accompanied by greater variability. Similarly, patients with MCI took longer to complete cognitive tests than healthy individuals (P<.001).
ConclusionsThe developed MCI detection framework has demonstrated exemplary performance and stability in large-scale validations. It establishes a new benchmark for noninvasive, effective early MCI detection that can be integrated into routine wearable and tablet-based assessments. Furthermore, the framework enables continuous and convenient self-screening within home or nonspecialized settings, effectively mitigating underresourced health care and geographic location constraints, making it an essential tool in the current fight against neurodegenerative diseases. |
| format | Article |
| id | doaj-art-c66ce990c96a4b72ba95d9950b54ce4f |
| institution | Kabale University |
| issn | 2291-9694 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Medical Informatics |
| spelling | doaj-art-c66ce990c96a4b72ba95d9950b54ce4f2025-01-20T15:15:32ZengJMIR PublicationsJMIR Medical Informatics2291-96942025-01-0113e6025010.2196/60250A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation StudyAoyu Lihttps://orcid.org/0000-0001-5249-9964Jingwen Lihttps://orcid.org/0009-0001-7991-6622Yishan Huhttps://orcid.org/0000-0003-2873-8800Yan Genghttps://orcid.org/0009-0006-5626-2925Yan Qianghttps://orcid.org/0000-0001-6231-3721Juanjuan Zhaohttps://orcid.org/0009-0001-4684-8897 BackgroundThe prompt and accurate identification of mild cognitive impairment (MCI) is crucial for preventing its progression into more severe neurodegenerative diseases. However, current diagnostic solutions, such as biomarkers and cognitive screening tests, prove costly, time-consuming, and invasive, hindering patient compliance and the accessibility of these tests. Therefore, exploring a more cost-effective, efficient, and noninvasive method to aid clinicians in detecting MCI is necessary. ObjectiveThis study aims to develop an ensemble learning framework that adaptively integrates multimodal physiological data collected from wearable wristbands and digital cognitive metrics recorded on tablets, thereby improving the accuracy and practicality of MCI detection. MethodsWe recruited 843 participants aged 60 years and older from the geriatrics and neurology departments of our collaborating hospitals, who were randomly divided into a development dataset (674/843 participants) and an internal test dataset (169/843 participants) at a 4:1 ratio. In addition, 226 older adults were recruited from 3 external centers to form an external test dataset. We measured their physiological signals (eg, electrodermal activity and photoplethysmography) and digital cognitive parameters (eg, reaction time and test scores) using the clinically certified Empatica 4 wristband and a tablet cognitive screening tool. The collected data underwent rigorous preprocessing, during which features in the time, frequency, and nonlinear domains were extracted from individual physiological signals. To address the challenges (eg, the curse of dimensionality and increased model complexity) posed by high-dimensional features, we developed a dynamic adaptive feature selection optimization algorithm to identify the most impactful subset of features for classification performance. Finally, the accuracy and efficiency of the classification model were improved by optimizing the combination of base learners. ResultsThe experimental results indicate that the proposed MCI detection framework achieved classification accuracies of 88.4%, 85.5%, and 84.5% on the development, internal test, and external test datasets, respectively. The area under the curve for the binary classification task was 0.945 (95% CI 0.903-0.986), 0.912 (95% CI 0.859-0.965), and 0.904 (95% CI 0.846-0.962) on these datasets. Furthermore, a statistical analysis of feature subsets during the iterative modeling process revealed that the decay time of skin conductance response, the percentage of continuous normal-to-normal intervals exceeding 50 milliseconds, the ratio of low-frequency to high-frequency (LF/HF) components in heart rate variability, and cognitive time features emerged as the most prevalent and effective indicators. Specifically, compared with healthy individuals, patients with MCI exhibited a longer skin conductance response decay time during cognitive testing (P<.001), a lower percentage of continuous normal-to-normal intervals exceeding 50 milliseconds (P<.001), and higher LF/HF (P<.001), accompanied by greater variability. Similarly, patients with MCI took longer to complete cognitive tests than healthy individuals (P<.001). ConclusionsThe developed MCI detection framework has demonstrated exemplary performance and stability in large-scale validations. It establishes a new benchmark for noninvasive, effective early MCI detection that can be integrated into routine wearable and tablet-based assessments. Furthermore, the framework enables continuous and convenient self-screening within home or nonspecialized settings, effectively mitigating underresourced health care and geographic location constraints, making it an essential tool in the current fight against neurodegenerative diseases.https://medinform.jmir.org/2025/1/e60250 |
| spellingShingle | Aoyu Li Jingwen Li Yishan Hu Yan Geng Yan Qiang Juanjuan Zhao A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation Study JMIR Medical Informatics |
| title | A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation Study |
| title_full | A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation Study |
| title_fullStr | A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation Study |
| title_full_unstemmed | A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation Study |
| title_short | A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation Study |
| title_sort | dynamic adaptive ensemble learning framework for noninvasive mild cognitive impairment detection development and validation study |
| url | https://medinform.jmir.org/2025/1/e60250 |
| work_keys_str_mv | AT aoyuli adynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT jingwenli adynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT yishanhu adynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT yangeng adynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT yanqiang adynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT juanjuanzhao adynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT aoyuli dynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT jingwenli dynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT yishanhu dynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT yangeng dynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT yanqiang dynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy AT juanjuanzhao dynamicadaptiveensemblelearningframeworkfornoninvasivemildcognitiveimpairmentdetectiondevelopmentandvalidationstudy |