Development and Validation of a Cost-Effective Machine Learning Model for Screening Potential Rheumatoid Arthritis in Primary Healthcare Clinics
Wenqi Wu,1,2,* Xiaohao Hu,1,2,* Linyang Yan,3,* Zhiyin Li,4 Bo Li,5 Xinpeng Chen,6 Zexun Lin,7 Huiqiong Zeng,8 Chun Li,9 Yingqian Mo,10 Yalin Wu,3 Qingwen Wang1,2 1Department of Rheumatology and Immunology, Peking University Shenzhen Hospital, Shenzhen, People’s Republic of C...
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Dove Medical Press
2025-02-01
|
| Series: | Journal of Inflammation Research |
| Subjects: | |
| Online Access: | https://www.dovepress.com/development-and-validation-of-a-cost-effective-machine-learning-model--peer-reviewed-fulltext-article-JIR |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832540640103104512 |
|---|---|
| author | Wu W Hu X Yan L Li Z Li B Chen X Lin Z Zeng H Li C Mo Y Wu Y Wang Q |
| author_facet | Wu W Hu X Yan L Li Z Li B Chen X Lin Z Zeng H Li C Mo Y Wu Y Wang Q |
| author_sort | Wu W |
| collection | DOAJ |
| description | Wenqi Wu,1,2,* Xiaohao Hu,1,2,* Linyang Yan,3,* Zhiyin Li,4 Bo Li,5 Xinpeng Chen,6 Zexun Lin,7 Huiqiong Zeng,8 Chun Li,9 Yingqian Mo,10 Yalin Wu,3 Qingwen Wang1,2 1Department of Rheumatology and Immunology, Peking University Shenzhen Hospital, Shenzhen, People’s Republic of China; 2Shenzhen Key Laboratory of Inflammatory and Immunology Diseases, Shenzhen, People’s Republic of China; 3Department of Ultrasound, Institute of Ultrasonic Medicine, Peking University Shenzhen Hospital, Shenzhen Peking University-The Hong Kong University of Science and Technology Medical Center, Shenzhen, 518036, People’s Republic of China; 4Department of Information Systems, City University of Hong Kong, Hong Kong, People’s Republic of China; 5Department of Rheumatology and Immunology, People’s Hospital of Longhua District, Shenzhen, People’s Republic of China; 6Department of Rheumatology and Immunology, Shenzhen Futian Hospital for Rheumatic Diseases, Shenzhen, People’s Republic of China; 7Shenzhen Nanshan Medical Group HQ Taohuayuan Community Health Service Center, Shenzhen, People’s Republic of China; 8Traditional Chinese Medicine Department of Rheumatism, Women & Children Health Institute, Shenzhen, People’s Republic of China; 9Department of Rheumatology and Immunology, Peking University People’s Hospital, Beijing, People’s Republic of China; 10Department of Rheumatology and Immunology, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, People’s Republic of China*These authors contributed equally to this workCorrespondence: Yalin Wu; Qingwen Wang, Email yalinwu@jj.ac.kr; wangqingwen@pkuszh.comObjective: In primary healthcare, diagnosing rheumatoid arthritis (RA) is challenging due to a general lack of in-depth knowledge of RA by general practitioners (GPs) and the lack of effective tools, leading to high rates of missed diagnosis. This study focuses on a screening model for primary healthcare, aiming to improve early RA screening accuracy and efficiency at a relatively lower cost, reducing delays in GPs’ recognition of RA.Methods: We randomly selected 2106 participants from the RA group or combined control group (comprising healthy individuals and patients with non-RA rheumatic diseases) at Peking University Shenzhen Hospital as the developing cohort. Guided by experienced rheumatologists, we built a comprehensive database with 26 clinical features. Using 10 classical machine learning algorithms, we developed screening models. Evaluation metrics determined the best model. Employing multivariatelogistic regression results and the best-performing model to identify the least costly features, ensuring applicability in primary healthcare clinics. Subsequently, we retrained and validated our proposed model based on two primary healthcare validation cohorts.Results: In experiments, the algorithms achieved over 88% accuracy on training and test sets. Random Forest (RF) excelled with 96.20% (95% CI 95.39% to 97.02%) accuracy, 96.22% (95% CI 95.40% to 97.03%) specificity, 96.18% (95% CI 95.37% to 97.00%) sensitivity, and 96.20% (95% CI 95.39% to 97.02%) Areas Under Curves (AUC). A meticulous feature selection identified 11 key features for RA screening. In an external test on two primary healthcare datasets with these features, RF demonstrated an accuracy of 88.435% (95% CI 85.55% to 91.32%), sensitivity of 98.55% (95% CI 97.47% to 99.63%), specificity of 85.56% (95% CI 82.39% to 88.73%), and an AUC of 92.055% (95% CI 89.62% to 94.49%).Conclusion: The screening model excels in automating prompt identification of RA in primary healthcare, improving the early detection of RA, and reducing delays and associated costs. Our findings contribute positively and are poised to elevate prospective RA management, fostering improvements in healthcare sector responsiveness and resource efficiency.Keywords: rheumatoid arthritis, machine learning, primary health care |
| format | Article |
| id | doaj-art-f01dd035b57645898d4c4c5312b846a1 |
| institution | Kabale University |
| issn | 1178-7031 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Dove Medical Press |
| record_format | Article |
| series | Journal of Inflammation Research |
| spelling | doaj-art-f01dd035b57645898d4c4c5312b846a12025-02-04T17:15:41ZengDove Medical PressJournal of Inflammation Research1178-70312025-02-01Volume 181511152299827Development and Validation of a Cost-Effective Machine Learning Model for Screening Potential Rheumatoid Arthritis in Primary Healthcare ClinicsWu WHu XYan LLi ZLi BChen XLin ZZeng HLi CMo YWu YWang QWenqi Wu,1,2,* Xiaohao Hu,1,2,* Linyang Yan,3,* Zhiyin Li,4 Bo Li,5 Xinpeng Chen,6 Zexun Lin,7 Huiqiong Zeng,8 Chun Li,9 Yingqian Mo,10 Yalin Wu,3 Qingwen Wang1,2 1Department of Rheumatology and Immunology, Peking University Shenzhen Hospital, Shenzhen, People’s Republic of China; 2Shenzhen Key Laboratory of Inflammatory and Immunology Diseases, Shenzhen, People’s Republic of China; 3Department of Ultrasound, Institute of Ultrasonic Medicine, Peking University Shenzhen Hospital, Shenzhen Peking University-The Hong Kong University of Science and Technology Medical Center, Shenzhen, 518036, People’s Republic of China; 4Department of Information Systems, City University of Hong Kong, Hong Kong, People’s Republic of China; 5Department of Rheumatology and Immunology, People’s Hospital of Longhua District, Shenzhen, People’s Republic of China; 6Department of Rheumatology and Immunology, Shenzhen Futian Hospital for Rheumatic Diseases, Shenzhen, People’s Republic of China; 7Shenzhen Nanshan Medical Group HQ Taohuayuan Community Health Service Center, Shenzhen, People’s Republic of China; 8Traditional Chinese Medicine Department of Rheumatism, Women & Children Health Institute, Shenzhen, People’s Republic of China; 9Department of Rheumatology and Immunology, Peking University People’s Hospital, Beijing, People’s Republic of China; 10Department of Rheumatology and Immunology, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, People’s Republic of China*These authors contributed equally to this workCorrespondence: Yalin Wu; Qingwen Wang, Email yalinwu@jj.ac.kr; wangqingwen@pkuszh.comObjective: In primary healthcare, diagnosing rheumatoid arthritis (RA) is challenging due to a general lack of in-depth knowledge of RA by general practitioners (GPs) and the lack of effective tools, leading to high rates of missed diagnosis. This study focuses on a screening model for primary healthcare, aiming to improve early RA screening accuracy and efficiency at a relatively lower cost, reducing delays in GPs’ recognition of RA.Methods: We randomly selected 2106 participants from the RA group or combined control group (comprising healthy individuals and patients with non-RA rheumatic diseases) at Peking University Shenzhen Hospital as the developing cohort. Guided by experienced rheumatologists, we built a comprehensive database with 26 clinical features. Using 10 classical machine learning algorithms, we developed screening models. Evaluation metrics determined the best model. Employing multivariatelogistic regression results and the best-performing model to identify the least costly features, ensuring applicability in primary healthcare clinics. Subsequently, we retrained and validated our proposed model based on two primary healthcare validation cohorts.Results: In experiments, the algorithms achieved over 88% accuracy on training and test sets. Random Forest (RF) excelled with 96.20% (95% CI 95.39% to 97.02%) accuracy, 96.22% (95% CI 95.40% to 97.03%) specificity, 96.18% (95% CI 95.37% to 97.00%) sensitivity, and 96.20% (95% CI 95.39% to 97.02%) Areas Under Curves (AUC). A meticulous feature selection identified 11 key features for RA screening. In an external test on two primary healthcare datasets with these features, RF demonstrated an accuracy of 88.435% (95% CI 85.55% to 91.32%), sensitivity of 98.55% (95% CI 97.47% to 99.63%), specificity of 85.56% (95% CI 82.39% to 88.73%), and an AUC of 92.055% (95% CI 89.62% to 94.49%).Conclusion: The screening model excels in automating prompt identification of RA in primary healthcare, improving the early detection of RA, and reducing delays and associated costs. Our findings contribute positively and are poised to elevate prospective RA management, fostering improvements in healthcare sector responsiveness and resource efficiency.Keywords: rheumatoid arthritis, machine learning, primary health carehttps://www.dovepress.com/development-and-validation-of-a-cost-effective-machine-learning-model--peer-reviewed-fulltext-article-JIRrheumatoid arthritismachine learningprimary health care |
| spellingShingle | Wu W Hu X Yan L Li Z Li B Chen X Lin Z Zeng H Li C Mo Y Wu Y Wang Q Development and Validation of a Cost-Effective Machine Learning Model for Screening Potential Rheumatoid Arthritis in Primary Healthcare Clinics Journal of Inflammation Research rheumatoid arthritis machine learning primary health care |
| title | Development and Validation of a Cost-Effective Machine Learning Model for Screening Potential Rheumatoid Arthritis in Primary Healthcare Clinics |
| title_full | Development and Validation of a Cost-Effective Machine Learning Model for Screening Potential Rheumatoid Arthritis in Primary Healthcare Clinics |
| title_fullStr | Development and Validation of a Cost-Effective Machine Learning Model for Screening Potential Rheumatoid Arthritis in Primary Healthcare Clinics |
| title_full_unstemmed | Development and Validation of a Cost-Effective Machine Learning Model for Screening Potential Rheumatoid Arthritis in Primary Healthcare Clinics |
| title_short | Development and Validation of a Cost-Effective Machine Learning Model for Screening Potential Rheumatoid Arthritis in Primary Healthcare Clinics |
| title_sort | development and validation of a cost effective machine learning model for screening potential rheumatoid arthritis in primary healthcare clinics |
| topic | rheumatoid arthritis machine learning primary health care |
| url | https://www.dovepress.com/development-and-validation-of-a-cost-effective-machine-learning-model--peer-reviewed-fulltext-article-JIR |
| work_keys_str_mv | AT wuw developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT hux developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT yanl developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT liz developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT lib developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT chenx developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT linz developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT zengh developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT lic developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT moy developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT wuy developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics AT wangq developmentandvalidationofacosteffectivemachinelearningmodelforscreeningpotentialrheumatoidarthritisinprimaryhealthcareclinics |