Community-engaged artificial intelligence research: A scoping review.
The degree to which artificial intelligence healthcare research is informed by data and stakeholders from community settings has not been previously described. As communities are the principal location of healthcare delivery, engaging them could represent an important opportunity to improve scientif...
Saved in:
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2024-08-01
|
| Series: | PLOS Digital Health |
| Online Access: | https://journals.plos.org/digitalhealth/article/file?id=10.1371/journal.pdig.0000561&type=printable |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832539982023098368 |
|---|---|
| author | Tyler J Loftus Jeremy A Balch Kenneth L Abbott Die Hu Matthew M Ruppert Benjamin Shickel Tezcan Ozrazgat-Baslanti Philip A Efron Patrick J Tighe William R Hogan Parisa Rashidi Michelle I Cardel Gilbert R Upchurch Azra Bihorac |
| author_facet | Tyler J Loftus Jeremy A Balch Kenneth L Abbott Die Hu Matthew M Ruppert Benjamin Shickel Tezcan Ozrazgat-Baslanti Philip A Efron Patrick J Tighe William R Hogan Parisa Rashidi Michelle I Cardel Gilbert R Upchurch Azra Bihorac |
| author_sort | Tyler J Loftus |
| collection | DOAJ |
| description | The degree to which artificial intelligence healthcare research is informed by data and stakeholders from community settings has not been previously described. As communities are the principal location of healthcare delivery, engaging them could represent an important opportunity to improve scientific quality. This scoping review systematically maps what is known and unknown about community-engaged artificial intelligence research and identifies opportunities to optimize the generalizability of these applications through involvement of community stakeholders and data throughout model development, validation, and implementation. Embase, PubMed, and MEDLINE databases were searched for articles describing artificial intelligence or machine learning healthcare applications with community involvement in model development, validation, or implementation. Model architecture and performance, the nature of community engagement, and barriers or facilitators to community engagement were reported according to PRISMA extension for Scoping Reviews guidelines. Of approximately 10,880 articles describing artificial intelligence healthcare applications, 21 (0.2%) described community involvement. All articles derived data from community settings, most commonly by leveraging existing datasets and sources that included community subjects, and often bolstered by internet-based data acquisition and subject recruitment. Only one article described inclusion of community stakeholders in designing an application-a natural language processing model that detected cases of likely child abuse with 90% accuracy using harmonized electronic health record notes from both hospital and community practice settings. The primary barrier to including community-derived data was small sample sizes, which may have affected 11 of the 21 studies (53%), introducing substantial risk for overfitting that threatens generalizability. Community engagement in artificial intelligence healthcare application development, validation, or implementation is rare. As healthcare delivery occurs primarily in community settings, investigators should consider engaging community stakeholders in user-centered design, usability, and clinical implementation studies to optimize generalizability. |
| format | Article |
| id | doaj-art-97d2852bab0441d2b2fe5eba8510b341 |
| institution | Kabale University |
| issn | 2767-3170 |
| language | English |
| publishDate | 2024-08-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLOS Digital Health |
| spelling | doaj-art-97d2852bab0441d2b2fe5eba8510b3412025-02-05T05:33:38ZengPublic Library of Science (PLoS)PLOS Digital Health2767-31702024-08-0138e000056110.1371/journal.pdig.0000561Community-engaged artificial intelligence research: A scoping review.Tyler J LoftusJeremy A BalchKenneth L AbbottDie HuMatthew M RuppertBenjamin ShickelTezcan Ozrazgat-BaslantiPhilip A EfronPatrick J TigheWilliam R HoganParisa RashidiMichelle I CardelGilbert R UpchurchAzra BihoracThe degree to which artificial intelligence healthcare research is informed by data and stakeholders from community settings has not been previously described. As communities are the principal location of healthcare delivery, engaging them could represent an important opportunity to improve scientific quality. This scoping review systematically maps what is known and unknown about community-engaged artificial intelligence research and identifies opportunities to optimize the generalizability of these applications through involvement of community stakeholders and data throughout model development, validation, and implementation. Embase, PubMed, and MEDLINE databases were searched for articles describing artificial intelligence or machine learning healthcare applications with community involvement in model development, validation, or implementation. Model architecture and performance, the nature of community engagement, and barriers or facilitators to community engagement were reported according to PRISMA extension for Scoping Reviews guidelines. Of approximately 10,880 articles describing artificial intelligence healthcare applications, 21 (0.2%) described community involvement. All articles derived data from community settings, most commonly by leveraging existing datasets and sources that included community subjects, and often bolstered by internet-based data acquisition and subject recruitment. Only one article described inclusion of community stakeholders in designing an application-a natural language processing model that detected cases of likely child abuse with 90% accuracy using harmonized electronic health record notes from both hospital and community practice settings. The primary barrier to including community-derived data was small sample sizes, which may have affected 11 of the 21 studies (53%), introducing substantial risk for overfitting that threatens generalizability. Community engagement in artificial intelligence healthcare application development, validation, or implementation is rare. As healthcare delivery occurs primarily in community settings, investigators should consider engaging community stakeholders in user-centered design, usability, and clinical implementation studies to optimize generalizability.https://journals.plos.org/digitalhealth/article/file?id=10.1371/journal.pdig.0000561&type=printable |
| spellingShingle | Tyler J Loftus Jeremy A Balch Kenneth L Abbott Die Hu Matthew M Ruppert Benjamin Shickel Tezcan Ozrazgat-Baslanti Philip A Efron Patrick J Tighe William R Hogan Parisa Rashidi Michelle I Cardel Gilbert R Upchurch Azra Bihorac Community-engaged artificial intelligence research: A scoping review. PLOS Digital Health |
| title | Community-engaged artificial intelligence research: A scoping review. |
| title_full | Community-engaged artificial intelligence research: A scoping review. |
| title_fullStr | Community-engaged artificial intelligence research: A scoping review. |
| title_full_unstemmed | Community-engaged artificial intelligence research: A scoping review. |
| title_short | Community-engaged artificial intelligence research: A scoping review. |
| title_sort | community engaged artificial intelligence research a scoping review |
| url | https://journals.plos.org/digitalhealth/article/file?id=10.1371/journal.pdig.0000561&type=printable |
| work_keys_str_mv | AT tylerjloftus communityengagedartificialintelligenceresearchascopingreview AT jeremyabalch communityengagedartificialintelligenceresearchascopingreview AT kennethlabbott communityengagedartificialintelligenceresearchascopingreview AT diehu communityengagedartificialintelligenceresearchascopingreview AT matthewmruppert communityengagedartificialintelligenceresearchascopingreview AT benjaminshickel communityengagedartificialintelligenceresearchascopingreview AT tezcanozrazgatbaslanti communityengagedartificialintelligenceresearchascopingreview AT philipaefron communityengagedartificialintelligenceresearchascopingreview AT patrickjtighe communityengagedartificialintelligenceresearchascopingreview AT williamrhogan communityengagedartificialintelligenceresearchascopingreview AT parisarashidi communityengagedartificialintelligenceresearchascopingreview AT michelleicardel communityengagedartificialintelligenceresearchascopingreview AT gilbertrupchurch communityengagedartificialintelligenceresearchascopingreview AT azrabihorac communityengagedartificialintelligenceresearchascopingreview |