Diversifying Kidney Transplant Education: Assessing the Artificial Intelligence-Powered Capability of ChatGPT

<b>Background</b>: Artificial intelligence (AI) has rapidly advanced, significantly impacting medicine. ChatGPT, a new AI model, generates responses based on user input. This study evaluates ChatGPT’s ability to assist with pre- and post-kidney transplantation (KT) patient education. <...

Full description

Saved in:
Bibliographic Details
Main Authors: Badi Rawashdeh, Joohyun Kim, Ty Dunn, Haneen Al-Abdallat, Ahmad Qasem, Rootvij Bhatt, Raj Prasad, Matthew Cooper
Format: Article
Language:English
Published: MDPI AG 2024-11-01
Series:Transplantology
Subjects:
Online Access:https://www.mdpi.com/2673-3943/5/4/27
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850036049409998848
author Badi Rawashdeh
Joohyun Kim
Ty Dunn
Haneen Al-Abdallat
Ahmad Qasem
Rootvij Bhatt
Raj Prasad
Matthew Cooper
author_facet Badi Rawashdeh
Joohyun Kim
Ty Dunn
Haneen Al-Abdallat
Ahmad Qasem
Rootvij Bhatt
Raj Prasad
Matthew Cooper
author_sort Badi Rawashdeh
collection DOAJ
description <b>Background</b>: Artificial intelligence (AI) has rapidly advanced, significantly impacting medicine. ChatGPT, a new AI model, generates responses based on user input. This study evaluates ChatGPT’s ability to assist with pre- and post-kidney transplantation (KT) patient education. <b>Methods:</b> ChatGPT was queried about KT on 21 February 2023 and 2 March 2023. Questions were categorized into general information for pre-KT patients or donors and post-KT patient instructions. Two experts independently assessed the accuracy of ChatGPT’s responses, and the Flesch–Kincaid readability test was applied to evaluate readability. <b>Results:</b> ChatGPT’s responses to general pre-KT questions were clear, concise, and accurate but occasionally misleading. Post-transplant instructions were generally clear and partially concise but lacked supporting evidence. Instructions for emergency situations post-KT were typically safe and reliable, whereas medication-related directions were often inaccurate and unreliable. The mean Flesch–Kincaid readability score was 30, indicating that ChatGPT’s answers were not easy to understand. <b>Conclusion:</b> This study demonstrates that while ChatGPT can provide clear definitions, explain symptoms, and offer reasonable advice on managing medical situations after KT, it frequently gives misleading answers to scientific inquiries. Transplantation researchers and providers should recognize ChatGPT as a potential information source for patients but exercise caution due to its incomplete accuracy and lack of references.
format Article
id doaj-art-21ec3bdd28d54b5cb06d613fc92c0dc7
institution DOAJ
issn 2673-3943
language English
publishDate 2024-11-01
publisher MDPI AG
record_format Article
series Transplantology
spelling doaj-art-21ec3bdd28d54b5cb06d613fc92c0dc72025-08-20T02:57:18ZengMDPI AGTransplantology2673-39432024-11-015427127910.3390/transplantology5040027Diversifying Kidney Transplant Education: Assessing the Artificial Intelligence-Powered Capability of ChatGPTBadi Rawashdeh0Joohyun Kim1Ty Dunn2Haneen Al-Abdallat3Ahmad Qasem4Rootvij Bhatt5Raj Prasad6Matthew Cooper7Division of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI 53226, USADivision of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI 53226, USADivision of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI 53226, USASchool of Medicine, the University of Jordan, Amman 11110, JordanSchool of Computer Science and Mathematics, University of Central Missouri, Warrensburg, MO 64093, USADepartment of Pharmacy, Froedtert Hospital, Milwaukee, WI 53226, USADivision of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI 53226, USADivision of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI 53226, USA<b>Background</b>: Artificial intelligence (AI) has rapidly advanced, significantly impacting medicine. ChatGPT, a new AI model, generates responses based on user input. This study evaluates ChatGPT’s ability to assist with pre- and post-kidney transplantation (KT) patient education. <b>Methods:</b> ChatGPT was queried about KT on 21 February 2023 and 2 March 2023. Questions were categorized into general information for pre-KT patients or donors and post-KT patient instructions. Two experts independently assessed the accuracy of ChatGPT’s responses, and the Flesch–Kincaid readability test was applied to evaluate readability. <b>Results:</b> ChatGPT’s responses to general pre-KT questions were clear, concise, and accurate but occasionally misleading. Post-transplant instructions were generally clear and partially concise but lacked supporting evidence. Instructions for emergency situations post-KT were typically safe and reliable, whereas medication-related directions were often inaccurate and unreliable. The mean Flesch–Kincaid readability score was 30, indicating that ChatGPT’s answers were not easy to understand. <b>Conclusion:</b> This study demonstrates that while ChatGPT can provide clear definitions, explain symptoms, and offer reasonable advice on managing medical situations after KT, it frequently gives misleading answers to scientific inquiries. Transplantation researchers and providers should recognize ChatGPT as a potential information source for patients but exercise caution due to its incomplete accuracy and lack of references.https://www.mdpi.com/2673-3943/5/4/27artificial intelligenceChatGPTkidney transplant education
spellingShingle Badi Rawashdeh
Joohyun Kim
Ty Dunn
Haneen Al-Abdallat
Ahmad Qasem
Rootvij Bhatt
Raj Prasad
Matthew Cooper
Diversifying Kidney Transplant Education: Assessing the Artificial Intelligence-Powered Capability of ChatGPT
Transplantology
artificial intelligence
ChatGPT
kidney transplant education
title Diversifying Kidney Transplant Education: Assessing the Artificial Intelligence-Powered Capability of ChatGPT
title_full Diversifying Kidney Transplant Education: Assessing the Artificial Intelligence-Powered Capability of ChatGPT
title_fullStr Diversifying Kidney Transplant Education: Assessing the Artificial Intelligence-Powered Capability of ChatGPT
title_full_unstemmed Diversifying Kidney Transplant Education: Assessing the Artificial Intelligence-Powered Capability of ChatGPT
title_short Diversifying Kidney Transplant Education: Assessing the Artificial Intelligence-Powered Capability of ChatGPT
title_sort diversifying kidney transplant education assessing the artificial intelligence powered capability of chatgpt
topic artificial intelligence
ChatGPT
kidney transplant education
url https://www.mdpi.com/2673-3943/5/4/27
work_keys_str_mv AT badirawashdeh diversifyingkidneytransplanteducationassessingtheartificialintelligencepoweredcapabilityofchatgpt
AT joohyunkim diversifyingkidneytransplanteducationassessingtheartificialintelligencepoweredcapabilityofchatgpt
AT tydunn diversifyingkidneytransplanteducationassessingtheartificialintelligencepoweredcapabilityofchatgpt
AT haneenalabdallat diversifyingkidneytransplanteducationassessingtheartificialintelligencepoweredcapabilityofchatgpt
AT ahmadqasem diversifyingkidneytransplanteducationassessingtheartificialintelligencepoweredcapabilityofchatgpt
AT rootvijbhatt diversifyingkidneytransplanteducationassessingtheartificialintelligencepoweredcapabilityofchatgpt
AT rajprasad diversifyingkidneytransplanteducationassessingtheartificialintelligencepoweredcapabilityofchatgpt
AT matthewcooper diversifyingkidneytransplanteducationassessingtheartificialintelligencepoweredcapabilityofchatgpt