Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy?
Objective: Chat Generative Pre-trained Transformer (ChatGPT) is an artificial intelligence (AI) language model that is trained to respond to questions across a wide range of topics. Our aim is to elucidate whether it would be beneficial for patients who are hesitant about vaccines and statins to use...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Galenos Publishing House
2024-03-01
|
| Series: | Medeniyet Medical Journal |
| Subjects: | |
| Online Access: | https://jag.journalagent.com/z4/download_fulltext.asp?pdir=medeniyet&un=MEDJ-03154 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832582752284704768 |
|---|---|
| author | Cundullah TORUN Abdurrahman SARMIS Aytekin OGUZ |
| author_facet | Cundullah TORUN Abdurrahman SARMIS Aytekin OGUZ |
| author_sort | Cundullah TORUN |
| collection | DOAJ |
| description | Objective: Chat Generative Pre-trained Transformer (ChatGPT) is an artificial intelligence (AI) language model that is trained to respond to questions across a wide range of topics. Our aim is to elucidate whether it would be beneficial for patients who are hesitant about vaccines and statins to use ChatGPT.
Methods: This cross-sectional and observational study was conducted from March 2 to March 30, 2023, using OpenAI ChatGPT-3.5. ChatGPT provided responses to 7 questions related to vaccine and statin hesitancy. The same questions were also directed at physicians. Both the answers from ChatGPT and the physicians were assessed for accuracy, clarity, and conciseness by experts in cardiology, internal medicine, and microbiology, who possessed a minimum of 30 years of professional experience. Responses were rated on a scale of 0-4, and the ChatGPT's average score was compared with that of physicians using the Mann-Whitney U test.
Results: The mean scores of ChatGPT (3.78+-0.36) and physicians (3.65+-0.57) were similar (Mann-Whitney U test p=0.33). The mean scores of ChatGPT were 3.85+-0.34 for vaccination and 3.68+-0.35 for statin use. The mean scores of physicians were 3.73+-0.51 for vaccination and 3.58+-0.61 for statin use. There was no statistically significant difference between the mean scores of ChatGPT and physicians for both vaccine and statin use (p=0.403 for vaccination, p=0.678 for statin). ChatGPT did not consider sources of conspiratorial information on vaccines and statins.
Conclusions: This study suggests that ChatGPT can be a valuable source of information for guiding patients with vaccine and statin hesitancy. |
| format | Article |
| id | doaj-art-7169ee350a7047c09d94e769182f84d2 |
| institution | Kabale University |
| issn | 2149-2042 2149-4606 |
| language | English |
| publishDate | 2024-03-01 |
| publisher | Galenos Publishing House |
| record_format | Article |
| series | Medeniyet Medical Journal |
| spelling | doaj-art-7169ee350a7047c09d94e769182f84d22025-01-29T10:26:22ZengGalenos Publishing HouseMedeniyet Medical Journal2149-20422149-46062024-03-013911710.4274/MMJ.galenos.2024.03154MEDJ-03154Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy?Cundullah TORUN0Abdurrahman SARMIS1Aytekin OGUZ2Istanbul Goztepe Prof. Dr. Suleyman Yalcin City Hospital, Clinic of Internal Medicine, Istanbul, TurkeyIstanbul Goztepe Prof. Dr. Suleyman Yalcin City Hospital, Clinic of Microbiology, Istanbul, TurkeyIstanbul Goztepe Prof. Dr. Suleyman Yalcin City Hospital, Clinic of Internal Medicine, Istanbul, TurkeyObjective: Chat Generative Pre-trained Transformer (ChatGPT) is an artificial intelligence (AI) language model that is trained to respond to questions across a wide range of topics. Our aim is to elucidate whether it would be beneficial for patients who are hesitant about vaccines and statins to use ChatGPT. Methods: This cross-sectional and observational study was conducted from March 2 to March 30, 2023, using OpenAI ChatGPT-3.5. ChatGPT provided responses to 7 questions related to vaccine and statin hesitancy. The same questions were also directed at physicians. Both the answers from ChatGPT and the physicians were assessed for accuracy, clarity, and conciseness by experts in cardiology, internal medicine, and microbiology, who possessed a minimum of 30 years of professional experience. Responses were rated on a scale of 0-4, and the ChatGPT's average score was compared with that of physicians using the Mann-Whitney U test. Results: The mean scores of ChatGPT (3.78+-0.36) and physicians (3.65+-0.57) were similar (Mann-Whitney U test p=0.33). The mean scores of ChatGPT were 3.85+-0.34 for vaccination and 3.68+-0.35 for statin use. The mean scores of physicians were 3.73+-0.51 for vaccination and 3.58+-0.61 for statin use. There was no statistically significant difference between the mean scores of ChatGPT and physicians for both vaccine and statin use (p=0.403 for vaccination, p=0.678 for statin). ChatGPT did not consider sources of conspiratorial information on vaccines and statins. Conclusions: This study suggests that ChatGPT can be a valuable source of information for guiding patients with vaccine and statin hesitancy.https://jag.journalagent.com/z4/download_fulltext.asp?pdir=medeniyet&un=MEDJ-03154primary preventionartificial intelligencemedication hesitancy |
| spellingShingle | Cundullah TORUN Abdurrahman SARMIS Aytekin OGUZ Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy? Medeniyet Medical Journal primary prevention artificial intelligence medication hesitancy |
| title | Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy? |
| title_full | Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy? |
| title_fullStr | Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy? |
| title_full_unstemmed | Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy? |
| title_short | Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy? |
| title_sort | is chatgpt an accurate and reliable source of information for patients with vaccine and statin hesitancy |
| topic | primary prevention artificial intelligence medication hesitancy |
| url | https://jag.journalagent.com/z4/download_fulltext.asp?pdir=medeniyet&un=MEDJ-03154 |
| work_keys_str_mv | AT cundullahtorun ischatgptanaccurateandreliablesourceofinformationforpatientswithvaccineandstatinhesitancy AT abdurrahmansarmis ischatgptanaccurateandreliablesourceofinformationforpatientswithvaccineandstatinhesitancy AT aytekinoguz ischatgptanaccurateandreliablesourceofinformationforpatientswithvaccineandstatinhesitancy |