Quality of Chatbot Responses to the Most Popular Questions Regarding Erectile Dysfunction
Objective: Erectile dysfunction (ED) is a common cause of male sexual dysfunction. We aimed to evaluate the quality of ChatGPT and Gemini’s responses to the most frequently asked questions about ED. Methods: This study was conducted as a cross-sectional, observational study. Google Trends was use...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
AVES
2024-07-01
|
| Series: | Urology Research and Practice |
| Online Access: | https://urologyresearchandpractice.org/en/quality-of-chatbot-responses-to-the-most-popular-questions-regarding-erectile-dysfunction-133951 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832575996877864960 |
|---|---|
| author | İrfan Şafak Barlas Lütfi Tunç |
| author_facet | İrfan Şafak Barlas Lütfi Tunç |
| author_sort | İrfan Şafak Barlas |
| collection | DOAJ |
| description | Objective: Erectile dysfunction (ED) is a common cause of male sexual dysfunction. We aimed to evaluate the quality of ChatGPT and Gemini’s responses to the most frequently asked questions about ED.
Methods: This study was conducted as a cross-sectional, observational study. Google Trends was used to determine the most frequently asked questions on the internet. ChatGPT-3.5 and Gemini were compared for these chatbots’ answers to the questions about ED. Two urologists with board certificates assessed the quality of responses using the Global Quality Score (GQS).
Results: Fifteen questions about ED were included according to the Google Trends. ChatGPT was able to answer all the questions systematically, whereas Gemini could not answer two questions. Upon assessing the quality of the responses provided by both researchers with the GQS, it was observed that the frequency of low-quality responses from Gemini exceeded that of ChatGPT. The agreement between researchers was 92% for ChatGPT and 95% for Gemini.
Conclusion: Despite the expeditious and comprehensive answers provided by chatbots, we identified inadequacies in their responses related to ED. In their current state, they cannot replace the patient-centered approach of healthcare professionals and require further development. |
| format | Article |
| id | doaj-art-6b7b06286c9d4435a19c1d18c02b7c36 |
| institution | Kabale University |
| issn | 2980-1478 |
| language | English |
| publishDate | 2024-07-01 |
| publisher | AVES |
| record_format | Article |
| series | Urology Research and Practice |
| spelling | doaj-art-6b7b06286c9d4435a19c1d18c02b7c362025-01-31T14:29:45ZengAVESUrology Research and Practice2980-14782024-07-0150425326010.5152/tud.2025.24098Quality of Chatbot Responses to the Most Popular Questions Regarding Erectile Dysfunctionİrfan Şafak Barlas0https://orcid.org/0000-0001-7894-9118Lütfi Tunç1https://orcid.org/0000-0002-7338-3909Clinic of Urology, Ankara Acibadem Hospital, Ankara, TürkiyeClinic of Urology, Ankara Acibadem Hospital, Ankara, TürkiyeObjective: Erectile dysfunction (ED) is a common cause of male sexual dysfunction. We aimed to evaluate the quality of ChatGPT and Gemini’s responses to the most frequently asked questions about ED. Methods: This study was conducted as a cross-sectional, observational study. Google Trends was used to determine the most frequently asked questions on the internet. ChatGPT-3.5 and Gemini were compared for these chatbots’ answers to the questions about ED. Two urologists with board certificates assessed the quality of responses using the Global Quality Score (GQS). Results: Fifteen questions about ED were included according to the Google Trends. ChatGPT was able to answer all the questions systematically, whereas Gemini could not answer two questions. Upon assessing the quality of the responses provided by both researchers with the GQS, it was observed that the frequency of low-quality responses from Gemini exceeded that of ChatGPT. The agreement between researchers was 92% for ChatGPT and 95% for Gemini. Conclusion: Despite the expeditious and comprehensive answers provided by chatbots, we identified inadequacies in their responses related to ED. In their current state, they cannot replace the patient-centered approach of healthcare professionals and require further development.https://urologyresearchandpractice.org/en/quality-of-chatbot-responses-to-the-most-popular-questions-regarding-erectile-dysfunction-133951 |
| spellingShingle | İrfan Şafak Barlas Lütfi Tunç Quality of Chatbot Responses to the Most Popular Questions Regarding Erectile Dysfunction Urology Research and Practice |
| title | Quality of Chatbot Responses to the Most Popular Questions Regarding Erectile Dysfunction |
| title_full | Quality of Chatbot Responses to the Most Popular Questions Regarding Erectile Dysfunction |
| title_fullStr | Quality of Chatbot Responses to the Most Popular Questions Regarding Erectile Dysfunction |
| title_full_unstemmed | Quality of Chatbot Responses to the Most Popular Questions Regarding Erectile Dysfunction |
| title_short | Quality of Chatbot Responses to the Most Popular Questions Regarding Erectile Dysfunction |
| title_sort | quality of chatbot responses to the most popular questions regarding erectile dysfunction |
| url | https://urologyresearchandpractice.org/en/quality-of-chatbot-responses-to-the-most-popular-questions-regarding-erectile-dysfunction-133951 |
| work_keys_str_mv | AT irfansafakbarlas qualityofchatbotresponsestothemostpopularquestionsregardingerectiledysfunction AT lutfitunc qualityofchatbotresponsestothemostpopularquestionsregardingerectiledysfunction |