Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review
IntroductionArtificial intelligence and machine learning are popular interconnected technologies. AI chatbots like ChatGPT and Gemini show considerable promise in medical inquiries. This scoping review aims to assess the accuracy and response length (in characters) of ChatGPT and Gemini in medical a...
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-02-01
|
| Series: | Frontiers in Digital Health |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fdgth.2025.1482712/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832548302809202688 |
|---|---|
| author | Fattah H. Fattah Fattah H. Fattah Abdulwahid M. Salih Abdulwahid M. Salih Ameer M. Salih Ameer M. Salih Saywan K. Asaad Saywan K. Asaad Abdullah K. Ghafour Rawa Bapir Rawa Bapir Rawa Bapir Berun A. Abdalla Berun A. Abdalla Snur Othman Sasan M. Ahmed Sasan M. Ahmed Sabah Jalal Hasan Yousif M. Mahmood Fahmi H. Kakamad Fahmi H. Kakamad Fahmi H. Kakamad |
| author_facet | Fattah H. Fattah Fattah H. Fattah Abdulwahid M. Salih Abdulwahid M. Salih Ameer M. Salih Ameer M. Salih Saywan K. Asaad Saywan K. Asaad Abdullah K. Ghafour Rawa Bapir Rawa Bapir Rawa Bapir Berun A. Abdalla Berun A. Abdalla Snur Othman Sasan M. Ahmed Sasan M. Ahmed Sabah Jalal Hasan Yousif M. Mahmood Fahmi H. Kakamad Fahmi H. Kakamad Fahmi H. Kakamad |
| author_sort | Fattah H. Fattah |
| collection | DOAJ |
| description | IntroductionArtificial intelligence and machine learning are popular interconnected technologies. AI chatbots like ChatGPT and Gemini show considerable promise in medical inquiries. This scoping review aims to assess the accuracy and response length (in characters) of ChatGPT and Gemini in medical applications.MethodsThe eligible databases were searched to find studies published in English from January 1 to October 20, 2023. The inclusion criteria consisted of studies that focused on using AI in medicine and assessed outcomes based on the accuracy and character count (length) of ChatGPT and Gemini. Data collected from the studies included the first author's name, the country where the study was conducted, the type of study design, publication year, sample size, medical speciality, and the accuracy and response length.ResultsThe initial search identified 64 papers, with 11 meeting the inclusion criteria, involving 1,177 samples. ChatGPT showed higher accuracy in radiology (87.43% vs. Gemini's 71%) and shorter responses (907 vs. 1,428 characters). Similar trends were noted in other specialties. However, Gemini outperformed ChatGPT in emergency scenarios (87% vs. 77%) and in renal diets with low potassium and high phosphorus (79% vs. 60% and 100% vs. 77%). Statistical analysis confirms that ChatGPT has greater accuracy and shorter responses than Gemini in medical studies, with a p-value of <.001 for both metrics.ConclusionThis Scoping review suggests that ChatGPT may demonstrate higher accuracy and provide shorter responses than Gemini in medical studies. |
| format | Article |
| id | doaj-art-f244bcb44f7140518a5e755c0f1ea643 |
| institution | Kabale University |
| issn | 2673-253X |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Digital Health |
| spelling | doaj-art-f244bcb44f7140518a5e755c0f1ea6432025-02-03T06:33:39ZengFrontiers Media S.A.Frontiers in Digital Health2673-253X2025-02-01710.3389/fdgth.2025.14827121482712Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping reviewFattah H. Fattah0Fattah H. Fattah1Abdulwahid M. Salih2Abdulwahid M. Salih3Ameer M. Salih4Ameer M. Salih5Saywan K. Asaad6Saywan K. Asaad7Abdullah K. Ghafour8Rawa Bapir9Rawa Bapir10Rawa Bapir11Berun A. Abdalla12Berun A. Abdalla13Snur Othman14Sasan M. Ahmed15Sasan M. Ahmed16Sabah Jalal Hasan17Yousif M. Mahmood18Fahmi H. Kakamad19Fahmi H. Kakamad20Fahmi H. Kakamad21Scientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqCollege of Medicine, University of Sulaimani, Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqCollege of Medicine, University of Sulaimani, Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqCivil Engineering Department, College of Engineering, University of Sulaimani, Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqCollege of Medicine, University of Sulaimani, Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqDepartment of Urology, Sulaimani Surgical Teaching Hospital, Sulaymaniyah, IraqKscien Organization for Scientific Research (Middle East Office), Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqKscien Organization for Scientific Research (Middle East Office), Sulaymaniyah, IraqKscien Organization for Scientific Research (Middle East Office), Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqKscien Organization for Scientific Research (Middle East Office), Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqScientific Affairs Department, Smart Health Tower, Sulaymaniyah, IraqCollege of Medicine, University of Sulaimani, Sulaymaniyah, IraqKscien Organization for Scientific Research (Middle East Office), Sulaymaniyah, IraqIntroductionArtificial intelligence and machine learning are popular interconnected technologies. AI chatbots like ChatGPT and Gemini show considerable promise in medical inquiries. This scoping review aims to assess the accuracy and response length (in characters) of ChatGPT and Gemini in medical applications.MethodsThe eligible databases were searched to find studies published in English from January 1 to October 20, 2023. The inclusion criteria consisted of studies that focused on using AI in medicine and assessed outcomes based on the accuracy and character count (length) of ChatGPT and Gemini. Data collected from the studies included the first author's name, the country where the study was conducted, the type of study design, publication year, sample size, medical speciality, and the accuracy and response length.ResultsThe initial search identified 64 papers, with 11 meeting the inclusion criteria, involving 1,177 samples. ChatGPT showed higher accuracy in radiology (87.43% vs. Gemini's 71%) and shorter responses (907 vs. 1,428 characters). Similar trends were noted in other specialties. However, Gemini outperformed ChatGPT in emergency scenarios (87% vs. 77%) and in renal diets with low potassium and high phosphorus (79% vs. 60% and 100% vs. 77%). Statistical analysis confirms that ChatGPT has greater accuracy and shorter responses than Gemini in medical studies, with a p-value of <.001 for both metrics.ConclusionThis Scoping review suggests that ChatGPT may demonstrate higher accuracy and provide shorter responses than Gemini in medical studies.https://www.frontiersin.org/articles/10.3389/fdgth.2025.1482712/fullChatGPTGoogle Bardmedical inquiriescomparisonmadical AI |
| spellingShingle | Fattah H. Fattah Fattah H. Fattah Abdulwahid M. Salih Abdulwahid M. Salih Ameer M. Salih Ameer M. Salih Saywan K. Asaad Saywan K. Asaad Abdullah K. Ghafour Rawa Bapir Rawa Bapir Rawa Bapir Berun A. Abdalla Berun A. Abdalla Snur Othman Sasan M. Ahmed Sasan M. Ahmed Sabah Jalal Hasan Yousif M. Mahmood Fahmi H. Kakamad Fahmi H. Kakamad Fahmi H. Kakamad Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review Frontiers in Digital Health ChatGPT Google Bard medical inquiries comparison madical AI |
| title | Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review |
| title_full | Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review |
| title_fullStr | Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review |
| title_full_unstemmed | Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review |
| title_short | Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review |
| title_sort | comparative analysis of chatgpt and gemini bard in medical inquiry a scoping review |
| topic | ChatGPT Google Bard medical inquiries comparison madical AI |
| url | https://www.frontiersin.org/articles/10.3389/fdgth.2025.1482712/full |
| work_keys_str_mv | AT fattahhfattah comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT fattahhfattah comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT abdulwahidmsalih comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT abdulwahidmsalih comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT ameermsalih comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT ameermsalih comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT saywankasaad comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT saywankasaad comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT abdullahkghafour comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT rawabapir comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT rawabapir comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT rawabapir comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT berunaabdalla comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT berunaabdalla comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT snurothman comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT sasanmahmed comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT sasanmahmed comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT sabahjalalhasan comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT yousifmmahmood comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT fahmihkakamad comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT fahmihkakamad comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview AT fahmihkakamad comparativeanalysisofchatgptandgeminibardinmedicalinquiryascopingreview |