Evaluating ChatGPT-3.5 in allergology: performance in the Polish Specialist Examination by Michał Bielówka, Jakub Kufel, Marcin Rojek, Adam Mitręga, Dominika Kaczyńska, Łukasz Czogalik, Michał Janik, Wiktoria Bartnikowska, Sylwia Mielcarska, Dominika Kondoł

Get full text

Analisis Performa Ekstraksi Konten GPT-3 Dengan Matrik Bertscore Dan Rouge by Yetti Yuniati, Kaira Milani Fitria, Melvi, Sri Purwiyanti, Emir Nasrullah, Meizano A Muhammad

Subjects: “…GPT-3…”
Get full text

الخدمة المرجعية والرد على الاستفسارات باستخدام (ChatGpt3.5) و (Gemini) دراسة تقييمية مقارنة by عبد الرحمن صابر عبد الرحمن عمار

“…أظهرت النتائج وجود فروق ذات دلالة إحصائية بين ChatGPT3.5 و Gemini في الرد على الاستفسارات المرجعية لصالح Gemini؛ حيث اتسمت إجاباته بدقة وشمولية أكبر. …”
Get full text

Performance of ChatGPT-3.5 and ChatGPT-4 in the Taiwan National Pharmacist Licensing Examination: Comparative Evaluation Study by Ying-Mei Wang, Hung-Wei Shen, Tzeng-Ji Chen, Shu-Chiung Chiang, Ting-Guan Lin

“… Abstract BackgroundOpenAI released versions ChatGPT-3.5 and GPT-4 between 2022 and 2023. GPT-3.5 has demonstrated proficiency in various examinations, particularly the United States Medical Licensing Examination. …”
Get full text

Readability and Appropriateness of Responses Generated by ChatGPT 3.5, ChatGPT 4.0, Gemini, and Microsoft Copilot for FAQs in Refractive Surgery by Fahri Onur Aydın, Burakhan Kürşat Aksoy, Ali Ceylan, Yusuf Berk Akbaş, Serhat Ermiş, Burçin Kepez Yıldız, Yusuf Yıldırım

“…Results: Based on the responses generated by the LLM chatbots, 45% (n=18) of the answers given by ChatGPT 3.5 were correct, while this rate was 52.5% (n=21) for ChatGPT 4.0, 87.5% (n=35) for Gemini, and 60% (n=24) for Copilot. …”
Get full text

Performance assessment of ChatGPT 4, ChatGPT 3.5, Gemini Advanced Pro 1.5 and Bard 2.0 to problem solving in pathology in French language by Georges Tarris, Laurent Martin

“…Seventy questions (25 first-order single response questions and 45 second-order multiple response questions) were submitted on May 2023 to ChatGPT 3.5 and Bard 2.0, and on September 2024 to Gemini 1.5 and ChatGPT-4. …”
Get full text

Large language models improve the identification of emergency department visits for symptomatic kidney stones by Cosmin A. Bejan, Amy M. Reed, Matthew Mikula, Siwei Zhang, Yaomin Xu, Daniel Fabbri, Peter J. Embí, Ryan S. Hsi

Subjects: Get full text

ChatGPT Conversations on Oral Cancer: Unveiling ChatGPT's Potential and Pitfalls by Nikunj Maniyar, Gargi S. Sarode, Sachin C. Sarode, Shruti Thakkar

Subjects: Get full text

Exploring the Impact of Large Language Models on Disease Diagnosis by Ibrahim Almubark

Subjects: Get full text

A Rule-Based Parser in Comparison with Statistical Neuronal Approaches in Terms of Grammar Competence by Simon M. Strübbe, Alexander T. D. Grünwald, Irina Sidorenko, Renée Lampe

Subjects: Get full text

Application of Conversational AI Models in Decision Making for Clinical Periodontology: Analysis and Predictive Modeling by Albert Camlet, Aida Kusiak, Dariusz Świetlik

“…The periodontology specialty examination test accuracy of ChatGPT-4 was significantly better than that of ChatGPT-3.5 for both sessions (<i>p</i> < 0.05). For the ChatGPT-4 spring session, it was significantly more effective in the English language (<i>p</i> = 0.0325) due to the lack of statistically significant differences for ChatGPT-3.5. …”
Get full text

An investigative analysis – ChatGPT’s capability to excel in the Polish speciality exam in pathology by Michał Bielówka, Jakub Kufel, Marcin Rojek, Dominika Kaczyńska, Łukasz Czogalik, Adam Mitręga, Wiktoria Bartnikowska, Dominika Kondoł, Kacper Palkij, Sylwia Mielcarska

“…ChatGPT-3.5 achieved a performance of 45.38%, which is significantly below the minimum PES pass threshold. …”
Get full text

ChatGPT and oral cancer: a study on informational reliability by Mesude Çi̇ti̇r

“…Methods A total of 20 questions were asked to ChatGPT-3.5, selected from Google Trends and questions asked by patients in the clinic. …”
Get full text

A mixed methods crossover randomized controlled trial exploring the experiences, perceptions, and usability of artificial intelligence (ChatGPT) in health sciences education by Mirella Veras, Joseph-Omer Dyer, Holly Shannon, Bryce J M Bogie, Morgan Ronney, Harmehr Sekhon, Derek Rutherford, Paulo Goberlânio Barros Silva, Dahlia Kairy

“…Technology usability was compared between ChatGPT-3.5 and the traditional tools using questionnaires. …”
Get full text

Clinical Characteristics of Children with Acute Post-Streptococcal Glomerulonephritis and Re-Evaluation of Patients with Artificial Intelligence by Emre LEVENTOGLU, Mustafa SORAN

“…Twelve questions about APSGN were directed to ChatGPT 3.5. The accuracy of the answers was evaluated by the researchers. …”
Get full text

Leveraging ChatGPT to Produce Patient Education Materials for Common Hand Conditions by George Abdelmalek, MD, Harjot Uppal, MBA, Daniel Garcia, BS, Joseph Farshchian, MD, Arash Emami, MD, Andrew McGinniss, MD

“…We evaluate the readability of PEMs generated by ChatGPT 3.5 and 4.0 for common hand conditions. Methods: We used Chat Generative Pre-Trained Transformer (ChatGPT) 3.5 and 4.0 to generate PEMs for 50 common hand pathologies. …”
Get full text

Evaluation of Chat Generative Pre-trained Transformer and Microsoft Copilot Performance on the American Society of Surgery of the Hand Self-Assessment Examinations by Taylor R. Rakauskas, BS, Antonio Da Costa, BS, Camberly Moriconi, BS, Gurnoor Gill, BA, Jeffrey W. Kwong, MD MS, Nicolas Lee, MD

“…Conclusions: In this study, ChatGPT-4 and Microsoft Copilot perform better on the hand surgery subspecialty examinations than did ChatGPT-3.5. Microsoft Copilot was more accurate than ChatGPT3.5 but less accurate than ChatGPT4. …”
Get full text

Large language models for pretreatment education in pediatric radiation oncology: A comparative evaluation study by Dominik Wawrzuta, Aleksandra Napieralska, Katarzyna Ludwikowska, Laimonas Jaruševičius, Anastasija Trofimoviča-Krasnorucka, Gints Rausis, Agata Szulc, Katarzyna Pędziwiatr, Kateřina Poláchová, Justyna Klejdysz, Marzanna Chojnacka

“…Responses were generated using GPT-3.5, GPT-4, and fine-tuned GPT-3.5, with fine-tuning based on pediatric radiotherapy guides from various institutions. …”
Get full text

TQFLL: a novel unified analytics framework for translation quality framework for large language model and human translation of allusions in multilingual corpora by Li Yating, Muhammad Afzaal, Xiao Shanshan, Dina Abdel Salam El-Dakhs

“…The findings of the study indicate that the GPT-3.5 translated version exhibits higher quality than the Volctrans version when evaluated by a machine. …”
Get full text

ChatGPT-4 Omni’s superiority in answering multiple-choice oral radiology questions by Melek Tassoker

“…ChatGPT-4o achieved the highest accuracy at 86.1%, followed by Google Bard at 61.8%. ChatGPT-3.5 demonstrated an accuracy rate of 43.9%, while Microsoft Copilot recorded a rate of 41.5%. …”
Get full text