Exploring the Credibility of Large Language Models for Mental Health Support: Protocol for a Scoping Review by Dipak Gautam, Philipp Kellmeyer

“… BackgroundThe rapid evolution of large language models (LLMs), such as Bidirectional Encoder Representations from Transformers (BERT; Google) and GPT (OpenAI), has introduced significant advancements in natural language processing. …”
Get full text

Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy? by Cundullah TORUN, Abdurrahman SARMIS, Aytekin OGUZ

“…Methods: This cross-sectional and observational study was conducted from March 2 to March 30, 2023, using OpenAI ChatGPT-3.5. ChatGPT provided responses to 7 questions related to vaccine and statin hesitancy. …”
Get full text

Possibilities and limitations of applying ChatGPT in the educational process by Namesztovszk Zsolt B., Glušac Dragana R., Arsović Branka B., Kovacs Elvira I.

“…One such technology is ChatGPT, a powerful large language model developed by OpenAI. In this paper, the authors consider the possibilities and limitations of applying artificial intelligence, primarily ChatGPT, in the educational process. …”
Get full text

Enhancing Environmental Control in Broiler Production: Retrieval-Augmented Generation for Improved Decision-Making with Large Language Models by Marcus Vinicius Leite, Jair Minoro Abe, Marcos Leandro Hoffmann Souza, Irenilza de Alencar Nääs

“…Experiments with the OpenAI GPT-4o model and semantic similarity analysis were used to evaluate response quality with and without RAG. …”
Get full text

Impact of artificial intelligence in managing musculoskeletal pathologies in physiatry: a qualitative observational study evaluating the potential use of ChatGPT versus Copilot for... by Christophe Ah-Yan, Ève Boissonnault, Mathieu Boudier-Revéret, Christopher Mares

“…Using a large language model (LLM), such as ChatGPT (OpenAI) or Copilot (Microsoft), could potentially enhance these outcomes further. …”
Get full text

Accuracy of latest large language models in answering multiple choice questions in dentistry: A comparative study. by Huy Cong Nguyen, Hai Phong Dang, Thuy Linh Nguyen, Viet Hoang, Viet Anh Nguyen

“…This study evaluated six of the latest LLMs as of August 2024, including ChatGPT 4.0 omni (OpenAI), Gemini Advanced 1.5 Pro (Google), Copilot Pro with GPT-4 Turbo (Microsoft), Claude 3.5 Sonnet (Anthropic), Mistral Large 2 (Mistral AI), and Llama 3.1 405b (Meta). χ2 tests were performed to determine whether there were significant differences in the percentages of correct answers among LLMs for both the total sample and each discipline (p < 0.05).…”
Get full text

ChatGPT vs. Orthopedic Residents! Who is the Winner? by Semih Yaş, Asim Ahmadov, Alim Can Baymurat, Mehmet Ali Tokgöz, Secdegül Coşkun Yaş, Mustafa Odluyurt, Tolga Tolunay

“…Objective: In recent advancements in artificial intelligence, ChatGPT by OpenAI has emerged as a versatile tool capable of performing various tasks; however, its application in medicine is challenged by complexities and limitations in accuracy. …”
Get full text

Medical students and ChatGPT: analyzing attitudes, practices, and academic perceptions by Ahmed Samir Abdelhafiz, Maysa I. Farghly, Eman Anwar Sultan, Moaz Elsayed Abouelmagd, Youssef Ashmawy, Eman Hany Elsebaie

“…Abstract Background ChatGPT, a chatbot launched by OpenAI in November 2022, has generated both excitement and concern within the healthcare education, research, and practice communities. …”
Get full text

Benchmarking LLM chatbots’ oncological knowledge with the Turkish Society of Medical Oncology’s annual board examination questions by Efe Cem Erdat, Engin Eren Kavak

“…Methods We assessed the performance of four LLMs—Claude 3.5 Sonnet (Anthropic), ChatGPT 4o (OpenAI), Llama-3 (Meta), and Gemini 1.5 (Google)—using the Turkish Society of Medical Oncology’s annual board examination questions from 2016 to 2024. …”
Get full text

Cypress Copilot: Development of an AI Assistant for Boosting Productivity and Transforming Web Application Testing by Suresh Babu Nettur, Shanthi Karpurapu, Unnati Nettur, Likhit Sagar Gajja

“…We comprehensively evaluated various OpenAI models, including GPT-4-Turbo, GPT-4o, and GitHub Copilot, using zero-shot and few-shot chain prompt techniques. …”
Get full text

ChatGPT for Univariate Statistics: Validation of AI-Assisted Data Analysis in Healthcare Research by Michael R Ruta, Tony Gaidici, Chase Irwin, Jonathan Lifshitz

“… BackgroundChatGPT, a conversational artificial intelligence developed by OpenAI, has rapidly become an invaluable tool for researchers. …”
Get full text

Bibliometric Analysis on ChatGPT Research with CiteSpace by Dongyan Nan, Xiangying Zhao, Chaomei Chen, Seungjong Sun, Kyeo Re Lee, Jang Hyun Kim

“…ChatGPT is a generative artificial intelligence (AI) based chatbot developed by OpenAI and has attracted great attention since its launch in late 2022. …”
Get full text

Performance of emergency triage prediction of an open access natural language processing based chatbot application (ChatGPT): A preliminary, scenario-based cross-sectional study by İbrahim Sarbay, Göksu Bozdereli Berikol, İbrahim Ulaş Özturan

“…The role of chatbots in health care is deemed worthy of research. OpenAI’s ChatGPT is a supervised and empowered machine learning-based chatbot. …”
Get full text

The Potential Clinical Utility of the Customized Large Language Model in Gastroenterology: A Pilot Study by Eun Jeong Gong, Chang Seok Bang, Jae Jun Lee, Jonghyung Park, Eunsil Kim, Subeen Kim, Minjae Kimm, Seoung-Ho Choi

“…<b>Method:</b> We established a customized GPT with the BM25 algorithm using Open AI’s GPT-4o model, which allows it to produce responses in the context of specific documents including textbooks of internal medicine (in English) and gastroenterology (in Korean). …”
Get full text

Large language models generating synthetic clinical datasets: a feasibility and comparative analysis with real-world perioperative data by Austin A. Barr, Joshua Quan, Eddie Guo, Emre Sezgin, Emre Sezgin

“…Recent advances in large language models (LLMs) provide an opportunity to generate synthetic data with reduced reliance on domain expertise, computational resources, and pre-training.ObjectiveThis study aims to assess the feasibility of generating realistic tabular clinical data with OpenAI’s GPT-4o using zero-shot prompting, and evaluate the fidelity of LLM-generated data by comparing its statistical properties to the Vital Signs DataBase (VitalDB), a real-world open-source perioperative dataset.MethodsIn Phase 1, GPT-4o was prompted to generate a dataset with qualitative descriptions of 13 clinical parameters. …”
Get full text

An automated information extraction model for unstructured discharge letters using large language models and GPT-4 by Robert M. Siepmann, Giulia Baldini, Cynthia S. Schmidt, Daniel Truhn, Gustav Anton Müller-Franzes, Amin Dada, Jens Kleesiek, Felix Nensa, René Hosch

“…This study aims to explore the use of Large Language Models (LLMs), specifically Generative Pretrained Transformer 4 (GPT-4) by OpenAI, for automated extraction of diagnoses, medications, and allergies from discharge letters. …”
Get full text

Development and Evaluation of a Mental Health Chatbot Using ChatGPT 4.0: Mixed Methods User Experience Study With Korean Users by Boyoung Kang, Munpyo Hong

“…CareSam, an advanced cross-lingual chatbot using ChatGPT 4.0 (OpenAI) to provide seamless support in both English and Korean contexts. …”
Get full text

Evaluating ChatGPT’s diagnostic potential for pathology images by Liya Ding, Lei Fan, Lei Fan, Miao Shen, Miao Shen, Yawen Wang, Kaiqin Sheng, Zijuan Zou, Huimin An, Zhinong Jiang

“…BackgroundChat Generative Pretrained Transformer (ChatGPT) is a type of large language model (LLM) developed by OpenAI, known for its extensive knowledge base and interactive capabilities. …”
Get full text

Semantic search helper: A tool based on the use of embeddings in multi-item questionnaires as a harmonization opportunity for merging large datasets – A feasibility study by Karl Gottfried, Karina Janson, Nathalie E. Holz, Olaf Reis, Johannes Kornhuber, Anna Eichler, Tobias Banaschewski, Frauke Nees, IMAC-Mind Consortium

“…Methods Using models like SBERT and OpenAI’s ADA, we developed a prototype application (“Semantic Search Helper”) to facilitate the harmonization process of detecting semantically similar items within extensive health-related datasets. …”
Get full text

Unveiling GPT-4V's hidden challenges behind high accuracy on USMLE questions: Observational Study by Zhichao Yang, Zonghai Yao, Mahbuba Tasmin, Parth Vashisht, Won Seok Jang, Feiyun Ouyang, Beining Wang, David McManus, Dan Berlowitz, Hong Yu

“… BackgroundRecent advancements in artificial intelligence, such as GPT-3.5 Turbo (OpenAI) and GPT-4, have demonstrated significant potential by achieving good scores on text-only United States Medical Licensing Examination (USMLE) exams and effectively answering questions from physicians. …”
Get full text