Can Large Language Models Serve as Reliable Tools for Information in Dentistry? A Systematic Review
Large language models (LLMs) have gained popularity among dental students for generating subject-related answers. However, their widespread use raises significant concerns about misinformation. This systematic review aims to critically evaluate studies assessing the performance of LLMs in dentistry....
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-08-01
|
| Series: | International Dental Journal |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S0020653925001248 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849718156953649152 |
|---|---|
| author | Nora Alhazmi Aram Alshehri Fahad BaHammam Manju Philip Muhammad Nadeem Sanjeev Khanagar |
| author_facet | Nora Alhazmi Aram Alshehri Fahad BaHammam Manju Philip Muhammad Nadeem Sanjeev Khanagar |
| author_sort | Nora Alhazmi |
| collection | DOAJ |
| description | Large language models (LLMs) have gained popularity among dental students for generating subject-related answers. However, their widespread use raises significant concerns about misinformation. This systematic review aims to critically evaluate studies assessing the performance of LLMs in dentistry. A comprehensive electronic search was conducted in PubMed/Medline, Scopus, Embase, Web of Science, Google Scholar, and the Saudi Digital Library to identify studies published up to September 2024. The study quality was assessed using the Prediction Model Risk of Bias Assessment Tool (PROBAST). A total of 2030 studies have been identified. After removing 907 duplicate records, 1123 studies remained for screening. Ultimately, 31 studies met the inclusion criteria. Approximately half of these studies were classified as “high risk,” while the remainder were classified as “low risk.” The applicability of the findings was rated as “low concern.” The primary limitations of LLMs include their inability to specify information sources and their tendency to generate fabricated citations. Based on this review, LLMs hold promise as supplementary educational tools in dentistry. Evidence indicates that students using LLMs may achieve improved academic performance compared to traditional methods. However, concerns about occasional inaccuracies and unreliable citations underscore the need for further research, integration with validated sources, and adherence to ethical guidelines. Ultimately, LLMs should be viewed as complementary tools within dental education, with careful consideration of their limitations. |
| format | Article |
| id | doaj-art-656c2a8ae9784e2087ed5c19cfe41da8 |
| institution | DOAJ |
| issn | 0020-6539 |
| language | English |
| publishDate | 2025-08-01 |
| publisher | Elsevier |
| record_format | Article |
| series | International Dental Journal |
| spelling | doaj-art-656c2a8ae9784e2087ed5c19cfe41da82025-08-20T03:12:27ZengElsevierInternational Dental Journal0020-65392025-08-0175410083510.1016/j.identj.2025.04.015Can Large Language Models Serve as Reliable Tools for Information in Dentistry? A Systematic ReviewNora Alhazmi0Aram Alshehri1Fahad BaHammam2Manju Philip3Muhammad Nadeem4Sanjeev Khanagar5Department of Preventive Dental Sciences, College of Dentistry, King Saud bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Ministry of the National Guard Health Affairs, Riyadh, Saudi Arabia; Corresponding author. American Board of Orthodontics, Division of Orthodontics, Preventive Dental Science Department, College of Dentistry, King Saud bin Abdulaziz University for Health Sciences, Prince Mutib Ibn Abdullah Ibn Abdulaziz Rd, Riyadh, Saudi Arabia.Department of Restorative and Prosthetic Dental Sciences, College of Dentistry, King Saud bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Ministry of the National Guard Health Affairs, Riyadh, Saudi ArabiaDepartment of Restorative and Prosthetic Dental Sciences, College of Dentistry, King Saud bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Ministry of the National Guard Health Affairs, Riyadh, Saudi ArabiaDepartment of Maxillofacial Surgery and Diagnostic Sciences, King Saud bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Ministry of the National Guard Health Affairs, Riyadh, Saudi ArabiaCollege of Dentistry, King Saud bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Ministry of the National Guard Health Affairs, Riyadh, Saudi ArabiaDepartment of Preventive Dental Sciences, College of Dentistry, King Saud bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Ministry of the National Guard Health Affairs, Riyadh, Saudi ArabiaLarge language models (LLMs) have gained popularity among dental students for generating subject-related answers. However, their widespread use raises significant concerns about misinformation. This systematic review aims to critically evaluate studies assessing the performance of LLMs in dentistry. A comprehensive electronic search was conducted in PubMed/Medline, Scopus, Embase, Web of Science, Google Scholar, and the Saudi Digital Library to identify studies published up to September 2024. The study quality was assessed using the Prediction Model Risk of Bias Assessment Tool (PROBAST). A total of 2030 studies have been identified. After removing 907 duplicate records, 1123 studies remained for screening. Ultimately, 31 studies met the inclusion criteria. Approximately half of these studies were classified as “high risk,” while the remainder were classified as “low risk.” The applicability of the findings was rated as “low concern.” The primary limitations of LLMs include their inability to specify information sources and their tendency to generate fabricated citations. Based on this review, LLMs hold promise as supplementary educational tools in dentistry. Evidence indicates that students using LLMs may achieve improved academic performance compared to traditional methods. However, concerns about occasional inaccuracies and unreliable citations underscore the need for further research, integration with validated sources, and adherence to ethical guidelines. Ultimately, LLMs should be viewed as complementary tools within dental education, with careful consideration of their limitations.http://www.sciencedirect.com/science/article/pii/S0020653925001248Large language modelsDentistryPerformanceAccuracy |
| spellingShingle | Nora Alhazmi Aram Alshehri Fahad BaHammam Manju Philip Muhammad Nadeem Sanjeev Khanagar Can Large Language Models Serve as Reliable Tools for Information in Dentistry? A Systematic Review International Dental Journal Large language models Dentistry Performance Accuracy |
| title | Can Large Language Models Serve as Reliable Tools for Information in Dentistry? A Systematic Review |
| title_full | Can Large Language Models Serve as Reliable Tools for Information in Dentistry? A Systematic Review |
| title_fullStr | Can Large Language Models Serve as Reliable Tools for Information in Dentistry? A Systematic Review |
| title_full_unstemmed | Can Large Language Models Serve as Reliable Tools for Information in Dentistry? A Systematic Review |
| title_short | Can Large Language Models Serve as Reliable Tools for Information in Dentistry? A Systematic Review |
| title_sort | can large language models serve as reliable tools for information in dentistry a systematic review |
| topic | Large language models Dentistry Performance Accuracy |
| url | http://www.sciencedirect.com/science/article/pii/S0020653925001248 |
| work_keys_str_mv | AT noraalhazmi canlargelanguagemodelsserveasreliabletoolsforinformationindentistryasystematicreview AT aramalshehri canlargelanguagemodelsserveasreliabletoolsforinformationindentistryasystematicreview AT fahadbahammam canlargelanguagemodelsserveasreliabletoolsforinformationindentistryasystematicreview AT manjuphilip canlargelanguagemodelsserveasreliabletoolsforinformationindentistryasystematicreview AT muhammadnadeem canlargelanguagemodelsserveasreliabletoolsforinformationindentistryasystematicreview AT sanjeevkhanagar canlargelanguagemodelsserveasreliabletoolsforinformationindentistryasystematicreview |