Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand
This study introduces a novel AI-driven approach to support elderly patients in Thailand with medication management, focusing on accurate drug label interpretation. Two model architectures were explored: a Two-Stage Optical Character Recognition (OCR) and Large Language Model (LLM) pipeline combinin...
Saved in:
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2025-01-01
|
Series: | Journal of Imaging |
Subjects: | |
Online Access: | https://www.mdpi.com/2313-433X/11/1/11 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832588307271254016 |
---|---|
author | Parinya Thetbanthad Benjaporn Sathanarugsawait Prasong Praneetpolgrang |
author_facet | Parinya Thetbanthad Benjaporn Sathanarugsawait Prasong Praneetpolgrang |
author_sort | Parinya Thetbanthad |
collection | DOAJ |
description | This study introduces a novel AI-driven approach to support elderly patients in Thailand with medication management, focusing on accurate drug label interpretation. Two model architectures were explored: a Two-Stage Optical Character Recognition (OCR) and Large Language Model (LLM) pipeline combining EasyOCR with Qwen2-72b-instruct and a Uni-Stage Visual Question Answering (VQA) model using Qwen2-72b-VL. Both models operated in a zero-shot capacity, utilizing Retrieval-Augmented Generation (RAG) with DrugBank references to ensure contextual relevance and accuracy. Performance was evaluated on a dataset of 100 diverse prescription labels from Thai healthcare facilities, using RAG Assessment (RAGAs) metrics to assess Context Recall, Factual Correctness, Faithfulness, and Semantic Similarity. The Two-Stage model achieved high accuracy (94%) and strong RAGAs scores, particularly in Context Recall (0.88) and Semantic Similarity (0.91), making it well-suited for complex medication instructions. In contrast, the Uni-Stage model delivered faster response times, making it practical for high-volume environments such as pharmacies. This study demonstrates the potential of zero-shot AI models in addressing medication management challenges for the elderly by providing clear, accurate, and contextually relevant label interpretations. The findings underscore the adaptability of AI in healthcare, balancing accuracy and efficiency to meet various real-world needs. |
format | Article |
id | doaj-art-c896c90aa808402b9a7a9fe4da4ba35b |
institution | Kabale University |
issn | 2313-433X |
language | English |
publishDate | 2025-01-01 |
publisher | MDPI AG |
record_format | Article |
series | Journal of Imaging |
spelling | doaj-art-c896c90aa808402b9a7a9fe4da4ba35b2025-01-24T13:36:15ZengMDPI AGJournal of Imaging2313-433X2025-01-011111110.3390/jimaging11010011Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of ThailandParinya Thetbanthad0Benjaporn Sathanarugsawait1Prasong Praneetpolgrang2School of Information Technology, Sripatum University, Bangkok 10900, ThailandSchool of Information Technology, Sripatum University, Bangkok 10900, ThailandSchool of Information Technology, Sripatum University, Bangkok 10900, ThailandThis study introduces a novel AI-driven approach to support elderly patients in Thailand with medication management, focusing on accurate drug label interpretation. Two model architectures were explored: a Two-Stage Optical Character Recognition (OCR) and Large Language Model (LLM) pipeline combining EasyOCR with Qwen2-72b-instruct and a Uni-Stage Visual Question Answering (VQA) model using Qwen2-72b-VL. Both models operated in a zero-shot capacity, utilizing Retrieval-Augmented Generation (RAG) with DrugBank references to ensure contextual relevance and accuracy. Performance was evaluated on a dataset of 100 diverse prescription labels from Thai healthcare facilities, using RAG Assessment (RAGAs) metrics to assess Context Recall, Factual Correctness, Faithfulness, and Semantic Similarity. The Two-Stage model achieved high accuracy (94%) and strong RAGAs scores, particularly in Context Recall (0.88) and Semantic Similarity (0.91), making it well-suited for complex medication instructions. In contrast, the Uni-Stage model delivered faster response times, making it practical for high-volume environments such as pharmacies. This study demonstrates the potential of zero-shot AI models in addressing medication management challenges for the elderly by providing clear, accurate, and contextually relevant label interpretations. The findings underscore the adaptability of AI in healthcare, balancing accuracy and efficiency to meet various real-world needs.https://www.mdpi.com/2313-433X/11/1/11AI in healthcareprescription label identificationvisual question answeringmedical image understandingLLM in healthcare |
spellingShingle | Parinya Thetbanthad Benjaporn Sathanarugsawait Prasong Praneetpolgrang Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand Journal of Imaging AI in healthcare prescription label identification visual question answering medical image understanding LLM in healthcare |
title | Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand |
title_full | Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand |
title_fullStr | Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand |
title_full_unstemmed | Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand |
title_short | Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand |
title_sort | application of generative artificial intelligence models for accurate prescription label identification and information retrieval for the elderly in northern east of thailand |
topic | AI in healthcare prescription label identification visual question answering medical image understanding LLM in healthcare |
url | https://www.mdpi.com/2313-433X/11/1/11 |
work_keys_str_mv | AT parinyathetbanthad applicationofgenerativeartificialintelligencemodelsforaccurateprescriptionlabelidentificationandinformationretrievalfortheelderlyinnortherneastofthailand AT benjapornsathanarugsawait applicationofgenerativeartificialintelligencemodelsforaccurateprescriptionlabelidentificationandinformationretrievalfortheelderlyinnortherneastofthailand AT prasongpraneetpolgrang applicationofgenerativeartificialintelligencemodelsforaccurateprescriptionlabelidentificationandinformationretrievalfortheelderlyinnortherneastofthailand |