Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand

This study introduces a novel AI-driven approach to support elderly patients in Thailand with medication management, focusing on accurate drug label interpretation. Two model architectures were explored: a Two-Stage Optical Character Recognition (OCR) and Large Language Model (LLM) pipeline combinin...

Full description

Saved in:
Bibliographic Details
Main Authors: Parinya Thetbanthad, Benjaporn Sathanarugsawait, Prasong Praneetpolgrang
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Journal of Imaging
Subjects:
Online Access:https://www.mdpi.com/2313-433X/11/1/11
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832588307271254016
author Parinya Thetbanthad
Benjaporn Sathanarugsawait
Prasong Praneetpolgrang
author_facet Parinya Thetbanthad
Benjaporn Sathanarugsawait
Prasong Praneetpolgrang
author_sort Parinya Thetbanthad
collection DOAJ
description This study introduces a novel AI-driven approach to support elderly patients in Thailand with medication management, focusing on accurate drug label interpretation. Two model architectures were explored: a Two-Stage Optical Character Recognition (OCR) and Large Language Model (LLM) pipeline combining EasyOCR with Qwen2-72b-instruct and a Uni-Stage Visual Question Answering (VQA) model using Qwen2-72b-VL. Both models operated in a zero-shot capacity, utilizing Retrieval-Augmented Generation (RAG) with DrugBank references to ensure contextual relevance and accuracy. Performance was evaluated on a dataset of 100 diverse prescription labels from Thai healthcare facilities, using RAG Assessment (RAGAs) metrics to assess Context Recall, Factual Correctness, Faithfulness, and Semantic Similarity. The Two-Stage model achieved high accuracy (94%) and strong RAGAs scores, particularly in Context Recall (0.88) and Semantic Similarity (0.91), making it well-suited for complex medication instructions. In contrast, the Uni-Stage model delivered faster response times, making it practical for high-volume environments such as pharmacies. This study demonstrates the potential of zero-shot AI models in addressing medication management challenges for the elderly by providing clear, accurate, and contextually relevant label interpretations. The findings underscore the adaptability of AI in healthcare, balancing accuracy and efficiency to meet various real-world needs.
format Article
id doaj-art-c896c90aa808402b9a7a9fe4da4ba35b
institution Kabale University
issn 2313-433X
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Journal of Imaging
spelling doaj-art-c896c90aa808402b9a7a9fe4da4ba35b2025-01-24T13:36:15ZengMDPI AGJournal of Imaging2313-433X2025-01-011111110.3390/jimaging11010011Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of ThailandParinya Thetbanthad0Benjaporn Sathanarugsawait1Prasong Praneetpolgrang2School of Information Technology, Sripatum University, Bangkok 10900, ThailandSchool of Information Technology, Sripatum University, Bangkok 10900, ThailandSchool of Information Technology, Sripatum University, Bangkok 10900, ThailandThis study introduces a novel AI-driven approach to support elderly patients in Thailand with medication management, focusing on accurate drug label interpretation. Two model architectures were explored: a Two-Stage Optical Character Recognition (OCR) and Large Language Model (LLM) pipeline combining EasyOCR with Qwen2-72b-instruct and a Uni-Stage Visual Question Answering (VQA) model using Qwen2-72b-VL. Both models operated in a zero-shot capacity, utilizing Retrieval-Augmented Generation (RAG) with DrugBank references to ensure contextual relevance and accuracy. Performance was evaluated on a dataset of 100 diverse prescription labels from Thai healthcare facilities, using RAG Assessment (RAGAs) metrics to assess Context Recall, Factual Correctness, Faithfulness, and Semantic Similarity. The Two-Stage model achieved high accuracy (94%) and strong RAGAs scores, particularly in Context Recall (0.88) and Semantic Similarity (0.91), making it well-suited for complex medication instructions. In contrast, the Uni-Stage model delivered faster response times, making it practical for high-volume environments such as pharmacies. This study demonstrates the potential of zero-shot AI models in addressing medication management challenges for the elderly by providing clear, accurate, and contextually relevant label interpretations. The findings underscore the adaptability of AI in healthcare, balancing accuracy and efficiency to meet various real-world needs.https://www.mdpi.com/2313-433X/11/1/11AI in healthcareprescription label identificationvisual question answeringmedical image understandingLLM in healthcare
spellingShingle Parinya Thetbanthad
Benjaporn Sathanarugsawait
Prasong Praneetpolgrang
Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand
Journal of Imaging
AI in healthcare
prescription label identification
visual question answering
medical image understanding
LLM in healthcare
title Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand
title_full Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand
title_fullStr Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand
title_full_unstemmed Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand
title_short Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand
title_sort application of generative artificial intelligence models for accurate prescription label identification and information retrieval for the elderly in northern east of thailand
topic AI in healthcare
prescription label identification
visual question answering
medical image understanding
LLM in healthcare
url https://www.mdpi.com/2313-433X/11/1/11
work_keys_str_mv AT parinyathetbanthad applicationofgenerativeartificialintelligencemodelsforaccurateprescriptionlabelidentificationandinformationretrievalfortheelderlyinnortherneastofthailand
AT benjapornsathanarugsawait applicationofgenerativeartificialintelligencemodelsforaccurateprescriptionlabelidentificationandinformationretrievalfortheelderlyinnortherneastofthailand
AT prasongpraneetpolgrang applicationofgenerativeartificialintelligencemodelsforaccurateprescriptionlabelidentificationandinformationretrievalfortheelderlyinnortherneastofthailand