MediScan: A Framework of U-Health and Prognostic AI Assessment on Medical Imaging
With technological advancements, remarkable progress has been made with the convergence of health sciences and Artificial Intelligence (AI). Modern health systems are proposed to ease patient diagnostics. However, the challenge is to provide AI-based precautions to patients and doctors for more accu...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-12-01
|
| Series: | Journal of Imaging |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2313-433X/10/12/322 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850042084128456704 |
|---|---|
| author | Sibtain Syed Rehan Ahmed Arshad Iqbal Naveed Ahmad Mohammed Ali Alshara |
| author_facet | Sibtain Syed Rehan Ahmed Arshad Iqbal Naveed Ahmad Mohammed Ali Alshara |
| author_sort | Sibtain Syed |
| collection | DOAJ |
| description | With technological advancements, remarkable progress has been made with the convergence of health sciences and Artificial Intelligence (AI). Modern health systems are proposed to ease patient diagnostics. However, the challenge is to provide AI-based precautions to patients and doctors for more accurate risk assessment. The proposed healthcare system aims to integrate patients, doctors, laboratories, pharmacies, and administrative personnel use cases and their primary functions onto a single platform. The proposed framework can also process microscopic images, CT scans, X-rays, and MRI to classify malignancy and give doctors a set of AI precautions for patient risk assessment. The proposed framework incorporates various DCNN models for identifying different forms of tumors and fractures in the human body i.e., brain, bones, lungs, kidneys, and skin, and generating precautions with the help of the Fined-Tuned Large Language Model (LLM) i.e., Generative Pretrained Transformer 4 (GPT-4). With enough training data, DCNN can learn highly representative, data-driven, hierarchical image features. The GPT-4 model is selected for generating precautions due to its explanation, reasoning, memory, and accuracy on prior medical assessments and research studies. Classification models are evaluated by classification report (i.e., Recall, Precision, F1 Score, Support, Accuracy, and Macro and Weighted Average) and confusion matrix and have shown robust performance compared to the conventional schemes. |
| format | Article |
| id | doaj-art-e7cf072ea67d464cbb1ca74a31cddf56 |
| institution | DOAJ |
| issn | 2313-433X |
| language | English |
| publishDate | 2024-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Imaging |
| spelling | doaj-art-e7cf072ea67d464cbb1ca74a31cddf562025-08-20T02:55:38ZengMDPI AGJournal of Imaging2313-433X2024-12-01101232210.3390/jimaging10120322MediScan: A Framework of U-Health and Prognostic AI Assessment on Medical ImagingSibtain Syed0Rehan Ahmed1Arshad Iqbal2Naveed Ahmad3Mohammed Ali Alshara4School of Computing Sciences, Pak-Austria Fachhochschule Institute of Applied Sciences and Technology (PAF-IAST), Mang, Haripur 22621, Khyber Pakhtunkhwa, PakistanSchool of Computing Sciences, Pak-Austria Fachhochschule Institute of Applied Sciences and Technology (PAF-IAST), Mang, Haripur 22621, Khyber Pakhtunkhwa, PakistanSino-Pak Center for Artificial Intelligence (SPCAI), Pak-Austria Fachhochschule Institute of Applied Sciences and Technology, Mang, Haripur 22621, Khyber Pakhtunkhwa, PakistanCollege of Computer and Information Sciences, Prince Sultan University, Riyadh 11586, Saudi ArabiaCollege of Computer and Information Sciences, Prince Sultan University, Riyadh 11586, Saudi ArabiaWith technological advancements, remarkable progress has been made with the convergence of health sciences and Artificial Intelligence (AI). Modern health systems are proposed to ease patient diagnostics. However, the challenge is to provide AI-based precautions to patients and doctors for more accurate risk assessment. The proposed healthcare system aims to integrate patients, doctors, laboratories, pharmacies, and administrative personnel use cases and their primary functions onto a single platform. The proposed framework can also process microscopic images, CT scans, X-rays, and MRI to classify malignancy and give doctors a set of AI precautions for patient risk assessment. The proposed framework incorporates various DCNN models for identifying different forms of tumors and fractures in the human body i.e., brain, bones, lungs, kidneys, and skin, and generating precautions with the help of the Fined-Tuned Large Language Model (LLM) i.e., Generative Pretrained Transformer 4 (GPT-4). With enough training data, DCNN can learn highly representative, data-driven, hierarchical image features. The GPT-4 model is selected for generating precautions due to its explanation, reasoning, memory, and accuracy on prior medical assessments and research studies. Classification models are evaluated by classification report (i.e., Recall, Precision, F1 Score, Support, Accuracy, and Macro and Weighted Average) and confusion matrix and have shown robust performance compared to the conventional schemes.https://www.mdpi.com/2313-433X/10/12/322convolutional neural networksdisease recognitionhealthcare applicationimage processingLarge Language Model (LLM)malignancy classification |
| spellingShingle | Sibtain Syed Rehan Ahmed Arshad Iqbal Naveed Ahmad Mohammed Ali Alshara MediScan: A Framework of U-Health and Prognostic AI Assessment on Medical Imaging Journal of Imaging convolutional neural networks disease recognition healthcare application image processing Large Language Model (LLM) malignancy classification |
| title | MediScan: A Framework of U-Health and Prognostic AI Assessment on Medical Imaging |
| title_full | MediScan: A Framework of U-Health and Prognostic AI Assessment on Medical Imaging |
| title_fullStr | MediScan: A Framework of U-Health and Prognostic AI Assessment on Medical Imaging |
| title_full_unstemmed | MediScan: A Framework of U-Health and Prognostic AI Assessment on Medical Imaging |
| title_short | MediScan: A Framework of U-Health and Prognostic AI Assessment on Medical Imaging |
| title_sort | mediscan a framework of u health and prognostic ai assessment on medical imaging |
| topic | convolutional neural networks disease recognition healthcare application image processing Large Language Model (LLM) malignancy classification |
| url | https://www.mdpi.com/2313-433X/10/12/322 |
| work_keys_str_mv | AT sibtainsyed mediscanaframeworkofuhealthandprognosticaiassessmentonmedicalimaging AT rehanahmed mediscanaframeworkofuhealthandprognosticaiassessmentonmedicalimaging AT arshadiqbal mediscanaframeworkofuhealthandprognosticaiassessmentonmedicalimaging AT naveedahmad mediscanaframeworkofuhealthandprognosticaiassessmentonmedicalimaging AT mohammedalialshara mediscanaframeworkofuhealthandprognosticaiassessmentonmedicalimaging |