Pre-trained convolutional neural network with transfer learning by artificial illustrated images classify power Doppler ultrasound images of rheumatoid arthritis joints

Objective To study the classification performance of a pre-trained convolutional neural network (CNN) with transfer learning by artificial joint ultrasonography images in rheumatoid arthritis (RA). Methods This retrospective study focused on abnormal synovial vascularity and created 870 artificial j...

Full description

Saved in:
Bibliographic Details
Main Authors: Jun Fukae, Yoshiharu Amasaki, Yuichiro Fujieda, Yuki Sone, Ken Katagishi, Tatsunori Horie, Tamotsu Kamishima, Tatsuya Atsumi
Format: Article
Language:English
Published: SAGE Publishing 2025-02-01
Series:Journal of International Medical Research
Online Access:https://doi.org/10.1177/03000605251318195
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832540333260406784
author Jun Fukae
Yoshiharu Amasaki
Yuichiro Fujieda
Yuki Sone
Ken Katagishi
Tatsunori Horie
Tamotsu Kamishima
Tatsuya Atsumi
author_facet Jun Fukae
Yoshiharu Amasaki
Yuichiro Fujieda
Yuki Sone
Ken Katagishi
Tatsunori Horie
Tamotsu Kamishima
Tatsuya Atsumi
author_sort Jun Fukae
collection DOAJ
description Objective To study the classification performance of a pre-trained convolutional neural network (CNN) with transfer learning by artificial joint ultrasonography images in rheumatoid arthritis (RA). Methods This retrospective study focused on abnormal synovial vascularity and created 870 artificial joint ultrasound images based on the European League Against Rheumatism/Outcome Measure in Rheumatology scoring system. One CNN, the Visual Geometry Group (VGG)-16, was trained with transfer learning using the 870 artificial images for initial training and the original plus five additional images for second training. The models were then tested for the ability to classify joints using real joint ultrasound images obtained from patients with RA. The study was registered in UMIN Clinical Trials Registry (UMIN000054321). Results A total of 156 clinical joint ultrasound images from 74 patients with RA were included. The initial model showed moderate classification performance, but the area under curve (AUC) for grade 1 synovitis was particularly low (0.59). The second model showed improvement in classifying grade 1 synovitis (AUC 0.73). Conclusions Artificial images may be useful for training VGG-16. The present novel approach of using artificial images as an alternative to actual images for training a CNN has the potential to be applied in medical imaging fields that face difficulties in collecting real clinical images.
format Article
id doaj-art-89d6d52f1174431288d38597db6772de
institution Kabale University
issn 1473-2300
language English
publishDate 2025-02-01
publisher SAGE Publishing
record_format Article
series Journal of International Medical Research
spelling doaj-art-89d6d52f1174431288d38597db6772de2025-02-05T05:03:26ZengSAGE PublishingJournal of International Medical Research1473-23002025-02-015310.1177/03000605251318195Pre-trained convolutional neural network with transfer learning by artificial illustrated images classify power Doppler ultrasound images of rheumatoid arthritis jointsJun FukaeYoshiharu AmasakiYuichiro FujiedaYuki SoneKen KatagishiTatsunori HorieTamotsu KamishimaTatsuya AtsumiObjective To study the classification performance of a pre-trained convolutional neural network (CNN) with transfer learning by artificial joint ultrasonography images in rheumatoid arthritis (RA). Methods This retrospective study focused on abnormal synovial vascularity and created 870 artificial joint ultrasound images based on the European League Against Rheumatism/Outcome Measure in Rheumatology scoring system. One CNN, the Visual Geometry Group (VGG)-16, was trained with transfer learning using the 870 artificial images for initial training and the original plus five additional images for second training. The models were then tested for the ability to classify joints using real joint ultrasound images obtained from patients with RA. The study was registered in UMIN Clinical Trials Registry (UMIN000054321). Results A total of 156 clinical joint ultrasound images from 74 patients with RA were included. The initial model showed moderate classification performance, but the area under curve (AUC) for grade 1 synovitis was particularly low (0.59). The second model showed improvement in classifying grade 1 synovitis (AUC 0.73). Conclusions Artificial images may be useful for training VGG-16. The present novel approach of using artificial images as an alternative to actual images for training a CNN has the potential to be applied in medical imaging fields that face difficulties in collecting real clinical images.https://doi.org/10.1177/03000605251318195
spellingShingle Jun Fukae
Yoshiharu Amasaki
Yuichiro Fujieda
Yuki Sone
Ken Katagishi
Tatsunori Horie
Tamotsu Kamishima
Tatsuya Atsumi
Pre-trained convolutional neural network with transfer learning by artificial illustrated images classify power Doppler ultrasound images of rheumatoid arthritis joints
Journal of International Medical Research
title Pre-trained convolutional neural network with transfer learning by artificial illustrated images classify power Doppler ultrasound images of rheumatoid arthritis joints
title_full Pre-trained convolutional neural network with transfer learning by artificial illustrated images classify power Doppler ultrasound images of rheumatoid arthritis joints
title_fullStr Pre-trained convolutional neural network with transfer learning by artificial illustrated images classify power Doppler ultrasound images of rheumatoid arthritis joints
title_full_unstemmed Pre-trained convolutional neural network with transfer learning by artificial illustrated images classify power Doppler ultrasound images of rheumatoid arthritis joints
title_short Pre-trained convolutional neural network with transfer learning by artificial illustrated images classify power Doppler ultrasound images of rheumatoid arthritis joints
title_sort pre trained convolutional neural network with transfer learning by artificial illustrated images classify power doppler ultrasound images of rheumatoid arthritis joints
url https://doi.org/10.1177/03000605251318195
work_keys_str_mv AT junfukae pretrainedconvolutionalneuralnetworkwithtransferlearningbyartificialillustratedimagesclassifypowerdopplerultrasoundimagesofrheumatoidarthritisjoints
AT yoshiharuamasaki pretrainedconvolutionalneuralnetworkwithtransferlearningbyartificialillustratedimagesclassifypowerdopplerultrasoundimagesofrheumatoidarthritisjoints
AT yuichirofujieda pretrainedconvolutionalneuralnetworkwithtransferlearningbyartificialillustratedimagesclassifypowerdopplerultrasoundimagesofrheumatoidarthritisjoints
AT yukisone pretrainedconvolutionalneuralnetworkwithtransferlearningbyartificialillustratedimagesclassifypowerdopplerultrasoundimagesofrheumatoidarthritisjoints
AT kenkatagishi pretrainedconvolutionalneuralnetworkwithtransferlearningbyartificialillustratedimagesclassifypowerdopplerultrasoundimagesofrheumatoidarthritisjoints
AT tatsunorihorie pretrainedconvolutionalneuralnetworkwithtransferlearningbyartificialillustratedimagesclassifypowerdopplerultrasoundimagesofrheumatoidarthritisjoints
AT tamotsukamishima pretrainedconvolutionalneuralnetworkwithtransferlearningbyartificialillustratedimagesclassifypowerdopplerultrasoundimagesofrheumatoidarthritisjoints
AT tatsuyaatsumi pretrainedconvolutionalneuralnetworkwithtransferlearningbyartificialillustratedimagesclassifypowerdopplerultrasoundimagesofrheumatoidarthritisjoints