Toward improving precision and complexity of transformer-based cost-sensitive learning models for plant disease detection

Early and accurate detection of plant diseases is crucial for making informed decisions to increase the yield and quality of crops through the decision of appropriate treatments. This study introduces an automated system for early disease detection in plants that enhanced a lightweight model based o...

Full description

Saved in:
Bibliographic Details
Main Authors: Manh-Tuan Do, Manh-Hung Ha, Duc-Chinh Nguyen, Oscal Tzyh-Chiang Chen
Format: Article
Language:English
Published: Frontiers Media S.A. 2025-01-01
Series:Frontiers in Computer Science
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fcomp.2024.1480481/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832591645963452416
author Manh-Tuan Do
Manh-Hung Ha
Duc-Chinh Nguyen
Oscal Tzyh-Chiang Chen
Oscal Tzyh-Chiang Chen
author_facet Manh-Tuan Do
Manh-Hung Ha
Duc-Chinh Nguyen
Oscal Tzyh-Chiang Chen
Oscal Tzyh-Chiang Chen
author_sort Manh-Tuan Do
collection DOAJ
description Early and accurate detection of plant diseases is crucial for making informed decisions to increase the yield and quality of crops through the decision of appropriate treatments. This study introduces an automated system for early disease detection in plants that enhanced a lightweight model based on the robust machine learning algorithm. In particular, we introduced a transformer module, a fusion of the SPP and C3TR modules, to synthesize features in various sizes and handle uneven input image sizes. The proposed model combined with transformer-based long-term dependency modeling and convolution-based visual feature extraction to improve object detection performance. To optimize a model to a lightweight version, we integrated the proposed transformer model with the Ghost module. Such an integration acted as regular convolutional layers that subsequently substituted for the original layers to cut computational costs. Furthermore, we adopted the SIoU loss function, a modified version of CIoU, applied to the YOLOv8s model, demonstrating a substantial improvement in accuracy. We implemented quantization to the YOLOv8 model using ONNX Runtime to enhance to facilitate real-time disease detection on strawberries. Through an experiment with our dataset, the proposed model demonstrated mAP@.5 characteristics of 80.30%, marking an 8% improvement compared to the original YOLOv8 model. In addition, the parameters and complexity were reduced to approximately one-third of the initial model. These findings demonstrate notable improvements in accuracy and complexity reduction, making it suitable for detecting strawberry diseases in diverse conditions.
format Article
id doaj-art-3ac69ac28ad14b059366a2f8a42c603a
institution Kabale University
issn 2624-9898
language English
publishDate 2025-01-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Computer Science
spelling doaj-art-3ac69ac28ad14b059366a2f8a42c603a2025-01-22T07:15:09ZengFrontiers Media S.A.Frontiers in Computer Science2624-98982025-01-01610.3389/fcomp.2024.14804811480481Toward improving precision and complexity of transformer-based cost-sensitive learning models for plant disease detectionManh-Tuan Do0Manh-Hung Ha1Duc-Chinh Nguyen2Oscal Tzyh-Chiang Chen3Oscal Tzyh-Chiang Chen4Faculty of Applied Sciences, International School, Vietnam National University, Hanoi, VietnamFaculty of Applied Sciences, International School, Vietnam National University, Hanoi, VietnamFaculty of Applied Sciences, International School, Vietnam National University, Hanoi, VietnamFaculty of Applied Sciences, International School, Vietnam National University, Hanoi, VietnamDepartment of Electrical Engineering, National Chung Cheng University, Chiayi, TaiwanEarly and accurate detection of plant diseases is crucial for making informed decisions to increase the yield and quality of crops through the decision of appropriate treatments. This study introduces an automated system for early disease detection in plants that enhanced a lightweight model based on the robust machine learning algorithm. In particular, we introduced a transformer module, a fusion of the SPP and C3TR modules, to synthesize features in various sizes and handle uneven input image sizes. The proposed model combined with transformer-based long-term dependency modeling and convolution-based visual feature extraction to improve object detection performance. To optimize a model to a lightweight version, we integrated the proposed transformer model with the Ghost module. Such an integration acted as regular convolutional layers that subsequently substituted for the original layers to cut computational costs. Furthermore, we adopted the SIoU loss function, a modified version of CIoU, applied to the YOLOv8s model, demonstrating a substantial improvement in accuracy. We implemented quantization to the YOLOv8 model using ONNX Runtime to enhance to facilitate real-time disease detection on strawberries. Through an experiment with our dataset, the proposed model demonstrated mAP@.5 characteristics of 80.30%, marking an 8% improvement compared to the original YOLOv8 model. In addition, the parameters and complexity were reduced to approximately one-third of the initial model. These findings demonstrate notable improvements in accuracy and complexity reduction, making it suitable for detecting strawberry diseases in diverse conditions.https://www.frontiersin.org/articles/10.3389/fcomp.2024.1480481/fullDNNtransformerGhost ConvSIoU loss functionpre-trainedquantization
spellingShingle Manh-Tuan Do
Manh-Hung Ha
Duc-Chinh Nguyen
Oscal Tzyh-Chiang Chen
Oscal Tzyh-Chiang Chen
Toward improving precision and complexity of transformer-based cost-sensitive learning models for plant disease detection
Frontiers in Computer Science
DNN
transformer
Ghost Conv
SIoU loss function
pre-trained
quantization
title Toward improving precision and complexity of transformer-based cost-sensitive learning models for plant disease detection
title_full Toward improving precision and complexity of transformer-based cost-sensitive learning models for plant disease detection
title_fullStr Toward improving precision and complexity of transformer-based cost-sensitive learning models for plant disease detection
title_full_unstemmed Toward improving precision and complexity of transformer-based cost-sensitive learning models for plant disease detection
title_short Toward improving precision and complexity of transformer-based cost-sensitive learning models for plant disease detection
title_sort toward improving precision and complexity of transformer based cost sensitive learning models for plant disease detection
topic DNN
transformer
Ghost Conv
SIoU loss function
pre-trained
quantization
url https://www.frontiersin.org/articles/10.3389/fcomp.2024.1480481/full
work_keys_str_mv AT manhtuando towardimprovingprecisionandcomplexityoftransformerbasedcostsensitivelearningmodelsforplantdiseasedetection
AT manhhungha towardimprovingprecisionandcomplexityoftransformerbasedcostsensitivelearningmodelsforplantdiseasedetection
AT ducchinhnguyen towardimprovingprecisionandcomplexityoftransformerbasedcostsensitivelearningmodelsforplantdiseasedetection
AT oscaltzyhchiangchen towardimprovingprecisionandcomplexityoftransformerbasedcostsensitivelearningmodelsforplantdiseasedetection
AT oscaltzyhchiangchen towardimprovingprecisionandcomplexityoftransformerbasedcostsensitivelearningmodelsforplantdiseasedetection