Transformer-Based Sunflower (<em>Helianthus annuus</em> L.) Recognition from Multi-Temporal UAV Orthomosaics

The first appearance of inflorescence in sunflowers (<em>Helianthus annuus</em> L.) signifies the transition of the sunflower from the vegetative stage to the reproductive (R). At this growth period, accurate and automated detection of sunflower inflorescences is of utmost significance f...

Full description

Saved in:
Bibliographic Details
Main Authors: E. Yildirim, I. Colkesen, U. G. Sefercik
Format: Article
Language:English
Published: Copernicus Publications 2025-05-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://isprs-archives.copernicus.org/articles/XLVIII-M-6-2025/309/2025/isprs-archives-XLVIII-M-6-2025-309-2025.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850271500944277504
author E. Yildirim
I. Colkesen
U. G. Sefercik
author_facet E. Yildirim
I. Colkesen
U. G. Sefercik
author_sort E. Yildirim
collection DOAJ
description The first appearance of inflorescence in sunflowers (<em>Helianthus annuus</em> L.) signifies the transition of the sunflower from the vegetative stage to the reproductive (R). At this growth period, accurate and automated detection of sunflower inflorescences is of utmost significance for sunflower yield estimation. Unmanned aerial vehicles (UAVs) have become essential in agricultural product detection due to their high spatial and temporal resolution data collection ability. With the rapid enhancements in deep learning, transformer architectures have emerged as a revolutionary paradigm, showing remarkable success in precision agriculture applications, including crop recognition and mapping. The main goal of this study is to investigate the potential of the DETection TRansformer (DETR) model in identifying sunflowers at the reproductive stage using multi-temporal UAV orthomosaics. To this end, orthomosaics were produced using high-resolution aerial photos collected with a DJI Phantom 4 Pro V2 UAV in a sunflower field located in Akyazı district of Sakarya province, during two reproductive periods of sunflower (R5.1 and R5.9). Utilizing the orthomosaics, two sunflower detection datasets were constructed to train and evaluate the model. The results revealed that the DETR performed better on the R5.9 growth stage (AP<sub>0.50</sub> = 92.40%, AR<sub>100</sub> = 68.00%) than the R5.1 (AP<sub>0.50</sub> = 83.70%, AR<sub>100</sub> = 53.90%). Furthermore, given increasing IoU thresholds, DETR demonstrated 16.4% and 29.8% improvements in AP and AP<sub>0.75</sub>, respectively, at the R5.9 stage. The results highlighted that DETR could be a powerful tool for identifying sunflowers, especially at advanced growth stages, likely due to more distinct and developed features of inflorescences.
format Article
id doaj-art-7d8024bbaed44c7daa95d115da5df8e2
institution OA Journals
issn 1682-1750
2194-9034
language English
publishDate 2025-05-01
publisher Copernicus Publications
record_format Article
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj-art-7d8024bbaed44c7daa95d115da5df8e22025-08-20T01:52:12ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342025-05-01XLVIII-M-6-202530931510.5194/isprs-archives-XLVIII-M-6-2025-309-2025Transformer-Based Sunflower (<em>Helianthus annuus</em> L.) Recognition from Multi-Temporal UAV OrthomosaicsE. Yildirim0I. Colkesen1U. G. Sefercik2Gebze Technical University, Engineering Faculty, Department of Geomatics Engineering, 41400 Kocaeli, TürkiyeGebze Technical University, Engineering Faculty, Department of Geomatics Engineering, 41400 Kocaeli, TürkiyeGebze Technical University, Engineering Faculty, Department of Geomatics Engineering, 41400 Kocaeli, TürkiyeThe first appearance of inflorescence in sunflowers (<em>Helianthus annuus</em> L.) signifies the transition of the sunflower from the vegetative stage to the reproductive (R). At this growth period, accurate and automated detection of sunflower inflorescences is of utmost significance for sunflower yield estimation. Unmanned aerial vehicles (UAVs) have become essential in agricultural product detection due to their high spatial and temporal resolution data collection ability. With the rapid enhancements in deep learning, transformer architectures have emerged as a revolutionary paradigm, showing remarkable success in precision agriculture applications, including crop recognition and mapping. The main goal of this study is to investigate the potential of the DETection TRansformer (DETR) model in identifying sunflowers at the reproductive stage using multi-temporal UAV orthomosaics. To this end, orthomosaics were produced using high-resolution aerial photos collected with a DJI Phantom 4 Pro V2 UAV in a sunflower field located in Akyazı district of Sakarya province, during two reproductive periods of sunflower (R5.1 and R5.9). Utilizing the orthomosaics, two sunflower detection datasets were constructed to train and evaluate the model. The results revealed that the DETR performed better on the R5.9 growth stage (AP<sub>0.50</sub> = 92.40%, AR<sub>100</sub> = 68.00%) than the R5.1 (AP<sub>0.50</sub> = 83.70%, AR<sub>100</sub> = 53.90%). Furthermore, given increasing IoU thresholds, DETR demonstrated 16.4% and 29.8% improvements in AP and AP<sub>0.75</sub>, respectively, at the R5.9 stage. The results highlighted that DETR could be a powerful tool for identifying sunflowers, especially at advanced growth stages, likely due to more distinct and developed features of inflorescences.https://isprs-archives.copernicus.org/articles/XLVIII-M-6-2025/309/2025/isprs-archives-XLVIII-M-6-2025-309-2025.pdf
spellingShingle E. Yildirim
I. Colkesen
U. G. Sefercik
Transformer-Based Sunflower (<em>Helianthus annuus</em> L.) Recognition from Multi-Temporal UAV Orthomosaics
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title Transformer-Based Sunflower (<em>Helianthus annuus</em> L.) Recognition from Multi-Temporal UAV Orthomosaics
title_full Transformer-Based Sunflower (<em>Helianthus annuus</em> L.) Recognition from Multi-Temporal UAV Orthomosaics
title_fullStr Transformer-Based Sunflower (<em>Helianthus annuus</em> L.) Recognition from Multi-Temporal UAV Orthomosaics
title_full_unstemmed Transformer-Based Sunflower (<em>Helianthus annuus</em> L.) Recognition from Multi-Temporal UAV Orthomosaics
title_short Transformer-Based Sunflower (<em>Helianthus annuus</em> L.) Recognition from Multi-Temporal UAV Orthomosaics
title_sort transformer based sunflower em helianthus annuus em l recognition from multi temporal uav orthomosaics
url https://isprs-archives.copernicus.org/articles/XLVIII-M-6-2025/309/2025/isprs-archives-XLVIII-M-6-2025-309-2025.pdf
work_keys_str_mv AT eyildirim transformerbasedsunfloweremhelianthusannuusemlrecognitionfrommultitemporaluavorthomosaics
AT icolkesen transformerbasedsunfloweremhelianthusannuusemlrecognitionfrommultitemporaluavorthomosaics
AT ugsefercik transformerbasedsunfloweremhelianthusannuusemlrecognitionfrommultitemporaluavorthomosaics