CMRNet: An Automatic Rapeseed Counting and Localization Method Based on the CNN-Mamba Hybrid Model

Lodging, a major agricultural issue, significantly compromises the yield, stability, and quality of oilseed crops, particularly rapeseed (Brassica napus L.). Real-time monitoring and accurate assessment of lodging are critical for precise yield estimation and the development of lodging-resistant var...

Full description

Saved in:
Bibliographic Details
Main Authors: Jie Li, Chenbo Yang, Chengyong Zhu, Tao Qin, Jingmin Tu, Binhui Wang, Jian Yao, Jiangwei Qiao
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/11018210/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Lodging, a major agricultural issue, significantly compromises the yield, stability, and quality of oilseed crops, particularly rapeseed (Brassica napus L.). Real-time monitoring and accurate assessment of lodging are critical for precise yield estimation and the development of lodging-resistant varieties. However, traditional methods for quantifying lodging rates, which rely on manual measurements of lodged plant proportions, are often labor-intensive and prone to inaccuracies, limiting their utility in large-scale breeding programs. This article provides an indirect method for lodging assessment by simplifying the lodging issue to the enumeration of upright plants. First, we use a deep learning model for plant counting from Unmanned aerial vehicle (UAV) imagery in plot level. A novel CMRNet model is developed for upright plants counting and localization, leveraging a hybrid CNN-Mamba backbone network. The model synergizes local feature extraction via CNN with the global modeling strengths of the Mamba state space model, yielding semantically rich features while significantly enhancing computational efficiency and inference speed. Then, we created a new Upright Rapeseed Center Point (URCP) dataset using high-altitude UAV remote sensing orthoimages, encompassing rapeseed fields at various maturity stages and lodging degrees. Training and validation of CMRNet on the URCP dataset yielded exceptional performance metrics, with mean absolute error (MAE) of 5.70, relative root mean square error (rrMSE) of 8.08, and coefficient of determination (R<inline-formula><tex-math notation="LaTeX">$^{2}$</tex-math></inline-formula>) of 0.9220. These results significantly outperformed existing TasselNetV2, RapeNet, and RPNet models. The number of parameters in our model is only 7.94 M, which is lower than SOTA counting networks. In addition, we also verified the robustness on different rape materials in two years, 2023 and 2025, and the R<inline-formula><tex-math notation="LaTeX">$^{2}$</tex-math></inline-formula> were all above 0.8, indicating that the model should cope with different field conditions.
ISSN:1939-1404
2151-1535