A Novel Approach to Optimize Key Limitations of Azure Kinect DK for Efficient and Precise Leaf Area Measurement
Maize leaf area offers valuable insights into physiological processes, playing a critical role in breeding and guiding agricultural practices. The Azure Kinect DK possesses the real-time capability to capture and analyze the spatial structural features of crops. However, its further application in m...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Agriculture |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2077-0472/15/2/173 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832589455512305664 |
|---|---|
| author | Ziang Niu Ting Huang Chengjia Xu Xinyue Sun Mohamed Farag Taha Yong He Zhengjun Qiu |
| author_facet | Ziang Niu Ting Huang Chengjia Xu Xinyue Sun Mohamed Farag Taha Yong He Zhengjun Qiu |
| author_sort | Ziang Niu |
| collection | DOAJ |
| description | Maize leaf area offers valuable insights into physiological processes, playing a critical role in breeding and guiding agricultural practices. The Azure Kinect DK possesses the real-time capability to capture and analyze the spatial structural features of crops. However, its further application in maize leaf area measurement is constrained by RGB–depth misalignment and limited sensitivity to detailed organ-level features. This study proposed a novel approach to address and optimize the limitations of the Azure Kinect DK through the multimodal coupling of RGB-D data for enhanced organ-level crop phenotyping. To correct RGB–depth misalignment, a unified recalibration method was developed to ensure accurate alignment between RGB and depth data. Furthermore, a semantic information-guided depth inpainting method was proposed, designed to repair void and flying pixels commonly observed in Azure Kinect DK outputs. The semantic information was extracted using a joint YOLOv11-SAM2 model, which utilizes supervised object recognition prompts and advanced visual large models to achieve precise RGB image semantic parsing with minimal manual input. An efficient pixel filter-based depth inpainting algorithm was then designed to inpaint void and flying pixels and restore consistent, high-confidence depth values within semantic regions. A validation of this approach through leaf area measurements in practical maize field applications—challenged by a limited workspace, constrained viewpoints, and environmental variability—demonstrated near-laboratory precision, achieving an MAPE of 6.549%, RMSE of 4.114 cm<sup>2</sup>, MAE of 2.980 cm<sup>2</sup>, and <i>R<sup>2</sup></i> of 0.976 across 60 maize leaf samples. By focusing processing efforts on the image level rather than directly on 3D point clouds, this approach markedly enhanced both efficiency and accuracy with the sufficient utilization of the Azure Kinect DK, making it a promising solution for high-throughput 3D crop phenotyping. |
| format | Article |
| id | doaj-art-1c71b2741f554dd69d652eaa5d3136f5 |
| institution | Kabale University |
| issn | 2077-0472 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Agriculture |
| spelling | doaj-art-1c71b2741f554dd69d652eaa5d3136f52025-01-24T13:16:00ZengMDPI AGAgriculture2077-04722025-01-0115217310.3390/agriculture15020173A Novel Approach to Optimize Key Limitations of Azure Kinect DK for Efficient and Precise Leaf Area MeasurementZiang Niu0Ting Huang1Chengjia Xu2Xinyue Sun3Mohamed Farag Taha4Yong He5Zhengjun Qiu6College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, ChinaCollege of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, ChinaCollege of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, ChinaCollege of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, ChinaSchool of Agricultural Engineering, Jiangsu University, Zhenjiang 212013, ChinaCollege of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, ChinaCollege of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, ChinaMaize leaf area offers valuable insights into physiological processes, playing a critical role in breeding and guiding agricultural practices. The Azure Kinect DK possesses the real-time capability to capture and analyze the spatial structural features of crops. However, its further application in maize leaf area measurement is constrained by RGB–depth misalignment and limited sensitivity to detailed organ-level features. This study proposed a novel approach to address and optimize the limitations of the Azure Kinect DK through the multimodal coupling of RGB-D data for enhanced organ-level crop phenotyping. To correct RGB–depth misalignment, a unified recalibration method was developed to ensure accurate alignment between RGB and depth data. Furthermore, a semantic information-guided depth inpainting method was proposed, designed to repair void and flying pixels commonly observed in Azure Kinect DK outputs. The semantic information was extracted using a joint YOLOv11-SAM2 model, which utilizes supervised object recognition prompts and advanced visual large models to achieve precise RGB image semantic parsing with minimal manual input. An efficient pixel filter-based depth inpainting algorithm was then designed to inpaint void and flying pixels and restore consistent, high-confidence depth values within semantic regions. A validation of this approach through leaf area measurements in practical maize field applications—challenged by a limited workspace, constrained viewpoints, and environmental variability—demonstrated near-laboratory precision, achieving an MAPE of 6.549%, RMSE of 4.114 cm<sup>2</sup>, MAE of 2.980 cm<sup>2</sup>, and <i>R<sup>2</sup></i> of 0.976 across 60 maize leaf samples. By focusing processing efforts on the image level rather than directly on 3D point clouds, this approach markedly enhanced both efficiency and accuracy with the sufficient utilization of the Azure Kinect DK, making it a promising solution for high-throughput 3D crop phenotyping.https://www.mdpi.com/2077-0472/15/2/1733Dphenotypingmisalignmentdepth qualityinpainting |
| spellingShingle | Ziang Niu Ting Huang Chengjia Xu Xinyue Sun Mohamed Farag Taha Yong He Zhengjun Qiu A Novel Approach to Optimize Key Limitations of Azure Kinect DK for Efficient and Precise Leaf Area Measurement Agriculture 3D phenotyping misalignment depth quality inpainting |
| title | A Novel Approach to Optimize Key Limitations of Azure Kinect DK for Efficient and Precise Leaf Area Measurement |
| title_full | A Novel Approach to Optimize Key Limitations of Azure Kinect DK for Efficient and Precise Leaf Area Measurement |
| title_fullStr | A Novel Approach to Optimize Key Limitations of Azure Kinect DK for Efficient and Precise Leaf Area Measurement |
| title_full_unstemmed | A Novel Approach to Optimize Key Limitations of Azure Kinect DK for Efficient and Precise Leaf Area Measurement |
| title_short | A Novel Approach to Optimize Key Limitations of Azure Kinect DK for Efficient and Precise Leaf Area Measurement |
| title_sort | novel approach to optimize key limitations of azure kinect dk for efficient and precise leaf area measurement |
| topic | 3D phenotyping misalignment depth quality inpainting |
| url | https://www.mdpi.com/2077-0472/15/2/173 |
| work_keys_str_mv | AT ziangniu anovelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT tinghuang anovelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT chengjiaxu anovelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT xinyuesun anovelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT mohamedfaragtaha anovelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT yonghe anovelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT zhengjunqiu anovelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT ziangniu novelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT tinghuang novelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT chengjiaxu novelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT xinyuesun novelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT mohamedfaragtaha novelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT yonghe novelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement AT zhengjunqiu novelapproachtooptimizekeylimitationsofazurekinectdkforefficientandpreciseleafareameasurement |