Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing
Crop yield forecasting plays a significant role in addressing growing concerns about food security and guiding decision-making for policymakers and farmers. When deep learning is employed, understanding the learning and decision-making processes of the models, as well as their interaction with the i...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2025-01-01
|
Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/10836770/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832576734717804544 |
---|---|
author | Hiba Najjar Miro Miranda Marlon Nuske Ribana Roscher Andreas Dengel |
author_facet | Hiba Najjar Miro Miranda Marlon Nuske Ribana Roscher Andreas Dengel |
author_sort | Hiba Najjar |
collection | DOAJ |
description | Crop yield forecasting plays a significant role in addressing growing concerns about food security and guiding decision-making for policymakers and farmers. When deep learning is employed, understanding the learning and decision-making processes of the models, as well as their interaction with the input data, is crucial for establishing trust in the models and gaining insight into their reliability. In this study, we focus on the task of crop yield prediction, specifically for soybean, wheat, and rapeseed crops in Argentina, Uruguay, and Germany. Our goal is to develop and explain predictive models for these crops, using a large dataset of satellite images, additional data modalities, and crop yield maps. We employ a long short-term memory network and investigate the impact of using different temporal samplings of the satellite data and the benefit of adding more relevant modalities. For model explainability, we utilize feature attribution methods to quantify input feature contributions, identify critical growth stages, analyze yield variability at the field level, and explain less accurate predictions. The modeling results show an improvement when adding more modalities or using all available instances of satellite data. The explainability results reveal distinct feature importance patterns for each crop and region. We further found that the most influential growth stages on the prediction are dependent on the temporal sampling of the input data. We demonstrated how these critical growth stages, which hold significant agronomic value, closely align with the existing literature in agronomy and crop development biology. |
format | Article |
id | doaj-art-08309426d23d480984f4719e6fd4a831 |
institution | Kabale University |
issn | 1939-1404 2151-1535 |
language | English |
publishDate | 2025-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
spelling | doaj-art-08309426d23d480984f4719e6fd4a8312025-01-31T00:00:30ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing1939-14042151-15352025-01-01184141416110.1109/JSTARS.2025.352806810836770Explainability of Subfield Level Crop Yield Prediction Using Remote SensingHiba Najjar0https://orcid.org/0000-0002-7498-794XMiro Miranda1https://orcid.org/0009-0002-8195-9776Marlon Nuske2https://orcid.org/0000-0002-0651-0664Ribana Roscher3https://orcid.org/0000-0003-0094-6210Andreas Dengel4https://orcid.org/0000-0002-6100-8255RPTU Kaiserslautern-Landau and the German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, GermanyRPTU Kaiserslautern-Landau and the German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, GermanyBundesanstalt für Landwirtschaft und Ernährung, Bonn, GermanyForschungszentrum Jülich GmbH, Jülich, GermanyRPTU Kaiserslautern-Landau and the German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, GermanyCrop yield forecasting plays a significant role in addressing growing concerns about food security and guiding decision-making for policymakers and farmers. When deep learning is employed, understanding the learning and decision-making processes of the models, as well as their interaction with the input data, is crucial for establishing trust in the models and gaining insight into their reliability. In this study, we focus on the task of crop yield prediction, specifically for soybean, wheat, and rapeseed crops in Argentina, Uruguay, and Germany. Our goal is to develop and explain predictive models for these crops, using a large dataset of satellite images, additional data modalities, and crop yield maps. We employ a long short-term memory network and investigate the impact of using different temporal samplings of the satellite data and the benefit of adding more relevant modalities. For model explainability, we utilize feature attribution methods to quantify input feature contributions, identify critical growth stages, analyze yield variability at the field level, and explain less accurate predictions. The modeling results show an improvement when adding more modalities or using all available instances of satellite data. The explainability results reveal distinct feature importance patterns for each crop and region. We further found that the most influential growth stages on the prediction are dependent on the temporal sampling of the input data. We demonstrated how these critical growth stages, which hold significant agronomic value, closely align with the existing literature in agronomy and crop development biology.https://ieeexplore.ieee.org/document/10836770/Explainabilityfeature attributionmachine learning (ML)temporal analysisyield prediction |
spellingShingle | Hiba Najjar Miro Miranda Marlon Nuske Ribana Roscher Andreas Dengel Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Explainability feature attribution machine learning (ML) temporal analysis yield prediction |
title | Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing |
title_full | Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing |
title_fullStr | Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing |
title_full_unstemmed | Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing |
title_short | Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing |
title_sort | explainability of subfield level crop yield prediction using remote sensing |
topic | Explainability feature attribution machine learning (ML) temporal analysis yield prediction |
url | https://ieeexplore.ieee.org/document/10836770/ |
work_keys_str_mv | AT hibanajjar explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing AT miromiranda explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing AT marlonnuske explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing AT ribanaroscher explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing AT andreasdengel explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing |