Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing

Crop yield forecasting plays a significant role in addressing growing concerns about food security and guiding decision-making for policymakers and farmers. When deep learning is employed, understanding the learning and decision-making processes of the models, as well as their interaction with the i...

Full description

Saved in:
Bibliographic Details
Main Authors: Hiba Najjar, Miro Miranda, Marlon Nuske, Ribana Roscher, Andreas Dengel
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10836770/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832576734717804544
author Hiba Najjar
Miro Miranda
Marlon Nuske
Ribana Roscher
Andreas Dengel
author_facet Hiba Najjar
Miro Miranda
Marlon Nuske
Ribana Roscher
Andreas Dengel
author_sort Hiba Najjar
collection DOAJ
description Crop yield forecasting plays a significant role in addressing growing concerns about food security and guiding decision-making for policymakers and farmers. When deep learning is employed, understanding the learning and decision-making processes of the models, as well as their interaction with the input data, is crucial for establishing trust in the models and gaining insight into their reliability. In this study, we focus on the task of crop yield prediction, specifically for soybean, wheat, and rapeseed crops in Argentina, Uruguay, and Germany. Our goal is to develop and explain predictive models for these crops, using a large dataset of satellite images, additional data modalities, and crop yield maps. We employ a long short-term memory network and investigate the impact of using different temporal samplings of the satellite data and the benefit of adding more relevant modalities. For model explainability, we utilize feature attribution methods to quantify input feature contributions, identify critical growth stages, analyze yield variability at the field level, and explain less accurate predictions. The modeling results show an improvement when adding more modalities or using all available instances of satellite data. The explainability results reveal distinct feature importance patterns for each crop and region. We further found that the most influential growth stages on the prediction are dependent on the temporal sampling of the input data. We demonstrated how these critical growth stages, which hold significant agronomic value, closely align with the existing literature in agronomy and crop development biology.
format Article
id doaj-art-08309426d23d480984f4719e6fd4a831
institution Kabale University
issn 1939-1404
2151-1535
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
spelling doaj-art-08309426d23d480984f4719e6fd4a8312025-01-31T00:00:30ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing1939-14042151-15352025-01-01184141416110.1109/JSTARS.2025.352806810836770Explainability of Subfield Level Crop Yield Prediction Using Remote SensingHiba Najjar0https://orcid.org/0000-0002-7498-794XMiro Miranda1https://orcid.org/0009-0002-8195-9776Marlon Nuske2https://orcid.org/0000-0002-0651-0664Ribana Roscher3https://orcid.org/0000-0003-0094-6210Andreas Dengel4https://orcid.org/0000-0002-6100-8255RPTU Kaiserslautern-Landau and the German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, GermanyRPTU Kaiserslautern-Landau and the German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, GermanyBundesanstalt für Landwirtschaft und Ernährung, Bonn, GermanyForschungszentrum Jülich GmbH, Jülich, GermanyRPTU Kaiserslautern-Landau and the German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, GermanyCrop yield forecasting plays a significant role in addressing growing concerns about food security and guiding decision-making for policymakers and farmers. When deep learning is employed, understanding the learning and decision-making processes of the models, as well as their interaction with the input data, is crucial for establishing trust in the models and gaining insight into their reliability. In this study, we focus on the task of crop yield prediction, specifically for soybean, wheat, and rapeseed crops in Argentina, Uruguay, and Germany. Our goal is to develop and explain predictive models for these crops, using a large dataset of satellite images, additional data modalities, and crop yield maps. We employ a long short-term memory network and investigate the impact of using different temporal samplings of the satellite data and the benefit of adding more relevant modalities. For model explainability, we utilize feature attribution methods to quantify input feature contributions, identify critical growth stages, analyze yield variability at the field level, and explain less accurate predictions. The modeling results show an improvement when adding more modalities or using all available instances of satellite data. The explainability results reveal distinct feature importance patterns for each crop and region. We further found that the most influential growth stages on the prediction are dependent on the temporal sampling of the input data. We demonstrated how these critical growth stages, which hold significant agronomic value, closely align with the existing literature in agronomy and crop development biology.https://ieeexplore.ieee.org/document/10836770/Explainabilityfeature attributionmachine learning (ML)temporal analysisyield prediction
spellingShingle Hiba Najjar
Miro Miranda
Marlon Nuske
Ribana Roscher
Andreas Dengel
Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Explainability
feature attribution
machine learning (ML)
temporal analysis
yield prediction
title Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing
title_full Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing
title_fullStr Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing
title_full_unstemmed Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing
title_short Explainability of Subfield Level Crop Yield Prediction Using Remote Sensing
title_sort explainability of subfield level crop yield prediction using remote sensing
topic Explainability
feature attribution
machine learning (ML)
temporal analysis
yield prediction
url https://ieeexplore.ieee.org/document/10836770/
work_keys_str_mv AT hibanajjar explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing
AT miromiranda explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing
AT marlonnuske explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing
AT ribanaroscher explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing
AT andreasdengel explainabilityofsubfieldlevelcropyieldpredictionusingremotesensing