Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images
The information of cropland is obtained efficiently and accurately as the basis for achieving precision agriculture (PA). As the boundary between cropland and other types of land in remote sensing images with different resolutions is fuzzy, the characteristics of cropland are easily confused when ex...
Saved in:
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2023-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/10258297/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832582352800317440 |
---|---|
author | Weimin Hou Yanxia Wang Jia Su Yanli Hou Ming Zhang Yan Shang |
author_facet | Weimin Hou Yanxia Wang Jia Su Yanli Hou Ming Zhang Yan Shang |
author_sort | Weimin Hou |
collection | DOAJ |
description | The information of cropland is obtained efficiently and accurately as the basis for achieving precision agriculture (PA). As the boundary between cropland and other types of land in remote sensing images with different resolutions is fuzzy, the characteristics of cropland are easily confused when extracting cropland, resulting in inaccurate identification and extraction of cropland under large and complex backgrounds and rough localization of marginal areas. We proposed a two-path multiscale attention self-supervised network with the perception of four directions in pixel space, called the multiscale bilateral spatial direction-aware network (MBSDANet), to solve these problems and improve the model’s ability to extract cropland in small samples. One path extracts attentional feature maps by spatial directions to preserve detailed direction-aware information and generate high-resolution features; the other path obtains local-to-global information through pyramid pooling and attention awareness to capture dense multiscale cropland features to separate targets in complex contexts. The features of the two branches at different levels are fused by weighting the multi-aware information. Triangular self-supervised and boundary-aware losses are used to achieve fine segmentation and extraction of cropland in small samples. We tested the extraction method on cropland in Denmark and the Hebei Province of China, demonstrating its effectiveness and generalization. Compared to other neural network models, MBSDANet achieves better accuracy with a precision of 0.9481, an IoU of 0.8937, and an F1 score of 0.9438. |
format | Article |
id | doaj-art-097fcc59c68f435dbc228f9318044a5d |
institution | Kabale University |
issn | 2169-3536 |
language | English |
publishDate | 2023-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj-art-097fcc59c68f435dbc228f9318044a5d2025-01-30T00:00:29ZengIEEEIEEE Access2169-35362023-01-011110999711000910.1109/ACCESS.2023.331800010258297Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing ImagesWeimin Hou0https://orcid.org/0000-0003-0956-7057Yanxia Wang1https://orcid.org/0009-0006-1627-3259Jia Su2https://orcid.org/0000-0003-2458-7021Yanli Hou3Ming Zhang4https://orcid.org/0000-0003-3766-8787Yan Shang5School of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaThe information of cropland is obtained efficiently and accurately as the basis for achieving precision agriculture (PA). As the boundary between cropland and other types of land in remote sensing images with different resolutions is fuzzy, the characteristics of cropland are easily confused when extracting cropland, resulting in inaccurate identification and extraction of cropland under large and complex backgrounds and rough localization of marginal areas. We proposed a two-path multiscale attention self-supervised network with the perception of four directions in pixel space, called the multiscale bilateral spatial direction-aware network (MBSDANet), to solve these problems and improve the model’s ability to extract cropland in small samples. One path extracts attentional feature maps by spatial directions to preserve detailed direction-aware information and generate high-resolution features; the other path obtains local-to-global information through pyramid pooling and attention awareness to capture dense multiscale cropland features to separate targets in complex contexts. The features of the two branches at different levels are fused by weighting the multi-aware information. Triangular self-supervised and boundary-aware losses are used to achieve fine segmentation and extraction of cropland in small samples. We tested the extraction method on cropland in Denmark and the Hebei Province of China, demonstrating its effectiveness and generalization. Compared to other neural network models, MBSDANet achieves better accuracy with a precision of 0.9481, an IoU of 0.8937, and an F1 score of 0.9438.https://ieeexplore.ieee.org/document/10258297/Cropland extractionremote sensing imagesmulti-aware informationspatial directions-awaretwo-path branch |
spellingShingle | Weimin Hou Yanxia Wang Jia Su Yanli Hou Ming Zhang Yan Shang Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images IEEE Access Cropland extraction remote sensing images multi-aware information spatial directions-aware two-path branch |
title | Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images |
title_full | Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images |
title_fullStr | Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images |
title_full_unstemmed | Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images |
title_short | Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images |
title_sort | multi scale bilateral spatial direction aware network for cropland extraction based on remote sensing images |
topic | Cropland extraction remote sensing images multi-aware information spatial directions-aware two-path branch |
url | https://ieeexplore.ieee.org/document/10258297/ |
work_keys_str_mv | AT weiminhou multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages AT yanxiawang multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages AT jiasu multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages AT yanlihou multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages AT mingzhang multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages AT yanshang multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages |