Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images

The information of cropland is obtained efficiently and accurately as the basis for achieving precision agriculture (PA). As the boundary between cropland and other types of land in remote sensing images with different resolutions is fuzzy, the characteristics of cropland are easily confused when ex...

Full description

Saved in:
Bibliographic Details
Main Authors: Weimin Hou, Yanxia Wang, Jia Su, Yanli Hou, Ming Zhang, Yan Shang
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10258297/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832582352800317440
author Weimin Hou
Yanxia Wang
Jia Su
Yanli Hou
Ming Zhang
Yan Shang
author_facet Weimin Hou
Yanxia Wang
Jia Su
Yanli Hou
Ming Zhang
Yan Shang
author_sort Weimin Hou
collection DOAJ
description The information of cropland is obtained efficiently and accurately as the basis for achieving precision agriculture (PA). As the boundary between cropland and other types of land in remote sensing images with different resolutions is fuzzy, the characteristics of cropland are easily confused when extracting cropland, resulting in inaccurate identification and extraction of cropland under large and complex backgrounds and rough localization of marginal areas. We proposed a two-path multiscale attention self-supervised network with the perception of four directions in pixel space, called the multiscale bilateral spatial direction-aware network (MBSDANet), to solve these problems and improve the model’s ability to extract cropland in small samples. One path extracts attentional feature maps by spatial directions to preserve detailed direction-aware information and generate high-resolution features; the other path obtains local-to-global information through pyramid pooling and attention awareness to capture dense multiscale cropland features to separate targets in complex contexts. The features of the two branches at different levels are fused by weighting the multi-aware information. Triangular self-supervised and boundary-aware losses are used to achieve fine segmentation and extraction of cropland in small samples. We tested the extraction method on cropland in Denmark and the Hebei Province of China, demonstrating its effectiveness and generalization. Compared to other neural network models, MBSDANet achieves better accuracy with a precision of 0.9481, an IoU of 0.8937, and an F1 score of 0.9438.
format Article
id doaj-art-097fcc59c68f435dbc228f9318044a5d
institution Kabale University
issn 2169-3536
language English
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-097fcc59c68f435dbc228f9318044a5d2025-01-30T00:00:29ZengIEEEIEEE Access2169-35362023-01-011110999711000910.1109/ACCESS.2023.331800010258297Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing ImagesWeimin Hou0https://orcid.org/0000-0003-0956-7057Yanxia Wang1https://orcid.org/0009-0006-1627-3259Jia Su2https://orcid.org/0000-0003-2458-7021Yanli Hou3Ming Zhang4https://orcid.org/0000-0003-3766-8787Yan Shang5School of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaSchool of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang, ChinaThe information of cropland is obtained efficiently and accurately as the basis for achieving precision agriculture (PA). As the boundary between cropland and other types of land in remote sensing images with different resolutions is fuzzy, the characteristics of cropland are easily confused when extracting cropland, resulting in inaccurate identification and extraction of cropland under large and complex backgrounds and rough localization of marginal areas. We proposed a two-path multiscale attention self-supervised network with the perception of four directions in pixel space, called the multiscale bilateral spatial direction-aware network (MBSDANet), to solve these problems and improve the model’s ability to extract cropland in small samples. One path extracts attentional feature maps by spatial directions to preserve detailed direction-aware information and generate high-resolution features; the other path obtains local-to-global information through pyramid pooling and attention awareness to capture dense multiscale cropland features to separate targets in complex contexts. The features of the two branches at different levels are fused by weighting the multi-aware information. Triangular self-supervised and boundary-aware losses are used to achieve fine segmentation and extraction of cropland in small samples. We tested the extraction method on cropland in Denmark and the Hebei Province of China, demonstrating its effectiveness and generalization. Compared to other neural network models, MBSDANet achieves better accuracy with a precision of 0.9481, an IoU of 0.8937, and an F1 score of 0.9438.https://ieeexplore.ieee.org/document/10258297/Cropland extractionremote sensing imagesmulti-aware informationspatial directions-awaretwo-path branch
spellingShingle Weimin Hou
Yanxia Wang
Jia Su
Yanli Hou
Ming Zhang
Yan Shang
Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images
IEEE Access
Cropland extraction
remote sensing images
multi-aware information
spatial directions-aware
two-path branch
title Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images
title_full Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images
title_fullStr Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images
title_full_unstemmed Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images
title_short Multi-Scale Bilateral Spatial Direction-Aware Network for Cropland Extraction Based on Remote Sensing Images
title_sort multi scale bilateral spatial direction aware network for cropland extraction based on remote sensing images
topic Cropland extraction
remote sensing images
multi-aware information
spatial directions-aware
two-path branch
url https://ieeexplore.ieee.org/document/10258297/
work_keys_str_mv AT weiminhou multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages
AT yanxiawang multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages
AT jiasu multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages
AT yanlihou multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages
AT mingzhang multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages
AT yanshang multiscalebilateralspatialdirectionawarenetworkforcroplandextractionbasedonremotesensingimages