Multiscale Adaptively Spatial Feature Fusion Network for Spacecraft Component Recognition

Spacecraft component recognition is crucial for tasks such as on-orbit maintenance and space docking, aiming to identify and categorize different parts of a spacecraft. Semantic segmentation, known for its excellence in instance-level recognition, precise boundary delineation, and enhancement of aut...

Full description

Saved in:
Bibliographic Details
Main Authors: Wuxia Zhang, Xiaoxiao Shao, Chao Mei, Xiaoying Pan, Xiaoqiang Lu
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10820967/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832592958682038272
author Wuxia Zhang
Xiaoxiao Shao
Chao Mei
Xiaoying Pan
Xiaoqiang Lu
author_facet Wuxia Zhang
Xiaoxiao Shao
Chao Mei
Xiaoying Pan
Xiaoqiang Lu
author_sort Wuxia Zhang
collection DOAJ
description Spacecraft component recognition is crucial for tasks such as on-orbit maintenance and space docking, aiming to identify and categorize different parts of a spacecraft. Semantic segmentation, known for its excellence in instance-level recognition, precise boundary delineation, and enhancement of automation capabilities, is well-suited for this task. However, applying existing semantic segmentation methods to spacecraft component recognition still encounters issues with false detections, missed detections, and unclear boundaries of spacecraft components. In order to address these issues, we propose a multiscale adaptively spatial feature fusion network (MASFFN) for spacecraft component recognition. The MASFFN comprises a spatial attention-aware encoder (SAE) and a multiscale adaptively spatial feature fusion-based decoder (Multi-ASFFD). First, the spatial attention-aware feature fusion module within the SAE integrates spatial attention-aware features, mid-level semantic features, and input features to enhance the extraction of component characteristics, thus improving the accuracy in capturing size, shape, and texture information. Second, the multi-scale adaptively spatial feature fusion module within the Multi-ASFFD cascades four adaptively spatial feature fusion blocks to fuse low-level, middle-level, and high-level features at various scales to enrich the semantic information for different spacecraft components. Finally, a compound loss function comprising the cross-entropy and boundary losses is presented to guide the MASFFN better focus on the unclear component edge. The proposed method has been validated on the UESD and URSO datasets, and the experimental results demonstrate the superiority of MASFFN over existing spacecraft component recognition methods.
format Article
id doaj-art-c869ad43e9d5403488df85ef619690bd
institution Kabale University
issn 1939-1404
2151-1535
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
spelling doaj-art-c869ad43e9d5403488df85ef619690bd2025-01-21T00:00:19ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing1939-14042151-15352025-01-01183501351310.1109/JSTARS.2024.352327310820967Multiscale Adaptively Spatial Feature Fusion Network for Spacecraft Component RecognitionWuxia Zhang0https://orcid.org/0000-0002-0759-2489Xiaoxiao Shao1Chao Mei2https://orcid.org/0009-0005-4257-6141Xiaoying Pan3https://orcid.org/0000-0002-8899-7540Xiaoqiang Lu4https://orcid.org/0000-0002-7037-5188Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, Xi'an, ChinaShaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, Xi'an, ChinaCenter for Optical Imagery Analysis and Learning, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, ChinaShaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, Xi'an, ChinaCollege of Physics and Information Engineering, Fuzhou University, Fuzhou, ChinaSpacecraft component recognition is crucial for tasks such as on-orbit maintenance and space docking, aiming to identify and categorize different parts of a spacecraft. Semantic segmentation, known for its excellence in instance-level recognition, precise boundary delineation, and enhancement of automation capabilities, is well-suited for this task. However, applying existing semantic segmentation methods to spacecraft component recognition still encounters issues with false detections, missed detections, and unclear boundaries of spacecraft components. In order to address these issues, we propose a multiscale adaptively spatial feature fusion network (MASFFN) for spacecraft component recognition. The MASFFN comprises a spatial attention-aware encoder (SAE) and a multiscale adaptively spatial feature fusion-based decoder (Multi-ASFFD). First, the spatial attention-aware feature fusion module within the SAE integrates spatial attention-aware features, mid-level semantic features, and input features to enhance the extraction of component characteristics, thus improving the accuracy in capturing size, shape, and texture information. Second, the multi-scale adaptively spatial feature fusion module within the Multi-ASFFD cascades four adaptively spatial feature fusion blocks to fuse low-level, middle-level, and high-level features at various scales to enrich the semantic information for different spacecraft components. Finally, a compound loss function comprising the cross-entropy and boundary losses is presented to guide the MASFFN better focus on the unclear component edge. The proposed method has been validated on the UESD and URSO datasets, and the experimental results demonstrate the superiority of MASFFN over existing spacecraft component recognition methods.https://ieeexplore.ieee.org/document/10820967/Deep learningfeature fusionmultiscalesemantic segmentationspacecraft component recognition
spellingShingle Wuxia Zhang
Xiaoxiao Shao
Chao Mei
Xiaoying Pan
Xiaoqiang Lu
Multiscale Adaptively Spatial Feature Fusion Network for Spacecraft Component Recognition
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Deep learning
feature fusion
multiscale
semantic segmentation
spacecraft component recognition
title Multiscale Adaptively Spatial Feature Fusion Network for Spacecraft Component Recognition
title_full Multiscale Adaptively Spatial Feature Fusion Network for Spacecraft Component Recognition
title_fullStr Multiscale Adaptively Spatial Feature Fusion Network for Spacecraft Component Recognition
title_full_unstemmed Multiscale Adaptively Spatial Feature Fusion Network for Spacecraft Component Recognition
title_short Multiscale Adaptively Spatial Feature Fusion Network for Spacecraft Component Recognition
title_sort multiscale adaptively spatial feature fusion network for spacecraft component recognition
topic Deep learning
feature fusion
multiscale
semantic segmentation
spacecraft component recognition
url https://ieeexplore.ieee.org/document/10820967/
work_keys_str_mv AT wuxiazhang multiscaleadaptivelyspatialfeaturefusionnetworkforspacecraftcomponentrecognition
AT xiaoxiaoshao multiscaleadaptivelyspatialfeaturefusionnetworkforspacecraftcomponentrecognition
AT chaomei multiscaleadaptivelyspatialfeaturefusionnetworkforspacecraftcomponentrecognition
AT xiaoyingpan multiscaleadaptivelyspatialfeaturefusionnetworkforspacecraftcomponentrecognition
AT xiaoqianglu multiscaleadaptivelyspatialfeaturefusionnetworkforspacecraftcomponentrecognition