Frequency-Aware Integrity Learning Network for Semantic Segmentation of Remote Sensing Images
The semantic segmentation of remote sensing images is crucial for computer perception tasks. Integrating dual-modal information enhances semantic understanding. However, existing segmentation methods often suffer from incomplete feature information (features without integrity), leading to inadequate...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10819987/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832592919246143488 |
|---|---|
| author | Penghan Yang Wujie Zhou Yuanyuan Liu |
| author_facet | Penghan Yang Wujie Zhou Yuanyuan Liu |
| author_sort | Penghan Yang |
| collection | DOAJ |
| description | The semantic segmentation of remote sensing images is crucial for computer perception tasks. Integrating dual-modal information enhances semantic understanding. However, existing segmentation methods often suffer from incomplete feature information (features without integrity), leading to inadequate segmentation of pixels near object boundaries. This study introduces the concept of integrity in semantic segmentation and presents a complete integrity learning network using contextual semantics in the multiscale feature decoding process. Specifically, we propose a frequency-aware integrity learning network (FILNet) that compensates for missing features by capturing a shared integrity feature, enabling accurate differentiation between object categories and precise pixel segmentation. First, we design a frequency-driven awareness generator that produces an awareness map by extracting frequency-domain features with high-level semantics, guiding the multiscale feature aggregation process. Second, we implement a split–fuse–replenish strategy, which divides features into two branches for feature extraction and information replenishment, followed by cross-modal fusion and direct connection for information replenishment, resulting in fused features. Finally, we present an integrity assignment and enhancement method that leverages a capsule network to learn the correlation of multiscale features, generating a shared integrity feature. This feature is assigned to multiscale features to enhance their integrity, leading to accurate predictions facilitated by an adaptive large kernel module. Experiments on the Vaihingen and Potsdam datasets demonstrate that our method outperforms current state-of-the-art segmentation techniques. |
| format | Article |
| id | doaj-art-4170535bc4174691ae1dc180d31016b2 |
| institution | Kabale University |
| issn | 1939-1404 2151-1535 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj-art-4170535bc4174691ae1dc180d31016b22025-01-21T00:00:14ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing1939-14042151-15352025-01-01183398340910.1109/JSTARS.2024.352475310819987Frequency-Aware Integrity Learning Network for Semantic Segmentation of Remote Sensing ImagesPenghan Yang0Wujie Zhou1https://orcid.org/0000-0002-3055-2493Yuanyuan Liu2https://orcid.org/0000-0003-0465-3976School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou, ChinaSchool of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou, ChinaSchool of Computer Science and Engineering, Nanyang Technological University, SingaporeThe semantic segmentation of remote sensing images is crucial for computer perception tasks. Integrating dual-modal information enhances semantic understanding. However, existing segmentation methods often suffer from incomplete feature information (features without integrity), leading to inadequate segmentation of pixels near object boundaries. This study introduces the concept of integrity in semantic segmentation and presents a complete integrity learning network using contextual semantics in the multiscale feature decoding process. Specifically, we propose a frequency-aware integrity learning network (FILNet) that compensates for missing features by capturing a shared integrity feature, enabling accurate differentiation between object categories and precise pixel segmentation. First, we design a frequency-driven awareness generator that produces an awareness map by extracting frequency-domain features with high-level semantics, guiding the multiscale feature aggregation process. Second, we implement a split–fuse–replenish strategy, which divides features into two branches for feature extraction and information replenishment, followed by cross-modal fusion and direct connection for information replenishment, resulting in fused features. Finally, we present an integrity assignment and enhancement method that leverages a capsule network to learn the correlation of multiscale features, generating a shared integrity feature. This feature is assigned to multiscale features to enhance their integrity, leading to accurate predictions facilitated by an adaptive large kernel module. Experiments on the Vaihingen and Potsdam datasets demonstrate that our method outperforms current state-of-the-art segmentation techniques.https://ieeexplore.ieee.org/document/10819987/Capsule network (CapsNet)frequency domainintegrity learningremote sensing image (RSI)semantic segmentation |
| spellingShingle | Penghan Yang Wujie Zhou Yuanyuan Liu Frequency-Aware Integrity Learning Network for Semantic Segmentation of Remote Sensing Images IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Capsule network (CapsNet) frequency domain integrity learning remote sensing image (RSI) semantic segmentation |
| title | Frequency-Aware Integrity Learning Network for Semantic Segmentation of Remote Sensing Images |
| title_full | Frequency-Aware Integrity Learning Network for Semantic Segmentation of Remote Sensing Images |
| title_fullStr | Frequency-Aware Integrity Learning Network for Semantic Segmentation of Remote Sensing Images |
| title_full_unstemmed | Frequency-Aware Integrity Learning Network for Semantic Segmentation of Remote Sensing Images |
| title_short | Frequency-Aware Integrity Learning Network for Semantic Segmentation of Remote Sensing Images |
| title_sort | frequency aware integrity learning network for semantic segmentation of remote sensing images |
| topic | Capsule network (CapsNet) frequency domain integrity learning remote sensing image (RSI) semantic segmentation |
| url | https://ieeexplore.ieee.org/document/10819987/ |
| work_keys_str_mv | AT penghanyang frequencyawareintegritylearningnetworkforsemanticsegmentationofremotesensingimages AT wujiezhou frequencyawareintegritylearningnetworkforsemanticsegmentationofremotesensingimages AT yuanyuanliu frequencyawareintegritylearningnetworkforsemanticsegmentationofremotesensingimages |