SFSCDNet: A Deep Learning Model With Spatial Flow-Based Semantic Change Detection From Bi-Temporal Satellite Images

Semantic change detection in remote sensing imagery plays a pivotal role in urban planning, environmental monitoring, and disaster assessment applications. Existing deep learning-based methods, particularly those relying on triple-branch architectures, often struggle to accurately localize and predi...

Full description

Saved in:
Bibliographic Details
Main Authors: K. S. Basavaraju, N. Sravya, Vibha Damodara Kevala, Shilpa Suresh, Shyam Lal
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10807279/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832540553460318208
author K. S. Basavaraju
N. Sravya
Vibha Damodara Kevala
Shilpa Suresh
Shyam Lal
author_facet K. S. Basavaraju
N. Sravya
Vibha Damodara Kevala
Shilpa Suresh
Shyam Lal
author_sort K. S. Basavaraju
collection DOAJ
description Semantic change detection in remote sensing imagery plays a pivotal role in urban planning, environmental monitoring, and disaster assessment applications. Existing deep learning-based methods, particularly those relying on triple-branch architectures, often struggle to accurately localize and predict changes in complex spatial environments characterized by diverse land-cover types. To overcome these limitations, this paper proposes a novel network called the Spatial Flow-based Semantic Change Detection Network. This network processes bi-temporal satellite images using a dual-encoder, triple-decoder architecture that progressively refines spatial features at each network stage, improving semantic change detection results. The Attention-Based Siamese Encoder, Cascaded Convolutional Attention Fusion Block, Cascaded Convolutional Attention Refinement Block and Differentiable Binarization layer helps in improving semantic change detection performance. Experimental results of proposed network on the SECOND dataset demonstrate that the proposed model significantly improves the ability to localize critical changes and distinguish between change and no-change regions. The proposed network achieves an overall accuracy of 86.32%, a mean Intersection over Union of 70.33%, a Separated Kappa of 21.21%, and an F1-score for semantic change detection of 66.01%, with a score of 35.94%. These results represent substantial improvements over previous state-of-the-art models, including a 0.26% increase in overall accuracy, a 2.21% increase in mean Intersection over Union, a 2.62% enhancement in Separated Kappa, and a 3.6% improvement in F1-score for semantic change detection compared to the best-performing models. Notably, the proposed network achieves these results with only 14.56 million parameters, making it more effective and efficient than its competitors, which utilize over 22 million parameters.
format Article
id doaj-art-b806600ed665468fbff06981b8539173
institution Kabale University
issn 2169-3536
language English
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-b806600ed665468fbff06981b85391732025-02-05T00:00:46ZengIEEEIEEE Access2169-35362024-01-011219503219505310.1109/ACCESS.2024.352042810807279SFSCDNet: A Deep Learning Model With Spatial Flow-Based Semantic Change Detection From Bi-Temporal Satellite ImagesK. S. Basavaraju0https://orcid.org/0000-0002-2755-595XN. Sravya1https://orcid.org/0009-0009-3823-1908Vibha Damodara Kevala2Shilpa Suresh3https://orcid.org/0000-0003-1796-5995Shyam Lal4https://orcid.org/0000-0002-4355-6354Department of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, Mangaluru, IndiaDepartment of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, Mangaluru, IndiaDepartment of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, Mangaluru, IndiaDepartment of Mechatronics, Manipal Institute of Technology, Manipal Academy of Higher Education, Udupi, Karnataka, IndiaDepartment of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, Mangaluru, IndiaSemantic change detection in remote sensing imagery plays a pivotal role in urban planning, environmental monitoring, and disaster assessment applications. Existing deep learning-based methods, particularly those relying on triple-branch architectures, often struggle to accurately localize and predict changes in complex spatial environments characterized by diverse land-cover types. To overcome these limitations, this paper proposes a novel network called the Spatial Flow-based Semantic Change Detection Network. This network processes bi-temporal satellite images using a dual-encoder, triple-decoder architecture that progressively refines spatial features at each network stage, improving semantic change detection results. The Attention-Based Siamese Encoder, Cascaded Convolutional Attention Fusion Block, Cascaded Convolutional Attention Refinement Block and Differentiable Binarization layer helps in improving semantic change detection performance. Experimental results of proposed network on the SECOND dataset demonstrate that the proposed model significantly improves the ability to localize critical changes and distinguish between change and no-change regions. The proposed network achieves an overall accuracy of 86.32%, a mean Intersection over Union of 70.33%, a Separated Kappa of 21.21%, and an F1-score for semantic change detection of 66.01%, with a score of 35.94%. These results represent substantial improvements over previous state-of-the-art models, including a 0.26% increase in overall accuracy, a 2.21% increase in mean Intersection over Union, a 2.62% enhancement in Separated Kappa, and a 3.6% improvement in F1-score for semantic change detection compared to the best-performing models. Notably, the proposed network achieves these results with only 14.56 million parameters, making it more effective and efficient than its competitors, which utilize over 22 million parameters.https://ieeexplore.ieee.org/document/10807279/Deep learningchange detectionbinary change detectionsemantic change detectionremote sensingsatellite images
spellingShingle K. S. Basavaraju
N. Sravya
Vibha Damodara Kevala
Shilpa Suresh
Shyam Lal
SFSCDNet: A Deep Learning Model With Spatial Flow-Based Semantic Change Detection From Bi-Temporal Satellite Images
IEEE Access
Deep learning
change detection
binary change detection
semantic change detection
remote sensing
satellite images
title SFSCDNet: A Deep Learning Model With Spatial Flow-Based Semantic Change Detection From Bi-Temporal Satellite Images
title_full SFSCDNet: A Deep Learning Model With Spatial Flow-Based Semantic Change Detection From Bi-Temporal Satellite Images
title_fullStr SFSCDNet: A Deep Learning Model With Spatial Flow-Based Semantic Change Detection From Bi-Temporal Satellite Images
title_full_unstemmed SFSCDNet: A Deep Learning Model With Spatial Flow-Based Semantic Change Detection From Bi-Temporal Satellite Images
title_short SFSCDNet: A Deep Learning Model With Spatial Flow-Based Semantic Change Detection From Bi-Temporal Satellite Images
title_sort sfscdnet a deep learning model with spatial flow based semantic change detection from bi temporal satellite images
topic Deep learning
change detection
binary change detection
semantic change detection
remote sensing
satellite images
url https://ieeexplore.ieee.org/document/10807279/
work_keys_str_mv AT ksbasavaraju sfscdnetadeeplearningmodelwithspatialflowbasedsemanticchangedetectionfrombitemporalsatelliteimages
AT nsravya sfscdnetadeeplearningmodelwithspatialflowbasedsemanticchangedetectionfrombitemporalsatelliteimages
AT vibhadamodarakevala sfscdnetadeeplearningmodelwithspatialflowbasedsemanticchangedetectionfrombitemporalsatelliteimages
AT shilpasuresh sfscdnetadeeplearningmodelwithspatialflowbasedsemanticchangedetectionfrombitemporalsatelliteimages
AT shyamlal sfscdnetadeeplearningmodelwithspatialflowbasedsemanticchangedetectionfrombitemporalsatelliteimages