Identification of diabetic retinopathy lesions in fundus images by integrating CNN and vision mamba models. by Zenglei Liu, Ailian Gao, Hui Sheng, Xueling Wang

“…The majority of deep learning techniques developed for medical image analysis rely on convolutional modules to extract the inherent structure of images within a certain local receptive field. …”
Get full text

Ensemble Streamflow Simulations in a Qinghai–Tibet Plateau Basin Using a Deep Learning Method with Remote Sensing Precipitation Data as Input by Jinqiang Wang, Zhanjie Li, Ling Zhou, Chi Ma, Wenchao Sun

“…Streamflow simulations were carried out using models with diverse structures, including the physically based BTOPMC (Block-wise use of TOPMODEL) and two machine learning models, i.e., Random Forest (RF) and Long Short-Term Memory Neural Networks (LSTM). …”
Get full text

Improved YOLOv8s-based foreign object detection method for mine conveyor belts by LI Runze, GUO Xingge, YANG Fazhan, ZHAO Peipei, XIE Guolong

“…The core feature extraction and fusion module C2f was improved by VMamba's Visual State Space (VSS) module, which efficiently captured global contextual information in images through a state space model and four-directional scanning mechanism, enhancing the model’s understanding of global image structure. …”
Get full text

ST-AGRNN: A Spatio-Temporal Attention-Gated Recurrent Neural Network for Traffic State Forecasting by Jian Yang, Jinhong Li, Lu Wei, Lei Gao, Fuqi Mao

“…In the proposed model, structure-based and location-based localized spatial features are obtained simultaneously by Graph Convolutional Networks (GCNs) and DeepWalk. …”
Get full text

Rice Leaf Disease Image Enhancement Based on Improved CycleGAN by YAN Congkuan, ZHU Dequan, MENG Fankai, YANG Yuqing, TANG Qixing, ZHANG Aifang, LIAO Juan

“…These included user perception evaluation (UPE), structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and the performance of disease recognition within object detection frameworks. …”
Get full text

Attention-Enhanced Hybrid Automatic Modulation Classification for Advanced Wireless Communication Systems: A Deep Learning-Transformer Framework by Sam Ansari, Khawla A. Alnajjar, Sohaib Majzoub, Eqab Almajali, Anwar Jarndal, Talal Bonny, Abir Hussain, Soliman Mahmoud

“…To address these limitations, this paper presents a novel attention-enhanced hybrid AMC framework that synergistically integrates specialized convolutional layers for efficient temporal feature extraction with a compact transformer encoder for global sequence modeling. …”
Get full text

DiffMamba: semantic diffusion guided feature modeling network for semantic segmentation of remote sensing images by Zhen Wang, Nan Xu, Zhuhong You, Shanwen Zhang

“…DiffMamba uses a hybrid CNNs-Transformer as the encoder structure, and is equipped with the efficient phase sensing module (EPSM), the multi-view transformer module (MVTrans), the semantic diffusion alignment module (SDAM), and the coordinate state space model (CAMamba). …”
Get full text

An Mcformer encoder integrating Mamba and Cgmlp for improved acoustic feature extraction by Nurmemet Yolwas, Yongchao Li, Lixu Sun, Jian Peng, Zhiwu Sun, Yajie Wei, Yineng Cai

“…To address this limitation, the Mcformer encoder is introduced, which incorporates the Mamba module in parallel with multi-head attention blocks to enhance the model’s global context processing capabilities. Additionally, a Convolutional Gated Multilayer Perceptron (Cgmlp) structure is employed to improve the extraction of local features through deep convolutional layers. …”
Get full text

CNN–Transformer Hybrid Architecture for Underwater Sonar Image Segmentation by Juan Lei, Huigang Wang, Zelin Lei, Jiayuan Li, Shaowei Rong

“…FLSSNet is built upon a CNN and Transformer backbone network, integrating four core submodules to address various technical challenges: (1) The asymmetric dual encoder–decoder (ADED) is capable of simultaneously extracting features from different modalities and systematically modeling both local contextual information and global spatial structure. (2) The Transformer feature converter (TFC) module optimizes the multimodal feature fusion process through feature transformation and channel compression. (3) The long-range correlation attention (LRCA) module enhances CNN’s ability to model long-range dependencies through the collaborative use of convolutional kernels, selective sequential scanning, and attention mechanisms, while effectively suppressing noise interference. (4) The recursive contour refinement (RCR) model refines edge contour information through a layer-by-layer recursive mechanism, achieving greater precision in boundary details. …”
Get full text

SFFNet: Shallow Feature Fusion Network Based on Detection Framework for Infrared Small Target Detection by Zhihui Yu, Nian Pan, Jin Zhou

“…Then, we design the visual-Mamba-based global information extension (VMamba-GIE) module, which leverages a multi-branch structure combining the capability of convolutional layers to extract features in local space with the advantages of state space models in the exploration of long-distance information. …”
Get full text

Rain removal method for single image of dual-branch joint network based on sparse transformer by Fangfang Qin, Zongpu Jia, Xiaoyan Pang, Shan Zhao

“…Indeed, RSTB preserves the most valuable self-attention values for the aggregation of features, facilitating high-quality image reconstruction from a global perspective. Finally, the parallel dual-branch joint module, composed of RSTB and UEDB branches, effectively captures the local context and global structure, culminating in a clear background image. …”
Get full text

MFPI-Net: A Multi-Scale Feature Perception and Interaction Network for Semantic Segmentation of Urban Remote Sensing Images by Xiaofei Song, Mingju Chen, Jie Rao, Yangming Luo, Zhihao Lin, Xingyue Zhang, Senyuan Li, Xiao Hu

“…The Swin Transformer efficiently extracts multi-level global semantic features through its hierarchical structure and window attention mechanism. …”
Get full text

A Spoofing Speech Detection Method Combining Multi-Scale Features and Cross-Layer Information by Hongyan Yuan, Linjuan Zhang, Baoning Niu, Xianrong Zheng

“…Spoofing speech detection, which is a pressing issue in the age of generative AI, requires both global information and local features of speech. The multi-layer transformer structure in pre-trained speech models can effectively capture temporal information and global context in speech, but there is still room for improvement in handling local features. …”
Get full text

Hierarchical Fusion of Infrared and Visible Images Based on Channel Attention Mechanism and Generative Adversarial Networks by Jie Wu, Shuai Yang, Xiaoming Wang, Yu Pei, Shuai Wang, Congcong Song

“…The results show that the proposed algorithm retains the global structure features of multilayer images and has obvious advantages in fusion performance, model generalization and computational efficiency.…”
Get full text

AutoLDT: a lightweight spatio-temporal decoupling transformer framework with AutoML method for time series classification by Peng Wang, Ke Wang, Yafei Song, Xiaodan Wang

“…Notably, we adopt the Covariance Matrix Adaptation Evolution Strategy and global adaptive pruning technique to realize automated network structure design, which further improves the model training efficiency and automation, and avoids the uncertainty problem of network design. …”
Get full text

DFPF-Net: Dynamically Focused Progressive Fusion Network for Remote Sensing Change Detection by Chengming Wang, Peng Duan, Jinjiang Li

“…To address these challenges, we propose the dynamically focused progressive fusion network (DFPF-Net) to simultaneously tackle global and local noise influences. On one hand, we utilize a pyramid vision transformer (PVT) as a weight-shared siamese network to implement change detection, efficiently fusing multilevel features extracted from the pyramid structure through a residual based progressive enhanced fusion module (PEFM). …”
Get full text

Application of CycleGAN-based low-light image enhancement algorithm in foreign object detection on belt conveyors in underground mines by Anxin Zhao, Qiuhong Zheng, Liang Li

“…For the discriminator network, a global-local discriminator structure is designed to optimize overall illumination while adaptively enhancing shadow and highlight regions. …”
Get full text

Adaptive Pixel-Level and Superpixel-Level Feature Fusion Transformer for Hyperspectral Image Classification by Wei Huang, Dazhan Zhou, Le Sun, Qiqiang Chen, Junru Yin

“…However, graph convolutional networks (GCNs) can effectively extract features from the global structure. …”
Get full text

SwinNowcast: A Swin Transformer-Based Model for Radar-Based Precipitation Nowcasting by Zhuang Li, Zhenyu Lu, Yizhe Li, Xuan Liu

“…Through the novel design of a multi-scale feature balancing module (M-FBM), the model dynamically integrates local-scale features with global spatiotemporal dependencies. Specifically, the multi-scale convolutional block attention module (MSCBAM) captures local multi-scale features, while the gated attention feature fusion unit (GAFFU) adaptively regulates the fusion intensity, thereby enhancing spatial structure and temporal continuity in a synergistic manner. …”
Get full text

IMViT: Adjacency Matrix-Based Lightweight Plain Vision Transformer by Qihao Chen, Yunfeng Yan, Xianbo Wang, Jishen Peng

“…Hierarchical vision transformers are a big family for better efficiency in computer vision, but in order to obtain global dependencies, their design is often complex. …”
Get full text