InGSA: integrating generalized self-attention in CNN for Alzheimer's disease classification by Faisal Binzagr, Anas W. Abulfaraj

“…Furthermore, several GSA heads are used to exploit other dependency structures of global features as well. Our evaluation of InGSA on a two benchmark dataset, using various pre-trained networks, demonstrates the GSA's superior performance.…”
Get full text

FingerDTA: A Fingerprint-Embedding Framework for Drug-Target Binding Affinity Prediction by Xuekai Zhu, Juan Liu, Jian Zhang, Zhihui Yang, Feng Yang, Xiaolei Zhang

“…Owing to the structural limitations of CNN, features extracted from this method are local patterns that lack global information. …”
Get full text

Improved YOLOv8s-based foreign object detection method for mine conveyor belts by LI Runze, GUO Xingge, YANG Fazhan, ZHAO Peipei, XIE Guolong

“…The core feature extraction and fusion module C2f was improved by VMamba's Visual State Space (VSS) module, which efficiently captured global contextual information in images through a state space model and four-directional scanning mechanism, enhancing the model’s understanding of global image structure. …”
Get full text

Data-Enabled Intelligence in Complex Industrial Systems Cross-Model Transformer Method for Medical Image Synthesis by Zebin Hu, Hao Liu, Zhendong Li, Zekuan Yu

“…Recently, generative adversarial network (GAN) models are applied to many medical image synthesis tasks and show prior performance, since they enable to capture structural details clearly. However, GAN still builds the main framework based on convolutional neural network (CNN) that exhibits a strong locality bias and spatial invariance through the use of shared weights across all positions. …”
Get full text

SwinCNet leveraging Swin Transformer V2 and CNN for precise color correction and detail enhancement in underwater image restoration by Chun Yang, Liwei Shao, Yi Deng, Jiahang Wang, Hexiang Zhai

“…Current methods face difficulties in effectively balancing local detail preservation with global information integration. This study proposes SwinCNet, an innovative deep learning architecture that incorporates an enhanced Swin Transformer V2 following primary convolutional layers to achieve synergistic processing of local details and global dependencies. …”
Get full text

Multi-Head Graph Attention Adversarial Autoencoder Network for Unsupervised Change Detection Using Heterogeneous Remote Sensing Images by Meng Jia, Xiangyu Lou, Zhiqiang Zhao, Xiaofeng Lu, Zhenghao Shi

“…Heterogeneous remote sensing images, acquired from different sensors, exhibit significant variations in data structure, resolution, and radiometric characteristics. …”
Get full text

DTC-m6Am: A Framework for Recognizing N6,2′-O-dimethyladenosine Sites in Unbalanced Classification Patterns Based on DenseNet and Attention Mechanisms by Hui Huang, Fenglin Zhou, Jianhua Jia, Huachun Zhang

“…The model then combines densely connected convolutional networks (DenseNet) and temporal convolutional network (TCN). …”
Get full text

A lightweight steel surface defect detection network based on YOLOv9 by Tianyi Zheng, Ling Yu, Yongbao Shi, Fanglin Niu

“…Next, we replace the regular convolution blocks in the model network with spatial-to-depth convolutions, further reducing the model’s computational complexity while retaining global feature information. …”
Get full text

Semantic ECG hash similarity graph by Yixian Fang, Shilin Zhang, Yuwei Ren

“…However, most existing graph structures primarily focus on local similarity while overlooking global semantic correlation. …”
Get full text

DBRSNet: a dual-branch remote sensing image segmentation model based on feature interaction and multi-scale feature fusion by Yong Ji, Wenbin Shi, Jingsheng Lei, Jiayin Ding

“…In DBRSNet, the Feature-Guided Selection Module (FGSM) adaptively integrates complementary features from CNN and Transformer branches, while the Convolutional Attention Integration Module (CAIM) enhances global dependencies and spectral correlations, ensuring a more comprehensive feature representation. …”
Get full text

GIVTED-Net: GhostNet-Mobile Involution ViT Encoder-Decoder Network for Lightweight Medical Image Segmentation by Resha Dwika Hefni Al-Fahsi, Ahmad Naghim Fauzaini Prawirosoenoto, Hanung Adi Nugroho, Igi Ardiyanto

“…Nevertheless, conventional CNN layers, such as convolution and pooling, demonstrate a spatial inductive bias that constrains their ability to instantly capture global context information. …”
Get full text

Edge-aware joint neural denoising and normal estimation for mobile and handheld laser point clouds by T. Zhang, S. Filin

“…To extract contextual information it introduces densely packed graph convolution layers and a global attention mechanism. …”
Get full text

YOLO-DAFS: A Composite-Enhanced Underwater Object Detection Algorithm by Shengfu Luo, Chao Dong, Guixin Dong, Rongmin Chen, Bing Zheng, Ming Xiang, Peng Zhang, Zhanwei Li

“…The backbone incorporates a DualBottleneck module to enhance feature extraction, replacing the standard bottleneck structure in C3k, thus enhancing the feature extraction and the channel aggregation. …”
Get full text

Short-term rainfall prediction based on radar echo using an efficient spatio-temporal recurrent unit by Dali Wu, Shunli Zhang, Guohong Zhao, Yongchao Feng, Yuan Ma, Yue Zhang

“…The combined effect of the Self-Attention (SA) mechanism and convolution allows the model to focus on both global and local dependencies in spatial information, improving the clarity of the generated images. …”
Get full text

A Comprehensive Evaluation of Monocular Depth Estimation Methods in Low-Altitude Forest Environment by Jiwen Jia, Junhua Kang, Lin Chen, Xiang Gao, Borui Zhang, Guijun Yang

“…The evaluated models include both self-supervised and supervised approaches, employing different network structures such as convolutional neural networks (CNNs) and Vision Transformers (ViTs). …”
Get full text

DEFIF-Net: A lightweight dual-encoding feature interaction fusion network for medical image segmentation. by Zhanlin Ji, Shengnan Hao, Quanming Zhao, Zidong Yu, Hongjiu Liu, Lei Li, Ivan Ganchev

“…Firstly, in the encoding stage of DEFIF-Net, a global dependency fusion branch is introduced as an additional encoder to capture distant feature dependencies, whereby the neighboring and distant feature dependencies are effectively integrated by the newly designed feature interaction fusion convolution. …”
Get full text

Adaptive Pixel-Level and Superpixel-Level Feature Fusion Transformer for Hyperspectral Image Classification by Wei Huang, Dazhan Zhou, Le Sun, Qiqiang Chen, Junru Yin

“…However, graph convolutional networks (GCNs) can effectively extract features from the global structure. …”
Get full text

Multilevel Feature Gated Fusion Based Spatial and Frequency Domain Attention Network for Joint Classification of Hyperspectral and LiDAR Data by Cuiping Shi, Zhipeng Zhong, Shihang Ding, Yeqi Lei, Liguo Wang, Zhan Jin

“…Hyperspectral images provide rich spectral information, while LiDAR data supplements three-dimensional spatial structural information. The combination of the two can effectively improve the accuracy of land cover classification. …”
Get full text

A Spatiotemporal-Adaptive-Network-Based Method for Predicting Axial Forces in Assembly Steel Struts with Servo System of Foundation Pits by Weiwei Liu, Jianchao Sheng, Jian Zhou, Jinbo Fu, Wangjing Yao, Kuan Chang, Zhe Wang

“…Due to its high sensitivity to temperature variations and direct influence on the lateral deformation of the foundation pit enclosure structure, accurate prediction is essential for safety monitoring and early warning. …”
Get full text

Enhancing Portfolio Optimization: A Two-Stage Approach with Deep Learning and Portfolio Optimization by Shiguo Huang, Linyu Cao, Ruili Sun, Tiefeng Ma, Shuangzhe Liu

“…Moreover, we incorporate the self-attention mechanism into the GCN to extract deeper data features and employ k-reciprocal NN to enhance the accuracy and robustness of the graph structure in the GCN. In the second stage, we employ the Global Minimum Variance (GMV) model for portfolio optimization, culminating in the AGC-CNN+GMV two-stage approach. …”
Get full text