Two-Branch Filtering Generative Network Based on Transformer for Image Inpainting by Feihan Cao, Qifeng Zhu, Yasheng Chang, Min Sun

“…This module utilizes predictive filtering constructed from convolutions to leverage local interactions, while simultaneously employing a transformer architecture with kernels from the predictive network to capture global correlations. …”
Get full text

A Spatiotemporal Sequence Prediction Framework Based on Mask Reconstruction: Application to Short-Duration Precipitation Radar Echoes by Zhi Yang, Changzheng Liu, Ping Mei, Lei Wang

“…During pre-training, the model learns global structural features of meteorological systems from sparse contexts by randomly masking local spatiotemporal regions of radar images. …”
Get full text

A Bio-Inspired Learning Dendritic Motion Detection Framework with Direction-Selective Horizontal Cells by Tianqi Chen, Yuki Todo, Zhiyu Qiu, Yuxiao Hua, Hiroki Sugiura, Zheng Tang

“…Additionally, in contrast to previous artificial visual systems (AVSs), our findings suggest that lateral geniculate nucleus (LGN) structures, though present in biological vision, may not be essential for motion direction detection. …”
Get full text

Short-term wind power forecasting method for extreme cold wave conditions based on small sample segmentation by Lin Lin, Jinhao Xu, Jianfei Liu, Hao Zhang, Pengchen Gao

“…In this context, nations have accelerated the transition of their energy structures to reduce dependence on fossil fuels and lower carbon emissions. …”
Get full text

Combining Multi-Scale Fusion and Attentional Mechanisms for Assessing Writing Accuracy by Renyuan Liu, Yunyu Shi, Xian Tang, Xiang Liu

“…In this paper, we propose a convolutional neural network (CNN) architecture that combines the attention mechanism with multi-scale feature fusion; specifically, the features are weighted by designing a bottleneck layer that combines the Squeeze-and-Excitation (SE) attention mechanism to highlight the important information and by applying a multi-scale feature fusion method to enable the network to capture both the global structure and the local details of Chinese characters. …”
Get full text

Bidirectional Mamba with Dual-Branch Feature Extraction for Hyperspectral Image Classification by Ming Sun, Jie Zhang, Xiaoou He, Yihe Zhong

“…The HSI classification methods based on convolutional neural networks (CNNs) have greatly improved the classification performance. …”
Get full text

Antenna Optimization Design Based on Deep Gaussian Process Model by Xin-Yu Zhang, Yu-Bo Tian, Xie Zheng

“…In order to solve this problem, this study constructs a deep GP (DGP) model by using the structural form of convolutional neural network (CNN) and combining it with GP. …”
Get full text

Automated recognition of deep-sea benthic megafauna in polymetallic nodule mining areas based on deep learning by Guofan Long, Wei Song, Xiangchun Liu, Ziyao Fang, Jinqi An, Kun Liu, Yaqin Huang, Xuebao He

“…Its backbone integrates deformable convolutions, attention mechanisms, and ResNet structures to improve feature extraction and reduce background interference. …”
Get full text

A Spatiotemporal-Adaptive-Network-Based Method for Predicting Axial Forces in Assembly Steel Struts with Servo System of Foundation Pits by Weiwei Liu, Jianchao Sheng, Jian Zhou, Jinbo Fu, Wangjing Yao, Kuan Chang, Zhe Wang

“…Due to its high sensitivity to temperature variations and direct influence on the lateral deformation of the foundation pit enclosure structure, accurate prediction is essential for safety monitoring and early warning. …”
Get full text

A secured accreditation and equivalency certification using Merkle mountain range and transformer based deep learning model for the education ecosystem by Sumathy Krishnan, Surendran Rajendran, Mohammad Zakariah

“…TCRN employs Bi-GRU to retain long-term academic trends, Depth-wise separable convolutions (DSC) to concentrate on course-specific information, and BERT to capture global semantic context. …”
Get full text

Enhancing Portfolio Optimization: A Two-Stage Approach with Deep Learning and Portfolio Optimization by Shiguo Huang, Linyu Cao, Ruili Sun, Tiefeng Ma, Shuangzhe Liu

“…Moreover, we incorporate the self-attention mechanism into the GCN to extract deeper data features and employ k-reciprocal NN to enhance the accuracy and robustness of the graph structure in the GCN. In the second stage, we employ the Global Minimum Variance (GMV) model for portfolio optimization, culminating in the AGC-CNN+GMV two-stage approach. …”
Get full text

A method for identifying gully-type debris flows based on adaptive multi-scale feature extraction by Qiuyu Liu, Ting Wang, Zhijie Zheng, Baoyun Wang

“…First, the feature extraction component consists of a dual-branch structure with a global feature extraction part based on self-attention mechanisms and a local feature extraction part based on multi-scale methods, designed to extract gully features at different scales and establish connections among them. …”
Get full text

PC3D-YOLO: An Enhanced Multi-Scale Network for Crack Detection in Precast Concrete Components by Zichun Kang, Kedi Gu, Andrew Yin Hu, Haonan Du, Qingyang Gu, Yang Jiang, Wenxia Gan

“…To address these limitations, we propose PC3D-YOLO, an enhanced framework derived from YOLOv11, which strengthens long-range dependency modeling through multi-scale feature integration, offering a novel approach for crack detection in precast concrete structures. Our methodology involves three key innovations: (1) the Multi-Dilation Spatial-Channel Fusion with Shuffling (MSFS) module, employing dilated convolutions and channel shuffling to enable global feature fusion, replaces the C3K2 bottleneck module to enhance long-distance dependency capture; (2) the AIFI_M2SA module substitutes the conventional SPPF to mitigate its restricted receptive field and information loss, incorporating multi-scale attention for improved near-far contextual integration; (3) a redesigned neck network (MSCD-Net) preserves rich contextual information across all feature scales. …”
Get full text

Bearing fault diagnosis based on efficient cross space multiscale CNN transformer parallelism by Qi Chen, Feng Zhang, Yin Wang, Qing Yu, Genfeng Lang, Lixiong Zeng

“…Subsequently, parallel branches are employed to extract spatio-temporal features: the Convolutional Neural Network (CNN) branch integrates a multiscale feature extraction module, a Reversed Residual Structure (RRS), and an Efficient Multiscale Attention (EMA) mechanism to enhance local and global feature extraction capabilities; the Transformer branch combines Bidirectional Gated Recurrent Units (BiGRU) and Transformer to capture both local temporal dynamics and long-term dependencies. …”
Get full text

An Efficient Semantic Segmentation Framework with Attention-Driven Context Enhancement and Dynamic Fusion for Autonomous Driving by Jia Tian, Peizeng Xin, Xinlu Bai, Zhiguo Xiao, Nianfeng Li

“…Recognizing the limitations of convolutional networks in modeling long-range dependencies and capturing global semantic context, the model incorporates an attention-based feature extraction component. …”
Get full text

Thyroid nodule segmentation in ultrasound images using transformer models with masked autoencoder pre-training by Yi Xiang, Rajendra Acharya, Quan Le, Jen Hong Tan, Chiaw-Ling Chng

“…Unlike traditional convolutional neural networks (CNNs), transformers capture global context from the first layer, enabling more comprehensive image representation, which is crucial for identifying subtle nodule boundaries. …”
Get full text

SCCA-YOLO: Spatial Channel Fusion and Context-Aware YOLO for Lunar Crater Detection by Jiahao Tang, Boyuan Gu, Tianyou Li, Ying-Bo Lu

“…Specifically, the Context-Aware Module (CAM) employs a multi-branch dilated convolutional structure to enhance feature richness and expand the local receptive field, thereby strengthening the feature extraction capability. …”
Get full text

MDNN-DTA: a multimodal deep neural network for drug-target affinity prediction by Xu Gao, Xu Gao, Mengfan Yan, Mengfan Yan, Chengwei Zhang, Chengwei Zhang, Gang Wu, Gang Wu, Jiandong Shang, Jiandong Shang, Congxiang Zhang, Congxiang Zhang, Kecheng Yang, Kecheng Yang

“…This model employs Graph Convolutional Networks (GCN) and Convolutional Neural Networks (CNN) to extract features from the drug and protein sequences, respectively. …”
Get full text

Extensive identification of landslide boundaries using remote sensing images and deep learning method by Chang-dong Li, Peng-fei Feng, Xi-hui Jiang, Shuang Zhang, Jie Meng, Bing-chen Li

“…SCDnn exhibits notable improvements in landslide feature extraction and semantic segmentation by combining an enhanced Atrous Spatial Pyramid Convolutional Block (ASPC) with a coding structure that reduces model complexity. …”
Get full text

Research on CTSA-DeepLabV3+ Urban Green Space Classification Model Based on GF-2 Images by Ruotong Li, Jian Zhao, Yanguo Fan

“…As an important part of urban ecosystems, urban green spaces play a key role in ecological environmental protection and urban spatial structure optimization. However, due to the complex morphology and high degree of fragmentation of urban green spaces, it is still challenging to effectively distinguish urban green space types from high spatial resolution images. …”
Get full text