FPE–Transformer: A Feature Positional Encoding-Based Transformer Model for Attack Detection by Hande Çavşi Zaim, Esra Nergis Yolaçan

“…FPE–Transformer incorporates an innovative feature positional encoding mechanism that encodes the positional information of each feature separately, enabling a deeper understanding of feature relationships and more precise attack detection. …”
Get full text

Arabic Speech Recognition Based on Encoder-Decoder Architecture of Transformer by Mohanad Sameer, Ahmed Talib, Alla Hussein, Husniza Husni

“…This research presents an Arabic speech recognition based on a transformer encoder-decoder architecture with self-attention to transcribe Arabic audio speech segments into text, which can be trained faster with more efficiency. …”
Get full text

Research on Transformer Noise Suppression Based on Redundant Convolutional Encoder Decoder by Quanjin XIN, Xiaohua LI, Yi YANG, Juncong LI, Nenghong XIA

Subjects: “…power transformer…”
Get full text

Evaluation of Encoder-Only Transformer for Multi-Step Traffic Flow Prediction by Mas Omar, Fitri Yakub, Andika Aji Wijaya, Ahmad Faiz Mohammad, Mohd Nazmin Maslan, Inge Dhamanti, Shi Zhongchao

Subjects: Get full text

Bladder lesion detection using EfficientNet and hybrid attention transformer through attention transformation by Poonam Sharma, Bhisham Sharma, Dhirendra Prasad Yadav, Deepti Thakral, Julian L. Webber

Subjects: Get full text

Encoding IoT Data: A Comprehensive Review of Image Transformation Techniques by Suat Özdemir, Feyza Yıldırım Okay, Duygu Altunkaya

Subjects: Get full text

Alternate encoder and dual decoder CNN-Transformer networks for medical image segmentation by Lin Zhang, Xinyu Guo, Hongkun Sun, Weigang Wang, Liwei Yao

Subjects: Get full text

Monocular Image Depth Estimation Based on the Fusion of Transformer and CNN by ZHANG Tao, ZHANG Xiao-li, REN Yan

Subjects: Get full text

TRACE: Transformer-Based Risk Assessment for Clinical Evaluation by Dionysis Christopoulos, Sotiris Spanos, Valsamis Ntouskos, Konstantinos Karantzalos

Subjects: Get full text

AnoViT: Unsupervised Anomaly Detection and Localization With Vision Transformer-Based Encoder-Decoder by Yunseung Lee, Pilsung Kang

“…Therefore, we propose a vision transformer-based encoder-decoder model, named AnoViT, designed to reflect normal information by additionally learning the global relationship between image patches, which is capable of both image anomaly detection and localization. …”
Get full text

Triplet-Style Dynamic Graph Network With Transformer Encoder for Scam Detection in Cryptocurrency Transactions by Min-Woo Nam, Hyeon-Ju Lee, Seok-Jun Buu

Subjects: Get full text

An enhanced network for extracting tunnel lining defects using transformer encoder and aggregate decoder by Bo Guo, Zhihai Huang, Haitao Luo, Perpetual Hope Akwensi, Ruisheng Wang, Bo Huang, Tsz Nam Chan

“…We propose a deep network model utilizing an encoder–decoder framework that integrates Transformer and convolution for comprehensive defect extraction. …”
Get full text

Noise robust aircraft trajectory prediction via autoregressive transformers with hybrid positional encoding by Youyou Li, Yuxiang Fang, Teng Long

“…This study introduces the Noise-Robust Autoregressive Transformer, a novel model that enhances prediction reliability by integrating noise-regularized embeddings within a multi-head attention equipped with hybrid positional encoding. …”
Get full text

Bidirectional Encoder representation from Image Transformers for recognizing sunflower diseases from photographs by V.A. Baboshina, P.A. Lyakhov, U.A. Lyakhova, V.A. Pismennyy

Subjects: “…image transformer…”
Get full text

The vestibular system implements a linear-nonlinear transformation in order to encode self-motion. by Corentin Massot, Adam D Schneider, Maurice J Chacron, Kathleen E Cullen

“…Although it is well established that the neural code representing the world changes at each stage of a sensory pathway, the transformations that mediate these changes are not well understood. …”
Get full text

Research on EEG signal classification of motor imagery based on AE and Transformer by Rui JIANG, Liuting SUN, Xiaoming WANG, Dapeng LI, Youyun XU

Subjects: “…motor imagery;deep learning;auto-encoder;attention module;Transformer model…”
Get full text

Chinese Paper-Cutting Style Transfer via Vision Transformer by Chao Wu, Yao Ren, Yuying Zhou, Ming Lou, Qing Zhang

Get full text

Rolling Bearing Life Prediction Based on Improved Transformer Encoding Layer and Multi-Scale Convolution by Zhuopeng Luo, Zhihai Wang, Xiaoqin Liu, Yingming Yang

“…To accurately and reliably characterize the degradation trend of rolling bearings and predict their life cycle, this paper proposes a bearing life prediction model based on an improved transformer encoder layer and multi-scale convolution. …”
Get full text

An Encoder-Only Transformer Model for Depression Detection from Social Network Data: The DEENT Approach by Robinson Narvaez Burbano, Oscar Mauricio Caicedo Rendon, Carlos. A. Astudillo

“…This paper aims to introduce a model based on encoder-only Transformer architecture to detect depression using a large Twitter dataset collected during the COVID-19 pandemic. …”
Get full text

Detection and Classification of Abnormal Power Load Data by Combining One-Hot Encoding and GAN–Transformer by Ting Yang, Hongyi Yu, Danhong Lu, Shengkui Bai, Yan Li, Wenyao Fan, Ketian Liu

Subjects: Get full text