Diversifying Multi-Head Attention in the Transformer Model by Nicholas Ampazis, Flora Sakketou

Subjects: Get full text

Head information bottleneck (HIB): leveraging information bottleneck for efficient transformer head attribution and pruning by Yukun Qian, Xuyi Zhuang, Mingjiang Wang

Subjects: Get full text

Vehicle Trajectory Prediction Algorithm Based on Hybrid Prediction Model with Multiple Influencing Factors by Tao Wang, Yiming Fu, Xing Cheng, Lin Li, Zhenxue He, Yuchi Xiao

Subjects: Get full text

Infant cry classification using an efficient graph structure and attention-based model by Qiao X., Jiao S., Li H.

Subjects: Get full text

Efficient fault diagnosis in rolling bearings lightweight hybrid model by Peng Yang, Bozheng Zhang, Jianda Zhao

Subjects: Get full text

Research on Fault Diagnosis of Rotating Parts Based on Transformer Deep Learning Model by Zilin Zhang, Yaohua Deng, Xiali Liu, Jige Liao

Subjects: Get full text

CochleaSpecNet: An Attention-Based Dual Branch Hybrid CNN-GRU Network for Speech Emotion Recognition Using Cochleagram and Spectrogram by Atkia Anika Namey, Khadija Akter, Md. Azad Hossain, M. Ali Akber Dewan

Subjects: Get full text

Diversity-Driven Multi-Head Attention for Enhanced Trajectory Prediction by Zhen Zhang

Subjects: Get full text

CLA-BERT: A Hybrid Model for Accurate Encrypted Traffic Classification by Combining Packet and Byte-Level Features by Hong Huang, Yinghang Zhou, Feng Jiang

Subjects: Get full text

Attention-Based Multi-Learning Approach for Speech Emotion Recognition With Dilated Convolution by Samuel, Kakuba, Alwin, Poulose

Subjects: Get full text

PD-Net: Parkinson’s Disease Detection Through Fusion of Two Spectral Features Using Attention-Based Hybrid Deep Neural Network by Munira Islam, Khadija Akter, Md. Azad Hossain, M. Ali Akber Dewan

Subjects: Get full text

Feature-Level Fusion Network for Hyperspectral Object Tracking via Mixed Multi-Head Self-Attention Learning by Long Gao, Langkun Chen, Yan Jiang, Bobo Xi, Weiying Xie, Yunsong Li

Subjects: Get full text

SMITIN: Self-Monitored Inference-Time INtervention for Generative Music Transformers by Junghyun Koo, Gordon Wichern, Francois G. Germain, Sameer Khurana, Jonathan Le Roux

Subjects: Get full text

Gaze Estimation Network Based on Multi-Head Attention, Fusion, and Interaction by Changli Li, Fangfang Li, Kao Zhang, Nenglun Chen, Zhigeng Pan

Subjects: Get full text

Enhanced Mamba model with multi-head attention mechanism and learnable scaling parameters for remaining useful life prediction by Fugang Liu, Shenyang Liu, Yuan Chai, Yongtao Zhu

Subjects: Get full text

Triple Channel Feature Fusion Few-Shot Intent Recognition With Orthogonality Constrained Multi-Head Attention by Di Wu, Yuying Zheng, Peng Cheng

Subjects: Get full text

Hierarchical Multi-Task Learning Based on Interactive Multi-Head Attention Feature Fusion for Speech Depression Recognition by Yujuan Xing, Ruifang He, Chengwen Zhang, Ping Tan

Subjects: Get full text

Entity and relation collaborative extraction approach based on multi-head attention and gated mechanism by Wei Zhao, Shan Zhao, Shuhui Chen, Tien-Hsiung Weng, WenJie Kang

Subjects: “…multi-head attention…”
Get full text

An Augmented AutoEncoder With Multi-Head Attention for Tool Wear Prediction in Smart Manufacturing by Chunping Dong, Jiaqiang Zhao

Subjects: Get full text

Prediction of Alzheimer’s Disease Based on Multi-Modal Domain Adaptation by Binbin Fu, Changsong Shen, Shuzu Liao, Fangxiang Wu, Bo Liao

Subjects: Get full text