Multichannel Speech Enhancement in Vehicle Environment Based on Interchannel Attention Mechanism
Speech enhancement in a vehicle environment remains a challenging task for the complex noise. The paper presents a feature extraction method that we use interchannel attention mechanism frame by frame for learning spatial features directly from the multichannel speech waveforms. The spatial features...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2021-01-01
|
| Series: | Journal of Advanced Transportation |
| Online Access: | http://dx.doi.org/10.1155/2021/9453911 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832564157558292480 |
|---|---|
| author | Xueli Shen Zhenxing Liang Shiyin Li Yanji Jiang |
| author_facet | Xueli Shen Zhenxing Liang Shiyin Li Yanji Jiang |
| author_sort | Xueli Shen |
| collection | DOAJ |
| description | Speech enhancement in a vehicle environment remains a challenging task for the complex noise. The paper presents a feature extraction method that we use interchannel attention mechanism frame by frame for learning spatial features directly from the multichannel speech waveforms. The spatial features of the individual signals learned through the proposed method are provided as an input so that the two-stage BiLSTM network is trained to perform adaptive spatial filtering as time-domain filters spanning signal channels. The two-stage BiLSTM network is capable of local and global features extracting and reaches competitive results. Using scenarios and data based on car cockpit simulations, in contrast to other methods that extract the feature from multichannel data, the results show the proposed method has a significant performance in terms of all SDR, SI-SNR, PESQ, and STOI. |
| format | Article |
| id | doaj-art-e7c29eef5ac44c39ac0fc2dfc3aeb7fd |
| institution | Kabale University |
| issn | 2042-3195 |
| language | English |
| publishDate | 2021-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Journal of Advanced Transportation |
| spelling | doaj-art-e7c29eef5ac44c39ac0fc2dfc3aeb7fd2025-02-03T01:11:41ZengWileyJournal of Advanced Transportation2042-31952021-01-01202110.1155/2021/9453911Multichannel Speech Enhancement in Vehicle Environment Based on Interchannel Attention MechanismXueli Shen0Zhenxing Liang1Shiyin Li2Yanji Jiang3School of Information and Control EngineeringSchool of SoftwareSchool of Information and Control EngineeringSchool of SoftwareSpeech enhancement in a vehicle environment remains a challenging task for the complex noise. The paper presents a feature extraction method that we use interchannel attention mechanism frame by frame for learning spatial features directly from the multichannel speech waveforms. The spatial features of the individual signals learned through the proposed method are provided as an input so that the two-stage BiLSTM network is trained to perform adaptive spatial filtering as time-domain filters spanning signal channels. The two-stage BiLSTM network is capable of local and global features extracting and reaches competitive results. Using scenarios and data based on car cockpit simulations, in contrast to other methods that extract the feature from multichannel data, the results show the proposed method has a significant performance in terms of all SDR, SI-SNR, PESQ, and STOI.http://dx.doi.org/10.1155/2021/9453911 |
| spellingShingle | Xueli Shen Zhenxing Liang Shiyin Li Yanji Jiang Multichannel Speech Enhancement in Vehicle Environment Based on Interchannel Attention Mechanism Journal of Advanced Transportation |
| title | Multichannel Speech Enhancement in Vehicle Environment Based on Interchannel Attention Mechanism |
| title_full | Multichannel Speech Enhancement in Vehicle Environment Based on Interchannel Attention Mechanism |
| title_fullStr | Multichannel Speech Enhancement in Vehicle Environment Based on Interchannel Attention Mechanism |
| title_full_unstemmed | Multichannel Speech Enhancement in Vehicle Environment Based on Interchannel Attention Mechanism |
| title_short | Multichannel Speech Enhancement in Vehicle Environment Based on Interchannel Attention Mechanism |
| title_sort | multichannel speech enhancement in vehicle environment based on interchannel attention mechanism |
| url | http://dx.doi.org/10.1155/2021/9453911 |
| work_keys_str_mv | AT xuelishen multichannelspeechenhancementinvehicleenvironmentbasedoninterchannelattentionmechanism AT zhenxingliang multichannelspeechenhancementinvehicleenvironmentbasedoninterchannelattentionmechanism AT shiyinli multichannelspeechenhancementinvehicleenvironmentbasedoninterchannelattentionmechanism AT yanjijiang multichannelspeechenhancementinvehicleenvironmentbasedoninterchannelattentionmechanism |