A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding
Motor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject’s intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attentio...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2020-01-01
|
| Series: | Neural Plasticity |
| Online Access: | http://dx.doi.org/10.1155/2020/8863223 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849467733829222400 |
|---|---|
| author | Juntao Xue Feiyue Ren Xinlin Sun Miaomiao Yin Jialing Wu Chao Ma Zhongke Gao |
| author_facet | Juntao Xue Feiyue Ren Xinlin Sun Miaomiao Yin Jialing Wu Chao Ma Zhongke Gao |
| author_sort | Juntao Xue |
| collection | DOAJ |
| description | Motor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject’s intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attention, especially in the research of rehabilitation training. We propose a novel multifrequency brain network-based deep learning framework for motor imagery decoding. Firstly, a multifrequency brain network is constructed from the multichannel MI-related EEG signals, and each layer corresponds to a specific brain frequency band. The structure of the multifrequency brain network matches the activity profile of the brain properly, which combines the information of channel and multifrequency. The filter bank common spatial pattern (FBCSP) algorithm filters the MI-based EEG signals in the spatial domain to extract features. Further, a multilayer convolutional network model is designed to distinguish different MI tasks accurately, which allows extracting and exploiting the topology in the multifrequency brain network. We use the public BCI competition IV dataset 2a and the public BCI competition III dataset IIIa to evaluate our framework and get state-of-the-art results in the first dataset, i.e., the average accuracy is 83.83% and the value of kappa is 0.784 for the BCI competition IV dataset 2a, and the accuracy is 89.45% and the value of kappa is 0.859 for the BCI competition III dataset IIIa. All these results demonstrate that our framework can classify different MI tasks from multichannel EEG signals effectively and show great potential in the study of remodelling the neural system of stroke patients. |
| format | Article |
| id | doaj-art-e06b96e3944f4eaf8faed7e7efc51e78 |
| institution | Kabale University |
| issn | 2090-5904 1687-5443 |
| language | English |
| publishDate | 2020-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Neural Plasticity |
| spelling | doaj-art-e06b96e3944f4eaf8faed7e7efc51e782025-08-20T03:26:05ZengWileyNeural Plasticity2090-59041687-54432020-01-01202010.1155/2020/88632238863223A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery DecodingJuntao Xue0Feiyue Ren1Xinlin Sun2Miaomiao Yin3Jialing Wu4Chao Ma5Zhongke Gao6School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, ChinaSchool of Electrical and Information Engineering, Tianjin University, Tianjin 300072, ChinaSchool of Electrical and Information Engineering, Tianjin University, Tianjin 300072, ChinaDepartment of Neurorehabilitation and Neurology, Tianjin Huanhu Hospital, Tianjin Key Laboratory of Cerebral Vascular and Neurodegenerative Diseases, Tianjin Neurosurgical Institute, Tianjin 300350, ChinaDepartment of Neurorehabilitation and Neurology, Tianjin Huanhu Hospital, Tianjin Key Laboratory of Cerebral Vascular and Neurodegenerative Diseases, Tianjin Neurosurgical Institute, Tianjin 300350, ChinaSchool of Electrical and Information Engineering, Tianjin University, Tianjin 300072, ChinaSchool of Electrical and Information Engineering, Tianjin University, Tianjin 300072, ChinaMotor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject’s intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attention, especially in the research of rehabilitation training. We propose a novel multifrequency brain network-based deep learning framework for motor imagery decoding. Firstly, a multifrequency brain network is constructed from the multichannel MI-related EEG signals, and each layer corresponds to a specific brain frequency band. The structure of the multifrequency brain network matches the activity profile of the brain properly, which combines the information of channel and multifrequency. The filter bank common spatial pattern (FBCSP) algorithm filters the MI-based EEG signals in the spatial domain to extract features. Further, a multilayer convolutional network model is designed to distinguish different MI tasks accurately, which allows extracting and exploiting the topology in the multifrequency brain network. We use the public BCI competition IV dataset 2a and the public BCI competition III dataset IIIa to evaluate our framework and get state-of-the-art results in the first dataset, i.e., the average accuracy is 83.83% and the value of kappa is 0.784 for the BCI competition IV dataset 2a, and the accuracy is 89.45% and the value of kappa is 0.859 for the BCI competition III dataset IIIa. All these results demonstrate that our framework can classify different MI tasks from multichannel EEG signals effectively and show great potential in the study of remodelling the neural system of stroke patients.http://dx.doi.org/10.1155/2020/8863223 |
| spellingShingle | Juntao Xue Feiyue Ren Xinlin Sun Miaomiao Yin Jialing Wu Chao Ma Zhongke Gao A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding Neural Plasticity |
| title | A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
| title_full | A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
| title_fullStr | A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
| title_full_unstemmed | A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
| title_short | A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding |
| title_sort | multifrequency brain network based deep learning framework for motor imagery decoding |
| url | http://dx.doi.org/10.1155/2020/8863223 |
| work_keys_str_mv | AT juntaoxue amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT feiyueren amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT xinlinsun amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT miaomiaoyin amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT jialingwu amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT chaoma amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT zhongkegao amultifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT juntaoxue multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT feiyueren multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT xinlinsun multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT miaomiaoyin multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT jialingwu multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT chaoma multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding AT zhongkegao multifrequencybrainnetworkbaseddeeplearningframeworkformotorimagerydecoding |