Construction of a Multimodal Neuroimaging Data Fusion System and Evaluation of Mental Fatigue Using Nonlinear Analysis

The purpose of this research is to explore the optimization and fusion application of multimodal neuroimaging technology and analyze the evaluation method of human brain fatigue based on multimodal neuroimaging technology. Based on electroencephalogram (EEG) and fMRI (functional magnetic resonance i...

Full description

Saved in:
Bibliographic Details
Main Authors: Rui Chen, Zhenzhong Li, Yi Lai
Format: Article
Language:English
Published: Wiley 2021-01-01
Series:Complexity
Online Access:http://dx.doi.org/10.1155/2021/8478868
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832561494048374784
author Rui Chen
Zhenzhong Li
Yi Lai
author_facet Rui Chen
Zhenzhong Li
Yi Lai
author_sort Rui Chen
collection DOAJ
description The purpose of this research is to explore the optimization and fusion application of multimodal neuroimaging technology and analyze the evaluation method of human brain fatigue based on multimodal neuroimaging technology. Based on electroencephalogram (EEG) and fMRI (functional magnetic resonance imaging), the four-dimensional consistency of local neural activities (FOCA) and local multimodal serial analysis (LMSA) are first introduced to fuse EEG and fMRI organically. Second, the eigenspace maximal information canonical correlation analysis (emiCCA) is introduced to construct the multimodal neuroimaging data fusion system. Finally, how the brain function network is constructed is introduced. Based on the binary and the weighted brain function networks, the relationship between the human brain fatigue and the brain function network is evaluated by calculating the fractal dimension. Results demonstrate that FOCA performs well in temporal and spatial consistency indexes, and the mean level and standard deviation in the case of temporal and spatial consistency are approximately 0.45. The effect of LMSA indexes is significantly better than generalized linear models (GLMs). Under different signal-to-noise ratios (SNRs), the regression coefficient based on LMSA is much larger than the GLM estimate; the corresponding significance level is p<0.05; and the maximum value of the regression coefficient appears near 0.2. In the data fusion system, the time-space matching has good results under the time accuracy based on EEG and the space accuracy based on fMRI, with the time accuracy above 88% and the space accuracy above 89%. The fractal dimension analysis based on the brain function network reveals that the weighted brain function network is more sensitive to mental fatigue. The state of human brain fatigue will make the brain function network more complicated. The fractal dimension with more network edges is around 2.2, while the fractal dimension with fewer network edges is around 1.6. The proposed data analysis and fusion system have great application potential and propose a new idea for analyzing human brain fatigue and brain aging.
format Article
id doaj-art-4f33239734d0498fbd01b32d78e2fc5d
institution Kabale University
issn 1076-2787
1099-0526
language English
publishDate 2021-01-01
publisher Wiley
record_format Article
series Complexity
spelling doaj-art-4f33239734d0498fbd01b32d78e2fc5d2025-02-03T01:24:48ZengWileyComplexity1076-27871099-05262021-01-01202110.1155/2021/84788688478868Construction of a Multimodal Neuroimaging Data Fusion System and Evaluation of Mental Fatigue Using Nonlinear AnalysisRui Chen0Zhenzhong Li1Yi Lai2School of Communications and Information Engineering, Xi’an University of Posts and Telecommunications, Xi’an 710121, ChinaSchool of Communications and Information Engineering, Xi’an University of Posts and Telecommunications, Xi’an 710121, ChinaSchool of Communications and Information Engineering, Xi’an University of Posts and Telecommunications, Xi’an 710121, ChinaThe purpose of this research is to explore the optimization and fusion application of multimodal neuroimaging technology and analyze the evaluation method of human brain fatigue based on multimodal neuroimaging technology. Based on electroencephalogram (EEG) and fMRI (functional magnetic resonance imaging), the four-dimensional consistency of local neural activities (FOCA) and local multimodal serial analysis (LMSA) are first introduced to fuse EEG and fMRI organically. Second, the eigenspace maximal information canonical correlation analysis (emiCCA) is introduced to construct the multimodal neuroimaging data fusion system. Finally, how the brain function network is constructed is introduced. Based on the binary and the weighted brain function networks, the relationship between the human brain fatigue and the brain function network is evaluated by calculating the fractal dimension. Results demonstrate that FOCA performs well in temporal and spatial consistency indexes, and the mean level and standard deviation in the case of temporal and spatial consistency are approximately 0.45. The effect of LMSA indexes is significantly better than generalized linear models (GLMs). Under different signal-to-noise ratios (SNRs), the regression coefficient based on LMSA is much larger than the GLM estimate; the corresponding significance level is p<0.05; and the maximum value of the regression coefficient appears near 0.2. In the data fusion system, the time-space matching has good results under the time accuracy based on EEG and the space accuracy based on fMRI, with the time accuracy above 88% and the space accuracy above 89%. The fractal dimension analysis based on the brain function network reveals that the weighted brain function network is more sensitive to mental fatigue. The state of human brain fatigue will make the brain function network more complicated. The fractal dimension with more network edges is around 2.2, while the fractal dimension with fewer network edges is around 1.6. The proposed data analysis and fusion system have great application potential and propose a new idea for analyzing human brain fatigue and brain aging.http://dx.doi.org/10.1155/2021/8478868
spellingShingle Rui Chen
Zhenzhong Li
Yi Lai
Construction of a Multimodal Neuroimaging Data Fusion System and Evaluation of Mental Fatigue Using Nonlinear Analysis
Complexity
title Construction of a Multimodal Neuroimaging Data Fusion System and Evaluation of Mental Fatigue Using Nonlinear Analysis
title_full Construction of a Multimodal Neuroimaging Data Fusion System and Evaluation of Mental Fatigue Using Nonlinear Analysis
title_fullStr Construction of a Multimodal Neuroimaging Data Fusion System and Evaluation of Mental Fatigue Using Nonlinear Analysis
title_full_unstemmed Construction of a Multimodal Neuroimaging Data Fusion System and Evaluation of Mental Fatigue Using Nonlinear Analysis
title_short Construction of a Multimodal Neuroimaging Data Fusion System and Evaluation of Mental Fatigue Using Nonlinear Analysis
title_sort construction of a multimodal neuroimaging data fusion system and evaluation of mental fatigue using nonlinear analysis
url http://dx.doi.org/10.1155/2021/8478868
work_keys_str_mv AT ruichen constructionofamultimodalneuroimagingdatafusionsystemandevaluationofmentalfatigueusingnonlinearanalysis
AT zhenzhongli constructionofamultimodalneuroimagingdatafusionsystemandevaluationofmentalfatigueusingnonlinearanalysis
AT yilai constructionofamultimodalneuroimagingdatafusionsystemandevaluationofmentalfatigueusingnonlinearanalysis