Multimodal Medical Image Fusion of Positron Emission Tomography and Magnetic Resonance Imaging Using Generative Adversarial Networks
Multimodal medical image fusion is a current technique applied in the applications related to medical field to combine images from the same modality or different modalities to improve the visual content of the image to perform further operations like image segmentation. Biomedical research and medic...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2022-01-01
|
| Series: | Behavioural Neurology |
| Online Access: | http://dx.doi.org/10.1155/2022/6878783 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832558387149144064 |
|---|---|
| author | R. Nandhini Abirami P. M. Durai Raj Vincent Kathiravan Srinivasan K. Suresh Manic Chuan-Yu Chang |
| author_facet | R. Nandhini Abirami P. M. Durai Raj Vincent Kathiravan Srinivasan K. Suresh Manic Chuan-Yu Chang |
| author_sort | R. Nandhini Abirami |
| collection | DOAJ |
| description | Multimodal medical image fusion is a current technique applied in the applications related to medical field to combine images from the same modality or different modalities to improve the visual content of the image to perform further operations like image segmentation. Biomedical research and medical image analysis highly demand medical image fusion to perform higher level of medical analysis. Multimodal medical fusion assists medical practitioners to visualize the internal organs and tissues. Multimodal medical fusion of brain image helps to medical practitioners to simultaneously visualize hard portion like skull and soft portion like tissue. Brain tumor segmentation can be accurately performed by utilizing the image obtained after multimodal medical image fusion. The area of the tumor can be accurately located with the information obtained from both Positron Emission Tomography and Magnetic Resonance Image in a single fused image. This approach increases the accuracy in diagnosing the tumor and reduces the time consumed in diagnosing and locating the tumor. The functional information of the brain is available in the Positron Emission Tomography while the anatomy of the brain tissue is available in the Magnetic Resonance Image. Thus, the spatial characteristics and functional information can be obtained from a single image using a robust multimodal medical image fusion model. The proposed approach uses a generative adversarial network to fuse Positron Emission Tomography and Magnetic Resonance Image into a single image. The results obtained from the proposed approach can be used for further medical analysis to locate the tumor and plan for further surgical procedures. The performance of the GAN based model is evaluated using two metrics, namely, structural similarity index and mutual information. The proposed approach achieved a structural similarity index of 0.8551 and a mutual information of 2.8059. |
| format | Article |
| id | doaj-art-5b9a30140f3541829cec57ec0e0d05a1 |
| institution | Kabale University |
| issn | 1875-8584 |
| language | English |
| publishDate | 2022-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Behavioural Neurology |
| spelling | doaj-art-5b9a30140f3541829cec57ec0e0d05a12025-02-03T01:32:33ZengWileyBehavioural Neurology1875-85842022-01-01202210.1155/2022/6878783Multimodal Medical Image Fusion of Positron Emission Tomography and Magnetic Resonance Imaging Using Generative Adversarial NetworksR. Nandhini Abirami0P. M. Durai Raj Vincent1Kathiravan Srinivasan2K. Suresh Manic3Chuan-Yu Chang4School of Information Technology and EngineeringSchool of Information Technology and EngineeringSchool of Computer Science and EngineeringDepartment of Electrical and Communication EngineeringDepartment of Computer Science and Information EngineeringMultimodal medical image fusion is a current technique applied in the applications related to medical field to combine images from the same modality or different modalities to improve the visual content of the image to perform further operations like image segmentation. Biomedical research and medical image analysis highly demand medical image fusion to perform higher level of medical analysis. Multimodal medical fusion assists medical practitioners to visualize the internal organs and tissues. Multimodal medical fusion of brain image helps to medical practitioners to simultaneously visualize hard portion like skull and soft portion like tissue. Brain tumor segmentation can be accurately performed by utilizing the image obtained after multimodal medical image fusion. The area of the tumor can be accurately located with the information obtained from both Positron Emission Tomography and Magnetic Resonance Image in a single fused image. This approach increases the accuracy in diagnosing the tumor and reduces the time consumed in diagnosing and locating the tumor. The functional information of the brain is available in the Positron Emission Tomography while the anatomy of the brain tissue is available in the Magnetic Resonance Image. Thus, the spatial characteristics and functional information can be obtained from a single image using a robust multimodal medical image fusion model. The proposed approach uses a generative adversarial network to fuse Positron Emission Tomography and Magnetic Resonance Image into a single image. The results obtained from the proposed approach can be used for further medical analysis to locate the tumor and plan for further surgical procedures. The performance of the GAN based model is evaluated using two metrics, namely, structural similarity index and mutual information. The proposed approach achieved a structural similarity index of 0.8551 and a mutual information of 2.8059.http://dx.doi.org/10.1155/2022/6878783 |
| spellingShingle | R. Nandhini Abirami P. M. Durai Raj Vincent Kathiravan Srinivasan K. Suresh Manic Chuan-Yu Chang Multimodal Medical Image Fusion of Positron Emission Tomography and Magnetic Resonance Imaging Using Generative Adversarial Networks Behavioural Neurology |
| title | Multimodal Medical Image Fusion of Positron Emission Tomography and Magnetic Resonance Imaging Using Generative Adversarial Networks |
| title_full | Multimodal Medical Image Fusion of Positron Emission Tomography and Magnetic Resonance Imaging Using Generative Adversarial Networks |
| title_fullStr | Multimodal Medical Image Fusion of Positron Emission Tomography and Magnetic Resonance Imaging Using Generative Adversarial Networks |
| title_full_unstemmed | Multimodal Medical Image Fusion of Positron Emission Tomography and Magnetic Resonance Imaging Using Generative Adversarial Networks |
| title_short | Multimodal Medical Image Fusion of Positron Emission Tomography and Magnetic Resonance Imaging Using Generative Adversarial Networks |
| title_sort | multimodal medical image fusion of positron emission tomography and magnetic resonance imaging using generative adversarial networks |
| url | http://dx.doi.org/10.1155/2022/6878783 |
| work_keys_str_mv | AT rnandhiniabirami multimodalmedicalimagefusionofpositronemissiontomographyandmagneticresonanceimagingusinggenerativeadversarialnetworks AT pmdurairajvincent multimodalmedicalimagefusionofpositronemissiontomographyandmagneticresonanceimagingusinggenerativeadversarialnetworks AT kathiravansrinivasan multimodalmedicalimagefusionofpositronemissiontomographyandmagneticresonanceimagingusinggenerativeadversarialnetworks AT ksureshmanic multimodalmedicalimagefusionofpositronemissiontomographyandmagneticresonanceimagingusinggenerativeadversarialnetworks AT chuanyuchang multimodalmedicalimagefusionofpositronemissiontomographyandmagneticresonanceimagingusinggenerativeadversarialnetworks |