Multimodal medical image fusion based on saliency features detection in NSST domain

Yuan Gao; Shiwei Ma

doi:10.1117/12.2579844

10 November 2020 Multimodal medical image fusion based on saliency features detection in NSST domain

Yuan Gao, Shiwei Ma

Proceedings Volume 11584, 2020 International Conference on Image, Video Processing and Artificial Intelligence; 115840J (2020) https://doi.org/10.1117/12.2579844
Event: Third International Conference on Image, Video Processing and Artificial Intelligence, 2020, Shanghai, China

Abstract

Multimodal medical image fusion is to extract information from different modal images into a single one and obtain the organizational characteristics of source images. Different medical imaging measures such as CT and MRI often bring different visual morphology, however, the salient features of tissues are basically the same from the perspective of human eyes. According to this characteristic, an improved image fusion algorithm based on visual salience detection is proposed in this paper. First, the GBVS algorithm was introduced to calculate visual salience of two registered source images, and then decompose the source images in NSST domain to obtain their low-frequency and high-frequency sub-bands. For the low-frequency sub-bands, local energy and GBVS graph are input into fuzzy logic system to obtain the respective weights for the fused low-frequency sub-band. For the high-frequency sub-bands, the NSML values of each sub-band were calculated and compared to obtain the fused high-frequency sub-band. The final fused image was obtained by using the inverse NSST transformation. Applying this method to multimodal medical image fusion, the visual quality of the image can be enhanced effectively and the salient features of tissues can be preserved well. Experiments on multimodal fusion of different gray-scale medical images show that the proposed method has advantages in retention of image salient features and the overall image contrast, and has better objective index than the comparison models.

Citation Download Citation

Yuan Gao and Shiwei Ma "Multimodal medical image fusion based on saliency features detection in NSST domain", Proc. SPIE 11584, 2020 International Conference on Image, Video Processing and Artificial Intelligence, 115840J (10 November 2020); https://doi.org/10.1117/12.2579844

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image fusion

Medical imaging

Fuzzy logic

Fusion energy

Feature extraction

Visualization

Performance modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years