期刊
INFORMATION FUSION
卷 76, 期 -, 页码 177-186出版社
ELSEVIER
DOI: 10.1016/j.inffus.2021.06.001
关键词
Medical image fusion; Unsupervised learning; Enhanced representation
资金
- National Natural Science Foundation of China [61773295]
- Key Research and Development Program of Hubei Province [2020BAB113]
- Natural Science Foundation of Hubei Province [2019CFA037]
This paper proposes an unsupervised enhanced medical image fusion network that preserves information through surface-level and deep-level constraints, while also enhancing the chrominance information of fusion results.
Existing image fusion methods always use the same representations for different modal medical images. Otherwise, they solve the fusion problem by subjectively defining characteristics to be preserved. However, it leads to the distortion of unique information and restricts the fusion performance. To address the limitations, this paper proposes an unsupervised enhanced medical image fusion network. We perform both surface-level and deep-level constraints for enhanced information preservation. The surface-level constraint is based on the saliency and abundance measurement to preserve the subjectively defined and intuitive characteristics. In the deep-level constraint, the unique information is objectively defined based on the unique channels of a pre-trained encoder. Moreover, in our method, the chrominance information of fusion results is also enhanced. It is because we use the high-quality details in structural images (e.g., MRI) to alleviate the mosaic in functional images (e.g., PET, SPECT). Both qualitative and quantitative experiments demonstrate the superiority of our method over the state-of-the-art fusion methods.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据