期刊
INFORMATION FUSION
卷 82, 期 -, 页码 28-42出版社
ELSEVIER
DOI: 10.1016/j.inffus.2021.12.004
关键词
Image fusion; Semantic aware; High-level vision task; Gradient residual dense block; Task-driven evaluation
资金
- National Natural Science Foundation of China [61773295]
This paper proposes a semantic-aware real-time image fusion network (SeAFusion), which effectively boosts the performance of high-level vision tasks on fused images and outperforms existing alternatives in terms of maintaining pixel intensity distribution and preserving texture detail.
Infrared and visible image fusion aims to synthesize a single fused image that not only contains salient targets and abundant texture details but also facilitates high-level vision tasks. However, the existing fusion algorithms unilaterally focus on the visual quality and statistical metrics of fused images but ignore the demands of high-level vision tasks. To address these challenges, this paper bridges the gap between image fusion and high-level vision tasks and proposes a semantic-aware real-time image fusion network (SeAFusion). On the one hand, we cascade the image fusion module and semantic segmentation module and leverage the semantic loss to guide high-level semantic information to flow back to the image fusion module, which effectively boosts the performance of high-level vision tasks on fused images. On the other hand, we design a gradient residual dense block (GRDB) to enhance the description ability of the fusion network for fine-grained spatial details. Extensive comparative and generalization experiments demonstrate the superiority of our SeAFusion over state -of-the-art alternatives in terms of maintaining pixel intensity distribution and preserving texture detail. More importantly, the performance comparison of various fusion algorithms in task-driven evaluation reveals the natural advantages of our framework in facilitating high-level vision tasks. In addition, the superior running efficiency allows our algorithm to be effortlessly deployed as a real-time pre-processing module for high-level vision tasks.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据