期刊
PHOTONICS RESEARCH
卷 10, 期 8, 页码 1848-1858出版社
CHINESE LASER PRESS
DOI: 10.1364/PRJ.458231
关键词
-
类别
资金
- New Generation of Artificial Intelligence Integration and Application Demonstration of the Chinese Academy of Sciences [RTLZ2021009]
- Westlake Foundation [2021B1501-2]
In this paper, a hybrid network module called convolution and contextual Transformer (CCoT) block is proposed for improving the reconstruction quality of spectral compressive imaging (SCI). The proposed CCoT block is integrated into a physics-driven deep unfolding framework to form the GAP-CCoT network. Experimental results demonstrate that the GAP-CCoT algorithm outperforms existing state-of-the-art methods in terms of reconstruction quality and running time.
Spectral compressive imaging (SCI) is able to encode a high-dimensional hyperspectral image into a two-dimensional snapshot measurement, and then use algorithms to reconstruct the spatio-spectral data-cube. At present, the main bottleneck of SCI is the reconstruction algorithm, and state-of-the-art (SOTA) reconstruction methods generally face problems of long reconstruction times and/or poor detail recovery. In this paper, we propose a hybrid network module, namely, a convolution and contextual Transformer (CCoT) block, that can simultaneously acquire the inductive bias ability of convolution and the powerful modeling ability of Transformer, which is conducive to improving the quality of reconstruction to restore fine details. We integrate the proposed CCoT block into a physics-driven deep unfolding framework based on the generalized alternating projection (GAP) algorithm, and further propose the GAP-CCoT network. Finally, we apply the GAP-CCoT algorithm to SCI reconstruction. Through experiments on a large amount of synthetic data and real data, our proposed model achieves higher reconstruction quality (>2 dB in peak signal-to-noise ratio on simulated benchmark datasets) and a shorter running time than existing SOTA algorithms by a large margin. The code and models are publicly available at https://github.com/ucaswangls/GAP-CCoT. (C) 2022 Chinese Laser Press
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据