期刊
IEEE TRANSACTIONS ON IMAGE PROCESSING
卷 30, 期 -, 页码 7170-7183出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIP.2021.3101916
关键词
Image reconstruction; Hyperspectral imaging; Sensors; Image coding; Particle measurements; Atmospheric measurements; Three-dimensional displays; Hyperspectral imaging; reconstruction; CASSI; RGB; spectral low-rank; fusion
资金
- Japan Society for the Promotion of Science (KAKENHI) [19K20308]
- Japan Science and Technology agency (JST), Fusion Oriented REsearch for disruptive Science and Technology (FOREST), Japan [JPMJFR206S]
- Grants-in-Aid for Scientific Research [19K20308] Funding Source: KAKEN
This paper proposes a fusion model for HSI reconstruction by combining CASSI and RGB measurements, utilizing low-dimensional spectral subspace property and patch processing strategy to improve the speed and quality of reconstruction. Extensive experiments demonstrate that the proposed method outperforms previous state-of-the-art methods and speeds up the reconstruction process significantly.
Coded aperture snapshot spectral imaging (CASSI) is a promising technique for capturing three-dimensional hyperspectral images (HSIs), in which algorithms are used to perform the inverse problem of HSI reconstruction from a single coded two-dimensional (2D) measurement. Due to the ill-posed nature of this problem, various regularizers have been exploited to reconstruct 3D data from 2D measurements. Unfortunately, the accuracy and computational complexity are unsatisfactory. One feasible solution is to utilize additional information such as the RGB measurement in CASSI. Considering the combined CASSI and RGB measurements, in this paper, we propose a fusion model for HSI reconstruction. Specifically, we investigate the low-dimensional spectral subspace property of HSIs composed of a spectral basis and spatial coefficients. In particular, the RGB measurement is utilized to estimate the coefficients, while the CASSI measurement is adopted to provide the spectral basis. We further propose a patch processing strategy to enhance the spectral low-rank property of HSIs. The optimization of the proposed model requires neither iteration nor the spectral sensing matrix of the RGB detector. Extensive experiments on both simulated and real HSI datasets demonstrate that our proposed method not only outperforms previous state-of-the-art (iterative algorithms) methods in quality but also speeds up the reconstruction by more than 5000 times.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据