Deep-learning-assisted Fourier transform imaging spectroscopy for hyperspectral fluorescence imaging

Hyperspectral fluorescence imaging is widely used when multiple fluorescent probes with close emission peaks are required. In particular, Fourier transform imaging spectroscopy (FTIS) provides unrivaled spectral resolution; however, the imaging throughput is very low due to the amount of interferogram sampling required. In this work, we apply deep learning to FTIS and show that the interferogram sampling can be drastically reduced by an order of magnitude without noticeable degradation in the image quality. For the demonstration, we use bovine pulmonary artery endothelial cells stained with three fluorescent dyes and 10 types of fluorescent beads with close emission peaks. Further, we show that the deep learning approach is more robust to the translation stage error and environmental vibrations. Thereby, the He-Ne correction, which is typically required for FTIS, can be bypassed, thus reducing the cost, size, and complexity of the FTIS system. Finally, we construct neural network models using Hyperband, an automatic hyperparameter selection algorithm, and compare the performance with our manually-optimized model.

Automated summary

In this study, deep learning is applied to Fourier transform imaging spectroscopy (FTIS) to significantly reduce interferogram sampling and improve imaging throughput without degrading image quality. The deep learning approach also demonstrates better robustness to translation stage error and environmental vibrations, eliminating the need for He-Ne correction in FTIS systems and reducing cost and complexity.