期刊
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING
卷 7, 期 -, 页码 1148-1160出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCI.2021.3122285
关键词
Imaging; Coded dperture design; computational imaging; deep learning; end-to-end optimization; regularization
资金
- VIE of UIS [2699]
- Academy of Finland [318083]
- Academy of Finland (AKA) [318083, 318083] Funding Source: Academy of Finland (AKA)
Covering a wide range of CI problems, the end-to-end deep learning-based optimization of CAs aims to easily change the loss function of the deep approach and includes regularizers to fulfill the widely used sensing requirements of the CI applications. The binary CA solution is encouraged, and the performance of the CI task is maximized in applications such as restoration, classification, and semantic segmentation.
Covering from photography to depth and spectral estimation, diverse computational imaging (CI) applications benefit from the versatile modulation of coded apertures (CAs). The lightwave fields as space, time, or spectral can be modulated to obtain projected encoded information at the sensor that is then decoded by efficient methods, such as the modern deep learning decoders. Although the CA can be fabricated to produce an analog modulation, a binary CA is preferred since more straightforward calibration, higher speed, and lower storage are achieved. As the performance of the decoder mainly depends on the structure of the CA, several works optimize the CA ensembles by customizing regularizers for a particular application without considering the critical physical constraints of the CAs. This work presents an end-to-end (E2E) deep learning-based optimization of CAs for CI tasks. The CA design method aims to cover a wide range of CI problems, easily changing the loss function of the deep approach. The designed loss function includes regularizers to fulfill the widely used sensing requirements of the CI applications. Mainly, the regularizers can be selected to optimize the transmittance, the compression ratio, and the correlation among measurements. At the same time, a binary CA solution is encouraged, and the performance of the CI task is maximized in applications such as restoration, classification, and semantic segmentation.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据