4.7 Article

Photon-Efficient Non-Line-of-Sight Imaging

Journal

IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING
Volume 8, Issue -, Pages 639-650

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCI.2022.3194721

Keywords

3-D imaging; computational imaging; depth cameras; LIDAR; low-light imaging; photon counting; Poisson processes; ranging; time-of-flight imaging; non-line-of-sight imaging

Funding

  1. Tencent Foundation
  2. National Key Research and Development (R&D) Plan of China [2020YFA0309701]
  3. National Natural Science Foundation of China [62031024]
  4. Shanghai Municipal Science and Technology Major Project [2019SHZDZX01]
  5. Shanghai Science and Technology Development Funds [22JC1402900]
  6. Shanghai Academic/Technology Research Leader [21XD1403800]
  7. Anhui Provincial Natural Science Foundation [2108085QA25]
  8. Chinese Academy of Sciences
  9. Key-Area Research and Development Program of Guangdong Province [2020B0303020001]

Ask authors/readers for more resources

Non-line-of-sight (NLOS) imaging techniques have the ability to look around corners, which attracts growing interest for diverse applications. This paper proposes a photon-efficient method to recover hidden scenes using only one detected photon at each scanning point. The method estimates the intensity information and utilizes convex optimization with joint regularization terms to recover the 3D information of the hidden scene. Simulations and experiments show that this method outperforms previous approaches under low-flux conditions.
Non-line-of-sight (NLOS) imaging techniques have the ability to look around corners, which attracts growing interest for diverse applications in autonomous navigation, medicine, transportation, manufacturing and many other domains. At present, to recover the hidden scenes, most existing transient NLOS methods need full histogram at each scanning point, which requires hund reds of detected photons to obta in both the time-of-flight (TOF) information and the intensity information. In this paper, we introduce a photon-efficient method to recover the hidden scene using only one detected photon, which contains only the TOF information of the detected photon, at each scanning point. Our method first uses the single detected photon to estimate the intensity information, and then introduces a convex optimization method with a tailored joint regularization term to recover the 3D information of the hidden scene. The regularization term contains a non-local self-similarity (NLSS) norm, which is used to capture the local structure of the hidden scene, and a total variation (TV) semi norm, which is used to enhance the edge features. To evaluate the performance of our method, both simulations and experiments are demonstrated in this paper. The results show that this photon-efficient method outperforms previous approaches under low-flux conditions.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available