4.7 Article

Tri-view two-photon microscopic image registration and deblurring with convolutional neural networks

Journal

NEURAL NETWORKS
Volume 152, Issue -, Pages 57-69

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neunet.2022.04.011

Keywords

Microscopy image; Deep learning; Convolutional neural network; Deblurring; Registration

Funding

  1. JST-CREST, Japan [JPMJCR1652, JPMJCR21E2]
  2. KAKENHI, Japan [17H06310, 20H05685]
  3. Takeda Science Foundation, Japan
  4. World Premier International Research Center Initiative (WPI) , MEXT, Japan
  5. Grants-in-Aid for Scientific Research [20H05685, 17H06310] Funding Source: KAKEN

Ask authors/readers for more resources

The paper proposes a novel approach for restoring the image quality of three-dimensional neural imaging using convolutional neural networks. By estimating and fusing the intersection regions of images captured from three orthogonal viewpoints, the method improves the image quality along the depth direction and enhances the identification of neural connectivity.
Two-photon fluorescence microscopy has enabled the three-dimensional (3D) neural imaging of deep cortical regions. While it can capture the detailed neural structures in the x-y image space, the image quality along the depth direction is lower because of lens blur, which often makes it difficult to identify the neural connectivity. To address this problem, we propose a novel approach for restoring the isotropic image volume by estimating and fusing the intersection regions of the images captured from three orthogonal viewpoints using convolutional neural networks (CNNs). Because convolution on 3D images is computationally complex, the proposed method takes the form of cascaded CNN models consisting of rigid transformation, dense registration, and deblurring networks for more efficient processing. In addition, to enable self-supervised learning, we trained the CNN models with simulated synthetic images by considering the distortions of the microscopic imaging process. Through extensive experiments, the proposed method achieved substantial image quality improvements.(c) 2022 Elsevier Ltd. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available