期刊
OPTICS LETTERS
卷 45, 期 10, 页码 2688-2691出版社
Optica Publishing Group
DOI: 10.1364/OL.389696
关键词
-
类别
资金
- Beijing Municipal Commission of Science and Technology [Z181100003118014]
- National Natural Science Foundation of China [61971020]
- TsinghuaUniversity Initiative ScientificResearch Program
The diffractive deep neural network ((DNN)-N-2) has demonstrated its importance in performing various all-optical machine learning tasks, e.g., classification, segmentation, etc. However, deeper D(2)NNs that provide higher inference complexity are more difficult to train due to the problem of gradient vanishing. We introduce the residual D(2)NNs (Res-(DNN)-N-2), which enables us to train substantially deeper diffractive networks by constructing diffractive residual learning blocks to learn the residual mapping functions. Unlike the existing plain D(2)NNs, Res-D(2)NNs contribute to the design of a learnable light shortcut to directly connect the input and output between optical layers. Such a shortcut offers a direct path for gradient backpropagation in training, which is an effective way to alleviate the gradient vanishing issue on very deep diffractive neural networks. Experimental results on image classification and pixel super-resolution demonstrate the superiority of Res-D(2)NNs over the existing plain (DNN)-N-2 architectures. (C) 2020 Optical Society of America
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据