期刊
NEURAL NETWORKS
卷 144, 期 -, 页码 271-278出版社
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neunet.2021.08.027
关键词
Semisupervised learning; Unsupervised learning; Deep neural network; Deep learning; Feature extraction
资金
- JST ERATO, Japan [JPMJER1801]
The study proposes a novel biologically motivated learning method for deep convolutional neural networks, which achieves state-of-the-art performance in image discrimination tasks without requiring a large amount of labeled data. Through unsupervised competitive learning, higher-level learning representations can be achieved solely based on forward propagating signals.
This study proposes a novel biologically motivated learning method for deep convolutional neural networks (CNNs). The combination of CNNs and backpropagation learning is the most powerful method in recent machine learning regimes. However, it requires a large amount of labeled data for training, and this requirement can occasionally become a barrier for real world applications. To address this problem and use unlabeled data, we introduce unsupervised competitive learning, which only requires forward propagating signals for CNNs. The method was evaluated on image discrimination tasks using the MNIST, CIFAR-10, and ImageNet datasets, and it achieved state-of-the-art performance with respect to other biologically motivated methods in the ImageNet benchmark. The results suggest that the method enables higher-level learning representations solely based on the forward propagating signals without the need for a backward error signal for training convolutional layers. The proposed method could be useful for a variety of poorly labeled data, for example, time series or medical data. (C) 2021 The Author. Published by Elsevier Ltd.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据