Journal
NEUROCOMPUTING
Volume 275, Issue -, Pages 1186-1199Publisher
ELSEVIER
DOI: 10.1016/j.neucom.2017.09.065
Keywords
Restricted Boltzmann Machine; Classification; Representational learning; Deep networks
Categories
Funding
- National Natural Science Foundation of China [61672522, 61379101]
- National Key Basic Research Program of China [2013CB329502]
- Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD)
- Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology (CICAEET)
Ask authors/readers for more resources
The Restricted Boltzmann Machine (RBM) has aroused wide interest in machine learning fields during the past decade. This review aims to report the recent developments in theoretical research and applications of the RBM. We first give an overview of the general RBM from the theoretical perspective, including stochastic approximation methods, stochastic gradient methods, and preventing overfitting methods. And then this review focuses on the RBM variants which further improve the learning ability of the RBM under general or specific applications. The RBM has recently been extended for representational learning, document modeling, multi-label learning, weakly supervised learning and many other tasks. The RBM and RBM variants provide powerful tools for representing dependency in the data, and they can be used as the basic building blocks to create deep networks. Apart from the Deep Belief Network (DBN) and the Deep Boltzmann Machine (DBM), the RBM can also be combined with the Convolutional Neural Network (CNN) to create deep networks. This review provides a comprehensive view of these advances in the RBM together with its future perspectives. (C) 2017 Elsevier B.V. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available