Journal
NEURAL COMPUTING & APPLICATIONS
Volume 33, Issue 12, Pages 6511-6526Publisher
SPRINGER LONDON LTD
DOI: 10.1007/s00521-020-05414-4
Keywords
Internet of Things; Random-based neural networks; Embedded systems
Categories
Funding
- Universita degli Studi di Genova within the CRUI-CARE Agreement
Ask authors/readers for more resources
The paper introduces a novel training procedure for random-based neural networks that combines ensemble techniques and dropout regularization, effectively limiting computational complexity. Experimental results demonstrated that the proposed approach improved accuracy overall, with a minor degradation in performance in some cases. When compared to traditional architectures, the proposed method achieved up to a 20x speedup in IoT devices.
Random-based learning paradigms exhibit efficient training algorithms and remarkable generalization performances. However, the computational cost of the training procedure scales with the cube of the number of hidden neurons. The paper presents a novel training procedure for random-based neural networks, which combines ensemble techniques and dropout regularization. This limits the computational complexity of the training phase without affecting classification performance significantly; the method best fits Internet of Things (IoT) applications. In the training algorithm, one first generates a pool of random neurons; then, an ensemble of independent sub-networks (each including a fraction of the original pool) is trained; finally, the sub-networks are integrated into one classifier. The experimental validation compared the proposed approach with state-of-the-art solutions, by taking into account both generalization performance and computational complexity. To verify the effectiveness in IoT applications, the training procedures were deployed on a pair of commercially available embedded devices. The results showed that the proposed approach overall improved accuracy, with a minor degradation in performance in a few cases. When considering embedded implementations as compared with conventional architectures, the speedup of the proposed method scored up to 20x in IoT devices.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available