Journal
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
Volume 29, Issue 6, Pages 2337-2351Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TNNLS.2017.2654357
Keywords
Big data; classification; extreme learning machine (ELM); matrix; parallel algorithms; Spark
Categories
Funding
- National Natural Science Foundation of China [61432005, 61370095, 61472124]
- National Outstanding Youth Science Program of National Natural Science Foundation of China [61625202]
- International (Regional) Cooperation and Exchange Program of National Natural Science Foundation of China [61661146006]
- International Science & Technology Cooperation Program of China [2015DFA11240, 2015AA015303]
- Natural Science Foundation of Hunan Province of China [2015JJ4100, 2016JJ4002]
Ask authors/readers for more resources
As data sets become larger and more complicated, an extreme learning machine (ELM) that runs in a traditional serial environment cannot realize its ability to be fast and effective. Although a parallel ELM (PELM) based on MapReduce to process large-scale data shows more efficient learning speed than identical ELM algorithms in a serial environment, some operations, such as intermediate results stored on disks and multiple copies for each task, are indispensable, and these operations create a large amount of extra overhead and degrade the learning speed and efficiency of the PELMs. In this paper, an efficient ELM based on the Spark framework (SELM), which includes three parallel subalgorithms, is proposed for big data classification. By partitioning the corresponding data sets reasonably, the hidden layer output matrix calculation algorithm, matrix U decomposition algorithm, and matrix V decomposition algorithm perform most of the computations locally. At the same time, they retain the intermediate results in distributed memory and cache the diagonal matrix as broadcast variables instead of several copies for each task to reduce a large amount of the costs, and these actions strengthen the learning ability of the SELM. Finally, we implement our SELM algorithm to classify large data sets. Extensive experiments have been conducted to validate the effectiveness of the proposed algorithms. As shown, our SELMachieves an 8.71 x speedup on a cluster with ten nodes, and reaches a 13.79 x speedup with 15 nodes, an 18.74 x speedup with 20 nodes, a 23.79 x speedup with 25 nodes, a 28.89 x speedup with 30 nodes, and a 33.81 x speedup with 35 nodes.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available