Journal
APPLIED INTELLIGENCE
Volume 52, Issue 7, Pages 8321-8336Publisher
SPRINGER
DOI: 10.1007/s10489-021-02915-0
Keywords
Representation learning; Extreme-learning-machine-based autoencoder; Polynomials approximation; Feature reconstruction; Dimension reduction
Categories
Ask authors/readers for more resources
The paper introduces a new ELM-AE model based on approximation of hybrid high-order polynomial functions to address issues in existing models and improve the effectiveness of feature learning.
As an effective algorithm in feature learning, autoencoder (AE) and its variants have been widely applied in machine learning. To overcome the expensive time consumption in backpropagation learning and parameters iterative tuning, extreme learning machine (ELM) is combined with AE, developed as ELM-based AE (ELM-AE) in unsupervised feature learning. However, random projection of ELM makes the learned features not stable for the final target recognition. On the other hand, considering to enhance high-order nonlinear expression in ELM-AE, common methods increase the computation overhead. Therefore, this paper proposes to construct a new ELM-AE based on approximation of hybrid high-order polynomial functions. The proposed model will keep fast learning speed by linearization of the high-order nonlinear expression, be robust to random projection issue, and learn discriminative features for pattern recognition. Two feature learning application scenarios, feature reconstruction and dimension reduction, are discussed based on different ELM-AE models. Experiments on publicly available datasets including small and large datasets demonstrate the proposed model's feasibility and superiority in feature learning.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available