Journal
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
Volume 33, Issue 2, Pages 811-825Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TNNLS.2020.3029198
Keywords
Kernel; Optimization; Learning systems; Robustness; Support vector machines; Mean square error methods; Extreme learning machine (ELM); kernel method; mixture correntropy; online learning
Categories
Funding
- National Natural Science Foundation of China [91648208, 61976175]
- National Natural Science Foundation-Shenzhen Joint Research Program [U1613219]
- Key Project of Natural Science Basic Research Plan in Shaanxi Province of China [2019JZ-05]
Ask authors/readers for more resources
This article introduces the kernel-based extreme learning machine (KELM) and its outstanding performance in addressing regression and classification problems. To improve the robustness of KELM, a mixture correntropy-based KELM (MC-KELM) is proposed, which adopts a maximum mixture correntropy criterion as the optimization criterion. Additionally, an online sequential version of MC-KELM (MCOS-KELM) is developed to handle sequentially arriving data. Experimental results demonstrate the superior performance of the new methods.
Kernel-based extreme learning machine (KELM), as a natural extension of ELM to kernel learning, has achieved outstanding performance in addressing various regression and classification problems. Compared with the basic ELM, KELM has a better generalization ability owing to no needs of the number of hidden nodes given beforehand and random projection mechanism. Since KELM is derived under the minimum mean square error (MMSE) criterion for the Gaussian assumption of noise, its performance may deteriorate under the non-Gaussian cases, seriously. To improve the robustness of KELM, this article proposes a mixture correntropy-based KELM (MC-KELM), which adopts the recently proposed maximum mixture correntropy criterion as the optimization criterion, instead of using the MMSE criterion. In addition, an online sequential version of MC-KELM (MCOS-KELM) is developed to deal with the case that the data arrive sequentially (one-by-one or chunk-by-chunk). Experimental results on regression and classification data sets are reported to validate the performance superiorities of the new methods.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available