期刊
IEEE ACCESS
卷 6, 期 -, 页码 10720-10732出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/ACCESS.2018.2810190
关键词
Echo state network; adaptive Levenberg-Marquardt algorithm; trust region technique; weight initialization; chaotic time series prediction
资金
- National Natural Science Foundation of China [61533002, 61603012]
- Beijing Municipal Education Commission Foundation [KM20170005025]
- Beijing Post-Doctoral Research Foundation of China [2017ZZ-028]
- China Post-Doctoral Science Foundation
Echo state networks (ESNs) have wide applications in chaotic time series prediction. In the ESN, if the smallest singular value of the reservoir state matrix is infinitesimal, the ill-posed problem might occur during the training process. To overcome this problem, an adaptive Levenberg Marquardt (LM) algorithm-based echo state network (ALM-ESN) is developed. In the developed ALM-ESN, a new adaptive damping term is introduced into the LM algorithm. The adaptive factor is amended by the trust region technique, furthermore, convergence analysis, and stability analysis are performed. Moreover, to make the inputs fall within the active region of the activation function and improve the learning speed, a weight initialization method using linear algebra is deployed to determine the appropriate input weights and reservoir weights. Simulations demonstrate that the ALM-ESN can overcome the ill-posed problem. Furthermore, it exhibits better performance and robustness for chaotic time series prediction than some other existing methods.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据