期刊
COGNITIVE COMPUTATION
卷 6, 期 3, 页码 595-607出版社
SPRINGER
DOI: 10.1007/s12559-014-9257-0
关键词
Slow feature analysis; Echo state network; Generalized eigenvalue problem; Recurrent Neural Network; GenEigSfa; Stone's criterion; Higher-order changes
In this paper, we aim to develop novel learning approaches for extracting invariant features from time series. Specifically, we implement an existing method of solving the generalized eigenproblem and use this to firstly implement the biologically inspired technique of slow feature analysis (SFA) originally developed by Wiskott and Sejnowski (Neural Comput 14:715-770, 2002) and a rival method derived earlier by Stone (Neural Comput 8(7):1463-1492, 1996). Secondly, we investigate preprocessing the data using echo state networks (ESNs) (Lukosevicius and Jaeger in Comput Sci Rev 3(3):127-149, 2009) and show that the combination of generalized eigensolver and ESN is very powerful as a more biologically plausible implementation of SFA. Thirdly, we also investigate the effect of higher-order derivatives as a smoothing constraint and show the overall smoothness in the output signal. We demonstrate the potential of our proposed techniques, benchmarked against state-of-the-art approaches, using datasets comprising artificial, MNIST digits and hand-written character trajectories.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据