期刊
NEURAL PROCESSING LETTERS
卷 38, 期 1, 页码 1-15出版社
SPRINGER
DOI: 10.1007/s11063-012-9259-4
关键词
Recurrent neural networks; Temporal processing; Long-term dependencies; Latch; Multiplexer; Finite state automata
It is known that recurrent neural networks may have difficulties remembering data over long time lags. To overcome this problem, we propose an extended architecture of recurrent neural networks, which is able to deal with long time lags between relevant input signals. A register of latches at the input layer of the network is applied to bypass irrelevant input information and to propagate relevant inputs. The latches are implemented with differentiable multiplexers, thus enabling the derivatives to be propagated through the network. The relevance of input vectors is learned concurrently with the weights of the network using a gradient-based algorithm.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据