Journal
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE
Volume 3, Issue -, Pages -Publisher
FRONTIERS RES FOUND
DOI: 10.3389/neuro.10.023.2009
Keywords
synaptic plasticity; intrinsic plasticity; recurrent neural networks; reservoir computing; time series prediction
Funding
- Hertie Foundation
- GABA Project [EU-04330]
- EC [MEXT-CT-2006-042484]
Ask authors/readers for more resources
Understanding the dynamics of recurrent neural networks is crucial for explaining how the brain processes information. In the neocortex, a range of different plasticity mechanisms are shaping recurrent networks into effective information processing circuits that learn appropriate representations for time-varying sensory stimuli. However, it has been difficult to mimic these abilities in artificial neural network models. Here we introduce SORN, a self-organizing recurrent network. It combines three distinct forms of local plasticity to learn spatio-temporal patterns in its input while maintaining its dynamics in a healthy regime suitable for learning. The SORN learns to encode information in the form of trajectories through its high-dimensional state space reminiscent of recent biological findings on cortical coding. All three forms of plasticity are shown to be essential for the network's success.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available