Journal
NEURAL NETWORKS
Volume 118, Issue -, Pages 140-147Publisher
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neunet.2019.06.002
Keywords
Reservoir computing; Sequence learning and retrieval; Short-term depression; Synaptic heterogeneity; Self-organized criticality; Optimal information processing
Funding
- National Key Research and Development Program of China [2017YFA0105203]
- Natural Science Foundation of China [81471368, 11505283, 91732305, 31620103905]
- Strategic Priority Research Program of the Chinese Academy of Sciences (CAS) [XDB32040200, XDB32030200]
- Hundred-Talent Program of CAS
- Key Research Program of Frontier Sciences, CAS [QYZDJ-SSW-SMC019]
Ask authors/readers for more resources
The brain is highly plastic, with synaptic weights changing across a wide range of time scales, from hundreds of milliseconds to days. Changes occurring at different temporal scales are believed to serve different purposes, with long-term changes for learning and memory and short-term changes for adaptation and synaptic computation. By studying the performance of reservoir computing (RC) models in a memory task, we revealed that short-term synaptic plasticity is fundamentally important for long-term synaptic changes in neural networks. Specifically, short-term depression (STD) greatly expands the operational range of a neural network in which it can accommodate long-term synaptic changes while maintaining system performance. This is achieved by dynamically adjusting neural networks close to a critical state. The effects of STD can be further strengthened by synaptic weight heterogeneity, resulting in networks that can tolerate very large, long-term changes in synaptic weights. Our results highlight a potential mechanism used by the brain to organize plasticity at different time scales, thereby maintaining optimal information processing while allowing internal structural changes necessary for learning and memory. (C) 2019 Elsevier Ltd. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available