期刊
出版社
NATL ACAD SCIENCES
DOI: 10.1073/pnas.2121331119
关键词
neural network; reinforcement learning; working memory; pruning
资金
- National Institute of Mental Health [ZIA MH002928]
Adolescent development is marked by improved cognitive processes, but a decline in the ability to learn new skills. Pruning of synapses occurs during this period. Our study shows that pruned neural networks perform better on certain tasks but learn new problems more slowly, indicating that overproduction and subsequent pruning of synapses is a computationally advantageous approach to developing a competent brain.
Adolescent development is characterized by an improvement in multiple cognitive processes. While performance on cognitive operations improves during this period, the ability to learn new skills quickly, for example, a new language, decreases. During this time, there is substantial pruning of excitatory synapses in cortex and specifically in prefrontal cortex. We have trained a series of recurrent neural networks to solve a working memory task and a reinforcement learning (RL) task. Performance on both of these tasks is known to improve during adolescence. After training, we pruned the networks by removing weak synapses. Pruning was done incrementally, and the networks were retrained during pruning. We found that pruned networks trained on the working memory task were more resistant to distraction. The pruned RL networks were able to produce more accurate value estimates and also make optimal choices more consistently. Both results are consistent with developmental improvements on these tasks. Pruned networks, however, learned some, but not all, new problems more slowly. Thus, improvements in task performance can come at the cost of flexibility. Our results show that overproduction and subsequent pruning of synapses is a computationally advantageous approach to building a competent brain.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据