Journal
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
Volume 119, Issue 22, Pages -Publisher
NATL ACAD SCIENCES
DOI: 10.1073/pnas.2121331119
Keywords
neural network; reinforcement learning; working memory; pruning
Categories
Funding
- National Institute of Mental Health [ZIA MH002928]
Ask authors/readers for more resources
Adolescent development is marked by improved cognitive processes, but a decline in the ability to learn new skills. Pruning of synapses occurs during this period. Our study shows that pruned neural networks perform better on certain tasks but learn new problems more slowly, indicating that overproduction and subsequent pruning of synapses is a computationally advantageous approach to developing a competent brain.
Adolescent development is characterized by an improvement in multiple cognitive processes. While performance on cognitive operations improves during this period, the ability to learn new skills quickly, for example, a new language, decreases. During this time, there is substantial pruning of excitatory synapses in cortex and specifically in prefrontal cortex. We have trained a series of recurrent neural networks to solve a working memory task and a reinforcement learning (RL) task. Performance on both of these tasks is known to improve during adolescence. After training, we pruned the networks by removing weak synapses. Pruning was done incrementally, and the networks were retrained during pruning. We found that pruned networks trained on the working memory task were more resistant to distraction. The pruned RL networks were able to produce more accurate value estimates and also make optimal choices more consistently. Both results are consistent with developmental improvements on these tasks. Pruned networks, however, learned some, but not all, new problems more slowly. Thus, improvements in task performance can come at the cost of flexibility. Our results show that overproduction and subsequent pruning of synapses is a computationally advantageous approach to building a competent brain.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available