4.8 Article

Neurons learn by predicting future activity

Journal

NATURE MACHINE INTELLIGENCE
Volume 4, Issue 1, Pages 62-+

Publisher

NATURE PORTFOLIO
DOI: 10.1038/s42256-021-00430-y

Keywords

-

Funding

  1. Compute Canada
  2. NSERC
  3. CIHR
  4. DARPA [HR0011-18-2-0021]
  5. NIH [MH125557]

Ask authors/readers for more resources

Understanding how the brain learns is crucial for developing machines with human-like intellectual capacities. Researchers have discovered that a single neuron's ability to predict its future activity could offer an effective learning mechanism. This predictive learning rule can be derived from a metabolic principle, with neurons minimizing their own synaptic activity while maximizing their impact on local blood supply. The study also suggests that spontaneous brain activity provides training data for neurons and minimizing surprise could be a key element in understanding brain computation.
Understanding how the brain learns may lead to machines with human-like intellectual capacities. It was previously proposed that the brain may operate on the principle of predictive coding. However, it is still not well understood how a predictive system could be implemented in the brain. Here we demonstrate that the ability of a single neuron to predict its future activity may provide an effective learning mechanism. Interestingly, this predictive learning rule can be derived from a metabolic principle, whereby neurons need to minimize their own synaptic activity (cost) while maximizing their impact on local blood supply by recruiting other neurons. We show how this mathematically derived learning rule can provide a theoretical connection between diverse types of brain-inspired algorithm, thus offering a step towards the development of a general theory of neuronal learning. We tested this predictive learning rule in neural network simulations and in data recorded from awake animals. Our results also suggest that spontaneous brain activity provides 'training data' for neurons to learn to predict cortical dynamics. Thus, the ability of a single neuron to minimize surprise-that is, the difference between actual and expected activity-could be an important missing element to understand computation in the brain. In artificial neural networks, a typical neuron generally performs a simple summation of inputs. Using computational and electrophysiological data, the authors show that a single neuron predicts its future activity. Neurons that predict their own future responses are a potential mechanism for learning in the brain and neural networks.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available