Journal
COMMUNICATIONS IN THEORETICAL PHYSICS
Volume 74, Issue 9, Pages -Publisher
IOP Publishing Ltd
DOI: 10.1088/1572-9494/ac7c03
Keywords
neural network; response dynamics; predictive coding; similarity; symmetry breaking
Categories
Funding
- National Natural Science Foundation of China [11975295, 12047503]
- Chinese Academy of Sciences [QYZDJ-SSW-SYS018, XDPD15]
Ask authors/readers for more resources
Predictive coding is a significant theoretical framework in neuroscience that utilizes internal models and prediction errors to perceive and understand the external world. This study focuses on the effects of lateral interactions in predictive coding, and through experiments and simulations, interesting phenomena are discovered, such as learning breaking the symmetry between neurons and high input correlation not necessarily leading to strong direct interactions.
Predictive coding is a promising theoretical framework in neuroscience for understanding information transmission and perception. It posits that the brain perceives the external world through internal models and updates these models under the guidance of prediction errors. Previous studies on predictive coding emphasized top-down feedback interactions in hierarchical multilayered networks but largely ignored lateral recurrent interactions. We perform analytical and numerical investigations in this work on the effects of single-layer lateral interactions. We consider a simple predictive response dynamics and run it on the MNIST dataset of hand-written digits. We find that learning will generally break the interaction symmetry between peer neurons, and that high input correlation between two neurons does not necessarily bring strong direct interactions between them. The optimized network responds to familiar input signals much faster than to novel or random inputs, and it significantly reduces the correlations between the output states of pairs of neurons.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available