Journal
NEURAL COMPUTATION
Volume 34, Issue 9, Pages 1841-1870Publisher
MIT PRESS
DOI: 10.1162/neco_a_01520
Keywords
-
Funding
- German Research Foundation (DFG) [419039588, 419039274]
Ask authors/readers for more resources
This article presents a model of the generative aspects of episodic memory, proposing that the hippocampus stores and retrieves selected aspects of an episode while the neocortex fills in missing parts based on general semantic information. The model combines neural network architectures to complete missing parts of a memory trace and can generate plausible images from scratch. It also demonstrates compression and robustness to noise. Furthermore, the model reproduces the findings of an episodic memory experiment, highlighting the importance of semantically congruent contexts.
Many studies have suggested that episodic memory is a generative process, but most computational models adopt a storage view. In this article, we present a model of the generative aspects of episodic memory. It is based on the central hypothesis that the hippocampus stores and retrieves selected aspects of an episode as a memory trace, which is necessarily incomplete. At recall, the neocortex reasonably fills in the missing parts based on general semantic information in a process we call semantic completion. The model combines two neural network architectures known from machine learning, the vector-quantized variational autoencoder (VQ-VAE) and the pixel convolutional neural network (PixelCNN). As episodes, we use images of digits and fashion items (MNIST) augmented by different backgrounds representing context. The model is able to complete missing parts of a memory trace in a semantically plausible way up to the point where it can generate plausible images from scratch, and it generalizes well to images not trained on. Compression as well as semantic completion contribute to a strong reduction in memory requirements and robustness to noise. Finally, we also model an episodic memory experiment and can reproduce that semantically congruent contexts are always recalled better than incongruent ones, high attention levels improve memory accuracy in both cases, and contexts that are not remembered correctly are more often remembered semantically congruently than completely wrong. This model contributes to a deeper understanding of the interplay between episodic memory and semantic information in the generative process of recalling the past.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available