Journal
FRONTIERS IN NEUROSCIENCE
Volume 16, Issue -, Pages -Publisher
FRONTIERS MEDIA SA
DOI: 10.3389/fnins.2022.877701
Keywords
spiking neural networks; reinforcement learning; temporal coding; fully differentiable; asynchronous processing
Categories
Funding
- National Natural Science Foundation of China
- [62002369]
Ask authors/readers for more resources
In recent years, there has been a growing demand for using spiking neural networks (SNNs) to implement artificial intelligent systems. A new temporal coding method has been proposed to train SNNs while preserving their asynchronous nature. This method, combined with self-incremental variables and an encoding method, enables SNNs to achieve comparable performance in reinforcement learning tasks as state-of-the-art artificial neural networks.
Recent years witness an increasing demand for using spiking neural networks (SNNs) to implement artificial intelligent systems. There is a demand of combining SNNs with reinforcement learning architectures to find an effective training method. Recently, temporal coding method has been proposed to train spiking neural networks while preserving the asynchronous nature of spiking neurons to preserve the asynchronous nature of SNNs. We propose a training method that enables temporal coding method in RL tasks. To tackle the problem of high sparsity of spikes, we introduce a self-incremental variable to push each spiking neuron to fire, which makes SNNs fully differentiable. In addition, an encoding method is proposed to solve the problem of information loss of temporal-coded inputs. The experimental results show that the SNNs trained by our proposed method can achieve comparable performance of the state-of-the-art artificial neural networks in benchmark tasks of reinforcement learning.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available