Journal
NEURAL NETWORKS
Volume 144, Issue -, Pages 496-506Publisher
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neunet.2021.09.010
Keywords
Spiking neural networks; Binary neural networks; STDP; Reinforcement learning
Funding
- FACEPE, Brazil
- CNPq, Brazil
- CAPES, Brazil
Ask authors/readers for more resources
This study combines a pre-trained binary convolutional neural network with an SNN trained online through reward-modulated STDP to leverage the advantages of both models. Experimental results show that this architecture can be a competitive alternative to deep reinforcement learning in high-dimensional observation environments.
Spiking neural networks (SNNs) aim to replicate energy efficiency, learning speed and temporal processing of biological brains. However, accuracy and learning speed of such networks is still behind reinforcement learning (RL) models based on traditional neural models. This work combines a pre trained binary convolutional neural network with an SNN trained online through reward-modulated STDP in order to leverage advantages of both models. The spiking network is an extension of its previous version, with improvements in architecture and dynamics to address a more challenging task. We focus on extensive experimental evaluation of the proposed model with optimized state-ofthe-art baselines, namely proximal policy optimization (PPO) and deep Q network (DQN). The models are compared on a grid-world environment with high dimensional observations, consisting of RGB images with up to 256 x 256 pixels. The experimental results show that the proposed architecture can be a competitive alternative to deep reinforcement learning (DRL) in the evaluated environment and provide a foundation for more complex future applications of spiking networks. (C) 2021 Elsevier Ltd. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available