期刊
NEURAL NETWORKS
卷 144, 期 -, 页码 496-506出版社
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neunet.2021.09.010
关键词
Spiking neural networks; Binary neural networks; STDP; Reinforcement learning
资金
- FACEPE, Brazil
- CNPq, Brazil
- CAPES, Brazil
This study combines a pre-trained binary convolutional neural network with an SNN trained online through reward-modulated STDP to leverage the advantages of both models. Experimental results show that this architecture can be a competitive alternative to deep reinforcement learning in high-dimensional observation environments.
Spiking neural networks (SNNs) aim to replicate energy efficiency, learning speed and temporal processing of biological brains. However, accuracy and learning speed of such networks is still behind reinforcement learning (RL) models based on traditional neural models. This work combines a pre trained binary convolutional neural network with an SNN trained online through reward-modulated STDP in order to leverage advantages of both models. The spiking network is an extension of its previous version, with improvements in architecture and dynamics to address a more challenging task. We focus on extensive experimental evaluation of the proposed model with optimized state-ofthe-art baselines, namely proximal policy optimization (PPO) and deep Q network (DQN). The models are compared on a grid-world environment with high dimensional observations, consisting of RGB images with up to 256 x 256 pixels. The experimental results show that the proposed architecture can be a competitive alternative to deep reinforcement learning (DRL) in the evaluated environment and provide a foundation for more complex future applications of spiking networks. (C) 2021 Elsevier Ltd. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据