4.8 Article

Nonideality-Aware Training for Accurate and Robust Low-Power Memristive Neural Networks

期刊

ADVANCED SCIENCE
卷 9, 期 17, 页码 -

出版社

WILEY
DOI: 10.1002/advs.202105784

关键词

hardware acceleration; memristors; neural networks

资金

  1. Royal Academy of Engineering
  2. Engineering and Physical Sciences Research Council [2094654, EP/S030069/1, EP/L016796/1, EP/P013503/1]
  3. Leverhulme Trust [RPG-2016-135]

向作者/读者索取更多资源

In recent years, artificial neural networks have been widely used in cognitive tasks. This article introduces a nonideality-aware training method for memristor-based neural networks, which improves energy efficiency while maintaining similar accuracy.
Recent years have seen a rapid rise of artificial neural networks being employed in a number of cognitive tasks. The ever-increasing computing requirements of these structures have contributed to a desire for novel technologies and paradigms, including memristor-based hardware accelerators. Solutions based on memristive crossbars and analog data processing promise to improve the overall energy efficiency. However, memristor nonidealities can lead to the degradation of neural network accuracy, while the attempts to mitigate these negative effects often introduce design trade-offs, such as those between power and reliability. In this work, authors design nonideality-aware training of memristor-based neural networks capable of dealing with the most common device nonidealities. The feasibility of using high-resistance devices that exhibit high I-V nonlinearity is demonstrated-by analyzing experimental data and employing nonideality-aware training, it is estimated that the energy efficiency of memristive vector-matrix multipliers is improved by almost three orders of magnitude (0.715 TOPs(-1)W(-1) to 381 TOPs(-1)W(-1)) while maintaining similar accuracy. It is shown that associating the parameters of neural networks with individual memristors allows to bias these devices toward less conductive states through regularization of the corresponding optimization problem, while modifying the validation procedure leads to more reliable estimates of performance. The authors demonstrate the universality and robustness of this approach when dealing with a wide range of nonidealities.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.8
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据