4.5 Article

A Memristive Spiking Neural Network Circuit With Selective Supervised Attention Algorithm

Related references

Note: Only part of the references are listed.
Article Engineering, Electrical & Electronic

Full-Circuit Implementation of Transformer Network Based on Memristor

Chao Yang et al.

Summary: Memristors, emerging as an in-memory element, have been widely utilized in neural network circuits and a proposed memristor-based full-circuit implementation for the Transformer Network (TN) aims to efficiently execute TN calculations, achieve various transformations, and enhance computational efficiency and noise immunity.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS (2022)

Article Computer Science, Hardware & Architecture

Three-Dimensional Neuromorphic Computing System With Two-Layer and Low-Variation Memristive Synapses

Hongyu An et al.

Summary: In this article, a novel 3D neuromorphic system utilizing two-layer memristors as electronic synapses is proposed and analyzed. The system achieves high-speed, energy-efficient, and small design area. Hardware-software co-design and simulation demonstrate the significant improvement of memristive synapses on design area, power consumption, and latency.

IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS (2022)

Article Neurosciences

ACE-SNN: Algorithm-Hardware Co-design of Energy-Efficient & Low-Latency Deep Spiking Neural Networks for 3D Image Recognition

Gourav Datta et al.

Summary: The study proposes a novel approach to convert iso-architecture CNNs into SNNs for high-quality 3D image recognition, achieving significant reduction in latency and improved computational efficiency by directly applying analog input values to the SNN input layer during training and inference. Additionally, the issue of energy-hungry digital multiplications introduced in the first layer is addressed by proposing the use of a processing-in-memory (PIM) architecture.

FRONTIERS IN NEUROSCIENCE (2022)

Article Automation & Control Systems

Brain-Like Initial-Boosted Hyperchaos and Application in Biomedical Image Encryption

Hairong Lin et al.

Summary: This article focuses on coupled neural networks with brain-like chaotic dynamics and their application in biomedical image encryption. A memristive-coupled neural network (MCNN) model is proposed and its dynamical behaviors are studied. Numerical results show that the MCNN can generate highly complex hyperchaotic attractors and boost the attractor positions by switching their initial states. A biomedical image encryption scheme is designed and its performance is evaluated.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2022)

Article Computer Science, Hardware & Architecture

NEAT: Nonlinearity Aware Training for Accurate, Energy-Efficient, and Robust Implementation of Neural Networks on 1T-1R Crossbars

Abhiroop Bhattacharjee et al.

Summary: In this era of IoT, it is important to implement energy-efficient and adversarially secure deep neural networks on hardware. Memristive crossbars have been widely used in deep learning hardware accelerators due to their efficient matrix-vector multiplication implementation. However, nonidealities in these crossbars degrade computational accuracy. This article proposes a nonlinearity aware training method (NEAT) to address the nonlinearity in ideal crossbars and demonstrates its effectiveness through experiments on benchmark datasets. The results show significant energy savings with minimal accuracy loss and improved performance in adversarial attacks.

IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS (2022)

Article Computer Science, Hardware & Architecture

Memristive Circuit Implementation of Context-Dependent Emotional Learning Network and Its Application in Multitask

Cong Xu et al.

Summary: Emotional intelligence plays a crucial role in artificial intelligence. This article introduces a context-dependent emotional learning network and its memristive circuit implementation, addressing the limitations of existing models in considering contextual information.

IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS (2022)

Article Computer Science, Hardware & Architecture

Multilayer Memristive Neural Network Circuit Based on Online Learning for License Plate Detection

Renao Yan et al.

Summary: This article presents a memristive self-learning neuron circuit and proposes circuit implementation schemes for single-layer and multi-layer neural networks. The circuits are validated through applications in pattern recognition and license plate detection with satisfactory results.

IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS (2022)

Article Engineering, Mechanical

Regulating memristive neuronal dynamical properties via excitatory or inhibitory magnetic field coupling

Zhenghui Wen et al.

Summary: This paper investigates the effect of magnetic field coupling between neurons on neuron dynamics and finds that it can change the firing mode of neurons, providing new insights into the mechanism of information interaction between neurons.

NONLINEAR DYNAMICS (2022)

Article Computer Science, Hardware & Architecture

A Novel Memristive Chaotic Neuron Circuit and Its Application in Chaotic Neural Networks for Associative Memory

Chaoxun Pan et al.

Summary: In this article, a novel chaotic neuron circuit with memristive neural synapses is proposed, and an architecture of memristive chaotic neural network (MCNN) is constructed for associative memory application of bipolar images. The MCNN utilizes memristors for parallel information processing and continuous recursive operations. Simulation results in PSPICE software validate the functions of the MCNN circuit.

IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS (2021)

Article Computer Science, Artificial Intelligence

Optimizing Deeper Spiking Neural Networks for Dynamic Vision Sensing

Youngeun Kim et al.

Summary: Spiking Neural Networks (SNNs) are considered a new generation of low-power deep neural networks due to their sparse, asynchronous, and binary event-driven processing characteristics. To improve the training effectiveness of deep SNNs, novel algorithmic and architectural advances like SALT and Switched-BN have been proposed.

NEURAL NETWORKS (2021)

Article Computer Science, Artificial Intelligence

Memristor-based neural network circuit with weighted sum simultaneous perturbation training and its applications

Cong Xu et al.

Summary: In this work, a memristor-based neural network circuit with weighted sum simultaneous perturbation training is proposed, which simplifies the training process and achieves practical and effective results. The circuit design is efficient and eliminates the need for complex computations, showing promising potential for neural network applications.

NEUROCOMPUTING (2021)

Article Multidisciplinary Sciences

Visual explanations from spiking neural networks using inter-spike intervals

Youngeun Kim et al.

Summary: Spiking Neural Networks (SNNs) offer an energy-efficient alternative to conventional deep learning by emulating biological features in the brain. The visual explanation tool SAM highlights neurons with short inter-spike interval activity to provide a transparent understanding for end-users on how SNNs make predictions and decisions without the use of gradients and ground truth. This approach opens up a new research area of 'explainable neuromorphic computing' that aims to establish trust in predictions from SNNs.

SCIENTIFIC REPORTS (2021)

Article Neurosciences

Revisiting Batch Normalization for Training Low-Latency Deep Spiking Neural Networks From Scratch

Youngeun Kim et al.

Summary: This study introduces a time Batch Normalization Through Time (BNTT) technique to address training issues in Spiking Neural Networks (SNNs), demonstrating near state-of-the-art performance on various datasets. By varying BN parameters at each time-step, the model can better learn the time-varying input distribution, showing interesting benefits towards robustness and enabling temporal early exit to reduce inference latency.

FRONTIERS IN NEUROSCIENCE (2021)

Article Engineering, Electrical & Electronic

Neural Bursting and Synchronization Emulated by Neural Networks and Circuits

Hairong Lin et al.

Summary: This paper investigates neural bursting and synchronization by modeling two neural network models based on the Hopfield neural network, showing that these networks can generate rich dynamic behaviors. The synchronization dynamics of the coupling neural network can produce different types of synchronous behaviors depending on the synaptic coupling strength, such as anti-phase bursting synchronization, anti-phase spiking synchronization, and complete bursting synchronization.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Training Energy-Efficient Deep Spiking Neural Networks with Single-Spike Hybrid Input Encoding

Gourav Datta et al.

Summary: Spiking Neural Networks (SNNs) offer higher computational efficiency compared to traditional deep learning frameworks, but suffer from high inference latency. This paper proposes a training framework that uses a hybrid encoding scheme and an improved gradient descent based spike timing dependent backpropagation mechanism to reduce latency and enhance computational efficiency.

2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) (2021)

Article Computer Science, Artificial Intelligence

Spiking Neural Networks for Computational Intelligence: An Overview

Shirin Dora et al.

Summary: Despite the potential of spiking neural networks in handling temporal data, high energy efficiency, and low latency, their research progress has not been as significant as deep neural networks. This may be due to benchmarking techniques for SNNs being influenced by methods used for evaluating deep neural networks, which do not provide a clear assessment of their capabilities and advantages.

BIG DATA AND COGNITIVE COMPUTING (2021)

Review Computer Science, Artificial Intelligence

A review of learning in biologically plausible spiking neural networks

Aboozar Taherkhani et al.

NEURAL NETWORKS (2020)

Editorial Material Chemistry, Physical

Memristors for Neuromorphic Circuits and Artificial Intelligence Applications

Enrique Miranda et al.

MATERIALS (2020)

Article Engineering, Electrical & Electronic

A Memristor-Based Spiking Neural Network With High Scalability and Learning Efficiency

Zhenyu Zhao et al.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS (2020)

Review Computer Science, Artificial Intelligence

Supervised learning in spiking neural networks: A review of algorithms and evaluations

Xiangwen Wang et al.

NEURAL NETWORKS (2020)

Article Engineering, Electrical & Electronic

A Multi-Stable Memristor and its Application in a Neural Network

Hairong Lin et al.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS (2020)

Article Neurosciences

Going Deeper in Spiking Neural Networks: VGG and Residual Architectures

Abhronil Sengupta et al.

FRONTIERS IN NEUROSCIENCE (2019)

Article Nanoscience & Nanotechnology

Graphene-ferroelectric transistors as complementary synapses for supervised learning in spiking neural network

Yangyang Chen et al.

NPJ 2D MATERIALS AND APPLICATIONS (2019)

Article Engineering, Biomedical

An On-Chip Trainable and the Clock-Less Spiking Neural Network With 1R Memristive Synapses

Aditya Shukla et al.

IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS (2018)

Article Engineering, Electrical & Electronic

Memristive Model for Synaptic Circuits

Yang Zhang et al.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS (2017)

Article Computer Science, Hardware & Architecture

Efficient Memristor Model Implementation for Simulation and Application

Xiaoping Wang et al.

IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS (2017)

Article Computer Science, Hardware & Architecture

A Compact Memristor-Based Dynamic Synapse for Spiking Neural Networks

Miao Hu et al.

IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS (2017)

Proceedings Paper Engineering, Electrical & Electronic

RESPARC: A Reconfigurable and Energy-Efficient Architecture with Memristive Crossbars for Deep Spiking Neural Networks

Aayush Ankit et al.

PROCEEDINGS OF THE 2017 54TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC) (2017)

Article Engineering, Biomedical

Neuronal Synapse as a Memristor: Modeling Pair- and Triplet-Based STDP Rule

Weiran Cai et al.

IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS (2015)

Article Engineering, Electrical & Electronic

VTEAM: A General Model for Voltage-Controlled Memristors

Shahar Kvatinsky et al.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS (2015)

Article Computer Science, Artificial Intelligence

Supervised Learning Using Spike-Timing-Dependent Plasticity of Memristive Synapses

Yu Nishitani et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2015)

Article Psychology

Components of Working Memory and Visual Selective Attention

Bryan R. Burnham et al.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE (2014)

Review Clinical Neurology

Bottom-Up and Top-Down Attention: Different Processes and Overlapping Neural Systems

Fumi Katsuki et al.

NEUROSCIENTIST (2014)

Article Engineering, Electrical & Electronic

TEAM: ThrEshold Adaptive Memristor Model

Shahar Kvatinsky et al.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS (2013)

Article Computer Science, Hardware & Architecture

Generalized Memristive Device SPICE Model and its Application in Circuit Design

Chris Yakopcic et al.

IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS (2013)

Article Computer Science, Artificial Intelligence

A New Supervised Learning Algorithm for Spiking Neurons

Yan Xu et al.

NEURAL COMPUTATION (2013)

Article Engineering, Electrical & Electronic

The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]

Li Deng

IEEE SIGNAL PROCESSING MAGAZINE (2012)

Review Behavioral Sciences

Top-down modulation: bridging selective attention and working memory

Adam Gazzaley et al.

TRENDS IN COGNITIVE SCIENCES (2012)

Article Computer Science, Artificial Intelligence

Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting

Filip Ponulak et al.

NEURAL COMPUTATION (2010)

Article Multidisciplinary Sciences

The missing memristor found

Dmitri B. Strukov et al.

NATURE (2008)

Article Computer Science, Artificial Intelligence

A new correlation-based measure of spike timing reliability

S Schreiber et al.

NEUROCOMPUTING (2003)