4.8 Article

Deep physical neural networks trained with backpropagation

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Artificial Intelligence

Reality-Assisted Evolution of Soft Robots through Large-Scale Physical Experimentation: A Review

Toby Howison et al.

ARTIFICIAL LIFE (2021)

Article Engineering, Electrical & Electronic

Fully On-Chip MAC at 14 nm Enabled by Accurate Row-Wise Programming of PCM-Based Weights and Parallel Vector-Transport in Duration-Format

P. Narayanan et al.

Summary: This article introduces a 14nm test chip for Analog AI inference, utilizing phase change memory devices to achieve high-efficiency MAC operations and DNN weight storage. With a closed-loop tuning algorithm, accurate weight programming and transfer are achieved, leading to near-software-equivalent accuracy on two different DNNs.

IEEE TRANSACTIONS ON ELECTRON DEVICES (2021)

Article Neurosciences

Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing Its Gradient Estimator Bias

Axel Laborieux et al.

Summary: Equilibrium Propagation is a biologically-inspired algorithm that trains convergent recurrent neural networks with a local learning rule, showing strong theoretical guarantees. By using symmetric nudging, the gradient bias in Equilibrium Propagation can be greatly reduced, allowing the training of deep convolutional neural networks.

FRONTIERS IN NEUROSCIENCE (2021)

Article Multidisciplinary Sciences

EqSpike: Spike-driven equilibrium propagation for neuromorphic implementations

Erwann Martin et al.

Summary: This study introduces a spiking neural network algorithm called EqSpike, which learns through equilibrium propagation and achieves high accuracy on the MNIST dataset. The algorithm implemented in silicon neuromorphic technology significantly reduces energy consumption and displays a form of spike-timing-dependent plasticity during learning.

ISCIENCE (2021)

Article Physics, Applied

Physical Deep Learning Based on Optimal Control of Dynamical Systems

Genki Furuhata et al.

Summary: This study explores the application of deep learning in dynamical systems, proposing a method for pattern recognition based on optimal control suitable for physical hardware implementation. By utilizing the time evolution of systems, image recognition and nonlinear classification can be achieved with just a few control signals.

PHYSICAL REVIEW APPLIED (2021)

Article Engineering, Electrical & Electronic

Noise-Resilient DNN: Tolerating Noise in PCM-Based AI Accelerators via Noise-Aware Training

Sanjay Kariyappa et al.

Summary: PCM-based Analog-AI accelerators are being used for inference in edge applications due to energy efficiency, but noise sources in PCM devices can lead to inaccuracies in DNN weight values. We propose drift regularization and multiplicative noise training techniques to improve noise resiliency of DNNs, showing up to a 12% increase in model accuracy over one month in convolutional and recurrent neural networks.

IEEE TRANSACTIONS ON ELECTRON DEVICES (2021)

Article Mathematical & Computational Biology

Toward Software-Equivalent Accuracy on Transformer-Based Deep Neural Networks With Analog Memory Devices

Katie Spoon et al.

Summary: This study explores the potential of Analog AI accelerators based on Non-Volatile Memory, particularly Phase Change Memory (PCM), for accurate inference in natural language processing applications. By implementing noise-aware training to combat PCM drift and noise sources, as well as using reduced-precision digital attention-block computation down to INT6, the researchers demonstrate a path to achieving software-equivalent accuracy on the GLUE benchmark with BERT (Bidirectional Encoder Representations from Transformers).

FRONTIERS IN COMPUTATIONAL NEUROSCIENCE (2021)

Proceedings Paper Computer Science, Artificial Intelligence

A Flexible and Fast PyTorch Toolkit for Simulating Training and Inference on Analog Crossbar Arrays

Malte J. Rasch et al.

Summary: The IBM ANALOG HARDWARE ACCELERATION KIT is an open source toolkit for simulating analog crossbar arrays in a convenient fashion from within PYTORCH. The toolkit allows for extending network modules and composing arbitrary ANNs, configuring analog tiles to emulate various hardware characteristics and non-idealities, and utilizing advanced analog optimization algorithms. Additionally, it enables hardware-aware training features and provides statistical noise and drift models to evaluate the accuracy of chips targeting inference acceleration.

2021 IEEE 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS) (2021)

Review Physics, Applied

Physics-informed machine learning

George Em Karniadakis et al.

Summary: Physics-informed learning seamlessly integrates data and mathematical models through neural networks or kernel-based regression networks for accurate inference of realistic and high-dimensional multiphysics problems. Challenges remain in incorporating noisy data seamlessly, complex mesh generation, and addressing high-dimensional problems.

NATURE REVIEWS PHYSICS (2021)

Article Multidisciplinary Sciences

Classification with a disordered dopantatom network in silicon

Tao Chen et al.

NATURE (2020)

Article Multidisciplinary Sciences

Ultrafast machine vision with 2D material neural network image sensors

Lukas Mennel et al.

NATURE (2020)

Article Optics

Neuromorphic metasurface

Zhicheng Wu et al.

PHOTONICS RESEARCH (2020)

Article Computer Science, Artificial Intelligence

Neural Sensors: Learning Pixel Exposures for HDR Imaging and Video Compressive Sensing With Programmable Sensors

Julien N. P. Martel et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2020)

Article Multidisciplinary Sciences

Supervised learning through physical changes in a mechanical system

Menachem Stern et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2020)

Article Multidisciplinary Sciences

Theoretical issues in deep networks

Tomaso Poggio et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2020)

Article Nanoscience & Nanotechnology

A deep-learning approach to realizing functionality in nanoelectronic devices

Hans-Christian Ruiz Euler et al.

NATURE NANOTECHNOLOGY (2020)

Review Multidisciplinary Sciences

Inference in artificial intelligence with deep optics and photonics

Gordon Wetzstein et al.

Summary: Artificial intelligence tasks require accelerators for fast and low-power execution. While general-purpose optical computing systems have not matured into a practical technology, recent research shows promise for optical computing in artificial intelligence applications, particularly for visual computing. The potential and challenges of all-optical and hybrid optical networks are discussed in this Perspective.

NATURE (2020)

Proceedings Paper Engineering, Electrical & Electronic

Unassisted True Analog Neural Network Training Chip

Y. Kohda et al.

2020 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM) (2020)

Article Engineering, Electrical & Electronic

Near-sensor and in-sensor computing

Feichi Zhou et al.

NATURE ELECTRONICS (2020)

Article Computer Science, Artificial Intelligence

Actor neural networks for the robust control of partially measured nonlinear systems showcased for image propagation through diffuse media

Babak Rahmani et al.

NATURE MACHINE INTELLIGENCE (2020)

Review Physics, Applied

Physics for neuromorphic computing

Danijela Markovic et al.

NATURE REVIEWS PHYSICS (2020)

Review Engineering, Electrical & Electronic

Neuromorphic spintronics

J. Grollier et al.

NATURE ELECTRONICS (2020)

Review Chemistry, Physical

Memristive crossbar arrays for brain-inspired computing

Qiangfei Xia et al.

NATURE MATERIALS (2019)

Review Computer Science, Artificial Intelligence

Recent advances in physical reservoir computing: A review

Gouhei Tanaka et al.

NEURAL NETWORKS (2019)

Article Computer Science, Artificial Intelligence

A Differentiable Physics Engine for Deep Learning in Robotics

Jonas Degrave et al.

FRONTIERS IN NEUROROBOTICS (2019)

Article Multidisciplinary Sciences

Wave physics as an analog recurrent neural network

Tyler W. Hughes et al.

SCIENCE ADVANCES (2019)

Proceedings Paper Engineering, Electrical & Electronic

The marriage of training and inference for scaled deep learning analog hardware

Tayfun Gokmen et al.

2019 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM) (2019)

Article Multidisciplinary Sciences

Nanophotonic particle simulation and inverse design using artificial neural networks

John Peurifoy et al.

SCIENCE ADVANCES (2018)

Article Multidisciplinary Sciences

All-optical machine learning using diffractive deep neural networks

Xing Lin et al.

SCIENCE (2018)

Article Multidisciplinary Sciences

Vowel recognition with four coupled spin-torque nano-oscillators

Miguel Romera et al.

NATURE (2018)

Review Optics

Inverse design in nanophotonics

Sean Molesky et al.

NATURE PHOTONICS (2018)

Article Optics

Quantum circuit learning

K. Mitarai et al.

PHYSICAL REVIEW A (2018)

Article Physics, Mathematical

Why Does Deep and Cheap Learning Work So Well?

Henry W. Lin et al.

JOURNAL OF STATISTICAL PHYSICS (2017)

Article Optics

Deep learning with coherent nanophotonic circuits

Yichen Shen et al.

NATURE PHOTONICS (2017)

Article Mathematical & Computational Biology

Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagation

Benjamin Scellier et al.

FRONTIERS IN COMPUTATIONAL NEUROSCIENCE (2017)

Article Multidisciplinary Sciences

Random synaptic feedback weights support error backpropagation for deep learning

Timothy P. Lillicrap et al.

NATURE COMMUNICATIONS (2016)

Article Multidisciplinary Sciences

Trainable hardware for dynamical computing using error backpropagation through physical media

Michiel Hermans et al.

NATURE COMMUNICATIONS (2015)

Review Computer Science, Artificial Intelligence

Evolution-in-materio: evolving computation in materials

Julian F. Miller et al.

EVOLUTIONARY INTELLIGENCE (2014)

Article Computer Science, Artificial Intelligence

Memristor Bridge Synapse-Based Neural Network and Its Learning

Shyam Prasad Adhikari et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2012)

Article Multidisciplinary Sciences

Information processing using a single dynamical node as complex system

L. Appeltant et al.

NATURE COMMUNICATIONS (2011)