4.1 Article

Towards a New Paradigm for Brain-inspired Computer Vision

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Artificial Intelligence

Event-Based Vision: A Survey

Guillermo Gallego et al.

Summary: This paper provides a comprehensive overview of event-based vision, focusing on the applications and algorithms developed for event cameras. Event cameras differ from traditional cameras in their asynchronous measurement of per-pixel brightness changes, offering high temporal resolution, very high dynamic range, low power consumption, and high pixel bandwidth. The paper discusses techniques for processing events, including learning-based methods and specialized processors. It also highlights the remaining challenges and opportunities in the field of bio-inspired perception and interaction for machines.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Multidisciplinary Sciences

Toroidal topology of population activity in grid cells

Richard J. Gardner et al.

Summary: The medial entorhinal cortex is part of a neural system that maps the position of an individual within a physical environment. Grid cells, a key component of this system, fire in a hexagonal pattern and collectively form a population code for the animal's position. The network dynamics of grid cells show on a toroidal manifold, with individual cells preferentially active at specific positions, which are maintained across environments and states.

NATURE (2022)

Article Multidisciplinary Sciences

Surrogate gradients for analog neuromorphic computing

Benjamin Cramer et al.

Summary: This study demonstrates the applicability of surrogate gradient learning on analog neuromorphic hardware using an in the-loop approach. The results show that learning can self-correct for device mismatch and achieve competitive spiking network performance on vision and speech benchmarks. This work sets several benchmarks for low-energy spiking network processing on analog neuromorphic hardware and paves the way for future on-chip learning algorithms.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2022)

Review Neurosciences

Priority coding in the visual system

Nicole C. Rust et al.

Summary: Visual priority coding refers to how the brain processes visual input, and our perception and response to visual information can vary in different situations. The neural mechanisms of visual priority coding are associated with perceptual expertise, goal-directed attention, visual salience, image memorability, and preferential looking. The brain combines different types of priority into a unified priority signal and uses different neural populations to decode them.

NATURE REVIEWS NEUROSCIENCE (2022)

Article Automation & Control Systems

Neuromorphic Vision-Based Fall Localization in Event Streams With Temporal-Spatial Attention Weighted Network

Guang Chen et al.

Summary: This article proposes a bioinspired vision sensor-based falls temporal localization framework that can localize fall events in long videos and has high dynamic range and privacy preserving. By using an adaptive temporal window conversion mechanism and the 1D-watershed algorithm for proposal generation, combined with temporal and spatial attention mechanism, precise falls temporal localization is achieved.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Editorial Material Neurosciences

Visualizing a joint future of neuroscience and neuromorphic engineering

Friedemann Zenke et al.

Summary: Recent research has successfully addressed the challenging issue of building biophysically plausible spiking neural models capable of complex information processing, opening up new opportunities in neuroscience and neuromorphic engineering.

NEURON (2021)

Article Computer Science, Artificial Intelligence

A brain-inspired computational model for spatio-temporal information processing

Xiaohan Lin et al.

Summary: The study introduces a novel brain-inspired computational model for generic spatio-temporal pattern recognition, consisting of reservoir and decision-making modules, capable of extracting frequency and order information of temporal inputs and performing well in looming pattern discrimination and gait recognition tasks, outperforming deep learning counterparts with limited training data.

NEURAL NETWORKS (2021)

Article Multidisciplinary Sciences

Highly accurate protein structure prediction with AlphaFold

John Jumper et al.

Summary: Proteins are essential for life, and accurate prediction of their structures is a crucial research problem. Current experimental methods are time-consuming, highlighting the need for accurate computational approaches to address the gap in structural coverage. Despite recent progress, existing methods fall short of atomic accuracy in protein structure prediction.

NATURE (2021)

Editorial Material Neurosciences

Superior colliculus activates new perspectives on decision-making

Kenneth W. Latimer et al.

Summary: Research on perturbations of the superior colliculus reveals a significant and causal role in accumulating evidence for decision-making, challenging the traditional view of this midbrain structure as being involved in simpler functions related to eye movement control.

NATURE NEUROSCIENCE (2021)

Proceedings Paper Computer Science, Artificial Intelligence

NeuSpike-Net: High Speed Video Reconstruction via Bio-inspired Neuromorphic Cameras

Lin Zhu et al.

Summary: Neuromorphic vision sensor is a new bio-inspired imaging paradigm that can continuously sense luminance intensity and fire asynchronous spikes with high temporal resolution. By combining dynamic vision sensor and spike camera, it is possible to achieve high-quality image reconstruction, with DVS responsible for perceiving motion and spike camera responsible for perceiving textures.

2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Spk2ImgNet: Learning to Reconstruct Dynamic Scene from Continuous Spike Stream

Jing Zhao et al.

Summary: The paper introduces a spike-to-image neural network for dynamic scene reconstruction from continuous spike streams, utilizing a hierarchical architecture to handle noise and high-speed motion. Experimental results show that the proposed network outperforms existing spike camera reconstruction methods.

2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021 (2021)

Review Automation & Control Systems

A Marr's Three-Level Analytical Framework for Neuromorphic Electronic Systems

Yunpeng Guo et al.

Summary: Neuromorphic electronics, aiming to build electronic mimics of the biological brain, has the potential to reshape the frontiers of information technology towards a more intelligent and efficient computing paradigm. The development of neuromorphic electronic systems faces a challenge similar to neuroscience, as achieving high-level brain-like computational functions requires bridging the gap between low-level knowledge and high-level capabilities through communication and co-design among different levels.

ADVANCED INTELLIGENT SYSTEMS (2021)

Article Computer Science, Theory & Methods

NeuroAED: Towards Efficient Abnormal Event Detection in Visual Surveillance With Neuromorphic Vision Sensor

Guang Chen et al.

Summary: The paper introduces a novel neuromorphic vision based abnormal event detection system using DVS sensors, which captures and processes events without the need for encryption design. It proposes an efficient method and a novel descriptor for feature extraction, and creates the NeuroAED dataset for abnormal event detection with neuromorphic vision sensors.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY (2021)

Article Engineering, Multidisciplinary

Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense

Yixin Zhu et al.

ENGINEERING (2020)

Review Neurosciences

Mechanisms Underlying the Neural Computation of Head Direction

Brad K. Hulse et al.

ANNUAL REVIEW OF NEUROSCIENCE, VOL 43 (2020)

Article Engineering, Electrical & Electronic

Event-Based Neuromorphic Vision for Autonomous Driving: A Paradigm Shift for Bio-Inspired Visual Sensing and Perception

Guang Chen et al.

IEEE SIGNAL PROCESSING MAGAZINE (2020)

Article Mathematical & Computational Biology

Excitation-Inhibition Balanced Neural Networks for Fast Signal Detection

Gengshuo Tian et al.

FRONTIERS IN COMPUTATIONAL NEUROSCIENCE (2020)

Review Neurosciences

Going in circles is the way forward: the role of recurrence in visual inference

Ruben S. van Bergen et al.

CURRENT OPINION IN NEUROBIOLOGY (2020)

Article Multidisciplinary Sciences

Towards artificial general intelligence with hybrid Tianjic chip architecture

Jing Pei et al.

NATURE (2019)

Article Multidisciplinary Sciences

Towards spike-based machine intelligence with neuromorphic computing

Kaushik Roy et al.

NATURE (2019)

Article Multidisciplinary Sciences

A critique of pure learning and what artificial neural networks can learn from animal brains

Anthony M. Zador

NATURE COMMUNICATIONS (2019)

Proceedings Paper Computer Science, Software Engineering

A RETINA-INSPIRED SAMPLING METHOD FOR VISUAL TEXTURE RECONSTRUCTION

Lin Zhu et al.

2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME) (2019)

Review Neurosciences

Neural Mechanisms of Motion Processing in the Mammalian Retina

Wei Wei

ANNUAL REVIEW OF VISION SCIENCE, VOL 4 (2018)

Review Neurosciences

Deep Learning With Spiking Neurons: Opportunities and Challenges

Michael Pfeiffer et al.

FRONTIERS IN NEUROSCIENCE (2018)

Review Neurosciences

The Brain as an Efficient and Robust Adaptive Learner

Sophie Deneve et al.

NEURON (2017)

Review Neurosciences

Neuroscience-Inspired Artificial Intelligence

Demis Hassabis et al.

NEURON (2017)

Article Multidisciplinary Sciences

Ring attractor dynamics in the Drosophila central brain

Sung Soo Kim et al.

SCIENCE (2017)

Review Automation & Control Systems

Imitating the Brain with Neurocomputer A New Way Towards Artificial General Intelligence

Tie-Jun Huang

INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING (2017)

Article Biochemistry & Molecular Biology

Vision Guides Selection of Freeze or Flight Defense Strategies in Mice

Gioia De Franceschi et al.

CURRENT BIOLOGY (2016)

Article Multidisciplinary Sciences

Mastering the game of Go with deep neural networks and tree search

David Silver et al.

NATURE (2016)

Review Multidisciplinary Sciences

Deep learning

Yann LeCun et al.

NATURE (2015)

Article Multidisciplinary Sciences

Processing of visually evoked innate fear by a non-canonical thalamic pathway

Pengfei Wei et al.

NATURE COMMUNICATIONS (2015)

Review Biochemistry & Molecular Biology

Neural Networks and Neuroscience-Inspired Computer Vision

David Daniel Cox et al.

CURRENT BIOLOGY (2014)

Article Engineering, Electrical & Electronic

Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output

Christoph Posch et al.

PROCEEDINGS OF THE IEEE (2014)

Review Neurosciences

Top-down influences on visual processing

Charles D. Gilbert et al.

NATURE REVIEWS NEUROSCIENCE (2013)

Article Computer Science, Artificial Intelligence

Re-visiting the echo state property

Izzet B. Yildiz et al.

NEURAL NETWORKS (2012)

Letter Biochemistry & Molecular Biology

Intact navigation skills after bilateral loss of striate cortex

Beatrice de Gelder et al.

CURRENT BIOLOGY (2008)

Article Neurosciences

A recurrent network mechanism of time integration in perceptual decisions

KF Wong et al.

JOURNAL OF NEUROSCIENCE (2006)

Article Neurosciences

Spatiotemporal elements of macaque V1 receptive fields

NC Rust et al.

NEURON (2005)

Article Neurosciences

Modeling attractor deformation in the rodent head-direction system

JP Goodridge et al.

JOURNAL OF NEUROPHYSIOLOGY (2000)