4.7 Article

SpikeSEE: An energy-efficient dynamic scenes processing framework for retinal prostheses

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Multidisciplinary Sciences

Simultaneous perception of prosthetic and natural vision in AMD patients

D. Palanker et al.

Summary: In this study, researchers conducted a clinical trial using a wireless photovoltaic subretinal implant on patients with atrophic age-related macular degeneration. The results showed that patients exhibited prosthetic visual perception closely matching the pixel size during the 18-24 month follow-up period.

NATURE COMMUNICATIONS (2022)

Article Ophthalmology

End-to-end optimization of prosthetic vision

Jaap de Ruyter van Steveninck et al.

Summary: Neural prosthetics can restore visual perception in certain forms of blindness, but finding an optimal preprocessing strategy remains a challenge in deep learning research. This paper presents a novel deep learning approach that optimizes the entire process of prosthetic vision generation using an auto-encoder architecture and a simulation module. Computational validation experiments demonstrate the potential of this end-to-end optimization method.

JOURNAL OF VISION (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Event-based Video Reconstruction via Potential-assisted Spiking Neural Network

Lin Zhu et al.

Summary: This paper introduces a new neuromorphic vision sensor that reports per-pixel brightness changes with high temporal resolution and dynamic range. The image reconstruction is achieved using a deep spiking neural network (SNN) and adaptive membrane potential (AMP) neuron. The proposed models achieve comparable performance to artificial neural network (ANN) models while being more computationally efficient in terms of energy consumption.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) (2022)

Article Computer Science, Artificial Intelligence

Periodic clustering of simple and complex cells in visual cortex

Gwangsu Kim et al.

Summary: Research suggests that simple and complex cells in the primary visual cortex (V1) arise commonly from retinal feedforward projections, with periodic clusters forming in V1 related to orientation maps. The study shows that these cells do not represent discrete hierarchical classes but instead originate from common retinal afferents.

NEURAL NETWORKS (2021)

Article Computer Science, Artificial Intelligence

Exploitation of image statistics with sparse coding in the case of stereo vision

Gerrit A. Ecke et al.

Summary: The study demonstrates the potential of sparse coding algorithm in discovering patterns within a dataset and estimating parameters in a stereo vision model. It suggests that sparse coding can generate a suitable general representation for subsequent inference tasks.

NEURAL NETWORKS (2021)

Article Computer Science, Artificial Intelligence

A brain-inspired computational model for spatio-temporal information processing

Xiaohan Lin et al.

Summary: The study introduces a novel brain-inspired computational model for generic spatio-temporal pattern recognition, consisting of reservoir and decision-making modules, capable of extracting frequency and order information of temporal inputs and performing well in looming pattern discrimination and gait recognition tasks, outperforming deep learning counterparts with limited training data.

NEURAL NETWORKS (2021)

Article Computer Science, Artificial Intelligence

Autoencoder networks extract latent variables and encode these variables in their connectomes

Matthew Farrell et al.

Summary: Advances in electron microscopy and data processing techniques are leading to increasingly large and complete microscale connectomes. Research shows that inferring circuit function from circuit connectivity may face challenges of weight ambiguity, but adding simple biologically motivated regularization of connectivity can resolve this issue.

NEURAL NETWORKS (2021)

Article Engineering, Biomedical

Real-Time Optimization of Retinal Ganglion Cell Spatial Activity in Response to Epiretinal Stimulation

Dorsa Haji Ghaffari et al.

Summary: Retinal prostheses aim to improve visual perception in patients with photoreceptor degeneration-induced blindness, but the current limitations in shape and letter perception are due to low spatial resolution. Research has shown that better patient outcomes are correlated with spatially separate phosphenes. By using an optimization algorithm to find optimal stimulation parameters for focal RGC activation, the time required for optimizing implant operation can be reduced.

IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING (2021)

Article Computer Science, Artificial Intelligence

Unraveling neural coding of dynamic natural visual scenes via convolutional recurrent neural networks

Yajing Zheng et al.

Summary: Traditional models of retinal system identification are limited by their analysis of neural responses to artificial stimuli and simplistic model designs. To bridge this gap, a deep-learning model was used to identify computational elements of the retinal circuit encoding natural scene dynamics. Experimental results show that recurrent connections are crucial for encoding complex visual scenes and learning the biological underpinnings of the retinal circuit, while also revealing the shapes and locations of ganglion cell spatiotemporal receptive fields.

PATTERNS (2021)

Review Neurosciences

Understanding the retinal basis of vision across species

Tom Baden et al.

NATURE REVIEWS NEUROSCIENCE (2020)

Review Engineering, Multidisciplinary

Toward the Next Generation of Retinal Neuroprosthesis: Visual Computation with Spikes

Zhaofei Yu et al.

ENGINEERING (2020)

Article Engineering, Biomedical

Computational challenges and opportunities for a bi-directional artificial retina

Nishal P. Shah et al.

JOURNAL OF NEURAL ENGINEERING (2020)

Article Neurosciences

Backpropagation through time and the brain

Timothy P. Lillicrap et al.

CURRENT OPINION IN NEUROBIOLOGY (2019)

Article Biochemical Research Methods

Deep convolutional models improve predictions of macaque V1 responses to natural images

Santiago A. Cadena et al.

PLOS COMPUTATIONAL BIOLOGY (2019)

Article Engineering, Biomedical

Global activity shaping strategies for a retinal implant

Martin J. Spencer et al.

JOURNAL OF NEURAL ENGINEERING (2019)

Review Neurosciences

Stimulus- and goal-oriented frameworks for understanding natural vision

Maxwell H. Turner et al.

NATURE NEUROSCIENCE (2019)

Article Computer Science, Artificial Intelligence

Efficient coding matters in the organization of the early visual system

Qingqun Kong et al.

NEURAL NETWORKS (2018)

Article Multidisciplinary Sciences

Design and validation of a foldable and photovoltaic wide-field epiretinal prosthesis

Laura Ferlauto et al.

NATURE COMMUNICATIONS (2018)

Article Computer Science, Artificial Intelligence

A 3D Convolutional Neural Network to Model Retinal Ganglion Cell's Responses to Light Patterns in Mice

Antonio Lozano et al.

INTERNATIONAL JOURNAL OF NEURAL SYSTEMS (2018)

Article Mathematical & Computational Biology

Linear-nonlinear-time-warp-poisson models of neural activity

Patrick N. Lawlor et al.

JOURNAL OF COMPUTATIONAL NEUROSCIENCE (2018)

Article Neurosciences

Models of Neuronal Stimulus-Response Functions: Elaboration, Estimation, and Evaluation

Arne F. Meyer et al.

FRONTIERS IN SYSTEMS NEUROSCIENCE (2017)

Review Ophthalmology

Retinal remodeling in human retinitis pigmentosa

B. W. Jones et al.

EXPERIMENTAL EYE RESEARCH (2016)

Article Biochemical Research Methods

Using Matrix and Tensor Factorizations for the Single-Trial Analysis of Population Spike Trains

Arno Onken et al.

PLOS COMPUTATIONAL BIOLOGY (2016)

Review Multidisciplinary Sciences

Deep learning

Yann LeCun et al.

NATURE (2015)

Article Biochemistry & Molecular Biology

Photovoltaic restoration of sight with high visual acuity

Henri Lorach et al.

NATURE MEDICINE (2015)

Article Engineering, Electrical & Electronic

A Complete 256-Electrode Retinal Prosthesis Chip

Nhan Tran et al.

IEEE JOURNAL OF SOLID-STATE CIRCUITS (2014)

Article Biochemical Research Methods

Inferring Nonlinear Neuronal Computation Based on Physiologically Plausible Inputs

James M. McFarland et al.

PLOS COMPUTATIONAL BIOLOGY (2013)

Article Engineering, Electrical & Electronic

A 3.6 μs Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-Sensor

Juan Antonio Lenero-Bardallo et al.

IEEE JOURNAL OF SOLID-STATE CIRCUITS (2011)

Article Ophthalmology

PKCα Is Essential for the Proper Activation and Termination of Rod Bipolar Cell Response

Klaus Ruether et al.

INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE (2010)

Article Multidisciplinary Sciences

Rapid neural coding in the retina with relative spike latencies

Tim Gollisch et al.

SCIENCE (2008)

Review Ophthalmology

Retinal remodeling during retinal degeneration

BW Jones et al.

EXPERIMENTAL EYE RESEARCH (2005)

Review Cell Biology

Photoreceptor degeneration and dysfunction in aging and age-related maculopathy

GR Jackson et al.

AGEING RESEARCH REVIEWS (2002)