4.3 Review

Canonical circuit computations for computer vision

Related references

Note: Only part of the references are listed.
Article Computer Science, Interdisciplinary Applications

Shape-selective processing in deep networks: integrating the evidence on perceptual integration

Christian Jarvers et al.

Summary: Understanding the similarities and differences between deep neural networks and human vision is important as they are widely used in Computer Vision and as models in Neuroscience. Research has yielded conflicting results on whether deep networks utilize the shape of objects similarly to human vision when classifying images. The discrepancies in results stem from differences in experimental methods used. Comparing the advantages and pitfalls of these methods, two hypotheses are proposed: deep networks are sensitive to local shape but not global shape, and higher layers of deep networks discard some shape information. Testing these hypotheses supports their validity, but with variations among different networks, suggesting further research into recurrent architectures for perceptual integration.

FRONTIERS IN COMPUTER SCIENCE (2023)

Article Computer Science, Artificial Intelligence

Event-Based Vision: A Survey

Guillermo Gallego et al.

Summary: This paper provides a comprehensive overview of event-based vision, focusing on the applications and algorithms developed for event cameras. Event cameras differ from traditional cameras in their asynchronous measurement of per-pixel brightness changes, offering high temporal resolution, very high dynamic range, low power consumption, and high pixel bandwidth. The paper discusses techniques for processing events, including learning-based methods and specialized processors. It also highlights the remaining challenges and opportunities in the field of bio-inspired perception and interaction for machines.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Review Neurosciences

Hearing in Complex Environments: Auditory Gain Control, Attention, and Hearing Loss

Benjamin D. Auerbach et al.

Summary: Extracting meaningful information from noisy or complex sound environments is challenging, but the auditory system has compensatory and selective attention mechanisms to deal with this. This review examines these mechanisms and how they are affected by hearing loss.

FRONTIERS IN NEUROSCIENCE (2022)

Proceedings Paper Automation & Control Systems

HDR luminance normalization via contextual facilitation in highly recurrent neuromorphic spiking networks

Alexander J. White et al.

Summary: Previous research has shown that luminance normalization mechanisms play a role in perceiving ambiguous textures under high dynamic range illumination. In this study, a recurrent spiking neural network is developed to reproduce experimental results and correctly segment ambiguous textures in HDR images. The network reduces the number of neurons required and improves the resilience of optical flow computations under complex naturalistic illumination.

UNMANNED SYSTEMS TECHNOLOGY XXIV (2022)

Article Multidisciplinary Sciences

An ecologically motivated image dataset for deep learning yields better models of human vision

Johannes Mehrer et al.

Summary: Deep neural networks are currently the best models for visual information processing in the primate brain, with the introduction of a new dataset called ecoset and trained neural network models leading to significant improvements in predicting representations in human higher-level visual cortex and perceptual judgments.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2021)

Article Engineering, Electrical & Electronic

Advancing Neuromorphic Computing With Loihi: A Survey of Results and Outlook

Mike Davies et al.

Summary: Neuromorphic computing aims to develop chips inspired by biological neural circuits to process new knowledge, adapt, behave, and learn in real time at low power levels, with recent advancements showing promising results with Intel's Loihi processor. Compelling neuromorphic networks using spike-based hardware demonstrate significantly lower latency and energy consumption compared to state-of-the-art conventional approaches, solving diverse problems representative of brain-like computation.

PROCEEDINGS OF THE IEEE (2021)

Article Computer Science, Artificial Intelligence

Sparse Representations for Object- and Ego-Motion Estimations in Dynamic Scenes

Hirak J. Kashyap et al.

Summary: The study proposes a learning-based method that predicts both ego-motion parameters and object-motion field (OMF) from image sequences, being robust to variations due to unconstrained scene depth. This is achieved by training with continuous ego-motion constraints and learning a sparsely activated overcomplete ego-motion field (EMF) basis set.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2021)

Article Biochemistry & Molecular Biology

General Anesthesia Decouples Cortical Pyramidal Neurons

Mototaka Suzuki et al.

Review Neurosciences

Visual Search: How Do We Find What We Are Looking For?

Jeremy M. Wolfe

ANNUAL REVIEW OF VISION SCIENCE, VOL 6, 2020 (2020)

Review Neurosciences

Role of Feedback Connections in Central Visual Processing

Farran Briggs

ANNUAL REVIEW OF VISION SCIENCE, VOL 6, 2020 (2020)

Article Multidisciplinary Sciences

A recurrent circuit implements normalization, simulating the dynamics of V1 activity

David J. Heeger et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2020)

Article Multidisciplinary Sciences

Diffuse neural coupling mediates complex network dynamics through the formation of quasi-critical brain states

Eli J. Mueller et al.

NATURE COMMUNICATIONS (2020)

Article Computer Science, Artificial Intelligence

Shortcut learning in deep neural networks

Robert Geirhos et al.

NATURE MACHINE INTELLIGENCE (2020)

Editorial Material Biochemistry & Molecular Biology

Visual Attention: The Multiple Ways in which History Shapes Selection

Jeremy M. Wolfe

CURRENT BIOLOGY (2019)

Article Neurosciences

The Role of Bottom-Up and Top-Down Cortical Interactions in Adaptation to Natural Scene Statistics

Sawn W. Habtegiorgis et al.

FRONTIERS IN NEURAL CIRCUITS (2019)

Article Neurosciences

A deep learning framework for neuroscience

Blake A. Richards et al.

NATURE NEUROSCIENCE (2019)

Article Computer Science, Hardware & Architecture

Loihi: A Neuromorphic Manycore Processor with On-Chip Learning

Mike Davies et al.

IEEE MICRO (2018)

Review Anatomy & Morphology

A Perspective on Cortical Layering and Layer-Spanning Neuronal Elements

Matthew E. Larkum et al.

FRONTIERS IN NEUROANATOMY (2018)

Review Neurosciences

Shape from Contour: Computation and Representation

James H. Elder

ANNUAL REVIEW OF VISION SCIENCE, VOL 4 (2018)

Article Computer Science, Artificial Intelligence

Revisiting active perception

Ruzena Bajesy et al.

AUTONOMOUS ROBOTS (2018)

Review Neurosciences

Dynamic models of large-scale brain activity

Michael Breakspear

NATURE NEUROSCIENCE (2017)

Review Neurosciences

Learning with three factors: modulating Hebbian plasticity with errors

Lukasz Kusmierz et al.

CURRENT OPINION IN NEUROBIOLOGY (2017)

Article Computer Science, Artificial Intelligence

Bio-inspired computer vision: Towards a synergistic approach of artificial and biological vision

N. V. Kartheek Medathati et al.

COMPUTER VISION AND IMAGE UNDERSTANDING (2016)

Review Neurosciences

Eight open questions in the computational modeling of higher sensory cortex

Daniel L. K. Yamins et al.

CURRENT OPINION IN NEUROBIOLOGY (2016)

Article Multidisciplinary Sciences

Active cortical dendrites modulate perception

Naoya Takahashi et al.

SCIENCE (2016)

Review Psychology, Biological

The effects of arousal on apical amplification and conscious state

W. A. Phillips et al.

NEUROSCIENCE OF CONSCIOUSNESS (2016)

Article Neurosciences

The role of memory for visual search in scenes

Melissa Le-Hoa Vo et al.

COMPETITIVE VISUAL PROCESSING ACROSS SPACE AND TIME: ATTENTION, MEMORY, AND PREDICTION (2015)

Article Computer Science, Cybernetics

Invariant visual object recognition: biologically plausible approaches

Leigh Robinson et al.

BIOLOGICAL CYBERNETICS (2015)

Review Multidisciplinary Sciences

Deep learning

Yann LeCun et al.

NATURE (2015)

Article Computer Science, Artificial Intelligence

Asynchronous event-based corner detection and matching

Xavier Clady et al.

NEURAL NETWORKS (2015)

Review Behavioral Sciences

On the functions, mechanisms, and malfunctions of intracortical contextual modulation

W. A. Phillips et al.

NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS (2015)

Article Neurosciences

On event-based optical flow detection

Tobias Brosch et al.

Frontiers in Neuroscience (2015)

Editorial Material Biochemistry & Molecular Biology

It's all about the constraints

John K. Tsotsos

CURRENT BIOLOGY (2014)

Review Biochemistry & Molecular Biology

Neural Networks and Neuroscience-Inspired Computer Vision

David Daniel Cox et al.

CURRENT BIOLOGY (2014)

Article Computer Science, Artificial Intelligence

Computing with a Canonical Neural Circuits Model with Pool Normalization and Modulating Feedback

Tobias Brosch et al.

NEURAL COMPUTATION (2014)

Article Computer Science, Artificial Intelligence

Interaction of feedforward and feedback streams in visual cortex in a firing-rate model of columnar computations

Tobias Brosch et al.

NEURAL NETWORKS (2014)

Article Engineering, Electrical & Electronic

Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output

Christoph Posch et al.

PROCEEDINGS OF THE IEEE (2014)

Article Engineering, Electrical & Electronic

The SpiNNaker Project

Steve B. Furber et al.

PROCEEDINGS OF THE IEEE (2014)

Article Engineering, Electrical & Electronic

Bioinspired Visual Motion Estimation

Garrick Orchard et al.

PROCEEDINGS OF THE IEEE (2014)

Article Computer Science, Artificial Intelligence

Event-Based Visual Flow

Ryad Benosman et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2014)

Article Psychology, Multidisciplinary

Cognitive programs: software for attention's executive

John K. Tsotsos et al.

FRONTIERS IN PSYCHOLOGY (2014)

Article Computer Science, Hardware & Architecture

Overview of the SpiNNaker System Architecture

Steve B. Furber et al.

IEEE TRANSACTIONS ON COMPUTERS (2013)

Review Neurosciences

Top-down influences on visual processing

Charles D. Gilbert et al.

NATURE REVIEWS NEUROSCIENCE (2013)

Article Computer Science, Artificial Intelligence

Artificial vision by multi-layered neural networks: Neocognitron and its advances

Kunihiko Fukushima

NEURAL NETWORKS (2013)

Article Neurosciences

Spontaneous recovery of motion and face aftereffects

Juraj Mesik et al.

VISION RESEARCH (2013)

Article Psychology, Multidisciplinary

Recurrent processing during object recognition

Randall C. O'Reilly et al.

FRONTIERS IN PSYCHOLOGY (2013)

Article Computer Science, Cybernetics

Time scales of memory, learning, and plasticity

Christian Tetzlaff et al.

BIOLOGICAL CYBERNETICS (2012)

Article Neurosciences

From circuits to behavior: a bridge too far?

Matteo Carandini

NATURE NEUROSCIENCE (2012)

Review Neurosciences

Normalization as a canonical neural computation

Matteo Carandini et al.

NATURE REVIEWS NEUROSCIENCE (2012)

Article Computer Science, Artificial Intelligence

Asynchronous frameless event-based optical flow

Ryad Benosman et al.

NEURAL NETWORKS (2012)

Review Neurosciences

How Does the Brain Solve Visual Object Recognition?

James J. DiCarlo et al.

NEURON (2012)

Article Computer Science, Artificial Intelligence

Asynchronous Event-Based Binocular Stereo Matching

Paul Rogister et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2012)

Article Computer Science, Artificial Intelligence

A Model of Motion Transparency Processing with Local Center-Surround Interactions and Feedback

Florian Raudies et al.

NEURAL COMPUTATION (2011)

Article Multidisciplinary Sciences

Combining Feature Selection and Integration-A Neural Model for MT Motion Selectivity

Cornelia Beck et al.

PLOS ONE (2011)

Review Neurosciences

Neuromorphic sensory systems

Shih-Chii Liu et al.

CURRENT OPINION IN NEUROBIOLOGY (2010)

Article Neurosciences

Interactions of motion and form in visual cortex - A neural model

Cornelia Beck et al.

JOURNAL OF PHYSIOLOGY-PARIS (2010)

Article Neurosciences

A model of neural mechanisms in monocular transparent motion perception

Florian Raudies et al.

JOURNAL OF PHYSIOLOGY-PARIS (2010)

Article Ophthalmology

A Bio-Inspired Evaluation Methodology for Motion Estimation

P. Kornprobst et al.

JOURNAL OF VISION (2010)

Review Neurosciences

The Normalization Model of Attention

John H. Reynolds et al.

NEURON (2009)

Article Engineering, Electrical & Electronic

A 128x128 120 dB 15 μs latency asynchronous temporal contrast vision sensor

Patrick Lichtsteiner et al.

IEEE JOURNAL OF SOLID-STATE CIRCUITS (2008)

Article Computer Science, Artificial Intelligence

Object class recognition and localization using sparse features with limited receptive fields

Jim Mutch et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2008)

Article Computer Science, Artificial Intelligence

Adaptive integration in the visual cortex by depressing recurrent cortical circuits

Mark C. W. van Rossum et al.

NEURAL COMPUTATION (2008)

Article Neurosciences

Texture segmentation in human perception:: A combined modeling and fMRI study

A. Thielscher et al.

NEUROSCIENCE (2008)

Article Computer Science, Artificial Intelligence

Robust object recognition with cortex-like mechanisms

Thomas Serre et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2007)

Article Mathematical & Computational Biology

A computational model to link psychophysics and cortical cell activation patterns in human texture processing

A. Thielscher et al.

JOURNAL OF COMPUTATIONAL NEUROSCIENCE (2007)

Article Neurosciences

Mechanisms underlying the perceived angular velocity of a rigidly rotating object

G. P. Caplovitz et al.

VISION RESEARCH (2006)

Article Neurosciences

Integration of contour and terminator signals in visual area MT of alert macaque

CC Pack et al.

JOURNAL OF NEUROSCIENCE (2004)

Article Neurosciences

A silicon early visual system as a model animal

T Delbrück et al.

VISION RESEARCH (2004)

Article Computer Science, Artificial Intelligence

Disambiguating visual motion through contextual feedback modulation

P Bayerl et al.

NEURAL COMPUTATION (2004)

Article Neurosciences

Top-down dendritic input increases the gain of layer 5 pyramidal neurons

ME Larkum et al.

CEREBRAL CORTEX (2004)

Article Neurosciences

Directional performance in motion transparency

OJ Braddick et al.

VISION RESEARCH (2002)

Article Computer Science, Artificial Intelligence

A taxonomy and evaluation of dense two-frame stereo correspondence algorithms

D Scharstein et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2002)

Review Neurosciences

Neural mechanisms of object recognition

M Riesenhuber et al.

CURRENT OPINION IN NEUROBIOLOGY (2002)

Article Mathematical & Computational Biology

Supervised and unsupervised learning with two sites of synaptic integration

KP Körding et al.

JOURNAL OF COMPUTATIONAL NEUROSCIENCE (2001)

Review Neurosciences

The fundamental plan of the retina

RH Masland

NATURE NEUROSCIENCE (2001)

Review Neurosciences

Models of object recognition

Maximilian Riesenhuber et al.

NATURE NEUROSCIENCE (2000)

Article Neurosciences

Seeing multiple directions of motion - physiology and psychophysics

S Treue et al.

NATURE NEUROSCIENCE (2000)