Journal
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
Volume 119, Issue 17, Pages -Publisher
NATL ACAD SCIENCES
DOI: 10.1073/pnas.2115302119
Keywords
ventral visual stream; deep neural networks; object perception; texture representation; BOLD
Categories
Funding
- Research to Prevent Blindness
- Lions Clubs International Foundation
- Hellman Fellows Fund
- Stanford Center for Cognitive and Neurobiological Imaging
Ask authors/readers for more resources
The human category-selective visual cortex provides a set of texture-like features that can be flexibly reconfigured to learn and identify new object categories. The representations in this visual cortex are not explicitly encoding objects, but rather capturing complex visual features that support object perception.
The human visual ability to recognize objects and scenes is widely thought to rely on representations in category-selective regions of the visual cortex. These representations could support object vision by specifically representing objects, or, more simply, by representing complex visual features regardless of the particular spatial arrangement needed to constitute real-world objects, that is, by representing visual textures. To discriminate between these hypotheses, we leveraged an image synthesis approach that, unlike previous methods, provides independent control over the complexity and spatial arrangement of visual features. We found that human observers could easily detect a natural object among synthetic images with similar complex features that were spatially scrambled. However, observer models built from BOLD responses from category-selective regions, as well as a model of macaque inferotemporal cortex and Imagenet-trained deep convolutional neural networks, were all unable to identify the real object. This inability was not due to a lack of signal to noise, as all observer models could predict human performance in image categorization tasks. How then might these texture-like representations in category-selective regions support object perception? An image specific readout from category-selective cortex yielded a representation that was more selective for natural feature arrangement, showing that the information necessary for natural object discrimination is available. Thus, our results suggest that the role of the human category-selective visual cortex is not to explicitly encode objects but rather to provide a basis set of texture-like features that can be infinitely reconfigured to flexibly learn and identify new object categories.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available