Three-dimensional shape coding in inferior temporal cortex

Neurons in the rostral lower bank of the superior temporal sulcus (TEs), part of the inferior temporal cortex, respond selectively to three-dimensional (3D) shapes. We have investigated how these neurons represent disparity-defined 3D structure. Most neurons were selective for either first-order (disparity gradients) or second-order (disparity curvature) disparities. The latter selectivity proved remarkably vulnerable to disparity discontinuities, such as sharp edges or steps in disparity. The majority of the neurons remained selective for small disparity variations within the stimulus. 3D shape selectivity was preserved when the fronto-parallel position or the stimulus size was altered. Thus, in TEs, 3D shape is coded by first- and second-order disparity-selective neurons, which are highly sensitive to spatial variations of disparity.