Interactions between luminance and color signals: Effects on shape

Although luminance and color are thought to be processed independently at early stages of visual processing, there is evidence that they interact at later stages. For example, chromatic information has been shown to enhance or suppress depth from luminance depending on whether chromatic edges are aligned or orthogonal with luminance edges. Here we explored more generally how chromatic information interacts with luminance information that specifies shape from shading. Using a depth-matching task, we measured perceived depth in sinusoidal and square-wave gratings (specifying close-to sinusoidal and triangle-wave depth profiles, respectively) in three conditions. In the first, as we varied luminance contrast in the presence of an orthogonal chromatic grating, perceived depth increased (consistent with classical shape from shading). When we held the luminance at a fixed contrast and varied the chromatic grating in the other two conditions (orthogonal or aligned), we found large and inconsistent individual differences. Some participants exhibited the expected pattern of enhancement and suppression, but most did not, either for the sinusoidal or square-wave stimuli. Our results cast doubt on the idea that the interaction demonstrates a single high-level heuristic linked to depth perception. Instead, we speculate that interactions are more likely due to early cross-channel masking.