Person:

Madsen, Joseph

We can recognize objects in complex images in a fraction of a second. Neuronal responses in macaque areas V4 and inferior temporal cortex to preferred stimuli are typically suppressed by the addition of other objects within the receptive field (see, however, [16, 17]). How can this suppression be reconciled with rapid visual recognition in complex scenes? Certain "special categories" could be unaffected by other objects, but this leaves the problem unsolved for other categories. Another possibility is that serial attentional shifts help ameliorate the problem of distractor objects. Yet, psychophysical studies, scalp recordings, and neurophysiological recordings suggest that the initial sweep of visual processing contains a significant amount of information. We recorded intracranial field potentials in human visual cortex during presentation of flashes of two-object images. Visual selectivity from temporal cortex during the initial approximately 200 ms was largely robust to the presence of other objects. We could train linear decoders on the responses to isolated objects and decode information in two-object images. These observations are compatible with parallel, hierarchical, and feed-forward theories of rapid visual recognition and may provide a neural substrate to begin to unravel rapid recognition in natural scenes.

The difficulty of visual recognition stems from the need to achieve high selectivity while maintaining robustness to object transformations within hundreds of milliseconds. Theories of visual recognition differ in whether the neuronal circuits invoke recurrent feedback connections or not. The timing of neurophysiological responses in visual cortex plays a key role in distinguishing between bottom-up and top-down theories. Here, we quantified at millisecond resolution the amount of visual information conveyed by intracranial field potentials from 912 electrodes in 11 human subjects. We could decode object category information from human visual cortex in single trials as early as 100 ms poststimulus. Decoding performance was robust to depth rotation and scale changes. The results suggest that physiological activity in the temporal lobe can account for key properties of visual recognition. The fast decoding in single trials is compatible with feedforward theories and provides strong constraints for computational models of human vision.