Person:

Xu, Yaoda

One important finding with the picture–word interference paradigm is that picture-naming performance is facilitated by the presentation of a distractor (e.g., CAP) formally related to the picture name (e.g., “cat”). In two picture-naming experiments we investigated the nature of such form facilitation effect with Mandarin Chinese, separating the effects of phonology and orthography. Significant facilitation effects were observed both when distractors were only orthographically or only phonologically related to the targets. The orthographic effect was overall stronger than the phonological effect. These findings suggest that the classic form facilitation effect in picture–word interference is a mixed effect with multiple loci: it cannot be attributed merely to the nonlexical activation of the target phonological segments from the visual input of the distractor. It seems instead that orthographically only related distractors facilitate the lexical selection process of picture naming, and phonologically only related distractors facilitate the retrieval of target phonological segments.

Objects are one of the most fundamental units in visual attentional selection and information processing. Studies have shown that, during object-based processing, all features of an attended object may be encoded together, even when these features are task irrelevant. Some recent studies, however, have failed to find this effect. What determines when object-based processing may or may not occur? In three experiments, observers were asked to encode object colors and the processing of task-irrelevant object shapes was evaluated by measuring functional magnetic resonance imaging responses from a brain area involved in shape representation. Whereas object-based task-irrelevant shape processing was present at low color-encoding load, it was attenuated or even suppressed at high color-encoding load. Moreover, such object-based processing was short-lived and was not sustained over a long delay period. Object-based processing for task-irrelevant features of attended objects thus does exist, as reported previously; but it is transient and its magnitude is determined by the encoding demand of the task-relevant feature.

Decades of vision research on how people search for a target item among distractor items have always avoided item clustering. Instead, researchers made sure that items were evenly distributed in search displays. This, however, is rarely the case in our everyday visual environment. Consequently, it is largely unknown how item clustering may impact visual search performance. In this study, I manipulated item clustering in search displays. In an easy feature search, observers looked for a target letter “T” among distractor letters “Os” and reported whether the target was pointing to the left or to the right. In a difficult spatial configuration search, observers searched and reported the orientation of the target letter “T” among distractor letters “Ls”. The two types of searches thus had the same target but different distractors. In two experiments, I found that while item clustering slowed down the easy feature search, it speeded up the difficult spatial configuration search. Together, these results show that item clustering significantly affects visual search performance and its exact impact (negative or positive) depends on the nature of the visual search.

Our visual system can extract summary statistics from large collections of similar objects without forming detailed representations of the individual objects in the ensemble. Such object ensemble representation is adaptive and allows us to overcome the capacity limitation associated with representing specific objects. Surprisingly, little is known about the neural mechanisms supporting such object ensemble representation. Here we showed human observers identical photographs of the same object ensemble, different photographs depicting the same ensemble, or different photographs depicting different ensembles. We observed fMRI adaptation in anterior-medial ventral visual cortex whenever object ensemble statistics repeated, even when local image features differed across photographs. Interestingly, such object ensemble processing is closely related to texture and scene processing in the brain. In contrast, the lateral occipital area, a region involved in object–shape processing, showed adaptation only when identical photographs were repeated. These results provide the first step toward understanding the neural underpinnings of real-world object ensemble representation.

In many everyday activities, we need to attend and encode multiple target objects among distractor objects. For example, when driving a car on a busy street, we need to simultaneously attend objects such as traffic signs, pedestrians, and other cars, while ignoring colorful and flashing objects in display windows. To explain how multiple visual objects are selected and encoded in visual STM and in perception in general, the neural object file theory argues that, whereas object selection and individuation is supported by inferior intraparietal sulcus (IPS), the encoding of detailed object features that enables object identification is mediated by superior IPS and higher visual areas such as the lateral occipital complex (LOC). Nevertheless, because task-irrelevant distractor objects were never present in previous studies, it is unclear how distractor objects would impact neural responses related to target object individuation and identification. To address this question, in two fMRI experiments, we asked participants to encode target object shapes among distractor object shapes, with targets and distractors shown in different spatial locations and in different colors. We found that distractor-related neural processing only occurred at low, but not at high, target encoding load and impacted both target individuation in inferior IPS and target identification in superior IPS and LOC. However, such distractor-related neural processing was short-lived, as it was only present during the visual STM encoding but not the delay period. Moreover, with spatial cuing of target locations in advance, distractor processing was attenuated during target encoding in superior IPS. These results are consistent with the load theory of visual information processing. They also show that, whereas inferior IPS and LOC were automatically engaged in distractor processing under low task load, with the help of precuing, superior IPS was able to only encode the task-relevant visual information.

Although human lesion data have indicated the importance of the parietal cortex in object-based representations, our understanding of parietal object grouping and selection mechanisms in normal observers remains largely incomplete. This study manipulated the grouping between shapes and found that fMRI response from the inferior intraparietal sulcus (IPS) was higher for the disconnected (ungrouped) than for the connected (grouped) shapes in a task in which observers simply watched the displays and performed a simple image motion jitter detection task. These results replicated similar findings from a previous study employing a different paradigm and showed that the inferior IPS plays an important role in tracking the grouping between visual elements during visual perception. Assuming that a lower response corresponds to a greater ease of representation, these results may explain why after parietal brain lesions grouped visual elements are easier to perceive than ungrouped ones.

To explain how multiple visual objects are attended and perceived, we propose that our visual system first selects a fixed number of about four objects from a crowded scene based on their spatial information (object individuation) and then encode their details (object identification). We describe the involvement of the inferior intra-parietal sulcus (IPS) in object individuation and the superior IPS and higher visual areas in object identification. Our neural object-file theory synthesizes and extends existing ideas in visual cognition and is supported by behavioral and neuroimaging results. It provides a better understanding of the role of the different parietal areas in encoding visual objects and can explain various forms of capacity-limited processing in visual cognition such as working memory.

To efficiently extract visual information from complex visual scenes to guide behavior and thought, visual input needs to be organized into discrete units that can be selectively attended and processed. One important such selection unit is visual objects. A crucial factor determining object-based selection is the grouping between visual elements. Although human lesion data have pointed to the importance of the parietal cortex in object-based representations, our understanding of these parietal mechanisms in normal human observers remains largely incomplete. Here we show that grouped shapes elicited lower functional MRI (fMRI) responses than ungrouped shapes in inferior intraparietal sulcus (IPS) even when grouping was task-irrelevant. This relative ease of representing grouped shapes allowed more shape information to be passed onto later stages of visual processing, such as information storage in superior IPS, and may explain why grouped visual elements are easier to perceive than ungrouped ones after parietal brain lesions. These results are discussed within a neural object file framework, which argues for distinctive neural mechanisms supporting object individuation and identification in visual perception.

Visual short-term memory (VSTM) plays an important role in visual cognition. Although objects are located on different 3-dimensional (3-D) surfaces in the real world, how VSTM capacity may be influenced by the presence of multiple 3-D surfaces has never been examined. By manipulating binocular disparities of visual displays, the authors found that more colored objects could be held in VSTM when they were placed on 2 rather than on I planar 3-D surfaces. This between-surface benefit in VSTM was present only when binding of objects' colors to their 3-D locations was required (i.e., when observers needed to remember which color appeared where). When binding was not required, no between-surface benefit in VSTM was observed. This benefit in VSTM could not be attributed to the number of spatial locations attended within a given surface. It was not due to a general perceptual grouping effect either, because grouping by motion and grouping by different regions of the same surface did not yield the same benefit. This increment in capacity indicates that VSTM benefits from the placement of objects in a 3-D scene.

Many everyday activities, such as driving on a busy street, require the encoding of distinctive visual objects from crowded scenes. Given resource limitations of our visual system, one solution to this difficult and challenging task is to first select individual objects from a crowded scene (object individuation) and then encode their details (object identification). Using functional magnetic resonance imaging, two distinctive brain mechanisms were recently identified that support these two stages of visual object processing. While the inferior intraparietal sulcus (IPS) selects a fixed number of about four objects via their spatial locations, the superior IPS and the lateral occipital complex (LOC) encode the features of a subset of the selected objects in great detail (object shapes in this case). Thus, the inferior IPS individuates visual objects from a crowded display and the superior IPS and higher visual areas participate in subsequent object identification. Consistent with the prediction of this theory, even when only object shape identity but not its location is task relevant, this study shows that object individuation in the inferior IPS treats four identical objects similarly as four objects that are all different, whereas object shape identification in the superior IPS and the LOC treat four identical objects as a single unique object. These results provide independent confirmation supporting the dissociation between visual object individuation and identification in the brain.