Person:

Caramazza, Alfonso

The cumulative semantic cost describes a phenomenon in which picture naming latencies increase monotonically with each additional within-category item that is named in a sequence of pictures. Here we test whether the cumulative semantic cost requires the assumption of lexical selection by competition. In Experiment 1 participants named a sequence of pictures, while in Experiment 2 participants named words instead of pictures, preceded by a gender marked determiner. We replicate the basic cumulative semantic cost with pictures (Exp. 1) and show that there is no cumulative semantic cost for word targets (Exp. 2). This pattern was replicated in Experiment 3 in which pictures and words were named along with their gender marked definite determiner, and were intermingled within the same experimental design. In addition, Experiment 3 showed that while picture naming induces a cumulative semantic cost for subsequently named words, word naming does not induce a cumulative semantic cost for subsequently named pictures. These findings suggest that the cumulative semantic cost arises prior to lexical selection and that the effect arises due to incremental changes to the connection weights between semantic and lexical representations.

The ability to process concurrently multiple visual objects is fundamental for a coherent perception of the world. A core component of this ability is the simultaneous individuation of multiple objects. Many studies have addressed the mechanism of object individuation but it remains unknown whether the visual system mandatorily individuates all relevant elements in the visual field, or whether object indexing depends on task demands. We used a neural measure of visual selection, the N2pc component, to evaluate the flexibility of multiple object individuation. In three ERP experiments, participants saw a variable number of target elements among homogenous distracters and performed either an enumeration task (Experiment 1) or a detection task, reporting whether at least one (Experiment 2) or a specified number of target elements (Experiment 3) was present. While in the enumeration task the N2pc response increased as a function of the number of targets, no such modulation was found in Experiment 2, indicating that individuation of multiple targets is not mandatory. However, a modulation of the N2pc similar to the enumeration task was visible in Experiment 3, further highlighting that object individuation is a flexible mechanism that binds indexes to object properties and locations as needed for further object processing.

The ability to generate novel sentences depends on cognitive operations that specify the syntactic function of nouns, verbs, and other words retrieved from the mental lexicon. Although neuropsychological studies suggest that such operations rely on neural circuits distinct from those encoding word form and meaning, it has not been possible to characterize this distinction definitively with neuroimaging. We used functional magnetic resonance imaging (fMRI) to show that a brain area engaged in a given grammatical operation can be identified uniquely by a monotonic decrease in activation as that operation is repeated. We applied this methodology to identify areas involved selectively in the operation of inflection of nouns or verbs. By contrast, areas involved in processing word meaning do not show this monotonic adaptation across stimuli. These results are the first to demonstrate adaptation in the fMR signal evoked not by specific stimuli, but by well-defined cognitive linguistic operations.

In this issue of Neuron, Orlov et al. show that the human occipitotemporal cortex contains regions responding preferentially to body part categories, such as upper limbs (hand, elbow), torsos, or lower faces (mouth, chin). This organization may reflect differences in the connectivity of these regions with other brain regions, to support the efficient processing of the different types of information different body parts provide.

Neurons in macaque primary motor cortex (M1) are broadly tuned to arm movement direction. Recent evidence suggests that human M1 contains directionally tuned neurons, but it is unclear which other areas are part of the network coding movement direction and what characterizes the responses of neuronal populations in those areas. Such information would be highly relevant for the implementation of brain–computer interfaces (BCIs) in paralyzed patients. We used functional magnetic resonance imaging adaptation to identify which areas of the human brain show directional selectivity and the degree to which these areas are affected by the type of motor act (to press vs to grasp). After adapting participants to one particular hand movement direction, we measured the release from adaptation during occasional test trials, parametrically varying the angular difference between adaptation and test direction. We identified multiple areas broadly tuned to movement direction, including M1, dorsal premotor cortex, intraparietal sulcus, and the parietal reach region. Within these areas, we observed a gradient of directional selectivity, with highest directional selectivity in the right parietal reach region, for both right- and left-hand movements. Moreover, directional selectivity was modulated by the type of motor act to varying degrees, with the largest effect in M1 and the smallest modulation in the parietal reach region. These data provide an important extension of our knowledge about directional tuning in the human brain. Furthermore, our results suggest that the parietal reach region might be an ideal candidate for the implementation of BCI in paralyzed patients.

Neuropsychological evidence has highlighted the role of the anterior temporal lobes in the processing of conceptual knowledge. That putative role is only beginning to be investigated with fMRI as methodological advances are able to compensate for well-known susceptibility artifacts that affect the quality of the BOLD signal. In this article, we described differential BOLD activation for pictures of animals and manipulable objects in the anterior temporal lobes, consistent with previous neuropsychological findings. Furthermore, we found that the pattern of BOLD signal in the anterior temporal lobes is qualitatively different from that in the fusiform gyri. The latter regions are activated to different extents but always above baseline by images of the preferred and of the nonpreferred categories, whereas the anterior temporal lobes tend to be activated by images of the preferred category and deactivated (BOLD below baseline) by images of the nonpreferred category. In our experimental design, we also manipulated the decision that participants made over stimuli from the different semantic categories. We found that in the right temporal pole, the BOLD signal shows some evidence of being modulated by the task that participants were asked to perform, whereas BOLD activity in more posterior regions (e.g., the fusiform gyri) is not modulated by the task. These results reconcile the fMRI literature with the neuropsychological findings of deficits for animals after damage to the right temporal pole and suggest that anterior and posterior regions within the temporal lobes involved in object processing perform qualitatively different computations.

The word class effect in the picture–word interference paradigm is a highly influential finding that has provided some of the most compelling support for word class constraints on lexical selection. However, methodological concerns called for a replication of the most convincing of those effects. Experiment 1 was a direct replication of Pechmann and Zerbst (2002; Experiment 4). Participants named pictures of objects in the context of noun and adverb distractors. Naming took place in bare noun and sentence frame contexts. A word class effect emerged in both bare noun and sentence frame naming conditions, suggesting a semantic origin of the effect. In Experiment 2, participants named objects in the context of noun and verb distractors whose word class relationship to the target and imageability were orthogonally manipulated. As before, naming took place in bare noun and sentence frame naming contexts. In both naming contexts, distractor imageability but not word class affected picture naming latencies. These findings confirm the sensitivity of the picture–word interference paradigm to distractor imageability and suggest the paradigm is not sensitive to distractor word class. The results undermine the use of the word class effect in the picture–word interference paradigm as supportive of word class constraints during lexical selection.

The dorsal visual processing stream subserves object-directed action, whereas the ventral visual processing stream subserves visual object recognition. Little is known about how information computed by dorsal-stream structures influences object recognition. We used continuous flash suppression to functionally separate information computed by the dorsal stream from that computed by the ventral stream. We show that information originating from the dorsal stream influences not only decisions requiring the selection of superordinate category labels, but also decisions that entail the selection of a basic-level object. We further show that information computed by the dorsal stream does not carry specific functional information about objects. Our results indicate that the dorsal stream, in isolation from the ventral stream, is agnostic as to the identity of the objects that it processes. We suggest that structures within the dorsal visual processing stream compute motor-relevant information (e.g., graspability), which influences the identification of manipulable objects, and is not either about the function of the object or function-specific.

Functional neuroimaging studies have implicated the left lateral occipitotemporal cortex (LOTC) in both tool and hand perception but the functional role of this region is not fully known. Here, by using a task manipulation, we tested whether tool-/hand-selective LOTC contributes to the discrimination of tool-associated hand actions. Participants viewed briefly presented pictures of kitchen and garage tools while they performed one of two tasks: in the action task, they judged whether the tool is associated with a hand rotation action (e.g., screwdriver) or a hand squeeze action (e.g., garlic press), while in the location task they judged whether the tool is typically found in the kitchen (e.g., garlic press) or in the garage (e.g., screwdriver). Both tasks were performed on the same stimulus set and were matched for difficulty. Contrasting fMRI responses between these tasks showed stronger activity during the action task than the location task in both tool- and hand-selective LOTC regions, which closely overlapped. No differences were found in nearby object- and motion-selective control regions. Importantly, these findings were confirmed by a TMS study, which showed that effective TMS over the tool-/hand-selective LOTC region significantly slowed responses for tool action discriminations relative to tool location discriminations, with no such difference during sham TMS. We conclude that left LOTC contributes to the discrimination of tool-associated hand actions.

Although our naïve experience of visual perception is that it is smooth and coherent, the actual input from the retina involves brief and discrete fixations separated by saccadic eye movements. This raises the question of whether our impression of stable and continuous vision is merely an illusion. To test this, we examined whether motion perception can “bridge” a saccade in a two-frame apparent motion display in which the two frames were separated by a saccade. We found that transformational apparent motion, in which an object is seen to change shape and even move in three dimensions during the motion trajectory, continues across saccades. Moreover, participants preferred an interpretation of motion in spatial, rather than retinal, coordinates. The strength of the motion percept depended on the temporal delay between the two motion frames and was sufficient to give rise to a motion-from-shape aftereffect, even when the motion was defined by a second-order shape cue (“phantom transformational apparent motion”). These findings suggest that motion and shape information are integrated across saccades into a single, coherent percept of a moving object.