Perceiving transformed movements when using tools

Human dexterity with tools is believed to stem from our ability to incorporate and use tools as parts of our body. However tool incorporation, evident as extensions in our body representation and peri-personal space, has been observed predominantly after extended tool exposures and does not explain our immediate motor behaviours when we change tools. Here we utilize two novel experiments to elucidate the presence of additional immediate tool incorporation effects that determine motor planning with tools. Interestingly, tools were observed to immediately induce a trial-by-trial, tool length dependent shortening of the perceived limb lengths, opposite to observations of elongations after extended tool use. Our results thus exhibit that tools induce a dual effect on our body representation; an immediate shortening that critically affects motor planning with a new tool, and the slow elongation, probably a consequence of skill related changes in sensory-motor mappings with the repeated use of the tool.

Brain, 2009

Misuse of tools and objects by patients with left brain damage is generally recognized as a manifestation of apraxia, caused by parietal lobe damage. The use of tools and objects can, however, be subdivided in several components. The purpose of our study was to find out which of these are dependent on parietal lobe function. Thirty-eight patients with left brain damage and aphasia were examined using tests to assess the retrieval of functional knowledge from semantic memory (Functional Associations), mechanical problem solving (Novel Tools) and use of everyday tools and objects (Common Tools). Voxel-wise analysis of magnetic resonance images revealed two regions where lesions had a significant impact on the test results. One extended rostrally from the central region and ventrally through the middle frontal cortex to the dorsal margin of the inferior frontal gyrus. The other reached dorsally and caudally from the supramarginal gyrus, through the inferior, to superior parietal lobe. Whereas the frontal lesions had an adverse influence on all experimental tests as well as on the subtests of the Aachen Aphasia test, parietal lesions impaired Novel and Common Tools, but did not have an adverse effect on the Functional Associates. An association between Functional Associations and temporal lesions became apparent when patients with only a selective deficit in the test were considered, but did not show up in the whole group analysis. The parietal influence was as strong for the selection as for the use of either novel or common tools, although choice of appropriate manual configuration and movements was more important for use than for selection. We conclude that the contribution of the parietal lobe to tool use concerns general principles of tool use rather than knowledge about the prototypical use of common tools and objects, and the comprehension of mechanical interactions of the tool with other tools, recipients or material rather than the selection of grip formation and manual movements.

New Ideas in Psychology

Modern technologies progressively create workplaces in which the execution of movements and the observation of their consequences are spatially separated. Challenging workplaces in which users act via technical equipment in a distant space include aviation, applied medical engineering and virtual reality. When using a tool, proprioceptive/tactile feedback from the moving hand (proximal action effect) and visual feedback from the moving effect point of the tool, such as the moving cursor on a display (the distal action effect) often do not correspond or are even in conflict. If proximal and distal feedback were equally important for controlling actions with tools, this discrepancy would be a constant source of interference. The human information processing system solves this problem by favoring the intended distal action effects while attenuating or ignoring proximal action effects. The study presents an overview of experiments aiming at the underlying motor and cognitive processes and the limitations of visual predominance in tool actions. The main findings are, that when transformations are in effect the awareness of one’s own actions is quite low. This seems to be advantageous when using tools, as it allows for wide range of flexible sensorimotor adaptations and – may be more important – it evokes the feeling of being in control. Thus, the attenuation of perceiving one’s own proximal action effects is an important precondition for using tools successfully. However, the ability to integrate discordant perception-action feedback has limits, especially, but not only, with complex transformations. When feature overlap between vision and proprioception is low, and when the existence of a transformation is obvious proximal action effects come to the fore and dominate action control in tool actions. In conclusion action–effect control plays an important role in understanding the constraints of the acquisition and application of tool transformations.

eLife, 2013

Sophisticated tool use is a defining characteristic of the primate species but how is it supported by the brain, particularly the human brain? Here we show, using functional MRI and pattern classification methods, that tool use is subserved by multiple distributed action-centred neural representations that are both shared with and distinct from those of the hand. In areas of frontoparietal cortex we found a common representation for planned hand-and tool-related actions. In contrast, in parietal and occipitotemporal regions implicated in hand actions and body perception we found that coding remained selectively linked to upcoming actions of the hand whereas in parietal and occipitotemporal regions implicated in tool-related processing the coding remained selectively linked to upcoming actions of the tool. The highly specialized and hierarchical nature of this coding suggests that hand-and tool-related actions are represented separately at earlier levels of sensorimotor processing before becoming integrated in frontoparietal cortex.

Zeitschrift für Psychologie, 2012

This research evaluated how the inertial properties of a tool influence tool-using actions. Grip patterns and movements of 3-, 4-, and 5year-old children and adults were recorded while hammering. Results revealed that both number of pegs driven and movement amplitude increased developmentally and changed as a function of inertial properties of the tool but other aspects of motor control (i.e., period, grip position) did not. This suggests that both children and adults were able to discriminate and modulate only those parameters that had the largest impact on performance (i.e., the delivery of force with the hammer). Even though the ability to adjust tool movements as tool characteristics change is evident during preschool years, the ability to do so did not reach adult levels and appears to continue to develop beyond preschool.

2014

The term affordance defines a property of objects, which relates to the possible interactions that an agent can carry out on that object. In monkeys, canonical neurons encode both the visual and the motor properties of objects with high specificity. However, it is not clear if in humans exists a similarly finegrained description of these visuomotor transformations. In particular, it has not yet been proven that the processing of visual features related to specific affordances induces both specific and early visuomotor transformations, given that complete specificity has been reported to emerge quite late (300-450 ms). In this study, we applied an adaptation-stimulation paradigm to investigate early corticospinal facilitation and hand movements' synergies evoked by the observation of tools. We adapted, through passive observation of finger movements, neuronal populations coding either for precision or power grip actions. We then presented the picture of one tool affording one of the two grasps types and applied single-pulse Transcranial Magnetic Stimulation (TMS) to the hand primary motor cortex, 150 ms after image onset. Cortico-spinal excitability of the Abductor Digiti Minimi and Abductor Pollicis Brevis showed a detailed pattern of modulations, matching tools' affordances. Similarly, TMS-induced hand movements showed a pattern of grip-specific whole hand synergies. These results offer a direct proof of the emergence of an early visuomotor transformation when tools are observed, that maintains the same amount of synergistic motor details as the actions we can perform on them.

When using lever tools, subjects have to deal with two, not necessarily concordant effects of their motor behavior: The body-related proximal effects, like tactile sensations from the moving hand, and/or more external distal effects, like the moving effect points of the lever. As a consequence, spatial compatibility relationships between stimulus (S; at which the effect points of the lever aim at), responding hand (R) and effect point of the lever (E) play a critical role in response generation. In the present study we examine whether the occurrence of compatibility effects needs real tool movements or whether a similar response pattern can be already evoked by pure mental imaginations of the tool effects. In general, response times and errors observed with real and imagined tool movements showed a similar pattern of results, but there were also differences. With incompatible relationships and thus more difficult tasks, response times were reduced with imagined tool movements than compared with real tool movements. On the contrary, with compatible relationships and thus high overlap between proximal and distal action effects, response times were increased with imagined tool movements. Results are only in parts consistent with the ideomotor theory of motor control.

The present study examined what participants perceive of their hand movements when using a tool. In the experiments different gains for either the x-axis or the y-axis perturbed the relation between hand movements on a digitizer tablet and cursor movements on a display. As a consequence of the perturbation participants drew circles on the display while their covered hand movements followed either vertical or horizontal ellipses on the digitizer tablet. When asked to evaluate their hand movements, participants were extremely uncertain about their trajectories. By varying the amount of visual feedback, findings indicated that the low awareness of one’s own movements originated mainly from an insufficient quality of the humans’ tactile and proprioceptive system or from an insufficient spatial reconstruction of this information in memory.

Cortex, 2020

The ability to build and expertly manipulate manual tools sets humans apart from other animals. Watching images of manual tools has been shown to elicit a distinct pattern of neural activity in a network of parietal areas, assumingly because tools entail a potential for actionda unique feature related to their functional use and not shared with other manipulable objects. However, a question has been raised whether this selectivity reflects a processing of low-level visual propertiesdsuch as elongated shape that is idiosyncratic to most tool-objectsdrather than action-specific features. To address this question, we created and behaviourally validated a stimulus set that dissociates objects that are manipulable and nonmanipulable, as well as objects with different degrees of body extension property (tools and non-tools), while controlling for object shape and low-level image properties. We tested the encoding of action-related features by investigating neural representations in two parietal regions of interest (intraparietal sulcus and superior parietal lobule) using functional MRI. Univariate differences between tools and non-tools were not observed when controlling for visual properties, but strong evidence for the action account was nevertheless revealed when using a multivariate approach. Overall, this study provides further evidence that the representational content in the dorsal visual stream reflects encoding of action-specific properties.