SENSORIMOTOR TRANSFORMATIONS FOR EYE-HAND COORDINATION
Eye-hand coordination is a fascinating topic which allows us to sum up almost everything that we have learned so far about the spatial aspects of sensation, motor control, and sensorimotor transformation. Tasks involving eye-hand coordination - like driving a car, catching and throwing a ball, using a tool etc. - are probably much more familiar and appreciated by the lay public than, say, making a saccade or coding a target location. And yet it seems that eye-hand coordination is only recently emerging as a coherent sub-field of sensorimotor neuroscience. Why? Probably because it is so complex. In fact, it incorporates most of the bits and pieces of behaviours that are easier to study in a lab.
What is eye hand-hand coordination? A quick scan of the eye-hand coordination literature reveals two meanings. Often, eye-hand coordination is considered as the process of coordinating movements of the eyes and hand / arm system so that they both move toward the same target.
However, this is probably not what the lay-person means by eye-hand coordination. In common usage, eye-hand coordination refers to the use of vision to guide arm movements. This second meaning is much more general. It could include the first definition, but it also poses questions about how we visually localize targets, store this information, perform the necessary reference frame transformations, and use this information to generate an arm movement. This is indeed a complex topic, because it assumes not only an understanding of vision, eye movements, cognition, and arm movements, but all of the ways that these systems interact during specific behaviours.
As we shall see, another important distinction is between which aspects of arm movement are controlled on the basis of initial visual information (like saccades were) and which are controlled by continuous visual feedback. There is not a lot of direct information about eye-hand coordination on the web, so for your preparatory activity I will just have you focus on a couple of sites. We will focus more on the current literature. But bear in mind that you will have to draw heavily on material learned previously in this course to understand the current topic.
Before the lecture I expect you to go through the following undergrad-level web courses on these topics. I have indicated which sections you should focus on. You should already know most of this stuff, so it should go quickly. Then consider the "KEY CONCEPTS" to see which ones you have understood. During the lecture, I will answer questions about these topics and then we will move on to some advanced and current topics, making use of the research papers listed at the bottom of this page. If you would like to present one of these papers as part of your seminar credit, please drop me a line at jdc@yorku.ca.
(York has a
subscription
to the linked Journals, so you can view them or download them from a
York
internet account)
Recent Reviews:
Wise SP, Boussaoud D, Johnson PB, and Caminiti R (1997) Premotor and parietal cortex: Corticocortical Connectivity and Combinatorial Computations Annu. Rev. Neurosci. 20 (1): 25-42.
Richard A. Andersen, Lawrence H.
Snyder,
David C. Bradley, and Jing Xing (1997) Multimodal representation of
space
in the posterior parietal cortex and its use in planning
movements.
Annu. Rev. Neurosci.
20 (1): 303-330.
Research papers:
S.F.W. Neggers and H. Bekkering Gaze Anchoring to a Pointing Target Is Present During the Entire Pointing Movement and Is Driven by a Non-Visual Signal J. Neurophysiol. 86 (2): 961-970, 2001.
Paul Van Donkelaar, Ji-Hang Lee, and Anthony S. Drew Transcranial Magnetic Stimulation Disrupts Eye-Hand Interactions in the Posterior Parietal Cortex J. Neurophysiol. 84 (3): 1677-1680, 2000.
Roland S. Johansson, Göran Westling, Anders Bäckström, and J. Randall Flanagan (2001) Eye-Hand Coordination in Object Manipulation J. Neurosci. 21 (17): 6917-6932.
Michel Desmurget, Helena Gréa, Jeff S. Grethe, Claude Prablanc, Garret E. Alexander, and Scott T. Grafton (2001) Functional Anatomy of Nonvisual Feedback Loops during Reaching: A Positron Emission Tomography Study J. Neurosci. 21 (8): 2919 -2928.
Joseph F. X. DeSouza, Sean P. Dukelow, Joseph S. Gati, Ravi S. Menon, Richard A. Andersen, and Tutis Vilis (2000) Eye Position Signal Modulates a Human Parietal Pointing Region during Memory-Guided Movements J. Neurosci. 20 (15): 5835 -5840.
Veit Stuphorn, Erhard Bauswein, and Klaus-Peter Hoffmann Neurons in the Primate Superior Colliculus Coding for Arm Movements in Gaze-Related Coordinates J. Neurophysiol. 83 (3): 1283-1299, 2000.
MEDENDORP, W.P., CRAWFORD, J.D., HENRIQUES, D.Y.P., VAN GISBERGEN, J.A.M. and GIELEN, C.C.A.M. Kinematic strategies for upper arm – forearm coordination in three dimensions. Journal of Neurophysiology 84 (5): 2302-2316, 2000
Batista AP, Buneo CA, Snyder LH, Andersen RA. Reach plans in eye-centered coordinates. Science. 1999 Jul 9;285(5425):257-60. Abstract
HENRIQUES,
D.Y.P.,
KLIER, E.M, SMITH, M.A., LOWY, D, and CRAWFORD, J.D. Gaze centered
remapping
of remembered visual space in an open-loop pointing task.
Journal
of
Neuroscience
18 (4): 1583-1594, 1998.