^BBSnline

Deictic Codes for the Embodiment of Cognition

Ballard, Dana H., Hayhoe, Mary M. , Pook, Polly K. and Rao, Rajesh P. N. Deictic Codes for the Embodiment of Cognition.

Short Abstract:

This target article focusses on how deictic bindings make it possible to perform natural tasks. Deictic computation provides a mechanism for representing the essential features that link external sensory data with internal cognitive programs and motor actions. One of the central features of cognition, working memory, can be related to moment-by-moment dispositions of body features such as eye and hand movements.

Long Abstract:

To describe phenomena that occur at different time scales, computational models of the brain must incorporate different levels of abstraction. At time scales of approximately one-third of a second, orienting movements of the body play a crucial role in cognition and form a useful computational level -- more abstract than that used to capture neural phenomena but less abstract than what is traditionally used to study high-level cognitive processes such as reasoning. At this embodiment level, the constraints of the physical system determine the nature of cognitive operations. The key synergy is that at time scales of about one-third second the natural sequentiality of body movements can be matched to the natural computational economies of sequential decision systems through a system of implicit reference (called deictic) in which pointing movements are used to bind objects in the world to cognitive programs. This target article focusses on how deictic bindings make it possible to perform natural tasks. Deictic computation provides a mechanism for representing the essential features that link external sensory data with internal cognitive programs and motor actions. One of the central features of cognition, working memory, can be related to moment-by-moment dispositions of body features such as eye and hand movements.

Keywords:	Deictic computations; embodiment; working memory; natural tasks; eye movements; brain computation; binding; sensory-motor tasks; pointers.
Subjects:	Psychology: Applied Cognitive Psychology Neuroscience: Behavioral Neuroscience Psychology: Cognitive Psychology Neuroscience: Computational Neuroscience Psychology: Learning and Memory Neuroscience: Motor Function Psychology: Perceptual Cognitive Psychology
ID code:	bbs00000424
Deposited by:	Dana Ballard on 30 April 2001