Children understand gesture+speech combinations in which a deictic gesture adds new information to the accompanying speech by age 1;6 (Morford & Goldin-Meadow, 1992; 'push'+point at ball). This study explores how early children understand gesture+speech combinations in which an iconic gesture conveys additional information not found in the accompanying speech (e.g., 'read'+BOOK gesture). Our an...

BACKGROUND: The study of communicative gestures is one of considerable interest for aphasia, in relation to theory, diagnosis, and treatment. Significant limitations currently permeate the general (psycho)linguistic literature on gesture production, and attention to these limitations is essential for both continued investigation and clinical application of gesture for people with aphasia. AIMS...

How might a human communication system be bootstrapped in the absence of conventional language? We argue that motivated signs play an important role (i.e., signs that are linked to meaning by structural resemblance or by natural association). An experimental study is then reported in which participants try to communicate a range of pre-specified items to a partner using repeated non-linguistic ...

We report the development and evaluation of a gesture-based interaction prototype for controlling the loading station of a factory automation system. In this context, gesture-based interaction has the potential to free users from the tedious physical controls but it must also account for safety considerations and users’ perceptions. We evaluated the gesture interaction concept in the field to u...

considering the deficiency of accurate hand gesture contour inaccessible and inefficiency in complex dynamic background in existing methods of hand gesture tracking, a two dimensional skin color probability forecast method is proposed. Based on this, a hand gesture segmentation method of multi-mode and a hand gesture tracking method of state estimation are extended. When hand gesture is segment...

This application helps the deaf and dumb person to communicate with the rest of the world using sign language. Suitable existing methods are integrated in this application. The key feature in this system is the real time gesture to text conversion. The processing steps include: gesture extraction, gesture matching and conversion to speech. Gesture extraction involves use of various image proces...

An affordance gesture motion interpolation is proposed, using an intuitive wireless 6DOF gesture input device, which includes Magnetic, Angular Rate, and Gravity (MARG) sensors, and a user interactive 3D gesture control interface, for creating motion by pose interpolation, from Dynamic Time Warping (DTW) gesture recognizer algorithm. In this paper we demonstrate that user can create and control...

Iconic gestures are hand movements that represent shapes, objects and functions of a referent. When gesture is restricted, imagery decreases and speech dysfluencies (which are most pronounced when communicating spatial information) increase. Since gesture restriction adversely affects both imagery and the communication of spatial information, many theorists have argued that visuospatial working...