Interface Features Affecting Deixis Production: a Simulation Study
نویسندگان
چکیده
This paper examines gestural deixis production in a multimodal (natural language and pointing) interaction. Users (N=30) were required to fill in 4 forms by interacting with a simulated system. Labelling of Entry Fields (LEF, Complete-Partial; between-subject) and Feedback (Present-Absent within-subject) were manipulated in a 2*2 design. Results indicate that deixis occurred more frequently in the Partial-LEF condition. Specific input device constraints influenced intermodal integration: pointing was performed after the end of writing, although feedback presence increased modality shifts. Simulation offered a valuable tool for the development of multimodal interaction models.
منابع مشابه
Wolfgang Wahlster
In face-to-face conversation humans frequently use deictic gestures parallel to verbal descriptions for referent identification. Such a multimodal form of communication is of great importance for intelligent interfaces, because it simplifies and speeds up reference to objects in a visual context. Natural pointing behavior is very flexible, but possibly ambiguous or vague, so that without a care...
متن کاملThe left inferior frontal gyrus under focus: an fMRI study of the production of deixis via syntactic extraction and prosodic focus
The left inferior frontal gyrus (LIFG, BA 44, 45, 47) has been associated with linguistic processing (from sentenceto syllable-parsing) as well as action analysis. We hypothesize that the function of the LIFG may be the monitoring of action, a function well adapted to agent deixis (verbal pointing at the agent of an action). The aim of this fMRI study was therefore to test the hypothesis that t...
متن کاملInteraction of Speech, Deixis and Graphical Interface
To solve certain problems of multimodal interaction the concept of graphical utterances is introduced. Two different functions of deictic gestures are discussed: deictic gestures may be used to focus on a certain context of interpretation and they may be used to provide a referent for an natural language expression. The relations between deictic gestures and visual utterances are presented. Pro...
متن کاملFactors Affecting the Willingness of Consumers to Pay for Electric Cars in the Country
Increasing environmental pollution from fuel vehicle and limited fossil fuel resources have increased tendency to produce electric vehicles. In Iran, the use of electric vehicles requires further study in the field of supply and demand for this product. Regardless of the supply issue, the use of electric vehicles requires a better understanding of the needs, wants and tastes of consumers. In th...
متن کاملFactors Affecting the Willingness of Consumers to Pay for Electric Cars in the Country
Increasing environmental pollution from fuel vehicle and limited fossil fuel resources have increased tendency to produce electric vehicles. In Iran, the use of electric vehicles requires further study in the field of supply and demand for this product. Regardless of the supply issue, the use of electric vehicles requires a better understanding of the needs, wants and tastes of consumers. In th...
متن کامل