We describe two approaches for unobtrusively sensing subtle nonverbal behaviors using a consumer-level depth sensing camera. The first signal, respiratory rate, is estimated by measuring the visual expansion and contraction of the user’s chest cavity during inhalation and exhalation. Additionally, we detect a specific type of fidgeting behavior, known as “leg jiggling,” by measuring high-freque...

Modern virtual agents require knowledge about their environment, the interaction itself, and their interlocutors’ behavior in order to be able to show appropriate nonverbal behavior as well as to adapt dialog policies accordingly. Recent achievements in the area of automatic behavior recognition and understanding can provide information about the interactants’ multimodal nonverbal behavior and ...

The purposes of this research were two-fold: first, to see whether or not lecturers’ immediacy behaviors linearly related their students’ Willingness Communicate (WTC); second, determine which behavior (Verbal Nonverbal) predominantly impacted on WTC. To achieve the purposes, two types questionnaires utilized, 1) WTC and 2) immediacy. Later, participants asked choose 1–5 scales question item. T...

Research in virtual agents has largely ignored the role and behavior of side participants and especially bystanders. Our view is that the behavior of these other participants is critical in multi-party interactions, especially in interactive drama. In this paper, we provide an analysis of nonverbal behaviors associated with these roles. We first review studies of interpersonal relationships and...

This paper describes an animated conversational agent called Kare1 which integrates a talking head interface with a linguistically motivated human-machine dialogue system. The agent has a range of nonverbal behaviors, which involve a mixture of machine vision, computer animation and natural language processing techniques. The system’s architecture couples the agent’s nonverbal communicative pro...

This paper describes a multi-level scheme to annotate gesture, posture and gaze in a spontaneous interactional corpus in French. In nonverbal behaviour research there is a lack of available, accessible and spontaneous multimodal corpora. One of the challenges is to use structural and reliable coding schemes to study the relationships among different nonverbal modalities. We propose a method to ...

The human body plays a central role in nonverbal communication, conveying attitudes, personality, and values during social interactions. Three experiments in a large, open classroom setting investigated whether the visibility of torso-located cues affects nonverbal communication of similarity. In Expts. 1 and 2, half the participants wore a black plastic bag over their torso. Participants inter...

Conversation is the most natural and popular means for people to communicate with each other. Conversation is everywhere around us, and even though you may feel that making conversation is relatively effortless, a closer look shows that a tremendous amount of sophisticated interaction is involved in initiating and sustaining conversation. Figure 1.1 illustrates a normal conversation scene in ou...

THISNATURALISTICSTUDY EXAMINED THE ROLE of nonverbal communication in the academic library. Library users with information needs face the choice of trying to find the solution themselves or asking a librarian for assistance. This decision to approach or not approach a librarian and engage in interaction was studied through use of Mehrabian’s (196’7)immediacy metaphor. It was hypothesized that t...