People naturally express themselves through facial gestures. We have implemented an interface that tracks a person's facial features robustly in real time (30Hz) and does not require artiicial artifacts such as special illumination or facial makeup. Even if features become occluded the system is capable of recovering tracking in a couple of frames after the features reappear in the image. Based...

People natural ly express themselves through facial gestures. We have implemented an interface that tracks a person's facial features robustly in real t ime (30Hz) and does not require art i f icial artifacts such as special i l lumination or facial makeup. Even if features become occluded the system is capable of recovering tracking in a couple of frames after the features reappear in the imag...

This paper provides evidence for imitative abilities in neonatal chimpanzees (Pan troglodytes), our closest relatives. Two chimpanzees were reared from birth by their biological mothers. At less than 7 days of age the chimpanzees could discriminate between, and imitate, human facial gestures (tongue protrusion and mouth opening). By the time they were 2 months old, however, the chimpanzees no l...

Temporal segmentation of facial gestures in spontaneous facial behavior recorded in real-world settings is an important, unsolved, and relatively unexplored problem in facial image analysis. Several issues contribute to the challenge of this task. These include non-frontal pose, moderate to large out-of-plane head motion, large variability in the temporal scale of facial gestures, and the expon...

We present IMU2Face, a gesture-driven facial reenactment system. To this end, we combine recent advances in facial motion capture and inertial measurement units (IMUs) to control the facial expressions of a person in a target video based on intuitive hand gestures. IMUs are omnipresent, since modern smart-phones, smart-watches and drones integrate such sensors; e.g., for changing the orientatio...

OBJECTIVE Blunted affect is a major symptom in schizophrenia, and affective deficits clinically encompass deficits in expressiveness. Emotion research and ethological studies have shown that patients with schizophrenia are impaired in various modalities of expressiveness (posed and spontaneous emotion expressions, coverbal gestures, and smiles). Similar deficits have been described in depressio...

This thesis provides a fully automatic framework to analyze the facial actions and head gestures in real time. This framework can be used in scenarios where the machine needs a perceptual ability to recognize, model and analyze the facial actions and head gestures in real time without any manual intervention. Rather than trying to recognize speci c prototypical emotional expressions like joy, a...

This experimental study employed a 2 2 2 factorial design to investigate the effects of type of instruction (procedural module, attitudinal module), deictic gesture (presence, absence), and facial expression (presence, absence) on student perception of pedagogical agent persona, attitude toward the content, and learning. The interaction effect between type of instruction and agent nonverbal beh...

At birth, human infants and newborns of other primate species demonstrate the capacity to attend and to respond to facial stimuli provided by a caregiver. Newborn infants are also capable of exhibiting a range of facial expressions. Identification of the neural underpinnings of these capacities represents a formidable challenge in understanding social development. One possible neuronal substrat...