Interpersonal stance recognition using non-verbal signals on several time windows
نویسندگان
چکیده
We present a computational model for interpreting nonverbal signals of a user during an interaction with a virtual character in order to obtain a representation of his interpersonal stance. Our model starts, on the one hand, from the analysis of multimodal signals. On the other hand, it takes into account the temporal patterns of the interactants behaviors. That is it analyses signals and reactions to signals in their immediate context, as well as features of signal production patterns and reaction patterns on different time windows : signal reaction, sentence reaction, conversation topic, whole interaction. In this paper, we propose a first model parameterized using data obtained from the literature on the expressions of stances through interpersonal behavior.
منابع مشابه
Beyond backchannels: co-construction of dyadic stancce by reciprocal reinforcement of smiles between virtual agents
When two persons participate in a discussion, they not only exchange the concepts and ideas they are discussing, they also express attitudes, feelings and commitments regarding their partner: they express interpersonal stances. Endowed with backchannel model, several virtual agents are able to react to their partners’ behaviour through their non-verbal behaviour. In this paper, we go beyond thi...
متن کاملFrom Non-verbal Signals Sequence Mining to Bayesian Networks for Interpersonal Attitudes Expression
In this paper, we present a model and its evaluation for expressing attitudes through sequences of non-verbal signals for Embodied Conversational Agents. To build our model, a corpus of interpersonal job interview interactions has been annotated at two levels: the non-verbal behavior of the recruiters as well as their expressed attitudes was annotated. Using a sequence mining method, sequences ...
متن کاملInvestigating Non-Verbal Behaviors Conveying Interpersonal Stances
Interpersonal stances are expressed by non-verbal behaviors on a variety of different modalities. The perception of these behaviors is influenced by the context of the interaction, how they are sequenced with other behaviors from the same person and behaviors from other interactants. In this paper, we introduce a framework considering the expressions of stances on different layers during an int...
متن کاملEMG-based wrist gesture recognition using a convolutional neural network
Background: Deep learning has revolutionized artificial intelligence and has transformed many fields. It allows processing high-dimensional data (such as signals or images) without the need for feature engineering. The aim of this research is to develop a deep learning-based system to decode motor intent from electromyogram (EMG) signals. Methods: A myoelectric system based on convolutional ne...
متن کاملارتباط رفتارهای غیرکلامی، پردازش و بازشناسی هیجان با علایم مثبت و منفی در بیماران مبتلا به اسکیزوفرنیا
Background and Objectives: Non-verbal behaviors, emotional processing and recognition play a great role in predicting the positive and negative symptoms of patients with schizophrenia. The aim of the present research was to determine the relationship of nonverbal behaviors, emotional processing and emotional recognition with positive and negative symptoms in patients with schizophrenia. Mat...
متن کامل