Gesture Saliency: A Context-Aware Analysis
نویسندگان
چکیده
This paper presents a motion attention model that aims at analyzing gesture saliency using context-related information at three different levels. At the first level, motion features are compared in the spatial context of the current video frame; at the intermediate level, salient behavior is analyzed on a short temporal context; at the third level, computation of saliency is extended to longer time windows. An attention/saliency index is computed at the three levels based on an information theory approach. This model can be considered as a preliminary step towards context-aware expressive gesture analysis.
منابع مشابه
Context aware saliency map generation using semantic segmentation
Saliency map detection, as a method for detecting important regions of an image, is used in many applications such as image classification and recognition. We propose that context detection could have an essential role in image saliency detection. This requires extraction of high level features. In this paper a saliency map is proposed, based on image context detection using semantic segmentati...
متن کاملGestures Saliency: a Context-based Analysis
Gestures’ expressivity, as perceived by humans, may be related to the amount of attention they attract. In this paper, we present two experiments that quantify behavior saliency by the rarity of selected motion and gestural features in a given context. The first one deals with the current quantity of motion of a person’s silhouette compared to a brief history of his quantity of motion values. T...
متن کاملTemporal Saliency in Videos
We discuss two experiments that deal with saliency in videos. In the first experiment, we combine motion detection algorithms with a context-aware saliency detection algorithm to add motion as a feature in video saliency. In the second experiment, we apply principles from spatial saliency in static images to pick out salient frames in a video.
متن کاملIndividual Differences in Frequency and Saliency of Speech-Accompanying Gestures: The Role of Cognitive Abilities and Empathy
The present study concerns individual differences in gesture production. We used correlational and multiple regression analyses to examine the relationship between individuals' cognitive abilities and empathy levels and their gesture frequency and saliency. We chose predictor variables according to experimental evidence of the functions of gesture in speech production and communication. We exam...
متن کاملCompressed-Sampling-Based Image Saliency Detection in the Wavelet Domain
When watching natural scenes, an overwhelming amount of information is delivered to the Human Visual System (HVS). The optic nerve is estimated to receive around 108 bits of information a second. This large amount of information can’t be processed right away through our neural system. Visual attention mechanism enables HVS to spend neural resources efficiently, only on the selected parts of the...
متن کامل