Fusion of Multi-modal Sensors in a Voxel Occupancy Grid for Tracking and Behaviour Analysis
نویسندگان
چکیده
In this paper, we present a multi-modal fusion scheme for tracking and behavior analysis in Smart Home environments. This is applied to tracking multiple people and detecting their behavior. To this end, information from multiple heterogeneous sensors (visual color sensor, thermal sensor, infrared sensor and photonic mixer devices) is combined in a common 3D voxel occupancy grid. Graph cuts are used for data fusion and to accurately reconstruct people in the scene. A Viterbi tracking framework is applied to track all people and simultaneously determine their behaviour. We evaluate the proposed fusion scheme on the PROMETHEUS Smart Home database and show the impact of different sensors and modalities to the final results.
منابع مشابه
Event Detection in a Smart Home Environment using Viterbi Filtering and Graph Cuts in a 3D Voxel Occupancy Grid
In this paper we present a system for detecting unusual events in smart home environments. A primary application of this is to prolong independent living for elderly people at their homes. We show how to effectively combine information from multiple heterogeneous sensors which are typically present in a smart home scenario. Data fusion is done in a 3D voxel occupancy grid. Graph Cuts are used t...
متن کاملA Novel Framework for Data Registration and Data Fusion in Presence of Multi-modal Sensors
This article presents a novel framework to register and fuse heterogeneous sensory data. Our approach is based on geometrically registration of sensory data onto a set of virtual parallel planes and then applying an occupancy grid for each layer. This framework is useful in surveillance applications in presence of multi-modal sensors and can be used specially in tracking and human behavior unde...
متن کاملTarget Tracking Based on Virtual Grid in Wireless Sensor Networks
One of the most important and typical application of wireless sensor networks (WSNs) is target tracking. Although target tracking, can provide benefits for large-scale WSNs and organize them into clusters but tracking a moving target in cluster-based WSNs suffers a boundary problem. The main goal of this paper was to introduce an efficient and novel mobility management protocol namely Target Tr...
متن کاملRobust multi-target sensing/tracking in the Bayesian Occupancy Filter framework
We present the “Bayesian Occupancy Filter” (BOF) and the “Fast ClusteringTracking” algorithms as a framework for robust sensing and multi-target tracking using multiple sensors. Perceiving of the surrounding physical environment reliably is a major demanding in smart systems requiring a high level of safety such as car driving assistant, autonomous robots, and surveillance. The dynamic environm...
متن کاملA Real-time Motion Tracking Wireless System for Upper Limb Exosuit Based on Inertial Measurement Units and Flex Sensors (TECHNICAL NOTE)
This paper puts forward a real-time angular tracking (motion capture) system for a low cost upper limb exosuit based on sensor fusion; which is integrated by an elastic sleeve-mitten, two inertial measurement units (IMU), two flex sensors and a wireless communication system. The device can accurately detect the angular position of the shoulder (flexion-extension, abduction-adduction and interna...
متن کامل