Anomalous video event detection using spatiotemporal context

1077-3142/$ see front matter 2010 Elsevier Inc. A doi:10.1016/j.cviu.2010.10.008 ⇑ Corresponding author. Fax: +1 847 491 4455. E-mail addresses: [email protected]. edu.sg (J. Yuan), [email protected] (S.A. Ts ern.edu (A.K. Katsaggelos). Compared to other anomalous video event detection approaches that analyze object trajectories only, we propose a context-aware method to detect anomalies. By tracking all moving objects in the video, three different levels of spatiotemporal contexts are considered, i.e., point anomaly of a video object, sequential anomaly of an object trajectory, and co-occurrence anomaly of multiple video objects. A hierarchical data mining approach is proposed. At each level, frequency-based analysis is performed to automatically discover regular rules of normal events. Events deviating from these rules are identified as anomalies. The proposed method is computationally efficient and can infer complex rules. Experiments on real traffic video validate that the detected video anomalies are hazardous or illegal according to traffic regulations. 2010 Elsevier Inc. All rights reserved.