Identification and classification of behaviors for abnormal behaviors detection using hidden Markov model

Abstract

This paper presents a new approach for modeling the normal behaviors and detecting the abnormal behaviors. The approach consists of several main steps. First, using a detection method, the foreground and background regions are separated. Then, the busy-idle rates are defined as the behavioral features and, based on these features, a behavioral model is extracted for each pixel block. In the following, spectral clustering is used to classify the normal behaviors on the condition that a set of normal data is provided. In the classification process, the pixel blocks with similar behaviors are grouped together. A behavioral model is defined for each group of the blocks with similar behaviors. The behavioral model adopted in this paper is Hidden Markov Model. The results of the obtained classification and normal behaviors are used to detect the abnormal behaviors; i.e., based on the normal-behavior model for each cluster, if the observation sequence probability given by the normal-behavior model is lower than the threshold level, the pixel block is identified as the region in which the abnormal behaviors happened. The experimental results obtained from video data confirm the efficiency, accuracy, and speed of the approach adopted in this paper. 

Keywords


   [1]      D. Kosmopoulos, A. Voulodimos and T. Varvarigou, "Behavior Recognition from Multiple Views Using Fused Hidden Markov Models", springer,Artificial Intelligence: Theories, Models and Applications, Vol. 6040, pp. 345-350, 2010.
   [2]      N. Anjum and A. Cavallaro , "Multifeature Object Trajectory Clustering for Video Analysis", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 18, No. 11, pp. 1555 - 1564, 2008.
   [3]      C. C. Loy, T. Xiang and S. Gong, "Detecting and discriminating behavioural anomalies", Pattern Recognition, Vol. 44, No. 1, pp. 117-132, 2011.
   [4]      F. Jiang, J. Yuan, S. A. Tsaftaris and A. K. Katsaggelos, "Anomalous video event detection using spatiotemporal context", Computer Vision and Image Understanding, Vol. 115, No. 3, pp. 323-333, 2011.
   [5]      D.Y Chen and P. C Huang, "Motion-based unusual event detection in human crowds", Journal of Visual Communication and Image Representation, Vol. 22, No. 2, pp. 178-186, 2011.
   [6]      B.D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision", Proceedings of the 1981 DARPA Imaging Understanding Workshop, pp. 121–130, 1981.
   [7]      I. Saleemi, K. Shafique and M. Shah, "Probabilistic Modeling of Scene Dynamics for Applications in Visual Surveillance", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, No. 8, pp. 1472 - 1485 , 2009.
   [8]      X. Wang, X. Ma and W. L. Grimson, "Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, No. 3, pp. 539 - 555, 2009.
   [9]      D. M. Blei, A.Y. Ng and M.I. Jordan, "Latent Dirichlet Allocation", Journal of Machine Learning Research , Vol. 3, pp. 993-1022, 2003.
[10]      Y.W. The, M.I. Jordan and M.J. Beal, "Hierarchical Dirichlet Process", Journal of the American Statistical Association, Vol. 101, No. 476, pp. 1566-1581, 2006.
[11]      E. B. Ermis, P. Clarot and P. M. Jodoin, "Activity Based Matching in Distributed Camera Networks", IEEE Transactions on Image Processing, Vol. 19, No. 10, pp. 2595 - 2613, 2010.
[12]      P. Clarot, E. B. Ermis and P. M. Jodoin, "Unsupervised Camera Network Structure Estimation Based on Activity", Third ACM/IEEE International Conference on Distributed Smart Cameras, pp. 1 - 8 , 2009.
[13]      P. M. Jodoin, V. Saligrama and J. Konrad, "Behavior Subtraction", Proceedings of SPIE, Vol. 6822, 2009.
[14]      M. Piccardi. "Background subtraction techniques: a review", In IEEE International Conference on Systems, Man and Cybernetics, Vol. 4, pp. 3099–3104, 2004.
[15]      L. Z. Manor, and P. Perona, "Self-Tuning Spectral Clustering", in Advances in Neural Information Processing Systems, 2004, pp. 1601-1608.
[16]      U. V. Luxburg, "A tutorial on spectral clustering", Journal Statistics and Computing, Vol. 17, No. 4, pp. 395 - 416, 2007.
[17]      L. R. Rabiner. "A tutorial on hidden Markov models and selected applications in speech recognition"In Readings in speech recognition, pp. 267–296. Morgan Kaufmann Publishers Inc., 1990.
[18]      Z. Ghahramani. "An introduction to hidden Markov models and Bayesian networks, " In Hidden Markov Models: Application in Computer Vision Series in Machine Perception and Artificial Intelligence, Vol. 45, chapter 2. Morgan Kaufmann Publishers Inc., 2001.
[19]      L. E. Baum, G. Soules, and N. Weiss. "A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains". Ann. Math. Stat., Vol. 41, No. 1, pp. 164- 171, 1970.
http://www.cvg.rdg.ac.uk/PETS2006/data.html