In this paper, we propose a novel method for anomalous crowd behaviour detection and localization with divergent centers in intelligent video sequence through multiple SVM (support vector machines) based appearance model. In multi-dimension SVM crowd detection, many features are available to track the object robustly with three main features which include 1 ) identification of an object by gray scale value, 2 ) histogram of oriented gradients (HOG) and 3 ) local binary pattern (LBP). We propose two more powerful features namely gray level co-occurrence matrix (GLCM ) and Gaber feature for more accurate and authenticate tracking result. To combine and process the corresponding SVMs obtained from each features, a new collaborative strategy is developed on the basis of the confidence distribution of the video samples which are weighted by entropy method. We have adopted subspace evolution strategy for reconstructing the image of the object by constructing an update model. Also, we determine reconstruction error from the samples and again automatically build an update model for the target which is tracked in the video sequences. Considering the movement of the targeted object, occlusion problem is considered and overc o me by constructing a collaborative model from that of appearance model and update model. Also if update model is of discriminative model type, binary classification problem is taken into account and overcome by collaborative model. We run the multi-view SVM tracking method in real time with subspace evolution strategy to track and detect the moving objects in the crowded scene accurately. As shown in the result part, our method also overcomes the occlusion problem that occurs frequently while objects under rotation and illumination change due to different environmental conditions.
KeywordsMultiple Support Vector MachineCrowd DetectionMotion BlurCollaborative ModelGaber Feature
Sand, P. and Teller, S. (2008) Particle Video: Long-Range Motion Estimation Using Point Trajectories. International Journal of Computer Vision, 80, 72-91. http://dx.doi.org/10.1007/s11263-008-0136-6
Buehler, P., Everingham, M., Huttenlocher, D.P. and Zisserman, A. (2008) Long Term Arm and Hand Tracking for Continuous Sign Language TV Broadcasts. British Machine Vision Conference, Leeds, 1-4 September 2008, 1105-1114. http://dx.doi.org/10.5244/c.22.110
Bibby, C. and Reid, I. (2010) Real-Time Tracking of Multiple Occluding Objects Using Level Sets. 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, 13-18 June 2010, 1307-1314. http://dx.doi.org/10.1109/CVPR.2010.5539818
Turk, M. and Pentland, A. (2001) Eigen Faces for Recognition, Journal of Cognitive Neuroscience, 3, 71-86. http://dx.doi.org/10.1162/jocn.1991.3.1.71
Huber, E. (1996) 3-D Real-Time Gesture Recognition Using Proximity Space. Proceedings of the International Conference on Pattern Recognition, Vienna, 2-4 December 1996, 136- 141. http://dx.doi.org/10.1109/acv.1996.572020
Iwasawa, S., Ebihara, K., Ohya, J. and Morishima, S. (1997) Real-Time Estimation of human Body Posture from Monocular Thermal Images. IEEE Conference on Computer Vision and Pattern Recognition, San Juan, 17-19 June 1997, 15-20. http://dx.doi.org/10.1109/CVPR.1997.609290
Leung, M.K. and Yang, Y.H. (1995) First Sight: A Human-Body Outline Labeling System. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17, 359-377. http://dx.doi.org/10.1109/34.385981
Lepetit, V. and Fua, P. (2006) Keypoint Recognition Using Randomized Trees. IEEE Trans. Pattern Analysis and Machine Intelligence, 28, 1465-1479. http://dx.doi.org/10.1109/TPAMI.2006.188
Adam, A., Rivlin, E. and Shimshoni, I. (2006) Robust Fragments-Based Tracking Using the Integral Histogram. IEEE Conference on Computer Vision and Pattern Recognition, 1, 798-805. http://dx.doi.org/10.1109/cvpr.2006.256
Etemad, K. and Pentland, A. (1997) Discriminant Analysis for Recognition of Human Faces Images. Journal of the Optical Society of America, 14, 1724-1733. http://dx.doi.org/10.1364/JOSAA.14.001724
Randen, T. and Husoy, J.H. (1999) Filtering for Texture Classification: A Comparative Study. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21, 291-310. http://dx.doi.org/10.1109/34.761261
Black, M.J. and Jepson, A.D. (1998) Eigen Tracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation. International Journal of Computer Vision, 26, 63-84. http://dx.doi.org/10.1023/A:1007939232436
Jepson, A.D., Fleet, D.J. and El Maraghi, T.F. (2001) Robust Online Appearance Model for Visual Tracking. 2001 IEEE Conference on Computer Vision and Pattern Recognition, 25, 1296-1311. http://dx.doi.org/10.1109/cvpr.2001.990505
Lim, J., Ross, D., Lin, R. and Yang, M. (2004) Incremental Learning for Visual Tracking. Advances in Neural Information Processing Systems (NIPS), 17, 793-800.
Lee, K.C. and Kriegman, D. (2005) Online Learning of Probabilistic Appearance Manifolds for Video Based Recognition and Tracking. 2005 IEEE Conference on Computer Vision and Pattern Recognition, San Diego, 20-25 June 2005, 852-859.
Elgammal, A. (2005) Learning to Track: Conceptual Manifold Map for Closed-Form Tracking. 2005 IEEE Conference on Computer Vision and Pattern Recognition, San Diego, 20-25 June 2005, 724-730. http://dx.doi.org/10.1109/CVPR.2005.209
Chum, O. and Zisserman, A. (2007) An Exemplar Model for Learning Object Classes. 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, 17-22 Jun 2007, 1-8. http://dx.doi.org/10.1109/CVPR.2007.383050
Frome, A., Singer, Y. and Malik, J. (2007) Image Retrieval and Classification Using Local Distance Functions. Proceedings of Advances in Neural Information Processing Systems, Vancouver, 4-7 December 2006, 417-424.
Frome, A., Singer, Y., Sha, F. and Malik, J. (2007) Learning Globally-Consistent Local Distance Functions for Shape-Based Image Retrieval and Classification. 11th International Conference on Computer Vision, Rio de Janeiro, 14-21 October 2007, 1-8. http://dx.doi.org/10.1109/iccv.2007.4408839
Commaniciu, D., Ramesh, V. and Meer, P. (2003) Kernel-Based Object Tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 564-577. http://dx.doi.org/10.1109/TPAMI.2003.1195991
Sun, X., Yao, H. and Zhang, S. (2011) A Novel Supervised Level Set Method for Non-Rigid Object Tracking. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, 20-25 June 2011, 3393-3400. http://dx.doi.org/10.1109/cvpr.2011.5995656
Black, M.J. and Jepson, A.D. (1998) Eigen Tracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation. International Journal of Computer Vision, 26, 63-84. http://dx.doi.org/10.1023/A:1007939232436
Wolf, J.K., Viterbi, A.M. and Dixson, G.S. (1989) Finding the Best Set of K Paths through a Trellis with Application to Multi Target Tracking. IEEE Transactions on Aerospace and Electronic Systems, 25, 287-295. http://dx.doi.org/10.1109/7.18692
Hampapur, A., Brown, L., Connell, J., Ekin, A., Haas, N., Lu, M., Merkl, H., Pankanti, S, Senior, A., Shu, C.F. and Tian, Y.L. (2005) Smart Video Surveillance. IEEE Signal Pro- cessing Magazine, 22, 38-51. http://dx.doi.org/10.1109/MSP.2005.1406476
Vedaldi, A. and Fulkerson, B. (2008) An Open and Portable Library of Computer Vision Algorithms. http://www.vlfeat.org/
Rivlin, A.E. and Shimshoni, I. (2006) Robust Fragments-Based on Tracking Using the Integral Histogram. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1, 798-805.
Ross, D., Lim, J., Lin, R. and Yang, M. (2008) Incremental Learning for Robust Visual Tracking. International Journal of Computer Vision, 77, 125-141. http://dx.doi.org/10.1007/s11263-007-0075-7
Babenko, B., Yang, M.-H. and Belongie, S. (2009) Visual Tracking with Online Multiple Instance Learning. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, 20-25 June 2009, 983-990.
Grabner, H., Grabner, M. and Bischof, H. (2006) Real-Time Tracking via On-Line Boosting. Proceedings of the British Machine Vision Conference (BMVC), 1, 47-56.
Mei, X. and Ling, H. (2009) Robust Visual Tracking Using l1 Minimization. IEEE International Conference on Computer Vision (ICCV), Kyoto, 29 September-2 October 2009, 1436-1443.
Kwon, J. and Lee, K.M. (2011) Tracking by Sampling Trackers. IEEE International Conference on Computer Vision (ICCV), Barcelona, 6-13 November 2011, 1195-1202.
Kalal, Z., Mikolajczyk, K. and Matas, J. (2012) Tracking-Learning-Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34, 1409-1422. http://dx.doi.org/10.1109/TPAMI.2011.239
Zhang, T., Ghanem, B., Liu, S. and Ahuja, N. (2012) Robust Visual Tracking via Multi- Task Sparse Learning. 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, 16-21 June 2012, 2042-2049. http://dx.doi.org/10.1109/CVPR.2012.6247908
Zhang, K., Zhang, L. and Yang, M.-H. (2012) Real-Time Compressive Tracking. Proceedings of the European Conference on Computer Vision (ECCV), Florence, 7-13 October 2012, 864-877. http://dx.doi.org/10.1007/978-3-642-33712-3_62
Kwon, J. and Lee, K.M. (2010) Visual Tracking Decomposition. 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, 13-18 June 2010, 1269- 1276. http://dx.doi.org/10.1109/CVPR.2010.5539821
Hare, S., Saffari, A. and Torr, P.H.S. (2011) Struck: Structured Output Tracking with Kernels. IEEE International Conference on Computer Vision (ICCV), Barcelona, 6-13 November 2011, 263-270.
Yao, R., Shi, Q., Shen, C., Zhang, Y. and van den Hengel, A. (2013) Part-Based Visual Tracking with Online Latent Structural Learning. 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, 23-28 June 2013, 2363-2370. http://dx.doi.org/10.1109/CVPR.2013.306
Luka, Matej, K. and Ales, L. (2014) Is My New Tracker Really Better than Yours? 2014 IEEE Winter Conference on Applications of Computer Vision (WACV), Steamboat Springs, 24-26 March 2014, 540-547.