An Integrated Face Tracking and Facial Expression Recognition System
- 1
- 2
- 3
Abstract
This article proposes a feature extraction method for an integrated face tracking and facial expression recognition in real time video. The method proposed by Viola and Jones [1] is used to detect the face region in the first frame of the video. A rectangular bounding box is fitted over for the face region and the detected face is tracked in the successive frames using the cascaded Support vector machine (SVM) and cascaded Radial basis function neural network (RBFNN). The haar-like features are extracted from the detected face region and they are used to create a cascaded SVM and RBFNN classifiers. Each stage of the SVM classifier and RBFNN classifier rejects the non-face regions and pass the face regions to the next stage in the cascade thereby efficiently tracking the face. The performance of tracking is evaluated using one hour video data. The performance of the cascaded SVM is compared with the cascaded RBFNN. The experiment results show that the proposed cascaded SVM classifier method gives better performance over the RBFNN and also the methods described in the literature using single SVM classifier [2]. While the face is being tracked, features are extracted from the mouth region for expression recognition. The features are modelled using a multi-class SVM. The SVM finds an optimal hyperplane to distinguish different facial expressions with an accuracy of 96.0%.
- P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proceedings of IEEE Computer So Ciety Conference on Computer Vision and Pat Tern Recognition, Kauai, 8-14 December 2001, Vol. 1, p. 511.
- L. Carminati, J. Benois-Pineau and C. Jennewein, “Knowledge-Based Super Vised Learning Methods in a Classical Problem of Video Object Tracking,” Proceedings of IEEE International Conference on Image Processing, Atlanta, 8-11 October 2006, pp. 2385-2389.
- H. A. Rowley, S. Baluj and T. Kanade, “Neural Network-Based Face Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 20, No.1, 1998, pp. 23-38. doi:10.1109/34.655647
- R. Feraud, O. J. Bernier, J. Vialle and M. Collobert, “A Fast and Accurate Face Detector Based on Neural Networks,” IEEE Transactions on Pat Tern Analysis and Machine Intelligence, Vol. 23, No. 1, 2001, pp. 42-53. doi:10.1109/34.899945
- C. Papageorgiou, M. Oren and T. Poggio, “A General Famework for Object Detection,” Proceedings of International Conference on Computer Vision, Bombay, 4-7 January 1998, pp. 555-562.
- C. Liu, “A Bayesian Discriminating Features Method for Face Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 6, 2003, pp. 725-740. doi:10.1109/TPAMI.2003.1201822
- D. Freedman, “Active Contours for Tracking Distributions,” IEEE Transactions on Image Processing, Vol. 13, No. 4, 2004, pp. 518-526. doi:10.1109/TIP.2003.821445
- H. T. Nguyen and A. W. M. Smeulders, “Fast Occluded Object Tracking by a Robust Appearance Filter,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, No. 8, 2004, pp. 1099-1104.
- H.-T. Chen, T.-L. Liu and C.-S. Fuh, “Probabilistic Tracking with Adaptive Feature Selection,” Proceedings of International Conference on Pattern Recognition, Wash- ington DC, Vol. 2, 2004, pp. 736-739. doi:10.1109/TPAMI.2004.45
- A. U. Batur and M. H. Hayes, “Adaptive Active Appearance Models,” IEEE Transactions on Image Processing, Vol. 14, No. 11, 2005, pp. 1707-1721. doi:10.1109/TIP.2005.854473
- P. Corcoran, M. C. Ionita and I. Bacivarov, “Next Generation Face Tracking Technology Using AAM Techniques,” Proceedings of International Symposium on Signals, Systems and Circuits, Vol. 1, 2007, pp. 1-4. doi:10.1109/ISSCS.2007.4292639
- K.-S. Cho, Y.-G. Kim and Y.-B. Lee, “Real-Time Expression Recognition System Using Active Appearance Model and EFM,” Proceedings of International Conference on Computational Intelligence and Security, Guang- zhou, Vol. 1, November 2006, pp. 747-750.