The face recognition with expression and occlusion variation becomes the greatest challenge in biometric applications to recognize people. The proposed work concentrates on recognizing occlusion and seven kinds of expression variations such as neutral, surprise, happy, sad, fear, disgust and angry. During enrollment process, principle component analysis (PCA) detects facial regions on the input image. The detected facial region is converted into fuzzy domain data to make decision during recognition process. The Haar wavelet transform extracts features from the detected facial regions. The Nested Hidden markov model is employed to train these features and each feature of face image is considered as states in a Markov chain to perform learning among the features. The maximum likelihood for the input image was estimated by using Baum Welch algorithm and these features were kept on database. During recognition process, the expression and occlusion varied face image is taken as the test image and maximum likelihood for test image is found by following same procedure done in enrollment process. The matching score between maximum likelihood of input image and test image is computed and it is utilized by fuzzy rule based method to decide whether the test image belongs to authorized or unauthorized. The proposed work was tested among several expression varied and occluded face images of JAFFE and AR datasets respectively.
KeywordsFace RecognitionFuzzy Rule Based MethodExpression and Occlusion VariationBaum Welch AlgorithmNested Hidden Markov Model
Yang, M.H., Kriegman, D. and Ahuja, N. (2002) Detecting Faces in Images: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 34-58. http://dx.doi.org/10.1109/34.982883
Pantic, M. and Patras, I. (2006) Dynamics of Facial Expressions: Recognition of Facial Actions and Their Temporal Segments from Face Profile Image Sequences. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 36, 433-449. http://dx.doi.org/10.1109/TSMCB.2005.859075
Bartlett, M.S. (2005) Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior. Proceedings of IEEE Conference in Computer Vision and Pattern Recognition, 2, 568-573.
Chang, Y. (2006) Manifold-Based Analysis of Facial Expression. Image and Vision Computing, 24, 605-614. http://dx.doi.org/10.1016/j.imavis.2005.08.006
Pantic, M. and Rothkrantz, L.J.M. (2000) Automatic Analysis of Facial Expressions: The State of the Art. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 1424-1445. http://dx.doi.org/10.1109/34.895976
Daugman, J. (1997) Face and Gesture Recognition: Overview. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 675-676. http://dx.doi.org/10.1109/34.598225
Valstar, M. and Pantic, M. (2012) Fully Automatic Recognition of the Temporal Phases of Facial Actions. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 42, 28-43. http://dx.doi.org/10.1109/TSMCB.2011.2163710
Tong, Y., Liao, W. and Ji, Q. (2007) Facial Action Unit Recognition by Exploiting Their Dynamic and Semantic Relationships. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29, 1683-1699. http://dx.doi.org/10.1109/TPAMI.2007.1094
Yan, Y., Wang, H.Z. and Suter, D. (2014) Multi-Subregion Based Correlation Filter Bank for Robust Face Recognition. Pattern Recognition, 47, 3487-3501. http://dx.doi.org/10.1016/j.patcog.2014.05.004
Li, Y.Q. (2013) Simultaneous Facial Feature Tracking and Facial Expression Recognition. IEEE Transactions on Image Processing, 22, 2559-2573. http://dx.doi.org/10.1109/TIP.2013.2253477
Koelstra, S., Pantic, M. and Patras, I. (2010) A Dynamic Texture-Based Approach to Recognition of Facial Actions and Their Temporal Models. The IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 1940-1954. http://dx.doi.org/10.1109/TPAMI.2010.50
Lu, X. and Jain, A. (2006) Automatic Feature Extraction for Multiview 3D Face Recognition. 7th IEEE International Conference on Automatic Face and Gesture Recognition (FG2006), Southampton, 2-6 April 2006, 585-590.
Vetter, T. and Blanz, V. (2003) Face Recognition Based on Fitting a 3D Morphable Model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 1063-1074. http://dx.doi.org/10.1109/TPAMI.2003.1227983
Valentin, D., Abdi, H., O’Toole, A.J. and Cottrell, G.W. (1994) Connectionist Models of Face Processing: A Survey. Pattern Recognition, 27, 1209-1230. http://dx.doi.org/10.1016/0031-3203(94)90006-X
Jackson, P. HMM Tutorial. Centre for Vision Speech & Signal Processing, University of Surrey, Guildford.
Frazzoli, E. (2010) Introduction to Hidden Markov Models with Baum-Welch Algorithm, Lecturer Notes on Principles of Autonomy and Decision Making. Aeronautics and Astronautics Massachusetts Institute of Technology.
Bronstein, A., Bronstein, M. and Kimmel, R. (2006) Robust Expression-Invariant Face Recognition from Partially Missed Data. 9th European Conference on Computer Vision, Graz, 7-13 May 2006, 396-408.
Dibeklioglu, H. (2008) Part-Based 3D Face Recognition under Pose and Expression Variations. Master’s Thesis, Bo?azi?i University, Istanbul.
Jingu, H., Prabhum, U. and Savvides, M. (2011) Unconstrained Pose-Invariant Face Recognition Using 3D Generic Elastic Models. IEEE Transactions on Patterns Analysis and Machine Intelligence, 33, 1952-1961.
Kittler, J., Kim, T.K. and Cipolla, R. (2010) On Line Learning of Mutually Orthogonal Subspaces for Face Recognition by Image Sets. IEEE Transactions on Image Processing, 19, 1067-1074.
Passalis, G., Perakis, P., Theoharis, T. and Kakadiaris, I.A. (2011) Using Facial Symmetry to Handle Pose Variations in Real-World 3D Face Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 1938-1951.
Mehta, R., Yuan, J. and Egiazarian, K. (2014) Face Recognition Using Scale-Adaptive Directional and Textural Features. Pattern Recognition, 47, 1846-1858. http://dx.doi.org/10.1016/j.patcog.2013.11.013
Kodandaram, R., Mallikarjun, S., Krishnamuthan, M. and Sivan, R. (2015) Face Recognition Using Truncated Transform Domain Feature Extraction. The International Arab Journal of Information Technology, 12, 211-219.
Jerritta, S., Murugappan, M., Khairunizam, W. and Ahmad, W. (2014) Emotion Recognition from Facial EMG Signals Using Higher Order Statistics and Principle Component Analysis. Journal of the Chinese Institute of Engineers, 37, 385-394. http://dx.doi.org/10.1080/02533839.2013.799946
Pan, Z.S., Deng, Z.T., Wang, Y.B. and Zhang, Y.Y. (2014) Dimensionality Reduction via Kernel Sparse Representation. Frontiers of Computer Science, 8, 807-815. http://dx.doi.org/10.1007/s11704-014-3317-1
Paul, L.C. and Sumam, A.A. (2012) Face Recognition Using Principle Component Analysis Method. International Journal of Advanced Research in Computer Engineering and Technology, 1, 135-139.
Roger Jang, J.-S., Sun, C.-T. and Mizutani, E. (1997) Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Prentice Hall Publication, Upple Sddle River.
Whitehill, J. and Omlin, C.W. (2006) Haar Features for FACS AU Recognition. 7th International Conference on Automatic Face and Gesture Recognition (FGR06), Southampton, 2-6 April 2006, 5-101. http://dx.doi.org/10.1109/FGR.2006.61
Arivazhagan, S. and Ganesan, L. (2003) Texture Segmentation Using Wavelet Transform. Pattern Recognition Letters, 24, 3197-3203.
Touj, S., Amara, N.B. and Amiri, H. (2005) Arabic Handwritten Words Recognition Based on a Planar Hidden Markov Model. The International Arab Journal of Information Technology, 2, 318-325.
Lucey, S., Ashraf, A. and Cohn, J. (2007) Investigating Spontaneous Facial Action Recognition through AAM Representations of the Face. In: Kurihara, K., Ed., Face Recognition Book, Pro Literature Verlag, Germany, 395-406.
Samal, A. and Iyengar, P.A. (1992) Automatic Recognition and Analysis of Human Faces and Facial Expressions: A Survey. Pattern Recognition, 25, 65-77. http://dx.doi.org/10.1016/0031-3203(92)90007-6