Hand Gesture Recognition Using Appearance Features Based on 3D Point Cloud
- 1 State Key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, China
- 2 State Key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, China
- 3 State Key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, China
Abstract
This paper presents a method for hand gesture recognition based on 3D point cloud. Digital image processing technology is used in this research. Based on the 3D point from depth camera, the system firstly extracts some raw data of the hand. After the data segmentation and preprocessing, three kinds of appearance features are extracted, including the number of stretched fingers, the angles between fingers and the gesture region’s area distribution feature. Based on these features, the system implements the identification of the gestures by using decision tree method. The results of experiment demonstrate that the proposed method is pretty efficient to recognize common gestures with a high accuracy.
- Ren, Z., Meng, J. and Yuan, J. (2011) Depth Camera Based Hand Gesture Recognition and Its Applications in Human-Computer-Interaction. Information, Communications and Signal Processing (ICICS), Singapore, 13-16 December 2011, 1-5.
- Suarez, J. and Murphy, R.R. (2012) Hand Gesture Recognition with Depth Images: A Review. RO-MAN, IEEE, Paris, 9-13 September 2012, 411-417.
- Liu, S., Liu, Y., Yu, J. and Wang, Z. (2015) Hierarchical Static Hand Gesture Recognition by Combining Finger Detection and HOG Features. Journal of Image and Graphics, 20, 0781-0788.
- Yu, S., Cao, J., Li, P., et al. (2015) Hand Gesture Recognition Based on The Spatial Pyramid Bag of Features. CAAI Transactions on Intelligent Systems, 10, 429-435.
- Janoch, A., Karayev, S., Jia, Y., Barron, J., Fritz, M., Saenko, K. and Darrell, T. (2013) A Category-Level 3D Object Dataset: Putting the Kinect to Work. In: Fossati, A., Gall, J., Grabner, H., Ren, X.F. and Konolige, K., Eds., Consumer Depth Cameras for Computer Vision, Springer London, London, 141-165. http://dx.doi.org/10.1007/978-1-4471-4640-7_8
- Dominio, F., Donadeo, M. and Zanuttigh, P. (2014) Combining Multiple Depth-Based Descriptors ForHand Gesture Recognition. In: Borgefors, G., Sanniti di Baja, G. and Sarkar, S., Eds., Pattern Recognition Letters, Elsevier, Amsterdam, 101-111. http://dx.doi.org/10.1016/j.patrec.2013.10.010
- Nguyen, L.T., Thanh, C.D., Ba, T.N., Viet, C.T. and Thanh, H.L. (2013) Contour Based Hand Gesture Recognition Using Depth Data. Advanced Science and Technology Letters, 29, 60-65.
- Konda, K.R., Konigs, A., Schulz, H. and Schulz, D. (2012) Real Time Interaction with Mobile Robots Using Hand Gestures. Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction, Boston, 5-8 March 2012, 177-178.
- Qin, S., Zhu, X., Yang, Y. and Jiang, Y. (2014) Real-Time Hand Gesture Recognition from Depth Images Using Convex Shape Decomposition Method. Journal of Signal Processing Systems, 74, 47-58. http://dx.doi.org/10.1007/s11265-013-0778-7
- Daribo, I. and Saito, H. (2011) A Novel Inpainting-based Layered Depth Video for 3dtv. IEEE Transactions on Broadcasting, 57, 533-541. http://dx.doi.org/10.1109/TBC.2011.2125110
- Telea, A. (2004) AnImage Inpainting Technique Based on the Fast Marching Method. Journal of Graphics Tools, 9, 23-34. http://dx.doi.org/10.1080/10867651.2004.10487596