The Microsoft KINECT: A Novel Tool for Psycholinguistic Research
- 1 Waseda Institute for Advanced Study, Waseda University, Tokyo, Japan
- 2 Graduate School of Engineering, Nagoya University, Nagoya, Japan
- 3 Graduate School of Engineering, Nagoya University, Nagoya, Japan
- 4 Graduate School of Languages and Cultures, Nagoya University, Nagoya, Japan
Abstract
The Microsoft KINECT is a 3D sensing device originally developed for the XBOX. The Microsoft KINECT opens up many exciting new opportunities for conducting experimental research on human behavior. We investigated some of these possibilities within the field of psycholinguistics (specifically: language production) by creating software, using C#, allowing for the KINECT to be used in a typical psycholinguistic experimental setting. The results of a naming experiment using this software confirmed that the KINECT was able to measure the effects of a robust psycholinguistic variable (word frequency) on naming latencies. However, although the current version of the software is able to measure psycholinguistic variables of interest, we also discuss several points where the software can still stand to be improved. The main aim of this paper is to make the software freely available for assessment and use by the psycholinguistic community and to illustrate the KINECT as a potentially valuable tool for investigating human behavior, especially in the field of psycholinguistics.
- Baayen, R. H. (2008). Analyzing Linguistic Data: A Practical Introduction to Statistics Using R. Cambridge: Cambridge University Press. http://dx.doi.org/10.1017/cbo9780511801686
- Bates, D., Maechler, M., & Dai, B. (2008). Lme4: Linear Mixed-Effects Models Using S4 Classes [Computer Software Manual]. http://lme4.r-forge.rproject.org/
- Biswas, K. K., & Basu, S. K. (2011). Gesture Recognition Using Microsoft Kinect?. Proceedings of the IEEE International Conference on Automation, Robotics and Applications, Wellington, 6-8 December 2011, 100-103. http://dx.doi.org/10.1109/ICARA.2011.6144864 http://www.ieee.org/conferences_events/conferences/conferencedetails/index.html?Conf_ID=19125
- Dell, G. S. (1986). A Spreading-Activation Theory of Retrieval in Sentence Production. Psychological Review, 93, 283-321. http://dx.doi.org/10.1037/0033-295X.93.3.283
- Forster, K. I., & Forster, J. C. (2003). DMDX: A Windows Display Program with Millisecond Accuracy. Behavior Research Methods, Instruments & Computers, 35, 116-124. http://dx.doi.org/10.3758/BF03195503
- Jescheniak, J. D., & Levelt, W. J. M. (1994). Word Frequency Effects in Speech Production: Retrieval of Syntactic Information and of Phonological Form. Journal of Experimental Psychology: Language, Memory, and Cognition, 20, 824-843. http://dx.doi.org/10.1037/0278-7393.20.4.824
- Kessler, B., Treiman, R., & Mullennix, J. (2002). Phonetic Biases in Voice Key Response Time Measurements. Journal of Memory and Language, 47, 145-171. http://dx.doi.org/10.1006/jmla.2001.2835
- Khoshelham, K., & Oude Elberink, S. (2012). Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications. Sensors, 12, 1437-1454. http://dx.doi.org/10.3390/s120201437
- Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2014). lmerTest: Tests for Random and Fixed Effects for Linear Mixed Effect Models (Lmer Objects of Lme4 Package). R Package Version 2.0-6. http://CRAN.R-project.org/package=lmerTest
- Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999). A Theory of Lexical Access in Speech Production. Behavioral and Brain Sciences, 22, 1-75. http://dx.doi.org/10.1017/S0140525X99001776
- Oldfield, R. C., & Wingfield, A. (1965). Response Latencies in Naming Objects. Quarterly Journal of Experimental Psychology, 17, 273-281. http://dx.doi.org/10.1080/17470216508416445
- Piana, S., Staglianò, A., Odone, F., Verri, A., & Camurri, A. (2014). Real-Time Automatic Emotion Recognition from Body Gestures. Computing Research Repository (CoRR). http://arxiv.org/abs/1402.5047