Research ArticleOpen AccessGoogle Scholar indexed
Multiple Choice Tests: Inferences Based on Estimators of Maximum Likelihood
Biostatistics, Faculty of Medicine, Department of Statistics and OR, University of Granada, Granada, Spain
Biostatistics, Faculty of Medicine, Department of Statistics and OR, University of Granada, Granada, Spain
- 1 Biostatistics, Faculty of Medicine, Department of Statistics and OR, University of Granada, Granada, Spain
- 2 Biostatistics, Faculty of Medicine, Department of Statistics and OR, University of Granada, Granada, Spain
Open Journal of Statistics·Volume 04 (2014)·Pages 466–483·Published 27 August 2014·DOI10.4236/ojs.2014.46045
Copy link · social · email
Abstract
This paper revises and expands the model Delta for estimating the knowledge level in multiple choice tests (MCT). This model was originally proposed by Martín and Luna in 1989 ( British Journal of Mathematical and Statistical Psychology , 42: 251) considering conditional inference. Consequently, the aim of this paper is to obtain the unconditioned estimators by means of the maximum likelihood method. Besides considering some properties arising from the unconditional inference, some additional issues regarding this model are also going to be addressed, e.g. test-inversion confidence intervals and how to treat omitted answers. A free program that allows the calculations described in the document is available on the website http://www.ugr.es/local/bioest/Delta
KeywordsModel DeltaMultiple-Choice TestsAgreementGuessing
- Tarrant, M., Ware, J. and Mohammed, A.M. (2009) An Assessment of Functioning and Non-Functioning Distractors in Multiple-Choice Questions: A Descriptive Analysis. BMC Medical Education, 9, 40-48. http://dx.doi.org/10.1186/1472-6920-9-40
- Simkin, M.G. and Kuechler, W.L. (2005) Multiple-Choice Tests and Student Understanding: What Is the Connection? Decision Sciences Journal of Innovative Education, 3, 73-97. http://dx.doi.org/10.1111/j.1540-4609.2005.00053.x
- Gronlund, N.E. and Waugh, C.K. (2008) Assessment of Student Achievement. Pearson, Upper Saddle River.
- Scharf, E.M. and Baldwin, L.P. (2007) Assessing Multiple Choice Question (MCQ) Tests—A Mathematical Perspective. Active Learning in Higher Education, 8, 31-47. http://dx.doi.org/10.1177/1469787407074009
- Lesage, E., Valcke, M. and Sabbe, E. (2013) Scoring Methods for Multiple Choice Assessment in Higher Education—Is It Still a Matter of Number Right Scoring or Negative Marking? Studies in Educational Evaluation, 39, 118-193. http://dx.doi.org/10.1016/j.stueduc.2013.07.001
- Martín Andrés, A. and Luna del Castillo, J.D. (1989) Tests and Intervals in Multiple Choice Tests: A Modification of the Simplest Classical Model. British Journal of Mathematical and Statistical Psychology, 42, 251-263. http://dx.doi.org/10.1111/j.2044-8317.1989.tb00914.x
- Budescu, D. and Bar-Hillel, M. (1993) To Guess or Not to Guess: A Decision-Theoretic View of Formula Scoring. Journal of Educational Measurement, 30, 277-291. http://dx.doi.org/10.1111/j.1745-3984.1993.tb00427.x
- Bar-Hillel, M., Budescu, D. and Attali, Y. (2005) Scoring and Keying Multiple Choice Tests: A Case Study in Irrationality. Mind & Society, 4, 3-12. http://dx.doi.org/10.1007/s11299-005-0001-z
- Espinosa, M.P. and Gardazabal, J. (2010) Optimal Correction for Guessing in Multiple-Choice Tests. Journal of Mathematical Psychology, 54, 415-425. http://dx.doi.org/10.1016/j.jmp.2010.06.001
- Hutchinson, T.P. (1982) Some Theories of Performance in Multiple-Choice Tests, and Their Implications for Variants of the Task. British Journal of Mathematical and Statistical Psychology, 35, 71-89.
- Lord, F.M. and Novick, M.R. (1968) Statistical Theories of Mental Test Scores. Addison-Wesley, Menlo Park.
- Martín Andrés, A. and Luna del Castillo, J.D. (1990) Multiple Choice Tests: Power, Length and Optimal Number of Choices Per Item. British Journal of Mathematical and Statistical Psychology, 43, 57-71. http://dx.doi.org/10.1111/j.2044-8317.1990.tb00926.x