Research ArticleOpen AccessGoogle Scholar indexed
A Systematic Error Leading to Overoptimistic Item Analysis of a Medical Admission Test
Institute of Physiological Chemistry, Center of Physiological Chemistry, Medical University of Graz, Graz, Austria
Organisational Unit for Studies and Teaching, Medical University of Graz, Graz, Austria
Organisational Unit for Studies and Teaching, Medical University of Graz, Graz, Austria
Office of the Vice Rector for Studies and Teaching, Medical University of Graz, Graz, Austria
Organisational Unit for Studies and Teaching, Medical University of Graz, Graz, Austria
- 1 Institute of Physiological Chemistry, Center of Physiological Chemistry, Medical University of Graz, Graz, Austria
- 2 Organisational Unit for Studies and Teaching, Medical University of Graz, Graz, Austria
- 3 Organisational Unit for Studies and Teaching, Medical University of Graz, Graz, Austria
- 4 Office of the Vice Rector for Studies and Teaching, Medical University of Graz, Graz, Austria
- 5 Organisational Unit for Studies and Teaching, Medical University of Graz, Graz, Austria
Creative Education·Volume 03 (2012)·Pages 943–945·Published 23 October 2012·DOI10.4236/ce.2012.326143
Copy link · social · email
Abstract
During the course of the admission procedure for the diploma programs Human Medicine and Dentistry at the Medical University of Graz in July 2009, a serious error occurred in the evaluation process resulting in the publication of an erroneous provisional list of successful applicants. Under considerable public interest this wrong list had to be withdrawn and corrected. The publication of the erroneous list had been encouraged by a preceding item analysis yielding falsely optimistic results due to this systematic error. The source of the error and its consequences are described in detail, and a simple recipe to avoid similar errors in the future is provided.
KeywordsItem AnalysisIndex of DifficultyIndex of DiscriminationAdmission TestMedical Studies
- Lienert, G. A., & Raatz, U. (1988). Testaufbau und testanalyse (6th ed.). Weinheim, Baden-Württemberg: Psychologie Verlags-Union.
- Reibnegger, G., Caluba, H.-C., Ithaler, D., Manhal, S., Neges, H. M., & Smolle, J. (2010). Progress of medical students after open admission or admission based on knowledge tests. Medical Education, 44, 205- 214. doi:10.1111/j.1365-2923.2009.03576.x
- Reibnegger, G., Caluba, H.-C., Ithaler, D., Manhal, S., Neges, H. M., & Smolle, J. (2011). Dropout rates in medical students at one school before and after the installation of admission tests in Austria. Academic Medicine, 86, 1040-1048. doi:10.1097/ACM.0b013e3182223a1b