Objective Structured Clinical Examination (OSCE) with Immediate Feedback in Early (Preclinical) Stages of the Dental Curriculum — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Objective Structured Clinical Examination (OSCE) with Immediate Feedback in Early (Preclinical) Stages of the Dental Curriculum
Peninsula Dental School, Plymouth University, Plymouth, UK
,
Peninsula Dental School, Plymouth University, Plymouth, UK
1 Peninsula Dental School, Plymouth University, Plymouth, UK
2 Peninsula Dental School, Plymouth University, Plymouth, UK
The Objective Structured Clinical Examination (OSCE) is a test of skills, behaviour, attitudes and application of knowledge, which has been an integral part of medical and dental curricula since late 1970s. As a procedural exam, it has been successfully supplementing other outcome-oriented assessment methods in order to measure students’ preparedness to practice. In addition to making a judgement about competence, the aim of assessment is to guide future learning and shape values. These added benefits can be harnessed by providing feedback on the students’ performance and encouraging reflection. As a tool to reinforce or modify behaviour by focusing on actual performance (compared with the intended performance level), feedback is central to support cognitive and professional development, especially in the early stages of the clinical curriculum. OSCE with immediate feedback combines a work-based assessment method and a short, immediate feedback discussion with the examiner on the student’s performance before they move to the next station. To get the most out of this modified assessment, it should be implemented early in the clinical curriculum. Giving feedback immediately after a task is an efficient learning method and valuable tool for improving student experience. The aim of this paper is to assess the validity and reliability of the OSCE with immediate feedback as an exciting and valuable learning opportunity for students and a revolutionary new informative assessment method for teachers.
Al-Naami, M. Y. (2008). Reliability, Validity, and Feasibility of the Objective Structured Clinical Examination in Assessing Clinical Skills of Final Year Surgical Clerkship. Saudi Medical Journal, 29, 1802-1807.
Amano, H., Sano, T., Gotoh, K., Kakuta, S., Suganuma, T., Kimura, Y., & Saeki, H. (2004). Strategies for Training Standardized Patient Instructors for a Competency Exam. Journal of Dental Education, 68, 1104-1111.
Archer, J. C. (2010). State of the Science in Health Professional Education: Effective Feedback. Medical Education, 44, 101-108. http://dx.doi.org/10.1111/j.1365-2923.2009.03546.x
Association for Medical Education in Europe (2011). How to Measure the Quality of the OSCE: A Review of Metrics. G. Pell (Ed.). Dundee: Association for Medical Education in Europe.
Auewarakul, C., Downing, S. M., Jaturatamrong, U., & Praditsuwan, R. (2005). Sources of Validity Evidence for an Internal Medicine Student Evaluation System: An Evaluative Study of Assessment Methods. Medical Education, 39, 276-283. http://dx.doi.org/10.1111/j.1365-2929.2005.02090.x
Brazeau, C., Boyd, L., & Crosson, J. (2002). Changing an Existing OSCE to a Teaching Tool: The Making of a Teaching OSCE. Academic Medicine: Journal of the Association of American Medical Colleges, 77, 932. http://dx.doi.org/10.1097/00001888-200209000-00036
Brown, G., Manogue, M., & Martin, M. (1999). The Validity and Reliability of an OSCE in Dentistry. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 3, 117-125. http://dx.doi.org/10.1111/j.1600-0579.1999.tb00077.x
Chandra, P. S., Chaturvedi, S. K., & Desai, G. (2009). Objective Standardized Clinical Assessment with Feedback: Adapting the Objective Structured Clinical Examination for Postgraduate Psychiatry training in India. Indian Journal of Medical Sciences, 63, 235-243. http://dx.doi.org/10.4103/0019-5359.53391
Cronbach, L. J. (1971). Test Validation. In R. Thorndike (Ed.), Educational Measurement (2nd ed., p. 443). Washington DC: American Council on Education.
Cushing, A., Abbott, S., Lothian, D., Hall, A., & Westwood, O. M. (2011). Peer Feedback as an Aid to Learning--What Do We Want? Feedback. When Do We Want It? Now! Medical Teacher, 33, e105-e112. http://dx.doi.org/10.3109/0142159X.2011.542522
Davis, M. H. (2003). OSCE: The Dundee Experience. Medical Teacher, 25, 255-261. http://dx.doi.org/10.1080/0142159031000100292
Dennehy, P. C., Susarla, S. M., & Karimbux, N. Y. (2008). Relationship between Dental Students’ Performance on Standardized Multiple-Choice Examinations and OSCEs. Journal of Dental Education, 72, 585-592.
Dong, T., Saguil, A., Artino Jr., A. R., Gilliland, W. R., Waechter, D. M., Lopreaito, J., Flanagan, A., & Durning, S. J. (2012). Relationship between OSCE Scores and Other Typical Medical School Performance Indicators: A 5-Year Cohort Study. Military Medicine, 177, 44-46. http://dx.doi.org/10.7205/MILMED-D-12-00237
Downing, S. M. (2003). Validity: On the Meaningful Interpretation of Assessment Data. Medical Education, 37, 830-837. http://dx.doi.org/10.1046/j.1365-2923.2003.01594.x
Downing, S. M. (2004). Reliability: On the Reproducibility of Assessment Data. Medical Education, 38, 1006-1012. http://dx.doi.org/10.1111/j.1365-2929.2004.01932.x
Downing, S. M. (2006). Face Validity of Assessments: Faith-Based Interpretations or Evidence-Based Science? Medical Education, 40, 7-8. http://dx.doi.org/10.1111/j.1365-2929.2005.02361.x
Eberhard, L., Hassel, A., Baumer, A., Becker, F., Beck-Mubotter, J., Bomicke, W., Wege, K. C. et al. (2011). Analysis of Quality and Feasibility of an Objective Structured Clinical Examination (OSCE) in Preclinical Dental Education. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 15, 172-178. http://dx.doi.org/10.1111/j.1600-0579.2010.00653.x
Epstein, R. M. (2007). Assessment in Medical Education. The New England Journal of Medicine, 356, 387-396. http://dx.doi.org/10.1056/NEJMra054784
Firmstone, V. R., Bullock, A. D., Frame, J. W., & Wilson, M. (2007). Temporary Registration in Primary Care for Dentists Moving to the UK from Outside the EU: An Evaluation of a National Pilot Scheme. British Dental Journal, 203, 251-255. http://dx.doi.org/10.1038/bdj.2007.789
Govaerts, M., & van der Vleuten, C. P. (2013). Validity in Work-Based Assessment: Expanding Our Horizons. Medical Education, 47, 1164-1174. http://dx.doi.org/10.1111/medu.12289
Graham, R., Zubiaurre Bitzer, L. A., & Anderson, O. R. (2013). Reliability and Predictive Validity of a Comprehensive Preclinical OSCE in Dental Education. Journal of Dental Education, 77, 161-167.
Gupta, P., Dewan, P., & Singh, T. (2010). Objective Structured Clinical Examination (OSCE) Revisited. Indian Pediatrics, 47, 911-920. http://dx.doi.org/10.1007/s13312-010-0155-6
Hamann, C., Volkan, K., Fishman, M. B., Silvestri, R. C., Simon, S. R., & Fletcher, S. W. (2002). How Well Do Second-Year Students Learn Physical Diagnosis? Observational Study of an Objective Structured Clinical Examination (OSCE). BMC Medical Education, 2, 1. http://dx.doi.org/10.1186/1472-6920-2-1
Hammad, M., Oweis, Y., Taha, S., Hattar, S., Madarati, A., & Kadim, F. (2013). Students’ Opinions and Attitudes after Performing a Dental OSCE for the First Time: A Jordanian Experience. Journal of Dental Education, 77, 99-104.
Harden, R. M. (1979). Assessment of Medical Competence Using an Objective Structured Clinical Examination (OSCE). Dundee: Association for the Study of Medical Education.
Hodder, R. V., Rivington, R. N., Calcutt, L. E., & Hart, I. R. (1989). The Effectiveness of Immediate Feedback during the Objective Structured Clinical Examination. Medical Education, 23, 184-188. http://dx.doi.org/10.1111/j.1365-2923.1989.tb00884.x
Hodges, B. (2003). Validity and the OSCE. Medical Teacher, 25, 250-254. http://dx.doi.org/10.1080/01421590310001002836
Homer, M., & Pell, G. (2009). The Impact of the Inclusion of Simulated Patient Ratings on the Reliability of OSCE Assessments under the Borderline Regression Method. Medical Teacher, 31, 420-425. http://dx.doi.org/10.1080/01421590802520949
Iramaneerat, C., Yudkowsky, R., Myford, C. M., & Downing, S. M. (2008). Quality Control of an OSCE Using Generalizability Theory and Many-Faceted Rasch Measurement. Advances in Health Sciences Education: Theory and Practice, 13, 479-493. http://dx.doi.org/10.1007/s10459-007-9060-8
Kaufman, D. M., Mann, K. V., Muijtjens, A. M., & van der Vleuten, C. P. (2000). A Comparison of Standard-Setting Procedures for an OSCE in Undergraduate Medical Education. Academic Medicine: Journal of the Association of American Medical Colleges, 75, 267-271. http://dx.doi.org/10.1097/00001888-200003000-00018
Kurz, J. M., Mahoney, K., Martin-Plank, L., & Lidicker, J. (2009). Objective Structured Clinical Examination and Advanced Practice Nursing Students. Journal of Professional Nursing: Official Journal of the American Association of Colleges of Nursing, 25, 186-191. http://dx.doi.org/10.1016/j.profnurs.2009.01.005
Logan, H. L., Muller, P. J., Edwards, Y., & Jakobsen, J. R. (1999). Using Standardized Patients to Assess Presentation of a Dental Treatment Plan. Journal of Dental Education, 63, 729-737.
Manogue, M., McLoughlin, J., Christersson, C., Delap, E., Lindh, C., Schoonheim-Klein, M., & Plasschaert, A. (2011). Curriculum Structure, Content, Learning and Assessment in European Undergraduate Dental Education—Update 2010. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 15, 133-141. http://dx.doi.org/10.1111/j.1600-0579.2011.00699.x
Martin, I. G., & Jolly, B. (2002). Predictive Validity and Estimated Cut Score of an Objective Structured Clinical Examination (OSCE) Used as an Assessment of Clinical Skills at the End of the First Clinical Year. Medical Education, 36, 418-425. http://dx.doi.org/10.1046/j.1365-2923.2002.01207.x
Mohtadi, N. G., Harasym, P. H., Pipe, A. L., Strother, R. T., & Mah, A. F. (1995). Using an Objective Structured Clinical Examination to Evaluate Competency in Sport Medicine. Clinical Journal of Sport Medicine: Official Journal of the Canadian Academy of Sport Medicine, 5, 82-85. http://dx.doi.org/10.1097/00042752-199504000-00002
Muller, E. S., Harik, P., Margolis, M., Clauser, B., McKinley, D., & Boulet, J. R. (2003). An Examination of the Relation-ship between Clinical Skills Examination Performance and Performance on USMLE Step 2. Academic Medicine: Journal of the Association of American Medical Colleges, 78, S27-S29. http://dx.doi.org/10.1097/00001888-200310001-00009
Napankangas, R., Harila, V., & Lahti, S. (2012). Experiences in Adding Multiple-Choice Questions to an Objective Structural Clinical Examination (OSCE) in Undergraduate Dental Education. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 16, e146-e150.
Ratzmann, A., Wiesmann, U., & Kordass, B. (2012). Integration of an Objective Structured Clinical Examination (OSCE) into the Dental Preliminary Exams. GMS Zeitschrift für medizinische Ausbildung, 29, Doc09.
Schoonheim-Klein, M., Muijtjens, A., Habets, L., Manogue, M., Van der Vleuten, C., Hoogstraten, J., & Van der Velden, U. (2008). On the Reliability of a Dental OSCE, Using SEM: Effect of Different Days. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 12, 131-137. http://dx.doi.org/10.1111/j.1600-0579.2008.00507.x
Schoonheim-Klein, M., Muijtjens, A., Habets, L., Manogue, M., van der Vleuten, C., & van der Velden, U. (2009). Who Will Pass the Dental OSCE? Comparison of the Angoff and the Borderline Regression Standard Setting Methods. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 13, 162-171. http://dx.doi.org/10.1111/j.1600-0579.2008.00568.x
Schoonheim-Klein, M., Walmsley, A. D., Habets, L., van der Velden, U., & Manogue, M. (2005). An Implementation Strategy for Introducing an OSCE into a Dental School. European Journal of Dental Education: Official Journal of the Association for Dental Education in Europe, 9, 143-149. http://dx.doi.org/10.1111/j.1600-0579.2005.00379.x
Silva, C. C., Lunardi, A. C., Mendes, F. A., Souza, F. F., & Carvalho, C. R. (2011). Objective Structured Clinical Evaluation as an Assessment Method for Undergraduate Chest Physical Therapy Students: A Cross-Sectional Study. Revista Brasileira De Fisioterapia (Sao Carlos (Sao Paulo, Brazil)), 15, 481-486. http://dx.doi.org/10.1590/S1413-35552011005000033
Simon, S. R., Volkan, K., Hamann, C., Duffey, C., & Fletcher, S. W. (2002). The Relationship between Second-Year Medical Students’ OSCE Scores and USMLE Step 1 Scores. Medical Teacher, 24, 535-539. http://dx.doi.org/10.1080/0142159021000012586
Sloan, D. A., Donnelly, M. B., Schwartz, R. W., Felts, J. L., Blue, A. V., & Strodel, W. E. (1996). The Use of the Objective Structured Clinical Examination (OSCE) for Evaluation and Instruction in Graduate Medical Education. The Journal of Surgical Research, 63, 225-230. http://dx.doi.org/10.1006/jsre.1996.0252
Tavakol, M., & Dennick, R. (2011). Post-Examination Analysis of Objective Tests. Medical Teacher, 33, 447-458. http://dx.doi.org/10.3109/0142159X.2011.564682
Townsend, A. H., McLlvenny, S., Miller, C. J., & Dunn, E. V. (2001). The Use of an Objective Structured Clinical Examination (OSCE) for Formative and Summative Assessment in a General Practice Clinical Attachment and Its Relationship to Final Medical School Examination Performance. Medical Education, 35, 841-846. http://dx.doi.org/10.1046/j.1365-2923.2001.00957.x
Van Der Vleuten, C. P. (1996). The Assessment of Professional Competence: Developments, Research and Practical Implications. Advances in Health Sciences Education: Theory and Practice, 1, 41-67. http://dx.doi.org/10.1007/BF00596229
Wilkinson, T. J., Newble, D. I., & Frampton, C. M. (2001). Standard Setting in an Objective Structured Clinical Examination: Use of Global Ratings of Borderline Performance to Determine the Passing Score. Medical Education, 35, 1043-1049. http://dx.doi.org/10.1046/j.1365-2923.2001.01041.x