Measuring the Effectiveness of Faculty Facilitation Training in Problem-Based Learning in a Medical School
- 1 Speech Pathology and Audiology, Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, Canada
- 2 Department of Anesthesiology, Faculty of Medicine, University of Alberta, Edmonton, Canada
- 3 Department of Surgery, Faculty of Medicine, University of Alberta, Edmonton, Canada
Abstract
This study examined the effectiveness of a faculty training program for problem-based learning (PBL) facilitation. A multi-level approach was used, following Kirkpatrick’s levels for assessing training effectiveness. Data were obtained from (1) tutor training workshop evaluations, (2) a survey of tutors’ attitudes and beliefs, (3) changes in tutors’ perceptions of their teaching styles through pre- and post-testing using the Teaching Styles Inventory (TSI), (4) changes in student attitudes and self-perceptions of their learning styles through pre- and post-testing using the Self-directed Learning Readiness Scale (SDLRS) and the revised Study Process Questionnaire (SPQ). The authors contend that measures were obtained for Kirkpatrick levels 1, 2, and 4 (Reaction, Learning, and Results, respectively) but that no measure of Kirkpatrick level 3 was completed. Overall, it was concluded that the training program was successful as measured at Kirkpatrick level 1 but was equivocally successful as assessed at higher levels in Kirkpatrick’s model. In addition to drawing conclusions regarding the training program for facilitators in PBL, limitations and challenges associated with assessment at each level are highlighted.
- Barrows, H. S. (1988). The Tutorial Process. Springfield, IL: Southern Illinois University School of Medicine.
- Biggs, J., Kember, D., & Leung, D. Y. P. (2001). The Revised Two-Factor Study Process Questionnaire: R-SPQ-2F. British Journal of Educational Psychology, 71, 133-149. http://dx.doi.org/10.1348/000709901158433
- Bonham, L. A. (1991). Guglielmino’s Self-Directed Learning Readiness Scale: What Does It Mean? Adult Education Quarterly, 41, 92-99. http://dx.doi.org/10.1177/0001848191041002003
- DesMarchais, J. E. (1993). A Student-Centred, Problem-Based Curriculum: 5 Years’ Experience. Canadian Medical Association Journal, 148, 1567-1572.
- Dinsmore, D. L., & Alexander, P. A. (2012). A Critical Discussion of Deep and Surface Processing: What It Means, How It Is Measured, the Role of Context, and Model Specification. Educational Psychology Review, 24, 499-567. http://dx.doi.org/10.1007/s10648-012-9198-7
- Dolmans, D., Wolfhagen, I., Schmidt, H. G., & Van der Vleuten, C. P. M. (1994). A Rating Scale for Tutor Evaluation in a Problem-Based Curriculum: Validity and Reliability. Medical Education, 28, 550-558. http://dx.doi.org/10.1111/j.1365-2923.1994.tb02735.x
- Farmer, E. A. (2004). Faculty Development for Problem-Based Learning. European Journal of Dental Education, 8, 59-66. http://dx.doi.org/10.1111/j.1600-0579.2003.00337.x
- Fisher, M., King, J., & Tague, G. (2001). Development of a Self-Directed Learning Readiness Scale for Nursing Education. Nurse Education Today, 21, 516-525. http://dx.doi.org/10.1054/nedt.2001.0589
- Guglielmino, L. M. (1978). Development of the Self-Directed Learning Readiness Scale. Dissertation, University of Georgia. Dissertation Abstracts International, 38, 6467.
- Hitchcock, M. A., & Mylona, Z.-H. (2000). Teaching Faculty to Conduct Problem-Based Learning. Teaching and Learning in Medicine: An International Journal, 12, 52-57. http://dx.doi.org/10.1207/S15328015TLM1201_8
- Hoban, J. D., Lawson, S. R., Mazmanian, P. E., Best, A. M., & Seibel, H. R. (2005). The Self-Directed Learning Readiness Scale: A Factor Analysis Study. Medical Education, 39, 370-379. http://dx.doi.org/10.1111/j.1365-2929.2005.02140.x
- Immekus, J. C., & Imbrie, P. K. (2010). A Test and Cross-Validation of the Revised Two-Factor Study Process Questionnaire Factor Structure among Western University Students. Educational and Psychological Measurement, 70, 495-510. http://dx.doi.org/10.1177/0013164409355685