Introduction: Although the research to operating room teaching is extensive, evidence relating surgical teachers’ behaviors to trainees’ objective complex psychomotor skills acquisition is limited. We aimed to identify objectively evidence-based teaching behaviors in hands-on training associated with increased complex psychomotor skills in surgical and non-surgical trainees. Methods: The MEDLINE, PsycINFO and ERIC databases were searched for relevant papers. Due to comparable training characteristics to complex surgical skill acquisition, papers on sports and music training were also included. Paper screening took place after training sessions with the inclusion and exclusion criteria. Inter-rater reliability was determined. Data w ere extracted and the quality of studies was assessed with the Medical Education Research Study Quality Instrument (MERSQI) and the Newcastle-Ottawa Scale-Education (NOS-E). Results: 18,337 references were identified. Seven studies were included. Teaching behaviors shown to improve trainees’ objective skills acquisition included feedback, instruction, active trainee involvement and demonstrations. Feedback and instruction with an external focus on the task and effect were supported by the strongest evidence. There was significant evidence regarding negative effects of harshly criticizing and belittling teaching behaviors. The data quality and evidence for most teaching behaviors w ere weak with low impact levels. Discussion: Feedback, instruction, active trainee involvement and demonstrations are important for the hands-on teaching of complex psychomotor skills. However, strong evidence supporting their effectiveness is lacking. Future research should be directed on investigating the relationship between clearly defined teaching behaviors and the objective acquisition of complex skills in surgical trainees.
KeywordsSurgical EducationEffective Intra-Operative TeachingSurgical Skills Training
Agha, R. A., & Fowler, A. J. (2015). The Role and Validity of Surgical Simulation. International Surgery, 100, 350-357. https://doi.org/10.9738/INTSURG-D-14-00004.1
Alken, A., Tan, E., Luursema, J. M., Fluit, C., & van Goor, H. (2013). Feedback Activities of Instructors during a Trauma Surgery Course. The American Journal of Surgery, 206, 599-604. https://doi.org/10.1016/j.amjsurg.2013.03.011
Alken, A., Tan, E., Luursema, J. M., Fluit, C., & van Goor, H. (2015). Coaching during a Trauma Surgery Team Training: Perceptions versus Structured Observations. The American Journal of Surgery, 209, 163-169. https://doi.org/10.1016/j.amjsurg.2014.02.009
Anderson, C. I., Gupta, R. N., Larson, J. R., Abubars, O. I., Kwiecien, A. J., Lake, A. D. et al. (2013). Impact of Objectively Assessing Surgeons’ Teaching on Effective Perioperative Instructional Behaviors. JAMA Surgery, 148, 915-922. https://doi.org/10.1001/jamasurg.2013.2144
Anton, N. E., & Stefanidis, D. (2016). Should Surgeons Have Mental Skills Training? Oxford: Oxford University Press. https://doi.org/10.1093/ejcts/ezw071
Belfield, C., Thomas, H., Bullock, A., Eynon, R., & Wall, D. (2001). Measuring Effectiveness for Best Evidence Medical Education: A Discussion. Medical Teacher, 23, 164-170. https://doi.org/10.1080/0142150020031084
Blom, E. M., Verdaasdonk, E. G., Stassen, L. P., Stassen, H. G., Wieringa, P. A., & Dankelman, J. (2007). Analysis of Verbal Communication during Teaching in the Operating Room and the Potentials for Surgical Training. Surgical Endoscopy, 21, 1560-1566. https://doi.org/10.1007/s00464-006-9161-0
Chen, X. P., Williams, R. G., Sanfey, H. A., & Smink, D. S. (2015). A Taxonomy of Surgeons’ Guiding Behaviors in the Operating Room. The American Journal of Surgery, 209, 15-20. https://doi.org/10.1016/j.amjsurg.2014.07.018
Claridge, J. A., Calland, J. F., Chandrasekhara, V., Young, J. S., Sanfey, H., & Schirmer, B. D. (2003). Comparing Resident Measurements to Attending Surgeon Self-Perceptions of Surgical Educators. The American Journal of Surgery, 185, 323-327. https://doi.org/10.1016/S0002-9610(02)01421-6
Cook, D. A., & Reed, D. A. (2015). Appraising the Quality of Medical Education Research Methods: The Medical Education Research Study Quality Instrument and the Newcastle-Ottawa Scale-Education. Academic Medicine, 90, 1067-1076. https://doi.org/10.1097/ACM.0000000000000786
Dawe, S. R., Pena, G. N., Windsor, J. A., Broeders, J. A., Cregan, P. C., Hewett, P. J. et al. (2014). Systematic Review of Skills Transfer after Surgical Simulation-Based Training. British Journal of Surgery, 101, 1063-1076. https://doi.org/10.1002/bjs.9482
De Win, G., Van Bruwaene, S., Kulkarni, J., Van Calster, B., Aggarwal, R., Allen, C. et al. (2016). An Evidence-Based Laparoscopic Simulation Curriculum Shortens the Clinical Learning Curve and Reduces Surgical Adverse Events. Advances in Medical Education and Practice, 7, 357-370. https://doi.org/10.2147/AMEP.S102000
Duke, R. A., & Henninger, J. C. (1998). Effects of Verbal Corrections on Student Attitude and Performance. Journal of Research in Music Education, 46, 482-495. https://doi.org/10.2307/3345345
Flinn, J. T., Miller, A., Pyatka, N., Brewer, J., Schneider, T., & Cao, C. G. (2016). The Effect of Stress on Learning in Surgical Skill Acquisition. Medical Teacher, 38, 897-903. https://doi.org/10.3109/0142159X.2015.1114597
Gurusamy, K. S., Aggarwal, R., Palanivelu, L., & Davidson, B. R. (2009). Virtual Reality Training for Surgical Trainees in Laparoscopic Surgery. Cochrane Database of Systematic Reviews, No. 1, CD006575. https://doi.org/10.1002/14651858.CD006575.pub2
Harrison, J. M., Fellingham, G. W., Buck, M. M., & Pellett, T. L. (1995). Effects of Practice and Command Styles on Rate of Change in Volleyball Performance and Self-Efficacy of High-, Medium-, and Low-Skilled Learners. Journal of Teaching in Physical Education, 14, 328-339. https://doi.org/10.1123/jtpe.14.3.328
Hauge, L. S., Wanzek, J. A., & Godellas, C. (2001). The Reliability of an Instrument for Identifying and Quantifying Surgeons’ Teaching in the Operating Room. The American Journal of Surgery, 181, 333-337. https://doi.org/10.1016/S0002-9610(01)00577-3
Henninger, J. C., Flowers, P. J., & Councill, K. H. (2006). Pedagogical Techniques and Student Outcomes in Applied Instrumental Lessons Taught by Experienced and Pre-Service American Music Teachers. International Journal of Music Education, 24, 71-84. https://doi.org/10.1177/0255761406063108
Jensen, A. R., Wright, A. S., Kim, S., Horvath, K. D., & Calhoun, K. E. (2012). Educational Feedback in the Operating Room: A Gap between Resident and Faculty Perceptions. The American Journal of Surgery, 204, 248-255. https://doi.org/10.1016/j.amjsurg.2011.08.019
Joels, M., Pu, Z., Wiegert, O., Oitzl, M. S., & Krugers, H. J. (2006). Learning under Stress: How Does It Work? Trends in Cognitive Sciences, 10, 152-158. https://doi.org/10.1016/j.tics.2006.02.002
Kneebone, R. (2003). Simulation in Surgical Training: Educational Issues and Practical Implications. Medical Education, 37, 267-277. https://doi.org/10.1046/j.1365-2923.2003.01440.x
Konge, L., & Lonn, L. (2016). Simulation-Based Training of Surgical Skills. Perspectives on Medical Education, 5, 3-4. https://doi.org/10.1007/s40037-016-0251-y
Levinson, K. L., Barlin, J. N., Altman, K., & Satin, A. J. (2010). Disparity between Resident and Attending Physician Perceptions of Intraoperative Supervision and Education. The Journal of Graduate Medical Education, 2, 31-36. https://doi.org/10.4300/JGME-D-09-00096.1
Li, M. M., & George, J. (2017). A Systematic Review of Low-Cost Laparoscopic Simulators. Surgical Endoscopy, 31, 38-48. https://doi.org/10.1007/s00464-016-4953-3
McCaskie, A. W., Kenny, D. T., & Deshmukh, S. (2011). How Can Surgical Training Benefit from Theories of Skilled Motor Development, Musical Skill Acquisition and Performance Psychology? The Medical Journal of Australia, 194, 463-465.
McKendy, K. M., Watanabe, Y., Lee, L., Bilgic, E., Enani, G., Feldman et al. (2017). Perioperative Feedback in Surgical Training: A Systematic Review. The American Journal of Surgery, 214, 117-126. https://doi.org/10.1016/j.amjsurg.2016.12.014
McSparron, J. I., Ricotta, D. N., Moskowitz, A., Volpicelli, F. M., Roberts, D. H., Schwartzstein, R. M. et al. (2015). The PrOSTE: Identifying Key Components of Effective Procedural Teaching. Annals of the American Thoracic Society, 12, 230-234. https://doi.org/10.1513/AnnalsATS.201406-237BC
Nicholls, D., Sweet, L., Muller, A., & Hyett, J. (2016). Teaching Psychomotor Skills in the Twenty-First Century: Revisiting and Reviewing Instructional Approaches through the Lens of Contemporary Literature. Medical Teacher, 38, 1056-1063. https://doi.org/10.3109/0142159X.2016.1150984
Reznick, R. K., & MacRae, H. (2006). Teaching Surgical Skills—Changes in the Wind. The New England Journal of Medicine, 355, 2664-2669. https://doi.org/10.1056/NEJMra054785
Ridder, J., McGaghie, W. C., Stokking, K. M., & Cate, O. T. (2015). Variables That Affect the Process and Outcome of Feedback, Relevant for Medical Training: A Meta-Review. Medical Education, 49, 658-673. https://doi.org/10.1111/medu.12744
Roberts, N. K., Brenner, M. J., Williams, R. G., Kim, M. J., & Dunnington, G. L. (2012). Capturing the Teachable Moment: A Grounded Theory Study of Verbal Teaching Interactions in the Operating Room. Surgery, 151, 643-650. https://doi.org/10.1016/j.surg.2011.12.011
Rogers, R. G. (2006). Mental Practice and Acquisition of Motor Skills: Examples from Sports Training and Surgical Education. Obstetrics and Gynecology Clinics of North America, 33, 297-304. https://doi.org/10.1016/j.ogc.2006.02.004 http://www.sciencedirect.com/science/article/pii/S0889854506000131
Rose, J. S., Waibel, B. H., & Schenarts, P. J. (2011). Disparity between Resident and Faculty Surgeons’ Perceptions of Preoperative Preparation, Intraoperative Teaching, and Postoperative Feedback. Journal of Surgical Education, 68, 459-464. https://doi.org/10.1016/j.jsurg.2011.04.003
Schwabe, L., Joels, M., Roozendaal, B., Wolf, O. T., & Oitzl, M. S. (2012). Stress Effects on Memory: An Update and Integration. Neuroscience & Biobehavioral Reviews, 36, 1740-1749. https://doi.org/10.1016/j.neubiorev.2011.07.002
Snyder, R. A., Tarpley, M. J., Tarpley, J. L., Davidson, M., Brophy, C., & Dattilo, J. B. (2012). Teaching in the Operating Room: Results of a National Survey. Journal of Surgical Education, 69, 643-649. https://doi.org/10.1016/j.jsurg.2012.06.007
Sturm, L. P., Windsor, J. A., Cosman, P. H., Cregan, P., Hewett, P. J., & Maddern, G. J. (2008). A Systematic Review of Skills Transfer after Surgical Simulation Training. Annals of Surgery, 248, 166-179. https://doi.org/10.1097/SLA.0b013e318176bf24
Sutherland, L. M., Middleton, P. F., Anthony, A., Hamdorf, J., Cregan, P., Scott, D. et al. (2006). Surgical Simulation: A Systematic Review. Annals of Surgery, 243, 291-300. https://doi.org/10.1097/01.sla.0000200839.93965.26
Sutkin, G., Littleton, E. B., & Kanter, S. L. (2015). How Surgical Mentors Teach: A Classification of in Vivo Teaching Behaviors Part 1: Verbal Teaching Guidance. Journal of Surgical Education, 72, 243-250. https://doi.org/10.1016/j.jsurg.2014.10.003
Timberlake, M. D., Mayo, H. G., Scott, L., Weis, J., & Gardner, A. K. (2017). What Do We Know about Intraoperative Teaching? A Systematic Review. Annals of Surgery, 266, 251-259. https://doi.org/10.1097/SLA.0000000000002131
Vogel, S., & Schwabe, L. (2016). Learning and Memory under Stress: Implications for the Classroom. NPJ Science of Learning, 1, 16011. https://doi.org/10.1038/npjscilearn.2016.11
White, C., Rodger, M. W. M., & Tang, T. (2016). Current Understanding of Learning Psychomotor Skills and the Impact on Teaching Laparoscopic Surgical Skills. The Obstetrician & Gynaecologist, 18, 53-63. https://doi.org/10.1111/tog.12255
Wulf, G., Lauterbach, B., & Toole, T. (1999). The Learning Advantages of an External Focus of Attention in Golf. Research Quarterly for Exercise and Sport, 70, 120-126. https://doi.org/10.1080/02701367.1999.10608029
Wulf, G., McConnel, N., Gartner, M., & Schwarz, A. (2002). Enhancing the Learning of Sport Skills through External-Focus Feedback. Journal of Motor Behavior, 34, 171-182. https://doi.org/10.1080/00222890209601939