Learning to Improve: Report of a Three-Year Capacity-Building Project Leveraging Professional Development + Coaching to Improve Third-Grade Reading Outcomes — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Learning to Improve: Report of a Three-Year Capacity-Building Project Leveraging Professional Development + Coaching to Improve Third-Grade Reading Outcomes
Bellarmine University, Louisville, KY, USA
,
Bellarmine University, Louisville, KY, USA
,
Sandra Dunagan Deal Center for Early Language and Literacy, Georgia College, Milledgeville, GA, USA
1 Bellarmine University, Louisville, KY, USA
2 Bellarmine University, Louisville, KY, USA
3 Sandra Dunagan Deal Center for Early Language and Literacy, Georgia College, Milledgeville, GA, USA
This study reports the results of a three-year capacity building effort to improve core reading knowledge and practice in 165 third-grade teachers working in 63 urban schools and its effects on student reading outcomes. Teachers volunteered to participate in one or two years of professional development lasting from 90 to 180 hours. Core reading knowledge among teachers resulted in statically significant growth with generally large effect sizes. Three cohorts of third-grade students taught by participating teachers were assessed on multiple measures of reading at the beginning and end of each school year. Results for within-year improvement showed large effects on all student outcomes. Analysis of the magnitude of student gains between the three years found that for two of the four measures gains in year one were exceeded in years two and three. Implications for professional training to facilitate improved reading outcomes are discussed.
Anderson, R. C., Hiebert, E. H., Wilkinson, I. A. G., & Scott, J. (1985). Becoming a Nation of Readers: The Report of the Commission on Reading. Washington DC: National Institute of Education.
Applegate, A. J., & Applegate, M. D. (2004). The Peter Effect: Reading Habits and Attitudes of Teacher Candidates. The Reading Teacher, 57, 554-563.
Atteberry, A., & Bryk, A. (2011). Analyzing Teacher Participation in Literacy Coaching Activities. The Elementary School Journal, 112, 356-382. https://doi.org/10.1086/661994
Bean, R. M., Swan, A. L., & Knaub, R. (2003). Reading Specialists in Schools with Exemplary Reading Programs: Functional, Versatile, and Prepared. The Reading Teacher, 56, 446-455.
Biancarosa, G., Bryk, A. S., & Dexter, E. R. (2010). Assessing the Value-Added Effects of Literacy Collaborative Professional Development on Student Learning. Elementary School Journal, 111, 7-34. https://doi.org/10.1086/653468
Binks-Cantrell, E., Washburn, E. K., Joshi, R. M., & Hougen, M. (2012). Peter Effect in the Preparation of Reading Teachers. Scientific Studies of Reading, 16, 526-536. https://doi.org/10.1080/10888438.2011.601434
Black, P., & William, D. (1998). Assessment and Classroom Learning. Assessment in Education: Principles, Policy, & Practice, 5, 7-74. https://doi.org/10.1080/0969595980050102
Blair, T. R., Rupley, W. H., & Nichols, W. D. (2007). The Effective Teacher of Reading: Considering the “What” and “How” of Instruction. Reading Teacher, 60, 432-438. https://doi.org/10.1598/RT.60.5.3
Blank, R. K., & de las Alas, N. (2009). Effects of Teacher Professional Development on Gains in Student Achievement. Washington DC: Council of Chief State School Officers. http://ccsso.org/Documents/2009/Effects_of_Teacher_Professional_2009.pdf
Bryk, A. S. (2014). 2014 AERA Distinguished Lecture: Accelerating How We Learn to Improve. Educational Researcher, 44, 467-477. https://doi.org/10.3102/0013189X15621543
Bush, R. N. (1984). Effective Staff Development in Making Schools More Effective: Proceedings of Three State Conferences. San Francisco, CA: Far West Laboratory. http://files.eric.ed.gov/fulltext/ED249576.pdf
Cohen, D. K. (1990). A Revolution in One Classroom: The Case of Mrs. Oublier. Educational Evaluation and Policy Analysis, 12, 311-329. https://doi.org/10.3102/01623737012003311
Cohen, D. K., & Hill, H. C. (2001). Learning Policy: When State Education Reform Works. New Haven, CT: Yale University Press. https://doi.org/10.12987/yale/9780300089479.001.0001
Cohen, D. K., Raudenbush, S., & Ball, D. (2000). Resources, Instruction and Research. A Working Paper from the Center for Teaching Policy.
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Corcoran, T. B., McVay, S., & Riordan, K. (2003). Getting It Right: The MISE Approach to Professional Development. CPRE Research Report Series RR-55. https://doi.org/10.12698/cpre.2003.rr55 https://repository.upenn.edu/cpre_researchreports/42/
Cornett, J., & Knight, J. (2009). Research on Coaching. In J. Knight (Ed.), Coaching: Approaches and Perspectives (pp. 192-216). Thousand Oaks, CA: Corwin Press.
Darling-Hammond, L., Wei, R. C., Andree, A., Richardson, N., & Orphanos, S. (2009). Professional Learning in the Learning Profession: A Status Report on Teacher Development in the United States and Abroad. Oxford, OH: National Staff Development Council.
Davis, M. H., McPartland, J. M., Pryseski, C., & Kim, E. (2018). The Effects of Coaching on English Teachers’ Reading Instruction Practices and Adolescent Students’ Reading Comprehension. Literacy Research and Instruction, 57, 255-275. https://doi.org/10.1080/19388071.2018.1453897
Deming, W. E. (2000). Out of the Crisis. Cambridge, MA: MIT Press.
Deno, S. L. (1985). Curriculum-Based Measurement: The Emerging Alternative. Exceptional Children, 52, 219-232. https://doi.org/10.1177/001440298505200303
Deno, S. L., Mirkin, P. K., & Chiang, B. (1982). Identifying Valid Measures of Reading. Exceptional Children, 49, 36-45. https://doi.org/10.1177/001440298204900105
Desimone, L. M. (2009). Improving Impact Studies of Teachers’ Professional Development: Toward Better Conceptualizations and Measures. Educational Researcher, 38, 181-199. https://doi.org/10.3102/0013189X08331140
Desimone, L. M., Porter, A. C., Garet, M. S., Yoon, K. S., & Birman, B. F. (2002). Effects on Professional Development on Teachers’ Instruction: Results from a Three-Year Longitudinal Study. Educational Evaluation and Policy Analysis, 24, 81-112. https://doi.org/10.3102/01623737024002081
Dole, J. A. (2004). The Changing Role of the Reading Specialist in School Reform. The Reading Teacher, 57, 462-471.
Dorph, R., Goldstein, D., Lee, S., Schneider, L, K., & Venkatsesan, S. (2007). The Status of Science Education in the Bay Area: Research Brief. Berkeley, CA: Lawrence Hall of Science, University of California.
Ehri, L. C. (1993). How English Orthography Influences Phonological Knowledge as Children Learn to Read and Spell. In R. J. Scales (Ed.), Literacy and Language Analysis (pp. 21-43). Hillsdale, NJ: Lawrence Erlbaum Associates.
Elmore, R. F. (2002). Bridging the Gap between Standards and Achievement: The Imperative for Professional Development in Education. Washington DC: Albert Shanker Institute.
Ermeling, B. (2009). Tracing the Effects of Teacher Inquiry on Classroom Practice. Teaching and Teacher Education, 26, 377-388. https://doi.org/10.1016/j.tate.2009.02.019
Feldman, J., Schneck, A., Feighan, K., Coffey, D., & Rui, N. (2011). Memphis Striving Readers Project, Evaluation Report Year 4. Research for Better Schools & RMC Research Corporation.
Flesch, R. (1955). Why Johnny Can’t Read. New York: HarperCollins.
Foorman, B., Beyler, N., Borradaile, K., Coyne, M., Denton, C. A., Dimino, J. et al. (2016). Foundational Skills to Support Reading for Understanding in Kindergarten through 3rd Grade (NCEE 2016-4008). Washington DC: National Center for Education Evaluation and Regional Assistance (NCEE), Institute of Education Sciences, U.S. Department of Education.
French, V. W. (1997). Teachers Must Be Learners, too: Professional Development and National Teaching Standards. NASSP Bulletin, 81, 38-44. https://doi.org/10.1177/019263659708158507
Fuchs, L. S., Fuchs, D., Hosp, M. K., & Jenkins, J. R. (2001). Oral Reading Fluency as an Indicator of Reading Competence: A Theoretical, Empirical, and Historical Analysis. Scientific Studies of Reading, 5, 239-256. https://doi.org/10.1207/S1532799XSSR0503_3
Gamse, B. C., Jacob, R. T., Horst, M., Boulay, B., & Unlu, F. (2008). Reading First Impact Study Final Report (NCEE 2009-4038). Washington DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education.
Ganske, K. (1994). Developmental Spelling Analysis: A Diagnostic Measure for Instruction and Research. Unpublished Doctoral Dissertation. Charlottesville, VA: University of Virginia.
Ganske, K. (2014). Word Journeys: Assessment-Guided Phonic, Spelling, and Vocabulary Instruction (2nd ed.). New York: The Guilford Press.
Garet, M. S., Cronen, S., Eaton, M., Kurki, A., Ludwig, M., Jones, W. et al. (2008). The Impact of Two Professional Development Interventions on Early Reading Instruction and Achievement (NCEE Report 2008-4031). Washington, DC: National Center for Educational Evaluation and Regional Assistance, Institute of Education Sciences.
Garet, M. S., Porter, A., Desimone, L., Birman, B., & Yoon, K. S. (2001). What Makes Professional Development Effective? Results from a National Sample of Teachers. American Educational Research Journal, 38, 915-945. https://doi.org/10.3102/00028312038004915
Goldhaber, D., & Anthony, E. (2007). Can Teacher Quality Be Effectively Assessed? National Board Certification as a Signal of Effective Teaching. Review of Economics and Statistics, 89, 134-150. https://doi.org/10.1162/rest.89.1.134
Graesser, A. C., McNamara, D. S., & Kulikowich, J. M. (2011). Coh-Metrix: Providing Multilevel Analysis of Text Characteristics. Educational Researcher, 40, 223-234. https://doi.org/10.3102/0013189X11413260
Gulamhussein, A. (2013). Teaching the Teachers: Effective Professional Development in the Era of High Stakes Accountability. National School Board Association, Center for Public Education. http://conference.ohioschoolboards.org/2017/wp-%20content/uploads/sites/17/2016/07/ 1pm111317A114Job-embedPD.pdf
Harris, D. N., & Sass, T. R. (2007). Teacher Training, Teacher Quality, and Student Achievement. (Working Paper #3). Washington DC: Calder Urban Institute, National Center for Analysis of Longitudinal Data in Education Research.
Hasbrouck, J., & Tindal, G. A. (2006). Oral Reading Fluency Norms: A Valuable Assessment Tool for Reading Teachers. The Reading Teacher, 59, 636-644. https://doi.org/10.1598/RT.59.7.3
Henderson, E. H., & Templeton, S. (1986). A Developmental Perspective of Formal Spelling Instruction through Alphabet, Pattern, and Meaning. The Elementary School Journal, 86, 317-323. https://doi.org/10.1086/461451
Huang, L. (2014). Learning to Read with the Whole Language Approach: The Teacher’s View. English Language Teaching, 7, 71-77. https://doi.org/10.5539/elt.v7n5p71
Introduction to SAS. UCLA: Statistical Consulting Group. https://stats.idre.ucla.edu/sas/modules/sas-learning-moduleintroduction-to-the-features-of-sas/
Jimenez, R. T. (1997). The Strategic Reading Abilities and Potential of Five Low-Literacy Latina/o Readers in Middle School. Reading Research Quarterly, 32, 224-243. https://doi.org/10.1598/RRQ.32.3.1
Kennedy, M. M. (1998). Form and Substance in in-Service Teacher Education. Madison, WI: University of Wisconsin National Institute for Science Education. https://www.msu.edu/~mkennedy/publications/valuePD.html
Kennedy, M. M. (2016). How Does Professional Development Improve Teaching? Review of Educational Research, 86, 945-980. https://doi.org/10.3102/0034654315626800
Kentucky Department of Education (2017). Kentucky Department of Education School Report Card 2016-17. https://education.ky.gov/AA/distsupp/Pages/SRC.aspx
Kentucky General Assembly (1990). “Kentucky Education Reform Act of 1990.” Regular Session 1990, House Bill 940, Section 104. Frankfort, KY: Kentucky General Assembly.
Lewis, C. (2009). What is the Nature of Knowledge Development in Lesson Study? Educational Action Research, 17, 95-110. https://doi.org/10.1080/09650790802667477
Licklider, B. L. (1997). Breaking Ranks: Change the in-Service Institution. NASSP Bulletin, 81, 9-22. https://doi.org/10.1177/019263659708158504
Luft, J. A., & Hewson, P. W. (2014). Research on Teacher Professional Development in Science. In N. G. Lederman, & S. K. Abel (Eds.), Handbook of Research on Science Education (Vol. 2, pp. 889-910). New York: Routledge.
Manzo, K. K. (2000). Dallas Reading Initiative Produces Limited Results. Education Week, 19, 11. https://www.edweek.org/ew/articles/2000/03/01/25read.h19.html
Marsh, J. A., McCombs, J. S., Lockwood, J. R., Martorell, F., Gershwin, D., Naftel, S. et al. (2008). Supporting Literacy across the Sunshine State: A Study of Florida Middle School Reading Coaches. Santa Monica, CA: RAND.
McGlinchey, M. T., & Hixson, M. D. (2004). Using Curriculum-Based Measurement to Predict Performance on State Assessments in Reading. School Psychology Review, 33, 193-203.
MetaMetrics (2016). The Lexile Framework for Reading. https://www.lexile.com/analyzer/
Moats, L. C. (2004). The Professional Development of Reading Teachers. In P. McCardle, & V. Chhabra (Eds.), The Voice of Evidence in Reading Research. Baltimore, MD: Paul H. Brookes Publishing Co.
National Assessment of Educational Progress (NAEP) (2017). 2017 Reading Assessment. U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP). https://www.nationsreportcard.gov/media.aspx
National Council of Teachers of Mathematics (1991). Commission on Teaching Standards for School Mathematics: Professional Standards for Teaching Mathematics. Reston, VA: National Council of Teachers of Mathematics.
National Institute of Child Health and Human Development (2000). Report of the National Reading Panel: Teaching Children to Read: An Evidence-Based Assessment of the Scientific Research Literature on Reading and Its Implications for Reading Instruction. Washington DC: U.S. Government Printing Office.
Newman, S. B., & Cunningham, L. (2009). The Impact of Professional Development and Coaching on Early Language and Literacy Practices. American Educational Research Journal, 46, 532-566. https://doi.org/10.3102/0002831208328088
Paige, D. D., Smith, G. S., Rasinski, T. V., Rupley, W. H., Magpuri-Lavell, T., & Nichols. W. D. (2019). A Path Analytic Model Linking Foundational Skills to Grade 3 State Reading Achievement. Journal of Educational Research, 112, 110-120. https://doi.org/10.1080/00220671.2018.1445609
Penuel, W. R., Fishman, B. J., Gallagher, L, P., Korbak, C., & Lopez-Prado, B. (2009). What Makes Professional Development Effective? Strategies that Foster Curriculum Implementation. American Educational Research Journal, 44, 921-958. https://doi.org/10.3102/0002831207308221
Peterson, P. L., & Comeaux, M. A. (1990). Evaluating the Systems: Teachers’ Perspectives on Teacher Evaluation. Educational Evaluation and Policy Analysis, 12, 3-24. https://doi.org/10.3102/01623737012001003
Rayner, K., Pollatsek, A., Ashby, J., & Clifton Jr., C. (2012). Psychology of Reading. New York: Psychology Press.
Reinking, D., & Bradley, B. A. (2004). Connecting Research and Practice Using Formative Design Experiments. In N. K. Duke, & M. H. Mallette (Eds.), Literacy Research Methodologies (pp. 149-169). New York: Guilford Press.
Reutzel, D. R., Dole, J. A., Fawson, P. C., Jones, C. D., Read, S., Fargo, J. D. et al. (2009). Connecting Primary Grade Teacher Knowledge to Primary Student Achievement: Developing an Evidence-Based Assessment Tool-The Literacy Instruction Knowledge Scales (LIKS). Washington DC: U.S. Department of Education, Institute of Education Sciences.
Richardson, J. T. E. (1998). The Availability and Effectiveness of Reported Mediators in Associative Learning: A Historical Review and an Experimental Investigation. Psychonomic Bulletin & Review, 5, 587-614. https://doi.org/10.3758/BF03208837
Roy, M., & Chi, M. T. H. (2005). The Self-Explanation Principle in Multimedia Learning. In R. E. Mayer (Ed.), Cambridge Handbook of Multimedia Learning (pp. 271-286). New York: Cambridge University Press. https://doi.org/10.1017/CBO9780511816819.018
Sailors, M., & Price, L. R. (2010). Professional Development that Supports the Teaching of Cognitive Reading Strategy Instruction. The Elementary School Journal, 110, 301-322. https://doi.org/10.1086/648980
Seidenberg, M. (2017). Language at the Speed of Sight: How We Read, Why so Many Can’t, and What Can Be Done about It. New York: Basic Books
Shewhart, W. A. (1980). Economic Control of Quality of Manufactured Product. Milwaukee, WI: Quality Press.
Shulman, L. (1986). Paradigms and Research Programs in the Study of Teaching: A Contemporary Perspective. In M. C. Witrock (Ed.), Handbook of Research in Teaching (3rd ed., pp. 3-36). New York: Macmillan.
Shulman, L. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57, 1-23. https://doi.org/10.17763/haer.57.1.j463w79r56455411
Snow, C. E., Burns, M. S., & Griffin, P. (1998). Preventing Reading Difficulties in Young Children. Washington DC: National Academy Press.
Snow, C., & Griffin, P. (2007). Knowledge to Support the Teaching of Reading: Preparing Teachers for a Changing World. San Francisco, CA: Jossey-Bass.
Sparks, D., & Loucks-Horsely, S. (1990). Models of Staff Development. In J. Sikula (Ed.), Handbook of Research on Teacher Education (pp. 234-250). New York: MacMillan Publishing Company.
Taylor, M., & Otinsky, G. (2007). Becoming Whole Language Teachers and Social Justice Agents: Pre-Service Teachers Inquire with Sixth Graders. International Journal of Progressive Education, 3, 68-83. http://www.inased.org/v3n2/IJPEv3n2.pdf
Torgesen, J. K., Wagner, R. K., & Rashotte, C. A. (2014). Test of Word Reading Efficiency (2nd ed.). Austin, TX: Pro-Ed.
Truesdale, W. T. (2003). The Implementation of Peer Coaching on the Transferability of Staff Development to Classroom Practice in Two Selected Chicago Public Elementary Schools. Chicago, IL: Loyola University of Chicago.
Van Kuijk, M. F., Deunk, M. I., Bosker, R. J., & Ritzema, E. S. (2016). Goals, Data Use, and Instruction: The Effect of a Teacher Professional Development Program on Reading Achievement. School Effectiveness and School Improvement, 27, 135-156. https://doi.org/10.1080/09243453.2015.1026268
Vanderburg, M., & Stephens, D. (2010). The Impact of Literacy Coaches: What Teachers Value and How Teacher Change. Elementary School Journal, 111, 141-163. https://doi.org/10.1086/653473
Wenglinsky, H. (2000). How Teaching Matters: Bringing the Classroom Back into Discussions of Teacher Quality. A Policy Information Center Report. Princeton, NJ: The Milken Family Foundation and Educational Testing Service. http://files.eric.ed.gov/fulltext/ED447128.pdf
Wharton-McDonald, R., Pressley, M., & Hampston, J. M. (1998). Literacy Instruction in Nine First-Grade Classrooms: Teacher Characteristics and Student Achievement. The Elementary School Journal, 99, 101-128. https://doi.org/10.1086/461918
Yang, L., & Tsiatis, A. (2001). Efficiency Study of Estimators for a Treatment Effect in a Pretest-Posttest Trial. The American Statistician, 55, 314-321. https://doi.org/10.1198/000313001753272466
Yoon, K. S., Duncan, T., Lee, S. W., Scarloss, B., & Shapley, K. L. (2007). Reviewing the Evidence on How Teacher Professional Development Affects Student Achievement (Issues & Answer Report, RL, 2007-No. 033). Washington DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Southwest. https://files.eric.ed.gov/fulltext/ED498548.pdf