Evidence for the Reliability and Validity of the Arabic Version of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors (SRSS-IE) — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Evidence for the Reliability and Validity of the Arabic Version of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors (SRSS-IE)
Department of Special Education, College of Education, King Saud University, Riyadh, Kingdom of Saudi Arabia
,
Department of Special Education, College of Education, King Saud University, Riyadh, Kingdom of Saudi Arabia
1 Department of Special Education, College of Education, King Saud University, Riyadh, Kingdom of Saudi Arabia
2 Department of Special Education, College of Education, King Saud University, Riyadh, Kingdom of Saudi Arabia
School-based universal screening for behavioral/emotional risk is a necessary first step to providing services in an educational setting for students with emotional and behavioral disorders (EBDs). Psychometric properties are critical to making decisions about choosing a screening instrument. The purpose of the present study was to examine the psychometric properties of the student risk screening scale for internalizing and externalizing behaviors (SRSS-IE). Participants included 3145 students and their teachers. Item-level analyses of the current sample supported the retention of all items. The internal consistency of the SRSS items ranged from 0.83 to 0.85. Convergent validity between the SRSS-IE and a well-established screening tool, the strength and difficulties questionnaire (SDQ), was found for the total score (r = 0.70). Additionally, the results of this study demonstrate strong social validity, suggesting the SRSS-IE to be a useful and functional screening tool. We conclude that the SRSS-IE is a valid and reliable instrument for assessing the level of emotional and behavioral difficulties among elementary students.
KeywordsThe Student Risk Screening Scale for Internalizing and Externalizing Behaviors (SRSS-IE)Strength and Difficulties Questionnaire (SDQ)Emotional and Behavioral DifficultiesScreening ToolsSystematic Screening
United Nations (2023) Sustainable Development Goal 4: Quality Education in Saudi Arabia. https://saudiarabia.un.org/en/sdgs/4
Tang, Q. (2015) Goal 4: Ensure Inclusive and Equitable Quality Education and Promote Lifelong Learning Opportunities for All. UN Chron, 51, 11-12. https://link.gale.com/apps/doc/A417020502/AONE?u=anon~8237a3b5&sid=googleScholar&xid=406bc6c8 https://doi.org/10.18356/b2b87b7d-en
Celestial, W.J. (2019) A Historical Perspective of the Field of Emotional and Behavioral Disorders: A Review of Literature. International Journal of Psychology and Counselling, 11, 81-85. https://doi.org/10.5897/IJPC2019.0512
(2023) Saudi Vision 2030. https://www.vision2030.gov.sa/media/rc0b5oy1/saudi_vision203.pdf
(2023) The National Center for Mental Health Promotion. https://ncmh.org.sa/view/16/3th
Walker, H.M. and Gresham, F.M. (2013) Handbook of Evidence-Based Practices for Emotional and Behavioral Disorders: Applications in Schools. Guilford Publications, New York.
Zionts, P., Zionts, L. and Simpson, R.L. (2002) Emotional and Behavioral Problems: A Handbook for Understanding and Handling Students. Corwin Press, Thousand Oaks.
Lane, K.L., Menzies, H.M., Oakes, W.P. and Kalberg, J.R. (2011) Systematic Screenings of Behavior to Support Instruction: From Preschool to High School. Guilford Press, New York.
Hepburn, L. and Beamish, W. (2019) Towards Implementation of Evidence-Based Practices for Classroom Management in Australia: A Review of Research. Australian Journal of Teacher Education, 44, 82-98. https://doi.org/10.14221/ajte.2018v44n2.6
Cortes, K.E., Fricke, H., Loeb, S., Song, D.S. and York, B.N. (2023) When Behavioral Barriers Are Too High or Low—How Timing Matters for Text-Based Parenting Interventions. Econ. Economics of Education Review, 92, Article ID: 102352. https://doi.org/10.1016/j.econedurev.2022.102352
Kern, L., Weist, M.D., Mathur, S.R. and Barber, B.R. (2021) Empowering School Staff to Implement Effective School Mental Health Services. Behavioral Disorders, 47, 207-219. https://doi.org/10.1177/01987429211030860
Carlock, K., Nygaard, M.A. and Ormiston, H.E. (2023) School Principals’ Perceived Barriers and Facilitators to the Normalization of School-Based Mental Health Services: A Multimethod Investigation. School Mental Health, 15, 940-954. https://doi.org/10.1007/s12310-023-09597-8
Jenkins, L.N., Demaray, M.K., Wren, N.S., Secord, S.M., Lyell, K.M., Magers, A.M., Setmeyer, A.J., Rodelo, C., Newcomb-McNeal, E. and Tennant, J. (2014) A Critical Review of Five Commonly Used Social-Emotional and Behavioral Screeners for Elementary or Secondary Schools. Contemporary School Psychology, 18, 241-254. https://doi.org/10.1007/s40688-014-0026-6
Walker, H.M. and Severson, H.H. (1992) Systematic Screening for Behavior Disorders (SSBD). Pacific Northwest Publishing, Longmont.
Kalberg, J.R., Lane, K.L., Driscoll, S. and Wehby, J. (2011) Systematic Screening for Emotional and Behavioral Disorders at the High School Level. Remedial and Special Education, 32, 506-520. https://doi.org/10.1177/0741932510362508
Wood, B.J. and Ellis, F. (2022) Universal Mental Health Screening Practices in Midwestern Schools: A Window of Opportunity for School Psychologist Leadership and Role Expansion? Contemporary School Psychology. https://doi.org/10.1007/s40688-022-00430-8
Kamphaus, R.W. and Reynolds, C.R. (2007) BASC-2 Behavioral and Emotional Screening System. APA, Washington DC. https://doi.org/10.1037/t29902-000
Lane, K.L., Oakes, W. and Menzies, H. (2010) Systematic Screenings to Prevent the Development of Learning and Behavior Problems: Considerations for Practitioners, Researchers, and Policy Makers. Journal of Disability Policy Studies, 21, 160-172. https://doi.org/10.1177/1044207310379123
Stiffler, M.C. and Dever, B.V. (2015) Mental Health Screening at School. Springer, Dordrecht. https://doi.org/10.1007/978-3-319-19171-3
Harrison, J.R., Vannest, K.J. and Reynolds, C.R. (2013) Social Acceptability of Five Screening Instruments for Social, Emotional, and Behavioral Challenges. Behavioral Disorders, 38, 171-189. https://doi.org/10.1177/019874291303800305
Lane, K.L., Kalberg, J.R., Lambert, E.W., Crnobori, M. and Bruhn, A.L. (2009) A Comparison of Systematic Screening Tools for Emotional and Behavioral Disorders. Journal of Emotional and Behavioral Disorders, 18, 100-112. https://doi.org/10.1177/1063426609341069
Drummond, T. (1994) Student Risk Screening Scale. APA PsycTests. https://doi.org/10.1037/t27737-000
Lane, K.L. and Menzies, H.M. (2009) Student Risk Screening Scale for Early Internalizing and Externalizing Behavior (SRSS-IE). https://www.ci3t.org/screening
Oakes, W.P., Wilder, K.S., Lane, K.L., Powers, L., Yokoyama, L.T.K., O’Hare, M.E. and Jenkins, A.B. (2010) Psychometric Properties of the Student Risk Screening Scale: An Effective Tool for Use in Diverse Urban Elementary Schools. Assessment for Effective Intervention, 35, 231-239. https://doi.org/10.1177/1534508410379796
Lane, K.L., Bruhn, A.L., Eisner, S.L. and Kalberg, J.R. (2010) Score Reliability and Validity of the Student Risk Screening Scale: A Psychometrically Sound, Feasible Tool for Use in Urban Middle Schools. Journal of Emotional and Behavioral Disorders, 18, 211-224. https://doi.org/10.1177/1063426609349733
Lane, K.L., Richards-Tutor, C., Oakes, W.P. and Connor, K. (2013) Initial Evidence for the Reliability and Validity of the Student Risk Screening Scale with Elementary Age English Learners. Assessment for Effective Intervention, 39, 219-232. https://doi.org/10.1177/1534508413496836
Lane, K.L., Buckman, M.M., Common, E.A., Oakes, W.P., Lane, N.A., Schatschneider, C., Perez-Clark, P., Sherod, R.L. and Menzies, H.M. (2020) The Student Risk Screening Scale for Early Childhood: Additional Validation Studies. Topics in Early Childhood Special Education, 41, 129-146. https://doi.org/10.1177/0271121420922299
Lane, K.L., Menzies, H.M., Oakes, W.P., Lambert, W., Cox, M. and Hankins, K. (2012) A Validation of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Patterns in Rural and Urban Elementary Schools. Behavioral Disorders, 37, 244-270. https://doi.org/10.1177/019874291203700405
Lane, K.L., Oakes, W.P., Swogger, E.D., Schatschneider, C., Menzies, H.M. and Sanchez, J. (2015) Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Preliminary Cut Scores to Support Data-Informed Decision Making. Behavioral Disorders, 40, 159-170. https://doi.org/10.17988/0198-7429-40.3.159
Lane, K.L., Oakes, W.P., Buckman, M.M., Lane, N.A., Lane, K.S., Fleming, K., Romine, R.E.S., Sherod, R.L., Chang, C.N., Jones, J., et al. (2023) Examination of the Factor Structure and Measurement Invariance of the SRSS-IE. Remedial and Special Education. https://doi.org/10.1177/07419325231193147
Barger, B., Graybill, E., Roach, A. and Lane, K. (2020) Differential Item and Test Functioning of the SRSS-IE12 across Race, Ethnicity, Gender, and Elementary Level. Assessment for Effective Intervention, 47, 79-88. https://doi.org/10.1177/1534508420976830
Lane, K.L., Oakes, W.P., Monahan, K., Smith, A., Lane, K.S., Buckman, M.M., Lane, N.A. and Sherod, R. (2023) A Comparison of DESSA-Mini and SRSS-IE Screening Tools. Education and Treatment of Children, 46, 367-381. https://doi.org/10.1007/s43494-023-00106-9
Li, X., Zhu, Y.T., Jiao, D.D., Sawada, Y., Tanaka, E., Watanabe, T., Tomisaki, E., Zhu, Z., Ajmal, A., Matsumoto, M., et al. (2022) Subtyping of Internalizing and Externalizing Behaviors in Japanese Community-Based Children: A Latent Class Analysis and Association with Family Activities. Children, 9, Article 210. https://doi.org/10.3390/children9020210
Wild, D., Grove, A., Martin, M., Eremenco, S., McElroy, S., Verjee-Lorenz, A., Erikson, P. and ISPOR Task Force for Translation and Cultural Adaptation (2005) Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health, 8, 94-104. https://doi.org/10.1111/j.1524-4733.2005.04054.x
Schumacker, R.E. and Lomax, R.G. (2004) A Beginner’s Guide to Structural Equation Modeling. 2nd Edition, Lawrence Erlbaum Associates, Mahwah.
Sousa, V.D. and Rojjanasrirat, W. (2011) Translation, Adaptation and Validation of Instruments or Scales for Use in Cross-Cultural Health Care Research: A Clear and User-Friendly Guideline. Journal of Evaluation in Clinical Practice, 17, 268-274. https://doi.org/10.1111/j.1365-2753.2010.01434.x
Mondrzak, R., Reinert, C., Sandri, A., Spanemberg, L., Nogueira, E.L., Bertoluci, M., Eizirik, C.L., Furtado, N.R. and Pucrs, B. (2016) Translation and Cross-Cultural Adaptation of the Rating Scale for Countertransference (RSCT) to American English. Trends in Psychiatry and Psychotherapy, 38, 221-226. https://doi.org/10.1590/2237-6089-2015-0078
Goodman, R. (1997) The Strengths and Difficulties Questionnaire: A Research Note. Journal of Child Psychology and Psychiatry, 38, 581-586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x
Goodman, R. (2001) Psychometric Properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 1337-1345. https://doi.org/10.1097/00004583-200111000-00015
Goodman, A. and Goodman, R. (2009) Strengths and Difficulties Questionnaire as a Dimensional Measure of Child Mental Health. Journal of the American Academy of Child & Adolescent Psychiatry, 48, 400-403. https://doi.org/10.1097/CHI.0b013e3181985068
Muris, P., Meesters, C. and Berg, F.V.D. (2003) The Strengths and Difficulties Questionnaire (SDQ). European Child & Adolescent Psychiatry, 12, 1-8. https://doi.org/10.1007/s00787-003-0298-2
Bourdon, K.H., Goodman, R., Rae, D.S., Simpson, G. and Koretz, D.S. (2005) The Strengths and Difficulties Questionnaire: U.S. Normative Data and Psychometric Properties. Journal of the American Academy of Child & Adolescent Psychiatry, 44, 557-564. https://doi.org/10.1097/01.chi.0000159157.57075.c8
Lane, K.L. and Oakes, W.P. (2010) Social validity: Screening Tool Rating Scale.
Lane, L.K., Oakes, W.P., Cantwell, E.D., Schatschneider, C., Menzies, H., Crittenden, M. and Messenger, M. (2016) Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Preliminary Cut Scores to Support Data-Informed Decision Making in Middle and High Schools. Behavioral Disorders, 42, 271-284. https://doi.org/10.17988/BD-16-115.1
Cronbach, L.J. and Shavelson, R.J. (2004) My Current Thoughts on Coefficient Alpha and Successor Procedures. Educational and Psychological Measurement, 64, 391-418. https://doi.org/10.1177/0013164404266386
Furr, R.M. (2011) Scale Construction and Psychometrics for Social and Personality Psychology. SAGE, Thousand Oaks. https://doi.org/10.4135/9781446287866
Lane, K.L., Oakes, W.P., Harris, P.J., Menzies, H.M., Cox, M. and Lambert, W. (2012) Initial Evidence for the Reliability and Validity of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors at the Elementary Level. Behavioral Disorders, 37, 99-122. https://doi.org/10.1177/019874291203700204
Gregory, C., Graybill, E.C., Barger, B., Roach, A.T. and Lane, K. (2020) Predictive Validity of the Student Risk Screening Scale-Internalizing and Externalizing (SRSS-IE) Scores. Journal of Emotional and Behavioral Disorders, 29, 105-112. https://doi.org/10.1177/1063426620967283
Lane, K.L., Oakes, W.P., Cantwell, E.D., Common, E.A., Royer, D.J., Leko, M.M., Schatschneider, C., Menzies, H.M., Buckman, M.M. and Allen, G.E. (2018) Predictive Validity of Student Risk Screening Scale—Internalizing and Externalizing (SRSS-IE) Scores in Elementary Schools. Journal of Emotional and Behavioral Disorders, 27, 221-234. https://doi.org/10.1177/1063426618795443
Lane, K.L., Oakes, W.P., Menzies, H.M., Major, R., Allegra, L., Powers, L. and Schatschneider, C. (2014) The Student Risk Screening Scale for Early Childhood. Topics in Early Childhood Special Education, 34, 234-249. https://doi.org/10.1177/0271121414544801
Lane, K.L., Parks, R.J., Kalberg, J.R. and Carter, E.W. (2007) Systematic Screening at the Middle School Level. Journal of Emotional and Behavioral Disorders, 15, 209-222. https://doi.org/10.1177/10634266070150040301
Lane, K.L., Oakes, W.P., Cantwell, E.D., Royer, D.J., Leko, M.M., Schatschneider, C. and Menzies, H.M. (2018) Predictive Validity of Student Risk Screening Scale for Internalizing and Externalizing Scores in Secondary Schools. Journal of Emotional and Behavioral Disorders, 27, 86-100. https://doi.org/10.1177/1063426617744746
Lane, K.L., Oakes, W.P., Cantwell, E.D., Menzies, H.M., Schatschneider, C., Lambert, W. and Common, E.A. (2016) Psychometric Evidence of SRSS-IE Scores in Middle and High Schools. Journal of Emotional and Behavioral Disorders, 25, 233-245. https://doi.org/10.1177/1063426616670862
Lane, K.L., Oakes, W.P., Ennis, R.P., Cox, M.L., Schatschneider, C. and Lambert, W. (2011) Additional Evidence for the Reliability and Validity of the Student Risk Screening Scale at the High School Level. Journal of Emotional and Behavioral Disorders, 21, 97-115. https://doi.org/10.1177/1063426611407339
Lane, K.L., Oakes, W.P., Common, E.A., Brunsting, N., Zorigian, K., Hicks, T. and Lane, N.A. (2018) A Comparison between SRSS-IE and BASC-2 BESS Scores at the Middle School Level. Behavioral Disorders, 44, 162-174. https://doi.org/10.1177/0198742918794843
Lane, K.L., Oakes, W.P., Common, E.A., Zorigian, K., Brunsting, N.C. and Schatschneider, C. (2014) A Comparison between SRSS-IE and SSiS-PSG Scores. Assessment for Effective Intervention, 40, 114-126. https://doi.org/10.1177/1534508414560346
Lane, K.L., Oakes, W.P., Ennis, R.P. and Royer, D.J. (2015) Additional Evidence of Convergent Validity between SRSS-IE and SSiS-PSG Scores. Behavioral Disorders, 40, 213-229. https://doi.org/10.17988/0198-7429-40.4.213