Methods: Participants included 1103 adolescents from Hunan Province and Hainan Province in China. A confirmatory factor analysis (CFA) was conducted to determine the structure of the RRS on a large scale. Multiple CFAs were utilized to test the measurement invariance of the three subscales included in the RRS, across gender and age. Results: The RRS exhibited strong internal consistency (overall Cronbach’s alpha coefficient = 0.927) and internal reliability (0.362 - 0.864). The CFA showed a valid three-factor model. Measurement invariance of the model across gender and age was fully supported. Conclusions: Total RRS and sub-scales have accepted validity and reliability. Three-factor model of the RRS across gender and age was established. Measurement equivalence of the RRS across gender and age was established among Chinese adolescents. These findings suggest that the use of the RRS in comparing samples across gender and age is valid.
KeywordsRuminative Response ScaleFactor StructureMeasurement InvarianceGender and AgeChinese Adolescents
Abramson, L. Y., Metalsky, G. I., & Alloy, L. B. (1989). Hopelessness Depression: A Theory-Based Subtype of Depression. Psychological Bulletin, 96, 358-372. https://doi.org/10.1037//0033-295X.96.2.358
Aker, M., Harmer, C., & Landro, N. I. (2014). More Rumination and Less Effective Emotion Regulation in Previously Depressed Women with Preserved Executive Functions. BMC Psychiatry, 14, 334. https://doi.org/10.1186/s12888-014-0334-4
Arana, F. G., & Rice, K. G. (2017). Cross-Cultural Validity of the Ruminative Responses Scale in Argentina and the United States. Assesment. https://doi.org/10.1177/1073191117729204
Bastin, M., Vanhalst, J., Raes, F., & Bijttebier, P. (2018). Co-Brooding and Co-Reflection as Differential Predictors of Depressive Symptoms and Friendship Quality in Adolescents: Investigating the Moderating Role of Gender. Journal of Youth and Adolescence, 47, 1037-1051. https://doi.org/10.1007/s10964-017-0746-9
Black, S. W., & Possel, P. (2015). Integrating Beck’s Cognitive Model and the Response Style Theory in an Adolescent Sample. Journal of Youth and Adolescence, 44, 195-210. https://doi.org/10.1007/s10964-013-0087-2
Broderick, P. C., & Korteland, C. (2004). A Prospective Study of Rumination and Depression in Early Adolescence. Clinical Child Psychology and Psychiatry, 9, 383-394. https://doi.org/10.1177/1359104504043920
Butler, L. D., & Nolen-Hoeksema, S. (1994). Gender Differences in Responses to Depressed Mood in a College Sample. Sex Roles, 30, 331-346. https://doi.org/10.1007/BF01420597
Campbell, T. S., Labelle, L. E., Bacon, S. L., Faris, P., & Carlson, L. E. (2012). Impact of Mindfulness-Based Stress Reduction (MBSR) on Attention, Rumination and Resting Blood Pressure in Women with Cancer: A Waitlist-Controlled Study. Journal of Behavioral Medicine, 35, 262-271. https://doi.org/10.1007/s10865-011-9357-1
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9, 233-255. https://doi.org/10.1207/S15328007SEM0902_5
Connolly, S. L., Hamilton, J. L., Stange, J. P. et al. (2015). Rumination and Overgeneral Autobiographical Memory in Adolescents: An Integration of Cognitive Vulnerabilities to Depression. Journal of Youth and Adolescence, 44, 806-818. https://doi.org/10.1007/s10964-014-0090-2
Dickson, K. S., Ciesla, J. A., & Zelic, K. (2017). Role of Executive Functioning in Adolescent Rumination and Depression. Cognitive Therapy and Research, 41, 62-72. https://doi.org/10.1007/s10608-016-9802-0
Evers, A., Sijtsma, K., Lucassen, W., & Meijer, R. R. (2010). The Dutch Review Process for Evaluating the Quality of Psychological Tests: History, Procedure, and Results. International Journal of Testing, 10, 295-317. https://doi.org/10.1080/15305058.2010.518325
Extremera, N., & Fernández-Berrocal, P. (2006). Validity and Reliability of Spanish Versions of the Ruminative Responses Scale-Short Form and the Distraction Responses Scale in a Sample of Spanish High School and College Students. Psychological Reports, 98, 141-150. https://doi.org/10.2466/pr0.98.1.141-150
Fornell, C., & Larcker, D. F. (1981). Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research, 18, 39-50. https://doi.org/10.1177/002224378101800104
Gotham, K. O., Siegle, G. J., Han, G. T. et al. (2018). Pupil Response to Social-Emotional Material Is Associated with Rumination and Depressive Symptoms in Adults with Autism Spectrum Disorder. PLoS ONE, 3, e0200340. https://doi.org/10.1371/journal.pone.0200340
Gunn, J., & Petersen, A. C. (1991). Studying the Emergence of Depression and Depressive Symptoms during Adolescence. Journal of Youth & Adolescence, 20, 115-119. https://doi.org/10.1007/BF01537603
Hasegawa, A. (2013). Translation and Internal Validation of the Japanese Version of the Ruminative Responses Scale. Psychological Reports, 112, 716-726. https://doi.org/10.2466/02.08.PR0.112.3.716-726
Johnson, E. C., Meade, A. W., & Braddy, P. W. (2008). Power and Sensitivity of Alternative Fit Indices in Tests of Measurement Invariance. Journal of Applied Psychology, 93, 568-592. https://doi.org/10.1037/0021-9010.93.3.568
Jos, P. E., & Weir, K. F. (2013). How Is Anxiety Involved in the Longitudinal Relationship between Brooding Rumination and Depressive Symptoms in Adolescents? Journal of Youth and Adolescence, 42, 1210-1222. https://doi.org/10.1007/s10964-012-9891-3
Kessler, R. C., Avenevoli, S., & Merikangas, K. R. (2001). Mood Disorders in Children and Adolescents: An Epidemiologic Perspective. Biological Psychiatry, 49, 1002-1014. https://doi.org/10.1016/S0006-3223(01)01129-5
Kline, R. B. (2005). Principles and Practice of Structural Equation Modeling (2nd ed., pp. 365-386). New York: Guilford.
Lee, S., & Kim, W. (2014). Cross-Cultural Adaptation, Reliability, and Validity of the Revised Korean Version of Ruminative Response Scale. Psychiatry Investigation, 11, 59-64. https://doi.org/10.4306/pi.2014.11.1.59
Lei, X., Zhong, M., Liu, Y. et al. (2017). Psychometric Properties of the 10-Item Ruminative Response Scale in Chinese University Students. BMC Psychiatry, 17, 152. https://doi.org/10.1186/s12888-017-1318-y
LeMoult, J., Humphreys, K. L., King, L. S. et al. (2019). Associations among Early Life Stress, Rumination, Symptoms of Psychopathology, and Sex in Youth in the Early Stages of Puberty: A Moderated Mediation Analysis. Journal of Abnormal Child Psychology, 47, 199-207. https://doi.org/10.1007/s10802-018-0430-x
Liverant, G. I., Kamholz, B. W., Sloan, D. M., & Brown, T. A. (2011). Rumination in Clinical Depression: A Type of Emotional Suppression? Cognitive Therapy and Research, 35, 253-265. https://doi.org/10.1007/s10608-010-9304-4
Lucena-Santos, P., Pinto-Gouveia, J., Carvalho, S. A., & da Silva Oliveira, M. (2018). Is the Widely Used Two-Factor Structure of the Ruminative Responses Scale Invariant across Different Samples of Women? Psychological Psychotherapy, 91, 398-416. https://doi.org/10.1111/papt.12168
Madian, N., Bredemeier, K., Heller, W., Miller, G. A., & Warren, S. L. (2018). Repetitive Negative Thought and Executive Dysfunction: An Interactive Pathway to Emotional Distress. Cognitive Therapy and Research, 43, 464-480.
McMurrich, S. L., & Johnson, S. L. (2008). Dispositional Rumination in Individuals with a Depression History. Cognitive Therapy and Research, 32, 542-553. https://doi.org/10.1007/s10608-006-9093-y
Moberly, N. J., & Watkins, E. R. (2008). Ruminative Self-Focus and Negative Affect: An Experience Sampling Study. Journal of Abnormal Psychology, 117, 314-323. https://doi.org/10.1037/0021-843X.117.2.314
Nolen-Hoecksema, S., Girgus, J. S., & Seligman, M. E. (1992). Predictors and Consequences of Childhood Depressive Symptoms: A 5-Year Longitudinal Study. Journal of Abnormal Psychology, 101, 405-422. https://doi.org/10.1037/0021-843X.101.3.405
Nolen-Hoeksema, S. (1987). Sex Differences in Unipolar Depression: Evidence and Theory. Psychological Bulletin, 101, 259-282.
Nolen-Hoeksema, S. (1991). Responses to Depression and Their Effects on the Duration of Depressive Episodes. Journal of Abnormal Psychology, 100, 569-582.
Nolen-Hoeksema, S., & Girgus, J. S. (1994). The Emergence of Gender Differences in Depression during Adolescence. Psychological Bulletin, 115, 424-443. https://doi.org/10.1037/0033-2909.115.3.424
Paredes, P. P., & Zumalde, E. C. (2015). A Test of the Vulnerability-Stress Model with Brooding and Reflection to Explain Depressive Symptoms in Adolescence. Journal of Youth and Adolescence, 44, 860-869. https://doi.org/10.1007/s10964-014-0148-1
Prince, M. (2008). Measurement Validity in Cross-Cultural Comparative Research. Epidemiologia E Psichiatria Sociale, 17, 211-220. https://doi.org/10.1017/S1121189X00001305
Sarkisian, K. L., Van Hulle, C. A., & Goldsmith, H. (2019). Brooding, Inattention, and Impulsivity as Predictors of Adolescent Suicidal Ideation. Journal of Abnormal Child Psychology, 47, 333-344. https://doi.org/10.1007/s10802-018-0435-5
Schoofs, H., Heamans, D., & Raes, F. (2010). Brooding and Reflection as Subtypes of Rumination: Evidence from Confirmatory Factor Analysis in Nonclinical Samples Using the Dutch Ruminative Responses Scale. Journal of Psychopathology and Behavioral Assessment, 32, 609-617. https://doi.org/10.1007/s10862-010-9182-9
Shin, K. M., Cho, S. M., & Kim, K. H. (2015). A Validation Study of the Korean Ruminative Response Scale in Korean Adolescents. Psychiatry Investigation, 12, 508-515. https://doi.org/10.4306/pi.2015.12.4.508
Stringars, A., & Goodman, R. (2013). The Value of Measuring Impact alongside Symptoms in Children and Adolescents: A Longitudinal Assessment in a Community Sample. Journal of Abnormal Child Psychology, 41, 1109-1120. https://doi.org/10.1007/s10802-013-9744-x
Thomsen, D. K., Jensen, A. B., Jensen, T. et al. (2013). Rumination, Reflection and Distress: An 8-Month Prospective Study of Colon-Cancer Patients. Cognitive Therapy and Research, 37, 1262-1268. https://doi.org/10.1007/s10608-013-9556-x
Thomsen, D. K., Schnieber, A., & Olesen, M. H. (2011). Rumination Is Associated with the Phenomenal Characteristics of Autobiographical Memories and Future Scenarios. Memory, 19, 574-584. https://doi.org/10.1080/09658211.2011.591533
Topper, M., Emmelkamp, P. M., Watkins, E., & Ehring, T. (2014). Development and Assessment of Brief Versions of the Penn State Worry Questionnaire and the Ruminative Response Scale. British Journal of Clinical Psychology, 53, 402-421. https://doi.org/10.1111/bjc.12052
Treynor, W., Gonzalez, R., & Nolen-Hoeksema, S. (2003). Rumination Reconsidered: A Psychometric Analysis. Cognitive Therapy and Research, 27, 247-259. https://doi.org/10.1023/A:1023910315561
Tsaousis, I., & Kazi, S. (2013). Factorial Invariance and Latent Mean Differences of Scores on Trait Emotional Intelligence across Gender and Age. Personality & Individual Differences, 54, 169-173. https://doi.org/10.1016/j.paid.2012.08.016
Whisman, M. A., Miranda, R., Fresco, D. M., Heimberg, R. G., Jeglic, E. L., & Weinstock, L. M. (2018). Measurement Invariance of the Ruminative Responses Scale across Gender. Assessment. https://doi.org/10.1177/1073191118774131
Wilkinson, P. O., & Goodyer, I. M. (2008). The Effects of Cognitive-Behavioural Therapy on Mood-Related Ruminative Response Style in Depressed Adolescents. Child and Adolescent Psychiatry and Mental Health, 2, 3. https://doi.org/10.1186/1753-2000-2-3
Wilkinson, P. O., Croudace, T. J., & Goodyer, I. M. (2013). Rumination, Anxiety, Depressive Symptoms and Subsequent Depression in Adolescents at Risk for Psychopathology: A Longitudinal Cohort Study. BMC Psychiatry, 13, 250. https://doi.org/10.1186/1471-244X-13-250
Xavier, A., Cunha, M., & Pinto-Gouveia, J. (2016). Rumination in Adolescence: The Distinctive Impact of Brooding and Reflection on Psychopathology. The Spanish Journal of Psychology, 19, E37. https://doi.org/10.1017/sjp.2016.41