Development and Validation of the Japanese-Translated Version of the Multiple-Choice Questionnaire of Depression Literacy (MCQ-DL) — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Development and Validation of the Japanese-Translated Version of the Multiple-Choice Questionnaire of Depression Literacy (MCQ-DL)
Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, Australia
,
Department of Psychology, College of Humanities and Sciences, Nihon University, Tokyo, Japan
,
Japan Society for the Promotion of Science, Tokyo, Japan
1 Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, Australia
2 Department of Psychology, College of Humanities and Sciences, Nihon University, Tokyo, Japan
3 Japan Society for the Promotion of Science, Tokyo, Japan
Although depression literacy plays a key role in encouraging people with depression to seek professional treatment, there exist no measures of depression literacy in Japan that are comparable to those validated in English-speaking countries. The present study therefore developed and validated a Japanese-translated version of the Multiple-Choice Questionnaire of Depression Literacy (MCQ-DL), which is rated as being of high quality by recent systematic reviews. We conducted an online two-wave survey ( N T1 = 325, N T2 = 180) and examined the psychometric properties of the full-item (27 items) and short (10 items) versions of the Japanese-translated MCQ-DL. Results provide several points of validity evidence for both versions as measures that capture individuals’ depression literacy profiles: 1) one-factor structures of these versions were supported by the data; and 2) the items used in both versions had a variety of difficulty and discrimination indices. Results also indicate several limitations of the Japanese-translated MCQ-DL for use in correlation-based and multivariate analyses: 1) internal consistencies seem insufficient (α = .68) and poor (α = .28) for the full-item and short versions, respectively; 2) the test-retest reliability was insufficient for the short version ( r = .51, p < .001, 95% CI [.40, .60]), 3) both the full-item and short versions of the MCQ-DL exhibited only weak correlations (| r | ≤ .22) with the other variables, including stigmatizing attitudes toward, and familiarity with, people with depression and components of empathy. The discussion highlights the usage of and further room for the validation of the Japanese-translated MCQ-DL we developed.
KeywordsDepressionMental Health LiteracyDepression LiteracyValidationJapan
American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders (5th ed.). Washington, DC: Author. https://doi.org/10.1176/appi.books.9780890425596
Bandalos, D. L. (2002). The Effects of Item Parceling on Goodness-of-Fit and Parameter Estimate Bias in Structural Equation Modeling. Structural Equation Modeling, 9, 78-102. https://doi.org/10.1207/S15328007SEM0901_5
Birnbaum, A. (1968). Some Latent Trait Models and Their Use in Inferring an Examinee’s Ability. In F. M. Lord & M. R. Novick (Eds.), Statistical Theories of Mental Test Scores (pp. 397-424). Reading, MA: Addison-Wesley.
Brislin, R. W. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1, 185-216. https://doi.org/10.1177/135910457000100301
Brislin, R. W. (1980). Translation and Content Analysis of Oral and Written Material. In H. C. Triandis & J. W. Berry (Eds.), Handbook of Crosscultural Psychology (Vol. 2, pp. 389-444). Boston: Allyn & Bacon.
Brislin, R. W., Lonner, W. J., & Thorndike, R. M. (1973). Cross-Cultural Research Methods. New York: Wiley.
Coffman, D. L., & MacCallum, R. C. (2005). Using Parcels to Convert Path Analysis Models into Latent Variable Models. Multivariate Behavioral Research, 40, 235-259. https://doi.org/10.1207/s15327906mbr4002_4
Corrigan, P. W., & Shapiro, J. R. (2010). Measuring the Impact of Programs that Challenge the Public Stigma of Mental Illness. Clinical Psychology Review, 30, 907-922. https://doi.org/10.1016/j.cpr.2010.06.004
Corrigan, P. W., Morris, S. B., Michaels, P. J., Rafacz, J. D., & Ruesch, N. (2012). Challenging the Public Stigma of Mental Illness: A Meta-Analysis of Outcome Studies. Psychiatric Services, 63, 963-973. https://doi.org/10.1176/appi.ps.201100529
Davis, M. H. (1980). A Multidimensional Approach to Individual Differences in Empathy. JSAS Catalog of Selected Documents in Psychology, 10, 85.
Davis, M. H. (1983). Measuring Individual-Differences in Empathy: Evidence for a Multidimensional Approach. Journal of Personality and Social Psychology, 44, 113-126. https://doi.org/10.1037/0022-3514.44.1.113
Evans-Lacko, S., Malcolm, E., West, K., Rose, D., London, J., Ruesch, N. et al. (2013). Influence of Time to Change’s Social Marketing Interventions on Stigma in England 2009-2011. British Journal of Psychiatry, 202, S77-S88. https://doi.org/10.1192/bjp.bp.113.126672
Finkelstein, J., & Lapshin, O. (2007). Reducing Depression Stigma Using a Web-Based Program. International Journal of Medical Informatics, 76, 726-734. https://doi.org/10.1016/j.ijmedinf.2006.07.004
Foster, S. D., Elischberger, H. B., & Hill, E. D. (2018). Examining the Link Between Socioeconomic Status and Mental Illness Prejudice: The Roles of Knowledge About Mental Illness and Empathy. Stigma and Health, 3, 139-151. https://doi.org/10.1037/sah0000084
Fricker, S., Galesic, M., Tourangeau, R., & Yan, T. (2005). An Experimental Comparison of Web and Telephone Surveys. Public Opinion Quarterly, 69, 370-392. https://doi.org/10.1093/poq/nfi027
Gabriel, A., & Violato, C. (2009). The Development of a Knowledge Test of Depression and Its Treatment for Patients Suffering from Non-Psychotic Depression: A Psychometric Assessment. BMC Psychiatry, 9, 56. https://doi.org/10.1186/1471-244X-9-56
Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004). Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions about Internet Questionnaires. American Psychologist, 59, 93-104. https://doi.org/10.1037/0003-066X.59.2.93
Gribbons, B. C., & Hocevar, D. (1998). Levels of Aggregation in Higher Level Confirmatory Factor Analysis: Application for Academic Self-Concept. Structural Equation Modeling, 5, 377-390. https://doi.org/10.1080/10705519809540113
Griffiths, K. M., Christensen, H., Jorm, A. F., Evans, K., & Groves, C. (2004). Effect of Web-Based Depression Literacy and Cognitive-Behavioural Therapy Interventions on Stigmatising Attitudes to Depression: Randomised Controlled Trial. British Journal of Psychiatry, 185, 342-349. https://doi.org/10.1192/bjp.185.4.342
Griffiths, K. M., Nakane, Y., Christensen, H., Yoshioka, K., Jorm, A. F., & Nakane, H. (2006). Stigma in Response to Mental Disorders: A Comparison of Australia and Japan. BMC Psychiatry, 6, 21. https://doi.org/10.1186/1471-244X-6-21
Hart, S. R., Kastelic, E. A., Wilcox, H. C., Beaudry, M. B., Musci, R. J., Heley, K. M., Swartz, K. L. et al. (2014). Achieving Depression Literacy: The Adolescent Depression Knowledge Questionnaire (ADKQ). School Mental Health, 6, 213-223. https://doi.org/10.1007/s12310-014-9120-1
Hashimoto, N., Suzuki, Y., Kato, T. A., Fujisawa, D., Sato, R., Aoyama-Uehara, K., Otsuka, K. et al. (2016). Effectiveness of Suicide Prevention Gatekeeper-Training for University Administrative Staff in Japan. Psychiatry and Clinical Neurosciences, 70, 62-70. https://doi.org/10.1111/pcn.12358
Henderson, C., & Thornicroft, G. (2009). Stigma and Discrimination in Mental Illness: Time to Change. The Lancet, 373, 1928-1930. https://doi.org/10.1016/S0140-6736(09)61046-1
Holmes, E. P., Corrigan, P. W., Williams, P., Canar, J., & Kubiak, M. A. (1999). Changing Attitudes about Schizophrenia. Schizophrenia Bulletin, 25, 447-456. https://doi.org/10.1093/oxfordjournals.schbul.a033392
Hu, L. T., & Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Structural Equation Modeling, 6, 1-55. https://doi.org/10.1080/10705519909540118
Jorm, A. F. (2012). Mental Health Literacy: Empowering the Community to Take Action for Better Mental Health. American Psychologist, 67, 231-243. https://doi.org/10.1037/a0025957
Jorm, A. F., Blewitt, K. A., Griffiths, K. M., Kitchener, B. A., & Parslow, R. A. (2005). Mental Health First Aid Responses of the Public: Results from an Australian National Survey. BMC Psychiatry, 5, 9. https://doi.org/10.1186/1471-244X-5-9
Kane, M. T. (2006). Validation. In R. B. Brennan (Ed.), Educational Measurement (4th ed., pp. 17-64). Westport, CT: American Council on Education/Praeger.
Kashihara, J. (2015). Examination of Stigmatizing Beliefs about Depression and Stigma-Reduction Effects of Education by Using Implicit Measures. Psychological Reports, 116, 337-362. https://doi.org/10.2466/15.PR0.116k20w9
Kashihara, J., & Sakamoto, S. (2018). Reducing Implicit Stigmatizing Beliefs and Attitudes toward Depression by Promoting Counterstereotypic Exemplars. Basic and Applied Social Psychology, 40, 87-103. https://doi.org/10.1080/01973533.2018.1441714
Kato, T. A., Suzuki, Y., Sato, R., Fujisawa, D., Uehara, K., Hashimoto, N., Otsuka, K. et al. (2010). Development of 2-Hour Suicide Intervention Program among Medical Residents: First Pilot Trial. Psychiatry and Clinical Neurosciences, 64, 531-540. https://doi.org/10.1111/j.1440-1819.2010.02114.x
Kiropoulos, L. A., Griffiths, K. M., & Blashki, G. (2011). Effects of a Multilingual Information Website Intervention on the Levels of Depression Literacy and Depression-Related Stigma in Greek-Born and Italian-Born Immigrants Living in Australia: A Randomized Controlled Trial. Journal of Medical Internet Research, 13, e34. https://doi.org/10.2196/jmir.1527
Kitchener, B. A., & Jorm, A. F. (2002a). Mental Health First Aid Manual. Canberra: Centre for Mental Health Research.
Kitchener, B. A., & Jorm, A. F. (2002b). Mental Health First Aid Training for the Public: Evaluation of Effects on Knowledge, Attitudes and Helping Behavior. BMC Psychiatry, 2, 10. https://doi.org/10.1186/1471-244X-2-10
Kitchener, B. A., & Jorm, A. F. (2008). Mental Health First Aid: An International Programme for Early Intervention. Early Intervention in Psychiatry, 2, 55-61. https://doi.org/10.1111/j.1751-7893.2007.00056.x
Krosnick, J. A. (1991). Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys. Applied Cognitive Psychology, 5, 213-236. https://doi.org/10.1002/acp.2350050305
Krosnick, J. A., Narayan, S. S., & Smith, W. R. (1996). Satisficing in Surveys: Initial Evidence. In M. T. Braverman, & J. K. Slater (Eds.), Advances in Survey Research (pp. 29-44). San Francisco, CA: Jossey-Bass.
Little, T. D., Cunningham, W. A., Shahar, G., & Widaman, K. F. (2002). To Parcel or Not to Parcel: Exploring the Question, Weighing the Merits. Structural Equation Modeling, 9, 151-173. https://doi.org/10.1207/S15328007SEM0902_1
Little, T. D., Rhemtulla, M., Gibson, K., & Schoemann, A. M. (2013). Why the Items versus Parcels Controversy Needn’t Be One. Psychological Methods, 18, 285-300. https://doi.org/10.1037/a0033266
Maniaci, M. R., & Rogge, R. D. (2014). Caring about Carelessness: Participant Inattention and Its Effects on Research. Journal of Research in Personality, 48, 61-83. https://doi.org/10.1016/j.jrp.2013.09.008
Marsh, H. W., Hau, K. T., Balla, J. R., & Grayson, D. (1998). Is More Ever Too Much? The Number of Indicators per Factor in Confirmatory Factor Analysis. Multivariate Behavioral Research, 33, 181-220. https://doi.org/10.1207/s15327906mbr3302_1
Muthén, L. K., & Muthén, B. O. (1998-2012). Mplus User’s Guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
Nakane, Y., Yoshioka, K., & Nakane, H. (2006). Perceptions of Mental Illness among Japanese: Results from Cross-Cultural Surveys of Mental Health Literacy in Japan and Australia. Japanese Bulletin of Social Psychiatry, 15, 25-38. (In Japanese)
Nunnally, J. C., & Bernstein, I. R. (1994). Psychometric Theory (3rd ed.). New York, NY: McGraw-Hill.
Paykel, E. S., Hart, D., & Priest, R. G. (1998). Changes in Public Attitudes to Depression during the Defeat Depression Campaign. British Journal of Psychiatry, 173, 519-522. https://doi.org/10.1192/bjp.173.6.519
Paykel, E. S., Tylee, A., Wright, A., Priest, R. G., Rix, S., & Hart, D. (1997). The Defeat Depression Campaign: Psychiatry in the Public Arena. American Journal of Psychiatry, 154, 59-66. https://doi.org/10.1176/ajp.154.6.59
R Development Core Team (2017). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. http://www.R-project.org
Rix, S., Paykel, E. S., Lelliott, P., Tylee, A., Freeling, P., Gask, L., & Hart, D. (1999). Impact of a National Campaign on GP Education: An Evaluation of the Defeat Depression Campaign. British Journal of General Practice, 49, 99-102.
Rusch, L. C., Kanter, J. W., & Brondino, M. J. (2009). A Comparison of Contextual and Biomedical Models of Stigma Reduction for Depression with a Nonclinical Undergraduate Sample. Journal of Nervous and Mental Disease, 197, 104-110. https://doi.org/10.1097/NMD.0b013e318192416f
Sakurai, S. (1988). The Relationship between Empathy and Helping Behavior in College Students. Bulletin of Nara University of Education, 37, 149-154. (In Japanese)
Sijtsma, K. (2009). On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha. Psychometrika, 74, 107-120. https://doi.org/10.1007/s11336-008-9101-0
StataCorp (2015). Stata Version 14 [Computer Software]. College Station, TX: StataCorp LP.
Suzuki, Y., Kato, T. A., Sato, R., Fujisawa, D., Aoyama-Uehara, K., Hashimoto, N., Otsuka, K. et al. (2014). Effectiveness of Brief Suicide Management Training Programme for Medical Residents in Japan: A Cluster Randomized Controlled Trial. Epidemiology and Psychiatric Sciences, 23, 167-176. https://doi.org/10.1017/S2045796013000334
Wei, Y. F., McGrath, P. J., Hayden, J., & Kutcher, S. (2015). Mental Health Literacy Measures Evaluating Knowledge, Attitudes and Help-Seeking: A Scoping Review. BMC Psychiatry, 15, 291. https://doi.org/10.1186/s12888-015-0681-9
Wei, Y. F., McGrath, P. J., Hayden, J., & Kutcher, S. (2016). Measurement Properties of Tools Measuring Mental Health Knowledge: A Systematic Review. BMC Psychiatry, 16, 297. https://doi.org/10.1186/s12888-016-1012-5
World Health Organization (2008). The Global Burden of Disease: 2004 Update. http://www.who.int/healthinfo/global_burden_disease/2004_report_update/en/
World Health Organization (2012a). Depression: A Global Crisis. http://www.who.int/mental_health/management/depression/wf mh_paper_depression_wmhd_2012.pdf
World Health Organization (2012b). Depression: A Global Public Health Concern. http://www.who.int/mental_health/management/depression/wh o_paper_depression_wfmh_2012.pdf
Yamakawa, I., Hirobiki, T., Honda, A., Machino, T., Okamura, N., Akiyama, M., Sakamoto, S. et al. (2012). The Effect of Depression Literacy and Emotional Valence Information on Anxiety about Suffering Depressive Disorder. Nihon University Psychological Research, 33, 49-57. (In Japanese)