A 3-Faced Construct Validation and a Bifactor Subjective Well-Being Model Using the Scale of Positive and Negative Experience, Greek Version — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
A 3-Faced Construct Validation and a Bifactor Subjective Well-Being Model Using the Scale of Positive and Negative Experience, Greek Version
Department of Psychology, Panteion University, Athens, Greece
,
Department of Psychology, Panteion University, Athens, Greece
,
Department of Psychology, Panteion University, Athens, Greece
,
Department of Psychology, Panteion University, Athens, Greece
1 Department of Psychology, Panteion University, Athens, Greece
2 Department of Psychology, Panteion University, Athens, Greece
3 Department of Psychology, Panteion University, Athens, Greece
4 Department of Psychology, Panteion University, Athens, Greece
The present study focused on the dimensionality of the Scale of Positive and Negative Experience (SPANE) by: 1) providing evidence that the Greek version of SPANE is a robust affect measure; 2) constructing a new, briefer SPANE version, the SPANE-8 with promising psychometric profile. The construct validation was implemented on 2272 Greek adults using the “3-faced construct validation method”, a construct validation procedure based on sample-splitting. Sample was split in three parts. EFA and Bifactor EFA models were evaluated in the 20% subsample. Then, in the 40% subsample, a total of 10 CFA models were examined (ICM-CFA, Bifactor CFA, ESEM and Bifactor ESEM models). The optimal models of SPANE-12 and SPANE-8 were successfully cross-validated in another 40% subsample. Strict measurement invariance, using the optimal model as a baseline model was successful for both SPANE versions. Reliability (α and ω) and AVE convergent validity were also satisfactory. Correlation analysis based on 10 different measures showed a consistent scheme of relations for both versions. Finally, a Bifactor CFA subjective well-being model using SPANE to measure affect was adequately fitted. In sum, the Greek version of SPANE-12 and the new SPANE-8 are invariant, reliable and valid measures of affect. Normative data are made available.
KeywordsSPANE3-Faced Construct Validation MethodESEMBifactor EFABifactor CFABifactor ESEMSubjective Well-Being Model
Awang, Z., Afthanorhan, A., & Asri, M. A. M. (2015). Parametric and Non Parametric Approach in Structural Equation Modeling (SEM): The Application of Bootstrapping. Modern Applied Science, 9, 58-67. https://doi.org/10.5539/mas.v9n9p58
Bai, X., Wu, C., Zheng, R., & Ren, X. (2011). The Psychometric Evaluation of the Satisfaction with Life Scale Using a Nationally Representative Sample of China. Journal of Happiness Studies, 12, 183-197. https://doi.org/10.1007/s10902-010-9186-x
Bentler, P. M., & Yuan, K. H. (1999). Structural Equation Modeling with Small Samples: Test of Global Self-Esteem. Journal of Personality and Social Psychology, 89, 623-642.
Brislin, R. W. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1, 185-216. https://doi.org/10.1177/135910457000100301
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (2nd ed.). New York: Guilford Publications.
Byrne, B. M. (2010). Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming (2nd ed.). New York: Routledge.
Chen, F. F. (2007). Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling, 14, 464-504. https://doi.org/10.1080/10705510701301834
Clark, D. A., Steer, R. A., & Beck, A. T. (1994). Common and Specific Dimensions of Self-Reported Anxiety and Depression: Implications for the Cognitive and Tripartite Models. Journal of Abnormal Psychology, 103, 645-654. https://doi.org/10.1037/0021-843X.103.4.645
Clark, L., & Watson, D. (1991). Tripartite Model of Anxiety and Depression: Psychometric Evidence and Taxonomic Implications. Journal of Abnormal Psychology, 100, 316-336. https://doi.org/10.1037/0021-843X.100.3.316
Comrey, A. L., & Lee, H. B. (1992). A First Course in Factor Analysis (2nd ed.). Hillsdale, NJ: Erlbaum.
Costa, P. T., & McCrae, R. R. (1980). Influence of Extraversion and Neuroticism on Subjective Well-Being: Happy and Unhappy People. Journal of Personality and Social Psychology, 38, 668-678. https://doi.org/10.1037/0022-3514.38.4.668
Crawford, J. R., & Henry, J. D. (2004). The Positive and Negative Affect Schedule (PANAS): Construct Validity, Measurement Properties and Normative Data in a Large Non-Clinical Sample. British Journal of Clinical Psychology, 43, 245-265. https://doi.org/10.1348/0144665031752934
Cronbach, L. J. (1951). Coefficient Alpha and the Internal Structure of Tests. Psychometrika, 16, 297-334. https://doi.org/10.1007/BF02310555
Damasio, B., & Koller, S. H. (2015). Meaning in Life Questionnaire: Adaptation Process and Psychometric Properties of the Brazilian Version. Revista Latinoamericana de Psicología, 47, 185-195. https://doi.org/10.1016/j.rlp.2015.06.004
DeVellis, R. F. (2017). Scale Development: Theory and Applications (4th ed.). Thousand Oaks, CA: Sage.
Diener, E. (1984). Subjective Well-Being. Psychological Bulletin, 95, 542-575. https://doi.org/10.1037/0033-2909.95.3.542
Diener, E. D., Colvin, C. R., Pavot, W. G., & Allman, A. (1991). The Psychic Costs of Intense Positive Affect. Journal of Personality and Social Psychology, 61, 492-503. https://doi.org/10.1037/0022-3514.61.3.492
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49, 71-75. https://doi.org/10.1207/s15327752jpa4901_13
Diener, E., Sandvik, E., & Pavot, W. (1991). Happiness Is the Frequency, Not the Intensity, of Positive versus Negative Affect. In F. Strack, M. Argyle, & N. Schwarz (Eds.), Subjective Well-Being: An Interdisciplinary Perspective (pp. 213-231). Dordrecht: Springer.
Diener, E., Suh, E. M., Lucas, R. E., & Smith, H. L. (1999). Subjective Well-Being: Three Decades of Progress. Psychological Bulletin, 125, 276-302. https://doi.org/10.1037/0033-2909.125.2.276
Diener, E., Wirtz, D., Biswas-Diener, R., Tov, W., Kim-Prieto, C., Choi, D., & Oishi, S. (2009). New Measures of Well-Being. In E. Diener (Eds.), Assessing Well-Being. Social Indicators Research Series (Vol. 39, pp. 247-266). Dordrecht: Springer. https://doi.org/10.1007/978-90-481-2354-4_12
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D, Oishi, S., & Biswas-Diener, R. (2010). New Well-Being Measures: Short Scales to Assess Flourishing and Positive and Negative Feelings. Social Indicators Research, 97, 143-156. https://doi.org/10.1007/s11205-009-9493-y
Doornik, J. A., & Hansen, H. (2008). An Omnibus Test for Univariate and Multivariate Normality. Oxford Bulletin of Economics and Statistics, 70, 927-939. https://doi.org/10.1111/j.1468-0084.2008.00537.x
Fornell, C., & Larcker, D. F. (1981). Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics. Journal of Marketing Research, 18, 382-388. https://doi.org/10.2307/3150980
Giuntoli, L., Ceccarini, F., Sica, C., & Caudek, C. (2017). Validation of the Italian Versions of the Flourishing Scale and of the Scale of Positive and Negative Experience. SAGE Open, 7, 1-12.
Govindji, R., & Linley, P. A. (2007). Strengths Use, Self-Concordance and Well-Being: Implications for Strengths Coaching and Coaching Psychologists. International Coaching Psychology Review, 2, 143-153.
Gray, E. K., & Watson, D. (2007). Assessing Positive and Negative Affect via Self-Report. In J. A. Coan, & J. J. B. Allen (Eds.), Handbook of Emotional Elicitation and Assessment (pp. 171-183). New York: Oxford University Press.
Guadagnoli, E., & Velicer, W. F. (1988). Relation to Sample Size to the Stability of Component Patterns. Psychological Bulletin, 103, 265-275. https://doi.org/10.1037/0033-2909.103.2.265
Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate Data Analysis (7th ed.). Upper Saddle River, NJ: Prentice-Hall, Inc.
Hammer, J. H., & Toland, M. D. (2016). Bifactor Analysis in Mplus. Lexington, KY: University of Kentucky. http://sites.education.uky.edu/apslab/upcoming-events/
Henze, N., & Zirkler, B. (1990). A Class of Invariant Consistent Tests for Multivariate Normality. Communications in Statistics: Theory and Methods, 19, 3595-3617. https://doi.org/10.1080/03610929008830400
Hoque, A. S., Awang, Z., Jusoff, K., Salleh, F., & Muda, H. (2017). Social Business Efficiency: Instrument Development and Validation Procedure Using Structural Equation Modeling. International Business Management, 11, 222-231.
Howard, J., Gagné, M., Morin, A. J. S., Wang, Z. N., & Forest, J. (2016). Using Bifactor Exploratory Structural Equation Modeling to Test for a Continuum Structure of Motivation. Journal of Management, 1-59.
Hu, L., & Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Structural Equation Modeling, 6, 1-55. https://doi.org/10.1080/10705519909540118
IBM (2017). IBM SPSS Statistical Software, Release 25. Spring House, PA: IBM Corporation.
Jennrich, R. I., & Bentler, P. M. (2011). Exploratory Bi-Factor Analysis. Psychometrika, 76, 537-549. https://doi.org/10.1007/s11336-011-9218-4
Jolly, J. B., Dyck, M. J., Kramer, T. A., & Wherry, J. N. (1994). Integration of Positive and Negative Affectivity and Cognitive Content-Specificity: Improved Discrimination of Anxious and Depressive Symptoms. Journal of Abnormal Psychology, 103, 544-552. https://doi.org/10.1037/0021-843X.103.3.544
Joshanloo, M., & Jovanovic, V. (2016). The Factor Structure of the Mental Health Continuum-Short Form (MHC-SF) in Serbia: An Evaluation Using Exploratory Structural Equation Modeling. Journal of Mental Health, 26, 510-515. https://doi.org/10.1080/09638237.2016.1222058
Joshanloo, M., Jose, P. E., & Kielpikowski, M. (2017). The Value of Exploratory Structural Equation Modeling in Identifying Factor Overlap in the Mental Health Continuum-Short Form (MHC-SF): A Study with a New Zealand Sample. Journal of Happiness Studies, 18, 1061-1074. https://doi.org/10.1007/s10902-016-9767-4
Jovanović, V. (2015). Beyond the PANAS: Incremental Validity of the Scale of Positive and Negative Experience (SPANE) in Relation to Well-Being. Personality and Individual Differences, 86, 487-491. https://doi.org/10.1016/j.paid.2015.07.015
Kashdan, T. B., Biswas-Diener, R., & King, L. A. (2008). Reconsidering Happiness: The Costs of Distinguishing between Hedonics and Eudaimonia. The Journal of Positive Psychology, 3, 219-233. https://doi.org/10.1080/17439760802303044
Keyes, C. L. M. (2002). The Mental Health Continuum: From Languishing to Flourishing in Life. Journal of Health and Social Behavior, 43, 207-222. https://doi.org/10.2307/3090197
Keyes, C. L. M. (2005). The Subjective Well-Being of America’s Youth: Toward a Comprehensive Assessment. Adolescent and Family Health, 4, 3-11.
Keyes, C. L. M. (2006). Subjective Well-Being in Mental Health and Human Development Research Worldwide: An Introduction. Social Indicators Research, 77, 1-10. https://doi.org/10.1007/s11205-005-5550-3
Keyes, C. L. M., & Magyar-Moe, J. L. (2003). The Measurement and Utility of Adult Subjective Well-Being. In S. J. Lopez, & C. R. Snyder (Eds.), Positive Psychological Assessment: A Handbook of Models and Measures (pp. 411-425). Washington DC: American Psychological Association. https://doi.org/10.1037/10612-026
Keyes, C. L. M., Wissing, M., Potgieter, J., Temane, M., Kruger, A., & van Rooy, S. (2008). Evaluation of the Mental Health Continuum-Short Form (MHC-SF) in Setswana-Speaking South Africans. Clinical Psychology and Psychotherapy, 15, 181-192. https://doi.org/10.1002/cpp.572
Kline, P. (2000). Handbook of Psychological Testing. London, UK: Routledge.
Kline, R. B. (2016). Principles and Practice of Structural Equation Modeling (4th ed.). New York: The Guilford Press.
Kyriazos, T. A., Stalikas, A., Prassa, K., & Yotsidi, V. (in press). Can the Depression Anxiety Stress Scales Short Be Shorter? Factor Structure and Measurement Invariance of DASS-21 and DASS-9 in a Greek, Non-Clinical Sample. Psychology.
Li, F., Bai, X., & Wang, Y. (2013). The Scale of Positive and Negative Experience (SPANE): Psychometric Properties and Normative Data in a Large Chinese Sample. PLoS ONE, 8, e61137. https://doi.org/10.1371/journal.pone.0061137
Linley, P. A., Maltby, J., Wood, A. M., Osborne, G., & Hurling, R. (2009). Measuring Happiness: The Higher Order Factor Structure of Subjective and Psychological Well-Being Measures. Personality and Individual Differences, 47, 878-884. https://doi.org/10.1016/j.paid.2009.07.010
Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the Depression Anxiety Stress Scales. Sydney, Australia: Psychology Foundation.
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power Analysis and Determination of Sample Size for Covariance Structure Modeling. Psychological Methods, 1, 130-149. https://doi.org/10.1037/1082-989X.1.2.130
Maltby, J., Day, L., & Barber, L. (2005). Forgiveness and Happiness. The Differing Contexts of Forgiveness Using the Distinction between Hedonic and Eudaimonic Happiness. Journal of Happiness Studies, 6, 1-13. https://doi.org/10.1007/s10902-004-0924-9
Mardia, K. V. (1970). Measures of Multivariate Skewness and Kurtosis with Applications. Biometrika, 57, 519-530. https://doi.org/10.1093/biomet/57.3.519
Marsh, H. W., Ludtke, O., Nagengast, B., Morin, A. J. S., & Von Davier, M. (2013). Why Item Parcels Are (Almost) Never Appropriate: Two Wrongs Do Not Make a Right—Camouflaging Misspecification with Item Parcels in CFA Models. Psychological Methods, 18, 257-284. https://doi.org/10.1037/a0032773
Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014). Exploratory Structural Equation Modeling: An Integration of the Best Features of Exploratory and Confirmatory Factor Analysis. Annual Review of Clinical Psychology, 10, 85-110. https://doi.org/10.1146/annurev-clinpsy-032813-153700
Massey, F. J. (1951). The Kolmogorov-Smirnov Tests for Goodness of Fit. Journal of American Statistical Association, 46, 68-78. https://doi.org/10.1080/01621459.1951.10500769
McCullough, M. E., Emmons, R. A., & Tsang, J. (2002). The Grateful Disposition: A Conceptual and Empirical Topography. Journal of Personality and Social Psychology, 82, 112-127. https://doi.org/10.1037/0022-3514.82.1.112
McDonald, R. P. (1999). Test Theory: A Unified Treatment. Mahwah, NJ: Erlbaum.
Muthen, B., & Asparouhov, T. (2002). Using Mplus Monte Carlo Simulations in Practice: A Note on Non-Normal Missing Data in Latent Variable Models. Mplus Web Notes: No. 2.
Muthen, L. K., & Muthen, B. O. (2012). Mplus Statistical Software, 1998-2012. Los Angeles, CA: Muthén & Muthé.
Norrish, J. M., & Vella-Brodrick, D. A. (2008). Is the Study of Happiness a Worthy Scientific Pursuit? Social Indicators Research, 87, 393-407. https://doi.org/10.1007/s11205-007-9147-x
Nunnally, J., & Berstein, I. (1994). Psychometric Theory. New York: McGraw-Hill.
Oishi, S., Schimmack, U., & Colcombe, S. (2003). The Contextual and Systematic Nature of Life Satisfaction Judgments. Journal of Experimental Social Psychology, 39, 232-247. https://doi.org/10.1016/S0022-1031(03)00016-7
Osborne, J. W., & Costello, A. B. (2004). Sample Size and Subject to Item Ratio in Principal Components Analysis. Practical Assessment, Research & Evaluation, 9, 1-9.
Pavot, W., & Diener, E. (1993). The Affective and Cognitive Context of Self-Reported Measures of Subjective Well-Being. Social Indicators Research, 28, 1-20. https://doi.org/10.1007/BF01086714
Rahm, T., Heise, E., & Schuldt, M. (2017). Measuring the Frequency of Emotions—Validation of the Scale of Positive and Negative Experience (SPANE) in Germany. PLoS ONE, 12, e071288. https://doi.org/10.1371/journal.pone.0171288
Reise, S. (2012). The Rediscovery of Bifactor Measurement Models. Multivariate Behavioral Research, 47, 667-696. https://doi.org/10.1080/00273171.2012.715555
Reise, S. P., Morizot, J., & Hays, R. D. (2007). The Role of the Bifactor Model in Resolving Dimensionality Issues in Health Outcomes Measures. Quality of Life Research, 16, 19-31. https://doi.org/10.1007/s11136-007-9183-7
Ruini, C. (2017). Positive Psychology in the Clinical Domains, Research and Practice. Netherlands: Springer. https://doi.org/10.1007/978-3-319-52112-1
Russell, J. A. (1980). A Circumplex Model of Affect. Journal of Personality and Social Psychology, 39, 1161-1178. https://doi.org/10.1037/h0077714
Russell, J. A., & Carroll, J. M. (1999). On the Bipolarity of Positive and Negative Affect. Psychological Bulletin, 125, 3-30. https://doi.org/10.1037/0033-2909.125.1.3
Ryan, R. M, & Deci, E. L. (2001). On Happiness and Human Potentials: A Review of Research on Hedonic and Eudaimonic Well-Being. Annual Review of Psychology, 52, 141-166. https://doi.org/10.1146/annurev.psych.52.1.141
Ryff, C. D. (1989). Happiness Is Everything, or Is It? Explorations on the Meaning of Psychological Wellbeing. Journal of Personality and Social Psychology, 57, 1069-1081. https://doi.org/10.1037/0022-3514.57.6.1069
Ryff, C. D., & Keyes, C. L. M. (1995). The Structure of Psychological Well-Being Revisited. Journal of Personality and Social Psychology, 69, 719-727. https://doi.org/10.1037/0022-3514.69.4.719
Schimmack, U., Diener, E., & Oishi, S. (2002). Life-Satisfaction Is a Momentary Judgment and a Stable Personality Characteristic: The Use of Chronically Accessible and Stable Sources. Journal of Personality, 70, 345-384. https://doi.org/10.1111/1467-6494.05008
Schmid, J., & Leiman, J. N. (1957). The Development of Hierarchical Factor Solutions. Psychometrika, 22, 53-61. https://doi.org/10.1007/BF02289209
Schumacker, R. E., & Lomax, R. G. (2015). A Beginner’s Guide to Structural Equation Modeling (4th ed.). New York: Routledge.
Silva, A., & Caetano, A. (2013). Validation of the Flourishing Scale and Scale of Positive and Negative Experience in Portugal. Social Indicators Research, 110, 469-478. https://doi.org/10.1007/s11205-011-9938-y
Singh, K., Junnarkar, M., & Jaswal, S., (2017). Validating the Flourishing Scale and the Scale of Positive and Negative Experience in India. Mental Health, Religion & Culture 19, 943-954.
Singh, K., Junnarkar, M., & Kaur, J. (2016). Measures of Positive Psychology, Development and Validation. Berlin: Springer. https://doi.org/10.1007/978-81-322-3631-3
Skevington, S. M. (1999). Measuring Quality of Life in Britain: Introducing the WHOQOL-100. Journal of Psychosomatic Research, 47, 5449-5459. https://doi.org/10.1016/S0022-3999(99)00051-3
Skevington, S. M., Lotfy, M., & O’Connell, K. A. (2004). The World Health Organization’s WHOQOL-BREF Quality of Life Assessment: Psychometric Properties and Results of the International Field Trial: A Report from the WHOQOL Group. Quality of Life Research, 13, 299-310. https://doi.org/10.1023/B:QURE.0000018486.91360.00
Smith, B. W., Dalen, J., Wiggins, K., Tooley, E., Christopher, P., & Bernard, J. (2008). The Brief Resilience Scale: Assessing the Ability to Bounce Back. International Journal of Behavioral Medicine, 15, 194-200. https://doi.org/10.1080/10705500802222972
Snyder, C. R., Harris, C., Anderson, J. R., Holleran, S. A., Irving, L. M., Sigmon, S. T., Yoshinobu, L., Gibb, J., Langelle, C., & Harney, P. (1991). The Will and the Ways: Development and Validation of an Individual-Differences Measure of Hope. Journal of Personality and Social Psychology, 60, 570-585. https://doi.org/10.1037/0022-3514.60.4.570
Stalikas, A., Kyriazos, T. A., & Petratou, I. (2017). The Scale of Positive and Negative Experience (SPANE), Greek Version. Athens: Hellenic Association of Positive Psychology.
Steger, M. F., Frazier, P., Oishi, S., & Kaler, M. (2006). The Meaning in Life Questionnaire. Assessing the Presence of and Search for Meaning in Life. Journal of Counseling Psychology, 53, 80-93. https://doi.org/10.1037/0022-0167.53.1.80
Sumi, K. (2014). Reliability and Validity of Japanese Versions of the Flourishing Scale and the Scale of Positive and Negative Experience. Social Indicators Research, 118, 601-615. https://doi.org/10.1007/s11205-013-0432-6
Telef, B. B. (2015). The Positive and Negative Experience Scale Adaptation for Turkish University Students. European Scientific Journal, 11, 49-59.
Tellegen, A. (1985). Structures of Mood and Personality and Their Relevance to Assessing Anxiety, with an Emphasis on Self-Report. In A. Tuma, & J. Maser (Eds.), Anxiety and the Anxiety Disorders (pp. 681-706). Hillsdale, NJ: Erlbaum.
Tellegen, A., Watson, D., & Clark, L. A. (1999). On the Dimensional and Hierarchical Structure of Affect. Psychological Science, 10, 297-303. https://doi.org/10.1111/1467-9280.00157
Tennant, R., Hiller, L., Fishwick, R., Platt, S., Joseph, S. et al. (2007) The Warwick-Edinburgh Mental Well-Being Scale (WEMWBS): Development and UK Validation. Health and Quality of Life Outcomes, 5, 63. https://doi.org/10.1186/1477-7525-5-63
Thompson, E. R. (2007). Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38, 227-242. https://doi.org/10.1177/0022022106297301
Tong, K. K., & Wang, Y. Y. (2017). Validation of the Flourishing Scale and Scale of Positive and Negative Experience in a Chinese Community Sample. PLoS ONE, 12, e0181616. https://doi.org/10.1371/journal.pone.0181616
Tsai, J. L., Knutson, B., & Fung, H. H. (2006). Cultural Variation in Affect Valuation. Journal of Personality and Social Psychology, 90, 288-307. https://doi.org/10.1037/0022-3514.90.2.288
Veenhoven, R. (2013). World Database of Happiness: Archive of Research Findings on Subjective Enjoyment of Life. Rotterdam: Erasmus University Rotterdam. http://worlddatabaseofhappiness.eur.nl/hap_quer/hqi_fp.htm
Watson, D. (2002). Positive Affectivity: The Disposition to Experience Pleasurable Emotional States. In C. R. Synder, & S. J. Lopez (Eds.), Handbook of Positive Psychology (pp. 106-119). New York: Oxford University Press.
Watson, D., & Clark, L. A. (1984). Negative Affectivity: The Disposition to Experience Aversive Emotional States. Psychological Bulletin, 96, 465-490. https://doi.org/10.1037/0033-2909.96.3.465
Watson, D., & Pennebaker, J. W. (1989). Health Complaints, Stress, and Distress: Exploring the Central Role of Negative Affectivity. Psychological Review, 96, 234-254. https://doi.org/10.1037/0033-295X.96.2.234
Watson, D., & Tellegen, A. (1985). Toward a Consensual Structure of Mood. Psychological Bulletin, 98, 219-235. https://doi.org/10.1037/0033-2909.98.2.219
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and Validation of Brief Measures of Positive and Negative Affect: The PANAS Scales. Journal of Personality and Social Psychology, 54, 1063-1070. https://doi.org/10.1037/0022-3514.54.6.1063
Werts, C. E., Linn, R. N., & Karl, G. J. (1974). Interclass Reliability Estimates: Testing Structural Assumptions. Educational & Psychological Measurement, 34, 25-33. https://doi.org/10.1177/001316447403400104
WHOQOL Group (1998a). The World Health Organization Quality of Life Assessment (WHOQOL): Development and General Psychometric Properties. Social Science & Medicine, 46, 1569-1585. https://doi.org/10.1016/S0277-9536(98)00009-4
WHOQOL Group (1998b). Development of the World Health Organization WHOQOL- BREF Quality of Life Assessment. Psychological Medicine, 28, 551-558. https://doi.org/10.1017/S0033291798006667
Yusoff, M. S. B. (2013). Psychometric Properties of the Depression Anxiety Stress Scale in a Sample of Medical Degree Applicants. International Medical Journal, 20, 295-300.