Factor analysis is carried out to psychometrically evaluate measurement instruments with multiple items like questionnaires or ability tests. EFA and CFA are widely used in measurement applications for construct validation and scale refinement. One of the more critical aspects of any CFA or EFA is communicating results. This work described reporting essentials of EFA with goodness of fit indices and CFA research when they are used to validate a measurement instrument with continuous variables in a different population from the one originally created. An overview of the minimum information to be reported is included along with short extracts from real published reports. For each reported section basic information to be included is described along with an example-extract adapted from published factor analysis construct validation studies. Additional issues covered include: Cross-validation, Measurement Invariance across Age and Gender, Reliability (α and ω), AVE-Based Validity, Convergent and Discriminant Validity with Correlation Analysis and Normative Data. Properly reported EFA and CFA could contribute to the improvement of the quality of the measurement instruments. A summary of good practices in CFA and SEM reporting based on literature is also included.
KeywordsWrite-UpFactor AnalysisLatent Variable ModelsEFA with Goodness of Fit IndicesConstruct Validation across Cultures
American Psychological Association (2001). Publication Manual of the American Psychological Association (5th ed.). Washington DC: Author
American Psychological Association (2010). Publication Manual of the American Psychological Association (6th ed.). Washington DC: Author.
APA Publications and Communications Board Working Group on Journal Article Reporting Standards (2018). Reporting Standards for Research in Psychology: Why Do We Need Them? What Might They Be? American Psychologist, 63, 839-851. https://doi.org/10.1037/0003-066X.63.9.839
Appelbaum, M., Kline, R. B., Nezu, A. M., Cooper, H., Mayo-Wilson, E., & Rao, S. M. (2018). Journal Article Reporting Standards for Quantitative Research in Psychology: The APA Publications and Communications Board Task Force Report. American Psychologist, 73, 3-25. https://doi.org/10.1037/amp0000191
Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K. et al. (2013). Recommendations for Increasing Replicability in Psychology. European Journal of Personality, 27, 108-119. https://doi.org/10.1002/per.1919
Aspelmeier, J. A. (2008). Sample APA Paper: The Efficacy of Psychotheraputic Interventions with Profoundly Deceased Patients. Radford University: Author.
Bartlett, M. S. (1951). The Effect of Standardization on a 2 Approximation in Factor Analysis. Biometrika, 38, 337-344.
Bartlett, M. S. (1954). A Note on the Multiplying Factors for Various Chi Square Approximations. Journal of the Royal Statistical Society (Series B), 16, 296-298.
Beaujean, A. A. (2014). Latent Variable Modeling Using R: A Step-by-Step Guide. New York, NY: Routledge. https://doi.org/10.4324/9781315869780
Beins, B. C. (2009). Research Methods: A Tool for Life (2nd ed.). Boston, MA: Allyn & Bacon.
Beins, B. C. (2012). APA Style Simplified: Writing in Psychology, Education, Nursing, and Sociology. London: John Wiley & Sons, Inc.
Bentler, P. M. (1990). Comparative Fit Indexes in Structural Models. Psychological Bulletin, 107, 238-246. https://doi.org/10.1037/0033-2909.107.2.238
Bentler, P. M. (1995). EQS Structural Equations Program Manual. Encino, CA: Multivariate Software.
Bollen, K. A. (1989). A New Incremental Fit Index for General Structural Equation Models. Sociological Methods & Research, 17, 303-316. https://doi.org/10.1177/0049124189017003004
Bollen, K. A., & Long, S. J. (1992). Tests for Structural Equation Models: Introduction. Sociological Methods & Research, 21, 123-131. https://doi.org/10.1177/0049124192021002001
Boomsma, A. (2000). Reporting Analyses of Covariance Structure. Structural Equation Modeling, 7, 461-483. https://doi.org/10.1207/S15328007SEM0703_6
Boomsma, A., Hoyle, R. H., & Panter, A. T. (2012). The Structural Equation Modeling Research Report. In R. H. Hoyle (Ed.), Handbook of Structural Equation Modeling (pp. 341-358). New York, NY: Guilford.
Breckler, S. J. (1990). Applications of Covariance Structure Modeling in Psychology: Cause for Concern? Psychological Bulletin, 107, 260-273. https://doi.org/10.1037/0033-2909.107.2.260
Brislin, R. W. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1, 185-216. https://doi.org/10.1177/135910457000100301
Brislin, R., Lonner, W., & Thorndike, R. (1973). Cross-Cultural Research Methods. New York, NY: John Wiley & Sons.
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (2nd ed.). New York, NY: Guilford Publications.
Brown, T. A., & Moore, M. T. (2012). Confirmatory Factor Analysis. In R. H. Hoyle (Ed.), Handbook of Structural Equation Modeling (pp. 361-379). New York, NY: Guilford Publications.
Byrne, B. M. (2012). Structural Equation Modeling with Mplus: Basic Concepts, Applications, and Programming. London: Routledge.
Byrne, B. M., & Stewart, S. M. (2006). The MACS Approach to Testing for Multigroup Invariance of a Second-Order Structure: A Walk through the Process. Structural Equation Modeling, 13, 287-321. https://doi.org/10.1207/s15328007sem1302_7
Byrne, B. M., Shavelson, R., & Muthen, B. (1989) Testing for the Equivalence of Factor Covariance and Mean Structures: The Issue of Partial Measurement Invariance. Psychological Bulletin, 105, 456-466. https://doi.org/10.1037/0033-2909.105.3.456
Campbell, D. T., & Fiske, D. W. (1959). Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix. Psychological Bulletin, 56, 81-105. https://doi.org/10.1037/h0046016
Cattell, R. B. (1966). The Scree Test for the Number of Factors. Multivariate Behavioral Research, 1, 245-276. https://doi.org/10.1207/s15327906mbr0102_10
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Structural Equation Modeling, 9, 233-255. https://doi.org/10.1207/S15328007SEM0902_5
Chmitorz, A., Wenzel, M., Stieglitz, R.-D., Kunzler, A., Bagusat, C., Helmreich, I. et al. (2018). Population-Based Validation of a German Version of the Brief Resilience Scale. PLoS ONE, 13, e0192761. https://doi.org/10.1371/journal.pone.0192761
Cronbach, L. J. (1951). Coefficient Alpha and the Internal Structure of Tests. Psychometrika, 16, 297-334. https://doi.org/10.1007/BF02310555
DeVellis, R. F. (2017). Scale Development: Theory and Applications (4th ed.). Thousand Oaks, CA: Sage.
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D, Oishi, S., & Biswas-Diener, R. (2010). New Well-Being Measures: Short Scales to Assess Flourishing and Positive and Negative Feelings. Social Indicators Research, 97, 143-156. https://doi.org/10.1007/s11205-009-9493-y
Fabrigar, L. R., & Wegener, D. T. (2012). Exploratory Factor Analysis. New York, NY: Oxford University Press, Inc.
Finch, H. W., Immekus, J. C., & French, B. F. (2016). Applied Psychometrics Using SPSS and AMOS. Charlotte, NC: Information Age Publishing Inc.
Floyd, F. J., & Widaman, K. F. (1995). Factor Analysis in the Development and Refinement of Clinical Assessment Instruments. Psychological Assessment, 7, 286. https://doi.org/10.1037/1040-3590.7.3.286
Fornell, C., & Larcker, D. F. (1981). Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics. Journal of Marketing Research, 18, 382-388. https://doi.org/10.2307/3150980
Giotsa, A. Z., Zergiotis, A. N., & Kyriazos, T. (2018). Is the Greek Version of Teacher’s Evaluation of Student’s Conduct (TESC) a Valid and Reliable Measure? Psychology, 9, 1208-1227. https://doi.org/10.4236/psych.2018.95074
Grant, N., & Fabrigar, L. R. (2007). Exploratory Factor Analysis. In N. J. Salkind (Ed.), Encyclopedia of Measurement and Statistics (pp. 332-335). Thousand Oaks, CA: Sage.
Hancock, G. R., & Mueller, R. O. (2010). The Reviewer’s Guide to Quantitative Methods in the Social Sciences. New York, NY: Routledge.
Hatcher, L. (1994). A Step-by-Step Approach to Using the SAS System for Factor Analysis and Structural Equation Modeling. Cary, NC: SAS Institute.
Hayduk, L. A. (1987). Structural Equation Modeling with LISREL: Essentials and Advances. Baltimore, MD: The Johns Hopkins University Press.
Hill, C. E., Thompson, B. J., & Williams, E. N. (1997). A Guide to Conducting Consensual Qualitative Research. The Counseling Psychologist, 25, 517-572. https://doi.org/10.1177/0011000097254001
Horn, J. L. (1965). A Rationale and Test for the Number of Factors in Factor Analysis. Psychometrika, 30, 179-185. https://doi.org/10.1007/BF02289447
Howitt, D., & Cramer, D. (2017). Understanding Statistics in Psychology with SPSS (7th ed.). London: Pearson Education.
Hoyle, R. H., & Isherwood, J. C. (2013). Reporting Results from Structural Equation Modeling Analyses in Archives of Scientific Psychology. Archives of Scientific Psychology, 1, 14-22. https://doi.org/10.1037/arc0000004
Hoyle, R. H., & Panter, A. T. (1995). Writing about Structural Equation Models. In R. H. Hoyle (Ed.), Structural Equation Modeling: Concepts, Issues, and Applications (pp. 158-176). Thousand Oaks, CA: Sage.
Joreskog, K. G., & Sorbom, D. (1988). LISREL 7. A Guide to the Program and Its Application. Chicago: SPSS Inc.
Joreskog, K. G., & Sorbom, D. (1992). LISREL VIII: Analysis of Linear Structural Relations. Mooresville, IN: Scientific Software.
Joreskog, K. G., & Sörbom, D. (1996). LISREL 8: User’s Reference Guide (2nd ed.). Chicago: Scientific Software International.
Kaiser, H. (1970). A Second Generation Little Jiffy. Psychometrika, 35, 401-415. https://doi.org/10.1007/BF02291817
Kaiser, H. (1974). An Index of Factorial Simplicity. Psychometrika, 39, 31-36. https://doi.org/10.1007/BF02291575
Kaiser, H. F. (1960). The Applications of Electronic Computer to Factor Analysis. Educational and Psychological Measurement, 20, 141-151. https://doi.org/10.1177/001316446002000116
Kelloway, E. K. (2015). Using Mplus for Structural Equation Modeling. Thousand Oaks, CA: Sage.
Kline, R. B. (2016). Principles and Practice of Structural Equation Modeling (4th ed.). New York, NY: The Guilford Press.
Kyriazos, T. A. (2018). Applied Psychometrics: The 3-Faced Construct Validation Method, a Routine for Evaluating a Factor Structure. Psychology, 9, 2044-2072. https://doi.org/10.4236/psych.2018.98117
Kyriazos, T. A., Stalikas, A., Prassa, K., & Yotsidi, V. (2018a). Can the Depression Anxiety Stress Scales Short Be Shorter? Factor Structure and Measurement Invariance of DASS-21 and DASS-9 in a Greek, Non-Clinical Sample. Psychology, 9, 1095-1127. https://doi.org/10.4236/psych.2018.95069
Kyriazos, T. A., Stalikas, A., Prassa, K., & Yotsidi, V. (2018b). A 3-Faced Construct Validation and a Bifactor Subjective Well-Being Model Using the Scale of Positive and Negative Experience, Greek Version. Psychology, 9, 1143-1175. https://doi.org/10.4236/psych.2018.95071
Kyriazos, T. A., Stalikas, A., Prassa, K., Galanakis, M., Flora, K., & Chatzilia, V. (2018c). The Flow Short Scale (FSS) Dimensionality and What MIMIC Shows on Heterogeneity and Invariance. Psychology, 9, 1357-1382. https://doi.org/10.4236/psych.2018.96083
Kyriazos, T. A., Stalikas, A., Prassa, K., Galanakis, M., Yotsidi, V., & Lakioti, A. (2018e). Psychometric Evidence of the Brief Resilience Scale (BRS) and Modeling Distinctiveness of Resilience from Depression and Stress. Psychology, 9, 1828-1857. https://doi.org/10.4236/psych.2018.97107
Kyriazos, T. A., Stalikas, A., Prassa, K., Yotsidi, V., Galanakis, M., & Pezirkianidis, C. (2018d). Validation of the Flourishing Scale (FS), Greek Version and Evaluation of Two Well-Being Models. Psychology, 9, 1789-1813. https://doi.org/10.4236/psych.2018.97105
Lawley, D. N. (1940). The Estimation of Factor Loadings by the Method of Maximumlikelihood. Proceedings of the Royal Society of Edinburgh, 60, 64-82.
Levitt, H. M., Creswell, J. W., Josselson, R., Bamberg, M., Frost, D. M., & Suárez-Orozco, C. (2018). Journal Article Reporting Standards for Qualitative Primary, Qualitative Meta-Analytic, and Mixed Methods Research in Psychology: The APA Publications and Communications Board Task Force Report. American Psychologist, 73, 26-46. https://doi.org/10.1037/amp0000151
Loehlin, J. C., & Beaujean, A. A. (2017). Latent Variable Models: An Introduction to Factor, Path, and Structural Equation Analysis. New York, NY: Taylor & Francis.
Lorenzo-Seva, U., Timmerman, M. E., & Kiers, H. A. L. (2011). The Hull Method for Selecting the Number of Common Factors. Multivariate Behavioral Research, 46, 340-364. https://doi.org/10.1080/00273171.2011.564527
Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the Depression Anxiety Stress Scales. Sydney: Psychology Foundation.
MacCallum, R. C., & Austin, J. T. (2000). Applications of Structural Equation Modeling in Psychological Research. Annual Review of Psychology, 51, 201-226. https://doi.org/10.1146/annurev.psych.51.1.201
Mardia, K. V. (1970). Measures of Multivariate Skewness and Kurtosis with Applications. Biometrika, 57, 519-530. https://doi.org/10.1093/biomet/57.3.519
McBride, D. M. (2012). Introduction to APA Publication. Illinois, IL: Author.
McBride, D. M., & Wagman, J. B. (1997). Rules for Reporting Statistics in Papers. Journal of APA Style Rules, 105, 55-67.
McDonald, R. P. (1999). Test Theory: A Unified Treatment. Mahwah, NJ: Erlbaum.
McDonald, R. P., & Ringo Ho, M. (2002). Principles and Practice in Reporting Structural Equation Analyses. Psychological Methods, 7, 64-82. https://doi.org/10.1037/1082-989X.7.1.64
Muthen, L. K., & Muthen, B. O. (2012). Mplus Statistical Software, 1998-2012. Los Angeles, CA: Muthen & Muthen.
Nicol, A. A. M., & Pexman, P. M. (2010). Presenting Your Findings: A Practical Guide for Creating Tables (6th ed.). Washington DC: American Psychological Association.
O’Rourke, R., & Hatcher, L. (2013). A Step-by-Step Approach to Using SAS for Factor Analysis and Structural Equation Modeling (2nd ed.). Cary, NC: SAS Institute.
Phelan, J. (2007). Guidelines for Writing an APA Style Lab Report. Illinois, IL: Author.
Porter, R. D., & Fabrigar, L. R. (2007). Factor Analysis. In N. J. Salkind (Ed.), Encyclope-Dia of Measurement and Statistics (pp. 341-345). Thousand Oaks, CA: Sage.
Raiche, G., Walls, T.A., Magis, D., Riopel, M., & Blais, J.G. (2013). Non-Graphical Solutions for Cattell’s Scree Test. Methodology, 9, 23-29. https://doi.org/10.1027/1614-2241/a000051
Raykov, T., Tomer, A., & Nesselroade, J. R. (1991). Reporting Structural Equation Modeling Results in Psychology and Aging: Some Proposed Guidelines. Psychology and Aging, 6, 499-533. https://doi.org/10.1037/0882-7974.6.4.499
Reichardt, C. S. (1992). The Fallibility of Our Judgments. Evaluation Practice, 13, 157-163. https://doi.org/10.1016/0886-1633(92)90001-R
Revelle, W., & Rocklin, T. (1979) Very Simple Structure—Alternative Procedure for Estimating the Optimal Number of Interpretable Factors. Multivariate Behavioral Research, 14, 403-414. https://doi.org/10.1207/s15327906mbr1404_2
Rohner, R. P. (2005). Teacher’s Evaluation of Student’s Conduct (TESC): Test Manual. In R. P. Rohner, & A. Khaleque (Eds.), Handbook for the Study of Parental Acceptance and Rejection (4th ed., pp. 323-324). Storrs, CT: Rohner Research Publications.
Schreiber, J. B. (2008). Core Reporting Practices in Structural Equation Modeling. Research in Social and Administrative Pharmacy, 4, 83-97. https://doi.org/10.1016/j.sapharm.2007.04.003
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results: A Review. Journal of Educational Research, 99, 323-337. https://doi.org/10.3200/JOER.99.6.323-338
Schumacker, R. E., & Lomax, R. G. (2016). A Beginner’s Guide to Structural Equation Modeling (4th ed.). New York, NY: Routledge.
Sinclair, S. J., Siefert, C. J., Slavin-Mulford, J. M., Stein, M. B., Renna, M., & Blais, M. A. (2012). Psychometric Evaluation and Normative Data for the Depression, Anxiety, and Stress Scale-21 (DASS-21) in a Nonclinical Sample of US Adults. Evaluation & the Health Professions, 35, 259-279. https://doi.org/10.1177/0163278711424282
Singh, K., Junnarkar, M., & Jaswal, S. (2017). Validating the Flourishing Scale and the Scale of Positive and Negative Experience in India. Mental Health, Religion & Culture, 19, 943-954. https://doi.org/10.1080/13674676.2016.1229289
Singh, K., Junnarkar, M., & Kaur, J. (2016). Measures of Positive Psychology, Development and Validation. Berlin: Springer. https://doi.org/10.1007/978-81-322-3631-3
Smith, B. W., Dalen, J., Wiggins, K., Tooley, E., Christopher, P., & Bernard, J. (2008). The Brief Resilience Scale: Assessing the Ability to Bounce Back. International Journal of Behavioral Medicine, 15, 194-200. https://doi.org/10.1080/10705500802222972
Smith, K. C. (2006). How to Write an APA-Style Paper in Psychology. Journal of APA Style Rules, 114, 23-25.
Stalikas, A., Kyriazos, T. A., Yotsidi, V., & Prassa, K. (2018). Using Bifactor EFA, Bifactor CFA and Exploratory Structural Equation Modeling to Validate Factor Structure of the Meaning in Life Questionnaire, Greek Version. Psychology, 9, 348-371. https://doi.org/10.4236/psych.2018.93022
Steger, M. F., Frazier, P., Oishi, S., & Kaler, M. (2006). The Meaning in Life Questionnaire. Assessing the Presence of and Search for Meaning in Life. Journal of Counseling Psychology, 53, 80-93. https://doi.org/10.1037/0022-0167.53.1.80
Steiger, J. H. (1988). Aspects of Person-Machine Communication in Structural Modeling of Correlations and Covariances. Multivariate Behavioral Research, 23, 281-290. https://doi.org/10.1207/s15327906mbr2302_14
Steiger, J. H., & Lind, J. C. (1980). Statistically Based Tests for the Number of Factors. Paper Presented at the Annual Meeting of the Psychometric Society.
Tabachnick, B. G., & Fidell, L. S. (2013). Using Multivariate Statistics (6th ed.) Boston, MA: Allyn & Bacon/Pearson Education.
Thompson, B. (1994). The Pivotal Role of Replication in Psychological Research: Empirically Evaluating the Replicability of Sample Results. Journal of Personality, 62, 157-176. https://doi.org/10.1111/j.1467-6494.1994.tb00289.x
Thompson, B. (2000). Ten Commandments of Structural Equation Modeling. In L. Grimm, & P. Yarnold (Eds.), Reading and Understanding More Multivariate Statistics (pp. 261-284). Washington DC: American Psychological Association.
Thompson, B. (2004). Exploratory and Confirmatory Factor Analysis, Understanding Concepts and Applications. Washington DC: American Psychological Association. https://doi.org/10.1037/10694-000
Thompson, B. (2013). Overview of Traditional/Classical Statistical Approaches. In T. Little (Ed.), The Oxford Handbook of Quantitative Methods (Vol. 1-2, pp. 7-25). New York, NY: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199934898.013.0002
Velicer, W.F. (1976). Determining the Number of Components from the Matrix of Partial Correlations. Psychometrika, 41, 321-327. https://doi.org/10.1007/BF02293557
Wang, J., & Wang, X. (2012). Structural Equation Modeling: Applications Using Mplus. Hoboken, NJ: John Wiley & Sons. https://doi.org/10.1002/9781118356258
Wang, L. L., Watts, A. S., Anderson, R. A., & Little, T. D. (2013). Common Fallacies in Quantitative Research Methodology. In T. D. Little (Ed), The Oxford Handbook of Quantitative Methods (pp. 718-758). New York, NY: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199934898.013.0031
Werts, C. E., Linn, R. N., & Joreskog, K. G. (1974). Interclass Reliability Estimates: Testing Structural Assumptions. Educational & Psychological Measurement, 34, 25-33. https://doi.org/10.1177/001316447403400104
Yusoff, M. S. B. (2013). Psychometric Properties of the Depression Anxiety Stress Scale in a Sample of Medical Degree Applicants. International Medical Journal, 20, 295-300.