The purpose of this research was to examine the psychometric properties of the Flow Short Scale by Rheinberg, Vollmeyer, and Engeser in 160 Greek adults. State flow (as opposed to dispositional flow) was measured while participants were involved in a leisure time activity. First, construct validity was evaluated with factor analysis techniques like ICM-CFA, ESEM, Bifactor CFA and Bifactor ESEM. A total of 15 alternative models were evaluated. Two solutions showed optimal fit. First, it was the two-factor structure replicating the original structure but with different item allocation on each factor, probably due to cultural differences. Second, it was a shorter version of FSS with 6 items in the two original factors instead of 10. A MIMIC model indicated a significant direct effect of age on FSS factors thus, population heterogeneity. A significant direct effect on an indicator was also found, hence measurement noninvariance. Reliability (α and ω) was acceptable, but not AVE. Flow had a significant positive, moderately strong relation with emotionality and life satisfaction. In sum, the suggested factor structures for FSS were found to be reliable and valid to use in Greek cultural context.
Awang, Z., Afthanorhan, A., & Asri, M. A. M. (2015). Parametric and Non Parametric Approach in Structural Equation Modeling (SEM): The Application of Bootstrapping. Modern Applied Science, 9, 58-67. https://doi.org/10.5539/mas.v9n9p58
Bentler, P. M., & Yuan, K. H. (1999). Structural Equation Modeling with Small Samples: Test of Global Self-Esteem. Journal of Personality and Social Psychology, 89, 623-642.
Berlyne, D. E. (1960). Conflict, Arousal and Curiosity. New York, NY: McGraw-Hill. https://doi.org/10.1037/11164-000
Boniwell, I. (2012). Positive Psychology in a Nutshell, the Science of Happiness (3rd ed.). England: Open University Press, McGraw-Hill Education.
Brislin, R., Lonner, W., & Thorndike, R. (1973). Cross-Cultural Research Methods. New York, NY: John Wiley & Sons.
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (2nd ed.). New York, NY: Guilford Publications.
Brunner, M., Nagy, G., & Wilhelm, O. (2012). A Tutorial on Hierarchically Structured Constructs. Journal of Personality, 80, 796-846. https://doi.org/10.1111/j.1467-6494.2011.00749.x
Comrey, A. L. (1988). Factor Analytic Methods of Scale Development in Personality and Clinical Psychology. Journal of Consulting and Clinical Psychology, 56, 754-761. https://doi.org/10.1037/0022-006X.56.5.754
Comrey, A. L., & Lee, H. B. (1992). A First Course in Factor Analysis (2nd ed.). Hillsdale, NJ: Erlbaum.
Cortina, J. M. (1993). What Is Coefficient Alpha? An Examination of Theory and Applications. Journal of Applied Psychology, 78, 98-104. https://doi.org/10.1037/0021-9010.78.1.98
Crawford, J. R., & Henry, J. D. (2004). The Positive and Negative Affect Schedule (PANAS): Construct Validity, Measurement Properties and Normative Data in a Large Non-Clinical Sample. British Journal of Clinical Psychology, 43, 245-265. https://doi.org/10.1348/0144665031752934
Cronbach, L. J. (1951). Coefficient Alpha and the Internal Structure of Tests. Psychometrika, 16, 297-334. https://doi.org/10.1007/BF02310555
Csikszentmihalyi, M. (1975/2000). Beyond Boredom and Anxiety: Experiencing Flow in Work and Play (2nd ed.). San Francisco, CA: Jossey Bass.
Csikszentmihalyi, M. (1978). Attention and the Holistic Approach to Behavior. In K. S. Pope, & J. L. Singer (Eds.), The Stream of Consciousness (pp. 335-356). New York: Plenum. https://doi.org/10.1007/978-1-4684-2466-9_13
Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. New York, NY: Harper Perennial.
Csikszentmihalyi, M. (1996). Creativity. New York, NY: HarperCollins.
Csikszentmihalyi, M. (2014). Flow and the Foundations of Positive Psychology. The Netherlands: Springer. https://doi.org/10.1007/978-94-017-9088-8
Csikszentmihalyi, M., & Csikszentmihalyi, I. (1988). Optimal Experience: Psychological Studies of Flow in Consciousness. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511621956
Csikszentmihalyi, M., & LeFevre, J. (1989). Optimal Experience in Work and Leisure. Journal of Personality and Social Psychology, 56, 815-822. https://doi.org/10.1037/0022-3514.56.5.815
Csikszentmihalyi, M., & Robinson, R. (1990). The Art of Seeing. Malibu, CA: J. Paul Getty Museum and the Getty Center for Education in the Arts.
Csikszentmihalyi, M., Larson, R. J., & Prescott, S. (1977). The Ecology of Adolescent Activity and Experience. Journal of Youth and Adolescence, 6, 281-294. https://doi.org/10.1007/BF02138940
Debus, M. E., Sonnentag, S., Deutsch, W., & Nussbeck, F. W. (2014). Making Flow Happen: The Effects of Being Recovered on Work-Related Flow between and within Days. Journal of Applied Psychology, 99, 713-722. https://doi.org/10.1037/a0035881
DeCharms, R. (1968). Personal Causation. New York, NY: Academic Press.
Deci, E. L., & Ryan, R. M. (1980). The Empirical Exploration of Intrinsic Motivational Processes. In L. Berkowitz (Ed.), Advances in Experimental Social Psychology (pp. 39-80). New York, NY: Academic Press. https://doi.org/10.1016/S0065-2601(08)60130-6
Delle Fave, A. (2013). Past, Present and Future of Flow. In S. A. David, I. Boniwell, & A. ConleyAyers (Eds.), The Oxford Handbook of Happiness (pp. 60-72). New York, NY: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199557257.013.0005
DeVellis, R. F. (2017). Scale Development: Theory and Applications (4th ed.). Thousand Oaks, CA: Sage.
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49, 71-75. https://doi.org/10.1207/s15327752jpa4901_13
Diener, E., Wirtz, D., Biswas-Diener, R., Tov, W., Kim-Prieto, C., Choi, D., et al. (2009). New Measures of Well-Being. The Netherlands: Springer. https://doi.org/10.1007/978-90-481-2354-4_12
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D., Oishi, S., & Biswas-Diener, R. (2010). New Well-Being Measures: Short Scales to Assess Flourishing and Positive and Negative Feelings. Social Indicators Research, 97, 143-156. https://doi.org/10.1007/s11205-009-9493-y
Doornik, J. A., & Hansen, H. (2008). An Omnibus Test for Univariate and Multivariate Normality. Oxford Bulletin of Economics and Statistics, 70, 927-939. https://doi.org/10.1111/j.1468-0084.2008.00537.x
Ellis, G. D., Voelkl, J. E., & Morris, C. (1994). Measurements and Analysis Issues with Explanation of Variance in Daily Experience Using the Flow Model. Journal of Leisure Research, 26, 337-356. https://doi.org/10.1080/00222216.1994.11969966
Engeser, S. (2012). Advances in Flow Research. New York, NY: Springer. https://doi.org/10.1007/978-1-4614-2359-1
Engeser, S., & Rheinberg, F. (2008). Flow Performance and Moderators of Challenge-Skill Balance. Motivation & Emotion, 32, 158-172. https://doi.org/10.1007/s11031-008-9102-4
Engeser, S., & Schiepe-Tiska, A. (2012). Historical Lines and an Overview of Current Research on Flow. In S. Engeser (Ed.), Advances in Flow Research (pp. 1-22). New York: Springer.
Fornell, C., & Larcker, D. F. (1981). Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics. Journal of Marketing Research, 18, 382-388. https://doi.org/10.2307/3150980
Fullagar, C., Delle Fave, A., & Van Krevelen, S. (2017). Flow at Work: The Evolution of a Construct. In C. Fullagar, A. Delle Fave, & S. Van Krevelen (Eds.), Flow at Work, Measurement and Implications (pp. 1-39). New York: Routledge.
Getzels, J. W., & Csikszentmihalyi, M. (1976). The Creative Vision. New York, NY: Wiley.
Goldberg, I. I., Harel, M., & Malach, R. (2006). When the Brain Loses Its Self: Prefrontal Inactivation during Sensorimotor Processing. Neuron, 50, 329-339. https://doi.org/10.1016/j.neuron.2006.03.015
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977). Limitations of Coefficient Alpha as an Index of Test Unidimensionality. Educational and Psychological Measurement, 37, 827-836. https://doi.org/10.1177/001316447703700403
Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate Data Analysis (7th ed.). Upper Saddle River, NJ: Prentice-Hall, Inc.
Hammer, J. H., & Toland, M. D. (2016). Bifactor Analysis in Mplus. Lexington, KY: University of Kentucky. http://sites.education.uky.edu/apslab/upcoming-events/
Hebb, D. O. (1955). Drives and the CNS. Psychological Review, 62, 243-254. https://doi.org/10.1037/h0041823
Henze, N., & Zirkler, B. (1990). A Class of Invariant Consistent Tests for Multivariate Normality. Communications in Statistics-Theory and Methods, 19, 3595-3617. https://doi.org/10.1080/03610929008830400
Hoque, A. S., Awang, Z., Jusoff, K., Salleh, F., &Muda, H. (2017). Social Business Efficiency: Instrument Development and Validation Procedure Using Structural Equation Modeling. International Business Management, 11, 222-231.
Howard, J., Gagné, M., Morin, A. J. S., Wang, Z. N., & Forest, J. (2016). Using Bifactor Exploratory Structural Equation Modeling to Test for a Continuum Structure of Motivation. Journal of Management, 1-59.
Hu, L., & Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Structural Equation Modeling, 6, 1-55. https://doi.org/10.1080/10705519909540118
Hunt, J. (1965). Intrinsic Motivation and Its Role in Development. Nebraska Symposium on Motivation, 12, 189-282.
IBM Corporation (2017). IBM SPSS Statistical Software, Release 25. Spring House, PA: IBM Corporation.
Jackson, S. (1995). Factors Influencing the Occurrence of Flow State in Elite Athletes. Journal of Applied Sport Psychology, 7, 138-166. https://doi.org/10.1080/10413209508406962
Jackson, S. (1996). Toward a Conceptual Understanding of the Flow Experience in Elite Athletes. Research Quarterly for Exercise and Sport, 67, 76-90. https://doi.org/10.1080/02701367.1996.10607928
Jackson, S. A., & Csikszentmihalyi, M. (1999). Flow in Sports: The Keys to Optimal Experiences and Performances. Champaign, IL: Human Kinetics.
Jackson, S. A., & Eklund, R. C. (2002). Assessing Flow in Physical Activity: The Flow State Scale-2 and Dispositional Flow Scale-2. Journal of Sport & Exercise Psychology, 24, 133-150. https://doi.org/10.1123/jsep.24.2.133
Jackson, S. A., & Eklund, R. C. (2004). Relationships between Quality of Experience and Participation in Diverse Performance Settings. Australian Journal of Psychology, 56, 193.
Jackson, S. A., & Marsh, H. W. (1996). Development and Validation of a Scale to Measure Optimal Experience: The Flow State Scale. Journal of Sport & Exercise Psychology, 18, 17-35. https://doi.org/10.1123/jsep.18.1.17
Jackson, S. A., Thomas, P. R., Marsh, H. W., & Smethurst, C. J. (2001). Relationships between Flow, Self-Concept, Psychological Skills, and Performance. Journal of Applied Sport Psychology, 13, 129-153. https://doi.org/10.1080/104132001753149865
Joshanloo, M., & Jovanovic, V. (2016). The Factor Structure of the Mental Health Continuum-Short Form (MHC-SF) in Serbia: An Evaluation Using Exploratory Structural Equation Modeling. Journal of Mental Health, 26, 510-515. https://doi.org/10.1080/09638237.2016.1222058
Joshanloo, M., Jose, P. E., & Kielpikowski, M. (2017). The Value of Exploratory Structural Equation Modeling in Identifying Factor Overlap in the Mental Health Continuum-Short Form (MHC-SF): A Study with a New Zealand Sample. Journal of Happiness Studies, 8, 1061-1074. https://doi.org/10.1007/s10902-016-9767-4
Keller, J., & Bless, H. (2008). Flow and Regulatory Compatibility: An Experimental Approach to the Flow Model of Intrinsic Motivation. Journal of Personality and Social Psychology Bulletin, 34, 196-209. https://doi.org/10.1177/0146167207310026
Keller, J., & Landhäußer, A. (2012). The Flow Model Revisited. In S. Engeser (Ed.), Advances in Flow Research (pp. 51-64). New York: Springer. https://doi.org/10.1007/978-1-4614-2359-1_3
Kline, P. (1999). Handbook of Psychological Testing. London: Routledge.
Kline, R. B. (2016). Principles and Practice of Structural Equation Modeling (4th ed.). New York, NY: The Guilford Press.
Kyriazos, T. A., Stalikas, A., Prassa, K., Yotsidi, V. (2018). A 3-Faced Construct Validation and a Bifactor Subjective Well-Being Model Using the Scale of Positive and Negative Experience, Greek Version. Psychology, 9, 1143-1175. https://doi.org/10.4236/psych.2018.95071
Malhotra, N. K., & Dash, S. (2011). Marketing Research an Applied Orientation. London: Pearson Publishing.
Mardia, K. V. (1970). Measures of Multivariate Skewness and Kurtosis with Applications. Biometrika, 57, 519-530. https://doi.org/10.1093/biomet/57.3.519
Marsh, H. W., Ludtke, O., Nagengast, B., Morin, A. J. S., & Von Davier, M. (2013). Why Item Parcels Are (Almost) Never Appropriate: Two Wrongs Do Not Make a Right—Camouflaging Misspecification with Item Parcels in CFA Models. Psychological Methods, 18, 257-284. https://doi.org/10.1037/a0032773
Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014). Exploratory Structural Equation Modeling: An Integration of the Best Features of Exploratory and Confirmatory Factor Analysis. Annual Review of Clinical Psychology, 10, 85-110. https://doi.org/10.1146/annurev-clinpsy-032813-153700
Massey, F. J. (1951). The Kolmogorov-Smirnov Tests for Goodness of Fit. Journal of American Statistical Association, 46, 68-78. https://doi.org/10.1080/01621459.1951.10500769
Massimini, F., & Delle Fave, A. (2000). Individual Development in a Bio-Cultural Perspective. American Psychologist, 55, 24-33. https://doi.org/10.1037/0003-066X.55.1.24
McDonald, R. P. (1999). Test Theory: A Unified Treatment. Mahwah, NJ: Erlbaum.
McReynolds, P. (1971). The Nature and Assessment of Intrinsic Motivation. In P. McReynolds (Ed.), Advances in Psychological Assessment (Vol. 2, pp. 157-177). Palo Alto: Science and Behavior Books.
Moneta, G. B. (2012). On the Measurement and Conceptualization of Flow. In S. Engeser (Ed.), Advances in Flow Research (pp. 23-50). New York, NY: Springer. https://doi.org/10.1007/978-1-4614-2359-1_2
Moneta, G. B., & Csikszentmihalyi, M. (1996). The Effect of Perceived Challenges and Skills on the Quality of Subjective Experience. Journal of Personality, 64, 274-310. https://doi.org/10.1111/j.1467-6494.1996.tb00512.x
Muthén, B. (1989). Latent Variable Modeling in Heterogeneous Populations. Psychometrika, 54, 557-585. https://doi.org/10.1007/BF02296397
Muthen, B., & Asparouhov, T. (2002). Using Mplus Monte Carlo Simulations in Practice: A Note on Non-Normal Missing Data in Latent Variable Models. Mplus Web Notes: No. 2.
Muthen, L. K., & Muthen, B. O. (2012). Mplus Statistical Software, 1998-2012. Los Angeles, CA: Muthén & Muthén.
Nakamura, J. (1988). Optimal Experience and the Uses of Talent. In M. Csikszentmihalyi, & I. Csikszentmihalyi (Eds.), Optimal Experience: Psychological Studies of Flow in Consciousness (pp. 319-326). Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511621956.019
Nakamura, J., & Csikszentmihalyi, M. (2005). The Concept of Flow. In C. R. Snyder, & S. J. Lopez (Eds.), Handbook of Positive Psychology (pp. 89-105). Oxford: University Press.
Novak, T. P., Hoffman, D. L., & Yung, Y. (1997). Measuring the Flow Experience among Web Users. Paper Presented at the Interval Research Corporation, Project 2000, Vanderbilt University.
Nunnally, J., & Berstein, I. (1995). Psychometric Theory. New York, NY: McGraw-Hill.
Pavot, W., & Diener, E. (1993). The Affective and Cognitive Context of Self-Reported Measures of Subjective Well-Being. Social Indicators Research, 28, 1-20. https://doi.org/10.1007/BF01086714
Pavot, W., & Diener, E. (2008). The Satisfaction with Life Scale and the Emerging Construct of Life Satisfaction. The Journal of Positive Psychology, 3, 137-152. https://doi.org/10.1080/17439760701756946
Perry, S. K. (1999). Writing in Flow. Cincinnati, OH: Writer’s Digest Books.
Pfister R. (2002). Flow im Alltag. Untersuchungen zum Quadrantenmodell des Flow-Erlebens und zum Konzept der autotelischen Personlichkeit mit der Experience Sampling Method (ESM) [Flow in Everyday Life: Studies on the Quadrant Model of Flow Experiencing and on the Concept of the Autotelic Personality with the Experience Sampling Method (ESM)]. Bern: Peter Lang.
Puca, R. M., & Schmalt, H. D. (1999). Task Enjoyment: A Mediator between Achievement Motives and Performance. Motivation and Emotion, 23, 15-29. https://doi.org/10.1023/A:1021327300925
Quinn, R. W. (2005). Flow in Knowledge Work: High Performance Experience in the Design of National Security Technology. Administrative Science Quarterly, 50, 610-641. https://doi.org/10.2189/asqu.50.4.610
Reise, S. (2012). The Rediscovery of Bifactor Measurement Models. Multivariate Behavioral Research, 47, 667-696. https://doi.org/10.1080/00273171.2012.715555
Reise, S. P., Morizot, J., & Hays, R. D. (2007). The Role of the Bifactor Model in Resolving Dimensionality Issues in Health Outcomes Measures. Quality of Life Research, 16, 19-31. https://doi.org/10.1007/s11136-007-9183-7
Rheinberg, F. (2008). Intrinsic Motivation and Flow-Experience. In H. Heckhausen, & J. Heckhausen (Eds.), Motivation and Action (pp. 323-348). Cambridge, UK: Cambridge University Press. https://doi.org/10.1017/CBO9780511499821.014
Rheinberg, F., Manig, Y., Kliegl, R., Engeser, S., & Vollmeyer, R. (2007). Flow bei der Arbeit,doch Glóck in der Freizeit [Flow during Work but Happiness during Leisure Time: Goals, Flow-Experience, and Happiness]. Zeitschrift fór Arbeitsund Organisationspsychologie [Journal of Work and Organizational Psychology], 51, 105-115.
Rheinberg, F., Vollmeyer, R., & Engeser, S. (2003). Die Erfassung des Flow-Erlebens [The Assessment of Flow Experience]. In J. Stiensmeier-Pelster, & F. Rheinberg (Eds.), Diagnostik von Selbstkonzept, Lernmotivation und Selbstregulation [Diagnosis of Motivation and Self-Concept]. Göttingen: Hogrefe.
Sahoo, F. M., & Sahu, R. (2009). The Role of Flow Experience in Human Happiness. Journal of the Indian Academy of Applied Psychology, 35, 40-47.
Schmid, J., & Leiman, J. N. (1957). The Development of Hierarchical Factor Solutions. Psychometrika, 22, 53-61. https://doi.org/10.1007/BF02289209
Schuler, J. (2010). Achievement Incentives Determine the Effects of Achievement-Motive Incongruence on Flow Experience. Motivation and Emotion, 34, 2-14. https://doi.org/10.1007/s11031-009-9150-4
Seligman, E. P. (2002). Authentic Happiness. New York, NY: Free Press.
Singh, K., Junnarkar, M., & Kaur, J. (2016). Measures of Positive Psychology, Development and Validation. Berlin: Springer. https://doi.org/10.1007/978-81-322-3631-3