Creativity or creative thinking are often viewed as intangibles that we can observe in their impact and consequences, but that in itself is hard to define and assess. Some would even argue that assessments, which generally look for the capacity of students to find and refine pre-defined answers, stand in direct opposition to efforts to strengthen creativity. However, what we cannot see is hard to improve and what we cannot measure will not get attention. For this reason, the OECD Programme for International Student Assessment (PISA) is making efforts to build a novel assessment that can capture elements of creative thinking. The approach is based on evidence-centred design which involves documented, explicit linkages among the test purposes, the assumptions made about the test takers and that the test seeks to measure among them, and the evidence supporting the claims. This paper summarises the rationale and design of this assessment.
Amabile, T. (1983). The Social Psychology of Creativity: A Componential Conceptualization. Journal of Personality and Social Psychology, 45, 357-376. https://doi.org/10.1037/0022-3514.45.2.357
Amabile, T. (1996). Creativity in Context: Update to the Social Psychology of Creativity. Westview Press.
Amabile, T. (1997). Motivating Creativity in Organizations: On Doing What You Love and Loving What You Do. California Management Review, 40, 39-58. https://doi.org/10.2307/41165921
Amabile, T. (2012). Componential Theory of Creativity. No. 12-096, Harvard Business School. http://www.hbs.edu/faculty/Publication%20Files/12-096.pdf
Amabile, T., & Pratt, M. (2016). The Dynamic Componential Model of Creativity and Innovation in Organizations: Making Progress, Making Meaning. Research in Organizational Behavior, 36, 157-183. https://doi.org/10.1016/j.riob.2016.10.001
Baer, J. (2011). Domains of Creativity. In M. Runco, & S. Pritzker (Eds.), Encyclopedia of Creativity (2nd ed., pp. 404-408). Elsevier Inc. https://doi.org/10.1016/B978-0-12-375038-9.00079-0
Baer, J. (2016). Creativity Doesn’t Develop in a Vacuum. Perspectives on Creativity Development: New Directions for Child and Adolescent Development, 2016, 9-20. https://doi.org/10.1002/cad.20151
Bandura, A. (1997). Self-Efficacy: The Exercise of Control. Worth Publishers. https://books.google.fr/books/about/Self_Efficacy.html?id=eJ-PN9g_o-EC&redir_esc=y
Barbot, B., & Heuser, B. (2017). Creativity and Identity Formation in Adolescence: A Developmental Perspective. In The Creative Self (pp. 87-98). Elsevier. https://doi.org/10.1016/B978-0-12-809790-8.00005-4
Barbot, B., Lubart, T., & Besancon, M. (2016). “Peaks, Slumps, and Bumps”: Individual Differences in the Development of Creativity in Children and Adolescents. In B. Barbot (Ed.), Perspectives on Creativity Development: New Directions for Child and Adolescent Development, No. 151 (pp. 33-45). Jossey-Bass. https://doi.org/10.1002/cad.20152
Batey, M., & Furnham, A. (2006). Creativity, Intelligence, and Personality: A Critical Review of the Scattered Literature. Genetic, Social and General Psychology Monographs, 132, 355-429. https://doi.org/10.3200/MONO.132.4.355-430
Beghetto, R. (2006). Creative Self-Efficacy: Correlates in Middle and Secondary Students. Creativity Research Journal, 18, 447-457. https://doi.org/10.1207/s15326934crj1804_4
Beghetto, R. (2010). Creativity in the Classroom. In J. Kaufman, & R. Sternberg (Eds.), The Cambridge Handbook of Creativity (pp. 447-464). Cambridge University Press. https://doi.org/10.1017/CBO9780511763205.027
Beghetto, R., & Kaufman, J. (2007). Toward a Broader Conception of Creativity: A Case for “mini-c” Creativity. Psychology of Aesthetics, Creativity, and the Arts, 1, 73-79. https://doi.org/10.1037/1931-3896.1.2.73
Beghetto, R., & Kaufman, J. (2010). Nurturing Creativity in the Classroom. Cambridge University Press. https://doi.org/10.1017/CBO9780511781629
Beghetto, R., & Plucker, J. (2006). The Relationship among Schooling, Learning, and Creativity: “All Roads Lead to Creativity” or “You Can’t Get There from Here”? In J. Kaufman, & J. Baer (Eds.), Creativity and Reason in Cognitive Development (pp. 316-332). Cambridge University Press. https://doi.org/10.1017/CBO9780511606915.019
Beghetto, R., & Karwowski, M. (2017). Toward Untangling Creative Self-Beliefs. In M. Karwowski, & J. Kaufman (Eds.), The Creative Self: Effect of Beliefs, Self-Efficacy, Mindset, and Identity (pp. 3-22). Academic Press. https://doi.org/10.1016/B978-0-12-809790-8.00001-7
Beghetto, R., Baer, J., & Kaufman, J. (2015). Teaching for Creativity in the Common Core Classroom. Teachers College Press.
Bereiter, C., & Scardamalia, M. (1987). The Psychology of Written Composition. L. Erlbaum Associates.
Berzonsky, M., & Sullivan, C. (1992). Social-Cognitive Aspects of Identity style. Journal of Adolescent Research, 7, 140-155. https://doi.org/10.1177/074355489272002
Brown, T., & Wyatt, J. (2010). Design Thinking for Social Innovation. Stanford Social Innovation Review. https://doi.org/10.1596/1020-797X_12_1_29 https://ssir.org/articles/entry/design_thinking_for_social_innovation
Bruner, J. (1979). On Knowing: Essays for the Left Hand. Belknap Press of Harvard University.
Carter, J. (2001). Creating Writers: A Creative Writing Manual for Schools. Routledge/ Falmer. https://doi.org/10.4324/9780203252031 https://epdf.tips/creating-writers-a-creative-writing-manual-for-schools.html
Cropley, A. (1990). Creativity and Mental Health in Everyday Life. Creativity Research Journal, 13, 167-178. https://doi.org/10.1080/10400419009534351
Cropley, A. (2006). In Praise of Convergent Thinking. Creativity Research Journal, 18, 391-404. https://doi.org/10.1207/s15326934crj1803_13
Csikszentmihalyi, M. (1996). Creativity: Flow and the Psychology of Discovery and Invention. Harper Collins Publishers. https://books.google.fr/books/about/Creativity.html?id=K0buAAAAMAAJ&redir_esc=y
Davis, G., & Rimm, S. (1985). Education of the Gifted and Talented. Prentice Hall. https://books.google.fr/books/about/Education_of_the_gifted_and_talented.html?id=2AEmAQAAIAAJ&redir_esc=y
DeCoker, G. (2000). Looking at U.S. Education through the Eyes of Japanese Teachers. Phi Delta Kappan, 81, 780-781.
DeYoung, C. (2014). Openness/Intellect: A Dimension of Personality Reflecting Cognitive Exploration. In M. Cooper, & R. Larsen (Eds.), APA Handbook of Personality and Social Psychology: Personality Processes and Individual Differences (pp. 369-399). American Psychological Association. https://doi.org/10.1037/14343-017 http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.725.2495&rep=rep1&type=pdf
Eisenberger, R., & Shanock, L. (2003). Rewards, Intrinsic Motivation, and Creativity: A Case Study of Conceptual and Methodological Isolation. Creativity Research Journal, 15, 121-130. https://doi.org/10.1207/S15326934CRJ152&3_02 http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.615.6890&rep=rep1&type=pdf
Essex, C. (1996). Teaching Creative Writing in the Elementary School. ERIC Digest. https://files.eric.ed.gov/fulltext/ED391182.pdf
Feist, G. (1998). A Meta-Analysis of Personality in Scientific and Artistic Creativity. Personality and Social Psychology Review, 2, 290-309. https://doi.org/10.1207/s15327957pspr0204_5
Gajda, A., Karwowski, M., & Beghetto, R. (2017). Creativity and Academic Achievement: A Meta-Analysis. Journal of Educational Psychology, 109, 269-299. https://doi.org/10.1037/edu0000133
Getzels, J., & Csikszentmihalyi, M. (1976). The Creative Vision: A Longitudinal Study of Problem Finding in Art. John Wiley & Sons.
Glaveanu, V. et al. (2013). Creativity as Action: Findings from Five Creative Domains. Frontiers in Psychology, 4, Article 176. https://doi.org/10.3389/fpsyg.2013.00176
Grivas, C., & Puccio, G. (2012). The Innovative Team: Unleashing Creative Potential for Breakthrough Results. Jossey-Bass.
Guastello, S. (2009). Creativity and Personality. In T. Rickards, M. Runco, & S. Moger (Eds.), The Routledge Companion to Creativity (pp. 267-278). Routledge/Taylor & Francis. http://psycnet.apa.org/record/2009-03983-022
Guilford, J. (1950). Creativity. American Psychologist, 5, 444-454. https://doi.org/10.1037/h0063487
Guilford, J. (1956). The Structure of Intellect. Psychological Bulletin, 53, 267-293. https://doi.org/10.1037/h0040755
Hatano, G., & Inagaki, K. (1986). Two Courses of Expertise. In H. Stevenson, H. Azuma, & K. Hakuta (Eds.), Child Development and Education in Japan (pp. 262-272). Freeman. https://doi.org/10.4324/9780203888841.ch22
Hennessey, B., & Amabile, T. (2010). Creativity. Annual Review of Psychology, 61, 569-598. https://doi.org/10.1146/annurev.psych.093008.100416
Higgins, S. et al. (2005). A Meta-Analysis of the Impact of the Implementation of Thinking Skills Approaches on Pupils. Eppi-Centre, University of London. http://eppi.ioe.ac.uk
Hoover, S. (1994). Scientific Problem Finding in Gifted Fifth-Grade Students. Roeper Review, 16, 156-159. https://doi.org/10.1080/02783199409553563
Hwang, S. (2015). Classrooms as Creative Learning Communities: A Lived Curricular Expression. https://digitalcommons.unl.edu/teachlearnstudent/55
Irish National Teacher Association (INTO) (2009). Creativity and the Arts in the Primary School. INTO. http://www.into.ie
Kashdan, T., & Fincham, F. (2002). Facilitating Creativity by Regulating Curiosity. The American Psychologist, 57, 373-374. http://www.ncbi.nlm.nih.gov/pubmed/12025769 https://doi.org/10.1037/0003-066X.57.5.373
Kaufman, J., & Baer, J. (2012). Beyond New and Appropriate: Who Decides What Is Creative? Creativity Research Journal, 24, 83-91. https://doi.org/10.1080/10400419.2012.649237
Kaufman, J., & Beghetto, R. (2009). Beyond Big and Little: The Four C Model of Creativity. Review of General Psychology, 13, 1-12. https://doi.org/10.1037/a0013688
Kaufman, J. et al. (2009). Personality and Self-Perceptions of Creativity across Domains. Imagination, Cognition and Personality, 29, 193-209. https://doi.org/10.2190/IC.29.3.c
Kaufman, S. et al. (2016). Openness to Experience and Intellect Differentially Predict Creative Achievement in the Arts and Sciences. Journal of Personality, 84, 248-258. https://doi.org/10.1111/jopy.12156
Kim, Y., Almond, R., & Shute, V. (2016). Applying Evidence-Centered Design for the development of Game-Based Assessments in Physics Playground. International Journal of Testing, 16, 142-163. https://doi.org/10.1080/15305058.2015.1108322
Long, H., & Plucker, J. (2015). Assessing Creative Thinking: Practical Applications. In R. Wegerif, L. Li, & J. Kaufman (Eds.), The Routledge International Handbook of Research on Teaching Thinking (pp. 315-329). Routledge.
Lubart, T. (1998). Creativity across Cultures. In R. Sternberg (Ed.), Handbook of Creativity (pp. 339-350). Cambridge University Press. https://doi.org/10.1017/CBO9780511807916.019
Lucas, B. (2016). A Five-Dimensional Model of Creativity and Its Assessment in Schools. Applied Measurement in Education, 29, 278-290. https://doi.org/10.1080/08957347.2016.1209206
Lucas, B., & Spencer, E. (2017). Teaching Creative Thinking: Developing Learners Who Generate Ideas and Can Think Critically. Crown House Publishing. https://bookshop.canterbury.ac.uk/Teaching-Creative-Thinking-Developing-learners-who-generate-ideas-and-can-think-critically_9781785832369
Mayer, R. (1989). Cognitive Views of Creativity: Creative Teaching for Creative Learning. Contemporary Educational Psychology, 14, 203-211. https://doi.org/10.1016/0361-476X(89)90010-6
McCrae, R. (1987). Creativity, Divergent Thinking, and Openness to Experience. Journal of Personality and Social Psychology, 52, 1258-1265. http://psycnet.apa.org/buy/1987-28199-001 https://doi.org/10.1037/0022-3514.52.6.1258
McCrae, R., & Costa, P. (1987). Validation of the Five-Factor Model of Personality across Instruments and Observers. Journal of Personality and Social Psychology, 52, 81-90. http://www.ncbi.nlm.nih.gov/pubmed/3820081 https://doi.org/10.1037/0022-3514.52.1.81
Mislevy, R., Steinberg, L., & Almond, R. (2003). On the Structure of Educational Assessments. Measurement: Interdisciplinary Research and Perspective, 1, 3-62. https://doi.org/10.1207/S15366359MEA0101_02
Moravcsik, M. (1981). Creativity in Science Education. Science Education, 65, 221-227. https://doi.org/10.1002/sce.3730650212
Nakamura, J., & Csikszentmihalyi, M. (2002). The Concept of Flow. In C. Snyder, & S. Lopez (Eds.), Handbook of Positive Psychology (pp. 89-105). Oxford University Press.
National Advisory Committee on Creative and Cultural Education (1999). All Our Futures: Creativity, Culture and Education. National Advisory Committee on Creative and Cultural Education.
Newell, A., Shaw, J., & Simon, H. (1962). The Processes of Creative Thinking. In H. Gruber, G. Terrell, & M. Wertheimer (Eds.), Contemporary Approaches to Creative Thinking (pp. 63-119). Atherton Press.
Ng, A. (2003). A Cultural Model of Creative and Conforming Behavior. Creativity Research Journal, 15, 223-233. https://doi.org/10.1207/S15326934CRJ152&3_12
Nickerson, R. (1999). Enhancing Creativity. In R. Sternberg (Ed.), Handbook of Creativity (pp. 392-410). Cambridge University Press. https://doi.org/10.1017/CBO9780511807916.022
Nickerson, R. (2010). How to Discourage Creative Thinking in the Classroom. In R. Beghetto, & J. Kaufman (Eds.), Nurturing Creativity in the Classroom (pp. 1-5). Cambridge University Press. https://doi.org/10.1017/CBO9780511781629.002
Niu, W., & Sternberg, R. (2003). Societal and School Influences on Student Creativity: The Case of China. Psychology in the Schools, 40, 103-114. https://doi.org/10.1002/pits.10072
OECD (2010). The OECD Innovation Strategy: Getting a Head Start on Tomorrow. OECD. https://doi.org/10.1787/9789264083479-en
OECD (2017). PISA 2021 Creative Thinking Strategic Advisory Group Report. Organisation for Economic Co-Operation and Development. https://one.oecd.org/document/EDU/PISA/GB(2017)19/en/pdf
Plucker, J., Beghetto, R., & Dow, G. (2004). Why Isn’t Creativity More Important to Educational Psychologists? Potentials, Pitfalls, and Future Directions in Creativity Research. Educational Psychologist, 39, 83-96. https://doi.org/10.1207/s15326985ep3902_1
Prabhu, V., Sutton, C., & Sauser, W. (2008). Creativity and Certain Personality Traits: Understanding the Mediating Effect of Intrinsic Motivation. Creativity Research Journal, 20, 53-66. https://doi.org/10.1080/10400410701841955
Prather, C. (2010). Manager’s Guide to Fostering Innovation and Creativity in Teams. McGraw-Hill.
Reiter-Palmon, R., & Robinson, E. (2009). Problem Identification and Construction: What Do We Know, What Is the Future? Psychology of Aesthetics, Creativity, and the Arts, 3, 43-47. https://doi.org/10.1037/a0014629
Rinne, T., Steel, G., & Fairweather, J. (2013). The Role of Hofstede’s Individualism in National-Level Creativity. Creativity Research Journal, 25, 126-136. https://doi.org/10.1080/10400419.2013.752293
Runco, M. (1997). The Creativity Research Handbook.
Sawyer, R. (2011). What Makes Good Teachers Great? The Artful Balance of Structure and Improvisation. In R. Sawyer (Ed.), Structure and Improvisation in Creative Teaching (pp. 1-24). Cambridge University Press. http://www.cambridge.org https://doi.org/10.1017/CBO9780511997105.002
Scardamalia, M. (2002). Collective Cognitive Responsibility for the Advancement of Knowledge. In B. Smith (Ed.), Liberal Education in a Knowledge Society (pp. 67-98). Open Court.
Schwartz, D., Bransford, J., & Sears, D. (2005). Efficiency and Innovation in Transfer. In J. Mestre (Ed.), Transfer of Learning from a Modern, Multidisciplinary Perspective (Vol. 3, pp. 1-51). Information Age Publishing.
Shute, V. et al. (2016). Advances in the Science of Assessment. Educational Assessment, 21, 34-59. https://doi.org/10.1080/10627197.2015.1127752
Shute, V., Hansen, E., & Almond, R. (2008). You Can’t Fatten a Hog by Weighing It—Or Can You? Evaluating an Assessment for Learning System Called ACED. International Journal of Artificial Intelligence in Education, 18, 289-316. https://dl.acm.org/citation.cfm?id=1497126
Smith, J., & Smith, L. (2010). Educational Creativity. In J. Kaufman, & R. Sternberg (Eds.), The Cambridge Handbook of Creativity (pp. 250-264). Cambridge University Press. https://doi.org/10.1017/CBO9780511763205.016
Spencer, E., & Lucas, B. (2018). Understanding the Role of Creative Self-Efficacy in Youth Social Action. University of Winchester.
Sternberg, R. (2006). The Nature of Creativity. Creativity Research Journal, 18, 87-98. https://www.cc.gatech.edu/classes/AY2013/cs7601_spring/papers/Sternberg_Nature-of-creativity.pdf https://doi.org/10.1207/s15326934crj1801_10
Sternberg, R., & Lubart, T. (1991). An Investment Theory of Creativity and Its Development. Human Development, 34, 1-31. https://doi.org/10.1159/000277029
Sternberg, R., & Lubart, T. (1995). Defying the Crowd: Cultivating Creativity in a Culture of Conformity. Free Press. http://psycnet.apa.org/record/1995-97404-000
Tanggaard, L. (2014). Fooling Around: Creative Learning Pathways. Information Age Publishing.
Tanggaard, L. (2018). Content-Driven Pedagogy: On Passion, Absorption and Immersion as Dynamic Drivers of Creativity. Springer. http://vbn.aau.dk/en/publications/contentdriven-pedagogy(96d07758-fcbe-490c-b090-426c6e096466).html https://doi.org/10.1007/978-3-319-99163-4_9
Tanggard, L., & Glaveanu, V. (2014). Creativity Assessment as Intervention: The Case-Study of Creative Learning. Academic Quarter, 9, 18-30.
Thompson, L., & Choi, H. (2005). Creativity and Innovation in Organizational Teams. Taylor & Francis Group, Psychology Press. https://www.taylorfrancis.com/books/e/9781135612382 https://doi.org/10.4324/9781410615732
Tompkins, G. (1982). Seven Reasons Why Children Should Write Stories. Language Arts, 59, 718-721. https://www.jstor.org/stable/41405103
Torrance, E. (1959). Current Research on the Nature of Creative Talent. Journal of Counseling Psychology, 6, 309-316. https://doi.org/10.1037/h0042285
Torrance, E. (1988). The Nature of Creativity as Manifest in Its Testing. In R. Sternberg (Ed.), The Nature of Creativity: Contemporary Psychological Perspectives (pp. 43-75). Cambridge University Press. http://psycnet.apa.org/record/1988-98009-002
Warhuus, J. et al. (2017). From I to We: Collaboration in Entrepreneurship Education and Learning? Education + Training, 59, 234-249. https://doi.org/10.1108/ET-08-2015-0077
Werner, C. et al. (2014). The Chinese Version of the Revised Creativity Domain Questionnaire (CDQ-R): First Evidence for Its Factorial Validity and Systematic Association with the Big Five. Journal of Creative Behavior, 48, 254-275. https://doi.org/10.1002/jocb.51
Wong, R., & Niu, W. (2013). Cultural Difference in Stereotype Perceptions and Performances in Nonverbal Deductive Reasoning and Creativity. The Journal of Creative Behavior, 47, 41-59. https://doi.org/10.1002/jocb.22
Zhou, J., & Su, Y. (2010). A Missing Piece of the Puzzle: The Organizational Context in Cultural Patterns of Creativity. Management and Organization Review, 6, 391-413. https://doi.org/10.1111/j.1740-8784.2010.00192.x