Validation of the Questionnaire of Students’ Attitudes toward STEM-PBL: Can Students’ Attitude toward STEM-PBL Predict their Academic Achievement? — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Validation of the Questionnaire of Students’ Attitudes toward STEM-PBL: Can Students’ Attitude toward STEM-PBL Predict their Academic Achievement?
University of Alberta, Edmonton, Canada
,
University of Alberta, Edmonton, Canada
,
Mount Saint Vincent University, Halifax, Canada
,
University of Alberta, Edmonton, Canada
,
Department of Psychology, Tehran Central Branch, Islamic Azad University, Tehran, Iran
1 University of Alberta, Edmonton, Canada
2 University of Alberta, Edmonton, Canada
3 Mount Saint Vincent University, Halifax, Canada
4 University of Alberta, Edmonton, Canada
5 Department of Psychology, Tehran Central Branch, Islamic Azad University, Tehran, Iran
The interdisciplinary curriculum of science, technology, engineering, math, and project-based learning (STEM-PBL) has currently received deep contemplation for its diverse benefits. This major attention has been focused on optimizing the curriculum by developing tools for assessing the diverse aspects of STEM in relation to teaching methods (e.g., PBL, teacher-centered learning, and game-based teaching), and students’ attitude. Following the principle of fallibility, the current research examined psychometric properties of the scale of students’ attitudes toward STEM-PBL. Also, the power of predictability of academic achievement by means of students’ attitude, and the mediating role of demographic factors were aimed to explore. The scale was completed by 337 students who were selected randomly. Using confirmatory factor analysis, Graded Response Modeling (GRM) based on Item Response Theory (IRT) provided technical informative details about each item of scale. Examining the items of scale displays reasonable psychometric properties including the validity of Student Attitude toward STEM-PBL Questionnaire. However, the analysis revealed that the removal of one of the items (item 22) may result in a better fit of the questionnaire. The results also showed that attitude toward STEM-PBL can predict students’ academic achievement using grade point average (GPA). Exploring the role of some mediating and demographic factors in this prediction revealed that self-learning had a high significant unique contribution in predicting GPA among respondents. The results displayed the significant association between GPA and students’ father education level. Also, students whose GPA and their fathers’ educational levels were high showed more positive attitude toward self-learning. Furthermore, the time of using technology and hands-on activity as a component of the students’ attitude toward STEM-PBL showed indirect relationship.
Ackerman, T. A., Gierl, M. J., & Walker, C. M. (2003). Using Multidimensional Item Response Theory to Evaluate Educational and Psychological Tests. Educational Measurement: Issues and Practice, 22, 37-53. https://doi.org/10.1111/j.1745-3992.2003.tb00136.x
Asghar, A., Ellington, R., Rice, E., Johnson, F., & Prime, G. M. (2012). Supporting STEM Education in Secondary Science Contexts. Interdisciplinary Journal of Problem-Based Learning, 6, 85-125. https://doi.org/10.7771/1541-5015.1349
Bartolucci, F., Bacci, S., & Gnaldi, M. (2012). MultiLCIRT: An R Package for Multidimensional Latente Class Item Response Models. arXiv:1210.5267v1 [stat.AP].
Capraro, M. M., & Jones, M. (2013). Interdisciplinary STEM Project-Based Learning. In R. M. Capraro, M. M. Capraro, & J. R. Morgan (Eds.), Project-Based Learning: An Integrated Science, Technology, Engineering, and Technology (STEM) Approach (pp.51-58). Rotterdam, The Netherlands: Sense Publishers. https://doi.org/10.1007/978-94-6209-143-6_6
Capraro, R. M., & Corlu, M. S. (2013). Changing Views on Assessment for STEM Project-Based Learning. In R. M. Capraro, M. M. Capraro, & J. R. Morgan (Eds.), Project-Based Learning: An Integrated Science, Technology, Engineering, and Technology (STEM) Approach (pp.109-118). Rotterdam, The Netherlands: Sense Publishers. https://doi.org/10.1007/978-94-6209-143-6_12
Capraro, M. R., & Slough, W. S. (2013). Why PBL? Why Stem? Why Now? An Introduction to Stem Project-Based Learning: An Integrated Science, Technology, Engineering, and Mathematics (Stem) Approach. In R. M. Capraro, M. M. Capraro, & J. R. Morgan (Eds.), Project-Based Learning: An Integrated Science, Technology, Engineering, and Technology (STEM) Approach (pp.1-6). Rotterdam, The Netherlands: Sense Publishers. https://doi.org/10.1007/978-94-6209-143-6_1
Chalmers, P., Pritikin, J, Robitzsch, A., & Zoltak, M. (2015). Mirt: Multidimensional Item Response Theory. (Computer Software) http://CRAN.Rproject.org/package=mirt
Cigdem, H. (2015). How Does Self-Regulation Affect Computer-Programming Achievement in a Blended Context? Contemporary Educational Technology, 6, 19-37.
Corlu, M. S., Capraro, R. M., & Capraro, M. M. (2014). Introducing STEM Education: Implications for Educating Our Teachers for the Age of Innovation. Education and Science, 39, 74-85.
Corsini, R. (2002). The Dictionary of Psychology. New York: Brunner-Routledge.
De Champlain, A. F. (2010). A Primer on Classical Test Theory and Item Response Theory for Assessments in Medical Education. Medical Education, No. 44, 109-117. https://doi.org/10.1111/j.1365-2923.2009.03425.x
Duke, N. K., Halvorsen, A.-L. & Strachan, S. L. (2016). Project-Based Learning Not Just for STEM Anymore. Phi Delta Kappan: SAGE Journal, 98, 14-19. https://doi.org/10.1177/0031721716666047
Ghasemi, V. (2011). Structural Equation Modeling in Social Research Using Amos Graphics. Iran: Jameeshenasan.
Hall, A., & Miro, D. (2016). A Study of Student Engagement in Project-Based Learning across Multiple Approaches to STEM Education Programs. School Science and Mathematics, 116, 310-319. https://doi.org/10.1111/ssm.12182
Hamaideh, S. H., & Hamdan-Mansour, A. M. (2014). Psychological, Cognitive, and Personal Variables That Predict College Academic Achievement among Health Sciences Students. Nurse Education Today, 34, 703-708. https://doi.org/10.1016/j.nedt.2013.09.010
Han, S. (2017). Korean Students’ Attitudes toward STEM Project-Based Learning and Major Selection. Educational Sciences: Theory & Practice, 17, 529-548. https://doi.org/10.12738/estp.2017.2.0264
Han, S., & Carpenter, D. (2014). Construct Validation of Student Attitude toward Science, Technology, Engineering, and Mathematics Project-Based Learning: The Case of Korean Middle Grade Students. Middle Grades Research Journal, 9, 27-41.
Han, S., Capraro, R. M., & Capraro, M. M. (2016). How Science, Technology, Engineering, and Mathematics Project-Based Learning Affects High-Need Students in the U.S. Learning and Individual Differences, 51, 157-166. https://doi.org/10.1016/j.lindif.2016.08.045
Han, S., Capraro, R., & Capraro, M. M. (2014). How Science, Technology, Engineering, and Mathematics (STEM) Project-Based Learning (PBL) Affects High, Middle, and Low Achievers Differently: The Impact of Student Factors on Achievement. International Journal of Science and Mathematics Education, 13, 1089-1113.
Han, S., Rosli, R., Capraro, M. M., & Capraro, R. M. (2016). The Effect of Science, Technology, Engineering and Mathematics (STEM) Project-Based Learning (PBL) on Students’ Achievement in Four Mathematics Topics. Journal of Turkish Science Education, 13, 3-29. http://www.tused.org
Henning, K. J. (2013). Attitude and Achievement: A Study of Parent and Student Attitudes towards Education and Their Effects on Achievement. Master’s Thesis, Wichita: Wichita State University.
Hoge, B. (2013). Authentic Learning through GBL: Using Inquiry and PBL Strategies to Accomplish Specific Learning Outcomes through Smart Games in Formal and Informal Settings. In International Conference on Cognition and Exploratory Learning in Digital Age (pp. 363-366). International Association for Development of the Information Society.
Hooman, H. (2012). Multivariate Data Analysis in Science Research (3th ed.). Tehran: Peyke Farhang.
Islamic Republic News Agency (2016). Restriction of Educational Programs: Opportunity or Threat of Employment. http://www.irna.ir/fa/News/82161605
Kumari, S., & Nandal, S. (2016). Emergence of Project-Based Learning in Professional Education. Scholedge International Journal of Multidisciplinary & Allied Studies, 3, 208-214. https://doi.org/10.19085/journal.sijmas031001
LaForce, M., Noble, E., & Blackwell, C. (2017). Problem-Based Learning (PBL) and Student Interest in STEM Careers: The Roles of Motivation and Ability Beliefs. Education Sciences, 7, 92. https://doi.org/10.3390/educsci7040092
Lim, H., Cha, J., & Noh, T. (2001). The Relationships of Verbal Behaviors with Learning Variables in Cooperative Learning Environments, and Middle School Students’ Perceptions of Cooperative Learning. Journal of the Korean Association for Research in Science Education, 21, 487-496.
Lou, S. J., Liu, Y. H., Shih, R. C., & Tseng, K. H. (2011). The Senior High School Students’ Learning Behavioral Model of STEM in PBL. International Journal of Technology Design Education, 21, 161-183.
Mohr-Schroeder, M. J., Jackson, C., Miller, M., Walcott, B., Little, D. L., Speler, L., Schooler, W., & Schroeder, D. C. (2014). Developing Middle School Students’ Interests in STEM via Summer Learning Experiences: See Blue STEM Camp. School Science and Mathematics, 114, 291-301. https://doi.org/10.1111/ssm.12079
Muraki, E., & Carlson, E. J. (1993). Full-Information Factor Analysis for Polytomous Item Responses. In Annual Meeting of the American Educational Research Association (pp. 1-33). Atlanta, GA, 12-16 April 1993.
Najafi, M., Ebrahimitabass, E., Dehghani, A., & Rezaei, M. (2012). Students’ Attitude towards Science and Technology. Interdisciplinary Journal of Contemporary Research in Business, 3, 129-134.
Oscarsson, M., Jidesjö, A., Karlsson, K.-G., & Strömdahl, H. (2009). Science in Society or Science in School: Swedish Secondary School Science Teachers’ Beliefs about Science and Science Lessons in Comparison with What Their Students Want to Learn. Nordina, 5, 18-34. https://doi.org/10.5617/nordina.280
Rubio, V., Aguado, D., Hontangas, P. M., & Hernindez, J. M. (2007). Psychometric Properties of an Emotional Adjustment Measure: An Application of the Graded Response Model. European Journal of Psychological Assessment, 23, 39-46. https://doi.org/10.1027/1015-5759.23.1.39
Sahin, A. (2013). STEM Project-Based Learning: Specialized form of Inquiry-Based Learning. In R. M. Capraro, & W. W. Slough (Eds.), Project-Based Learning: An Integrated Science, Technology, Engineering, and Technology (STEM) Approach (pp. 59-64). Rotterdam: Sense Publishers.
Samejima, F. (1969). Estimation of Latent Trait Ability Using a Response Pattern of Graded Scores. Psychometrika Monograph, 34, 1-100. https://doi.org/10.1007/BF03372160
Schreiner, C., & Sjøberg, S. (2004). ROSE: The Relevance of Science Education. Sowing the Seeds of ROSE. Background, Rationale, Questionnaire Development and Data Collection for ROSE—A Comparative Study of Students’ Views of Science and Science Education. Oslo: Department of Teacher Education and School Development, University of Oslo. http://www.ils.uio.no/forskning/rose
Shahin, A., & Top, N. (2015). STEM Students on the Stage (SOS): Promoting Student Voice and Choice in STEM Education through an Interdisciplinary, Standards-Focused, Project-Based Learning Approach. Journal of STEM Education, 16, 24-33.
Shojaee, M., Bulut, O., & Shahidi, M. (2016). Examining Psychometric Properties of the Kutcher Adolescent Depression Scale (kads-11) Using Multidimensional Item Response Theory. International Journal of Current Research, 8, 27120-2713.
Stearns, L. M., Morgan, J., Capraro, M. M., & Capraro, R. M. (2012). A Teacher Observation Instrument for PBL Classroom Instruction. Journal of STEM Education, 13, 7-16.
Steinmayr, R., Meissner, A., Weidinger, A. F., & Wirthwein, L. (2015). Academic Achievement. Oxford Bibliographies. https://doi.org/10.1093/obo/9780199756810-0108 http://www.oxfordbibliographies.com/view/document/obo-9780199756810/obo-9780199756810-0108.xml
Tabachnick, B. G., & Fidell, L. S. (2007). Using Multivariate Statistics (5th ed.). Boston: Allyn & Bacon.
Tawfik, R., & Trueman, R. (2015). Effects of Case Libraries in Supporting a Problem-Based Learning STEM Course. Journal of Educational Technology Systems, 44, 5-21. https://doi.org/10.1177/0047239515596724
Tseng, K.-H., Chang, C.-C., Lou, S.-J., & Chen, W.-P. (2013). Attitudes towards Science, Technology, Engineering and Mathematics (STEM) in a Project-Based Learning (PjBL) Environment. International Journal of Technology Design Education, 23, 87-102. https://doi.org/10.1007/s10798-011-9160-x
Tsigarides, J., Wingfield, L. R., & Kulendran, M. (2017). Does a PBL-Based Medical Curriculum Predispose Training in Specific Career Paths? A Systematic Review of the Literature. BMC Research Notes, 10, 24. https://doi.org/10.1186/s13104-016-2348-0
Veresova, M., & Dana Mala, D. (2016). Attitude toward School and Learning and Academic Achievement of Adolescents. The European Proceedings of Social & Behavioral Sciences, 870-876. https://doi.org/10.15405/epsbs.2016.11.90
Wallace, M. F. G., & Webb, A. W. (2016). In the Midst of a Shift: Undergraduate STEM Education and “PBL” Enactment. Journal of College Science Teaching, 46, 47-55. https://doi.org/10.2505/4/jcst16_046_02_47