Designing a Pronunciation Self-Assessment Checklist for Aircraft Engineering Technology Students in an ESL Higher Education Context — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Designing a Pronunciation Self-Assessment Checklist for Aircraft Engineering Technology Students in an ESL Higher Education Context
Department of English, Universiti Putra Malaysia, Serdang, Malaysia
,
Department of English, Universiti Putra Malaysia, Serdang, Malaysia
,
School of English, University of Sheffield, Sheffield, UK
,
School of Education, Taylor’s University, Subang Jaya, Malaysia
,
Student Development Department, Universiti Kuala Lumpur, Kuala Lumpur, Malaysia
,
Aerospace Department, Universiti Kuala Lumpur, Kuala Lumpur, Malaysia
1 Department of English, Universiti Putra Malaysia, Serdang, Malaysia
2 Department of English, Universiti Putra Malaysia, Serdang, Malaysia
3 School of English, University of Sheffield, Sheffield, UK
4 School of Education, Taylor’s University, Subang Jaya, Malaysia
5 Student Development Department, Universiti Kuala Lumpur, Kuala Lumpur, Malaysia
6 Aerospace Department, Universiti Kuala Lumpur, Kuala Lumpur, Malaysia
The aim of this study was to design a useful self-assessment checklist for pronunciation as a pedagogical tool for use by Bachelor of Aircraft Engineering Technology students in an ESL Higher Education context in a private university in Malaysia. The emphasis on pronunciation arose from the importance attached to communications in maximising safety in the aviation industry. Self-assessment was operationalised as developing students’ understanding of how to self-assess. Globally, self-assessment of pronunciation is a subject of interest, with the number of studies increasing in recent years. Whereas previous studies tended to focus on perceptual training or on the reliability and accuracy of self-assessment, this study focused on students’ awareness of their use of learning strategies before, during and after a speaking activity. The checklist design was adapted from other checklists and based on the literature review. The checklist items to be completed and the accompanying extended guide were contained in two separate documents. These documents were submitted for expert validation, followed by semi-structured interviews with Aviation English teachers and a structured group interview with students, to ensure clarity and understanding of the checklist. Interesting issues regarding criteria, item wording and layout were raised by experts (n = 2), teachers (n = 2) and students (n = 8), which led to changes in the checklist and the creation of a single document incorporating the extended guide. This is an ongoing study that will ensure the usefulness of the checklist prior to its implementation in Aviation English classes for aircraft maintenance students at the university.
KeywordsSelf-AssessmentEFL/ESLPronunciationAircraft Engineering Technology Students
Accessibility Guidelines Working Group (2022). W3C Accessibility Guidelines (WCAG) 3.0 : W3C Working Draft 21 January 2021 . https://www.w3.org/TR/2021/WD-wcag-3.0-20210121/
Anderson, N. J. (2008). Metacognition and Good Language Learners. In C. Griffiths (Ed.), Lessons from Good Language Learners (Cambridge Language Teaching Library) (pp. 99-109). Cambridge University Press. https://doi.org/10.1017/CBO9780511497667.010
Andrade, H. (2019). A Critical Review of Research on Student Self-Assessment. Frontiers in Education, 4, Article 87. https://doi.org/10.3389/feduc.2019.00087
Andrade, H., & Valtcheva, A. (2009). Promoting Learning and Achievement through Self-assessment. Theory into Practice, 48, 12-19. https://doi.org/10.1080/00405840802577544
Australian Government Style Manual (n.d.). https://www.stylemanual.gov.au/
Butler, Y. G. (2023). Self-assessment in Second Language Learning. Language Teaching , 56, 1-15. https://doi.org/10.1017/S0261444822000489
Civil Aviation Authority of Malaysia (CAAM) (2021). Aircraft Maintenance Licence CAAM Part 66. Civil Aviation Directive 1801, Issue 1, Revision 00 . https://www.caam.gov.my/wp-content/uploads/2021/04/CAD-1801-Aircraft-Maintenance-Licence-CAAM-Part-66-1.pdf
Cojo Guatame, A. (2019). Fostering Segmental Pronunciation through Self-Assessment . Unpublished Master Report, Universidad de La Sabana.
Council of Europe (2020). CEFR Phonological Scale . https://rm.coe.int/chapter-5-communicative-language-competences/1680a084c3
Creswell, J. W. A. (2014). Concise Introduction to Mixed Methods Research (4th ed.). SAGE Publications.
Department of Civil Aviation Malaysia (DCAM) (2014). English Language Proficiency (ELP) for Aircraft Maintenance Licence (AML) Personnel . Airworthiness Guidance Ag No. 1101, Issue 1.
Derwing, T. M., & Rossiter, M. J. (2003). ESL Learners’ Perceptions of Their Pronunciation Needs and Strategies. System , 30, 155-166. https://doi.org/10.1016/S0346-251X(02)00012-X
Dlaska, A., & Krekeler, C. (2008). Self-Assessment of Pronunciation. System: An Intern a tional Journal of Educational Technology and Applied Linguistics, 36, 506-516. https://doi.org/10.1016/j.system.2008.03.003
Dörnyei, Z. (2003). Questionnaires in Second Language Research: Construction, Admin i stration, and Processing . Lawrence Erlbaum Associates.
Drury, C. G., Ma, J., & Marin, C. V. (2005). Language Error in Aviation Maintenance: F i nal Report . Prepared for: Federal Aviation Administration William J. Hughes Technical Center, the Federal Aviation Administration under research grant #2002-G-025.
Eckstein, G. T. (2007). A Correlation of Pronunciation Learning Strategies with Spont a neous English Pronunciation of Adult ESL Learners . Unpublished Master Dissertation, Brigham Young University.
Gralińska-Brawata, A. (2022). Polish Learners’ Self-Assessment and Reflections on Their Pronunciation Progress. Językoznawstwo , 2, 229-252. https://doi.org/10.25312/2391-5137.17/2022_17agb
Harris, L. R., & Brown, G. T. L. (2018). Using Self-Assessment to Improve Student Learning . Routledge. https://doi.org/10.4324/9781351036979
Haukås, Å. (2018). Metacognition in Language Learning and Teaching: An Overview. In Å. Haukås, C. Bjørke, & M. Dypedahl (Eds.), Metacognition in Language Learning and Teaching (pp. 11-30). Routledge. https://doi.org/10.4324/9781351049146-2
Hua, C. (2023). Pronunciation Assessment of Learners, by Learners, and for Learners: Effects, Validity and Reliability, and Learners’ Perception. Language Teaching Research , 1-19. https://doi.org/10.1177/13621688231195143
International Civil Aviation Organization (ICAO) (2010). Publication of Doc 9835- AN / 453 . Order No. 9835.
Isaacs, T., & Harding, L. (2017). Research Timeline: Pronunciation Assessment. Language Teaching, 50, 347-366. https://doi.org/10.1017/S0261444817000118
Isaacs, T., Trofimovich, P., & Foote, J. A. (2018). Developing a User-Oriented Second Language Comprehensibility Scale for English-medium Universities. Language Testing, 35, 193-216. https://doi.org/10.1177/0265532217703433
Jankowska, A., & Zielińska, U. (2015). Designing a Self-Assessment Instrument for Developing the Speaking Skill at the Advanced Level. In M. Pawlak, & E. Waniek-Klimczak (Eds.), Issues in Teaching, Learning and Testing Speaking in a Second La n guage. Second Language Learning and Teaching (pp. 251-265). Springer. https://doi.org/10.1007/978-3-642-38339-7_16
Jessner, U. (2018). Metacognition in Multilingual Learning: A DMM Perspective. In Å. Haukås, C. Bjørke, & M. Dypedahl (Eds.), Metacognition in Language Learning and Teaching (pp. 31-47). Routledge. https://doi.org/10.4324/9781351049146-3
Levis, J. M., & McCrocklin, S. (2018). Reflective and Effective Teaching of Pronunciation. In M. Zeraatpishe, A. Faravani, H. R. Kargozari, & M. Azarnoosh (Eds.), Issues in A p plying SLA Theories Toward Reflective and Effective Teaching (pp. 77-89). Brill. https://doi.org/10.1163/9789004380882_007
Levis, J.M. (2020). Revisiting the Intelligibility and Nativeness Principles. Journal of Se c ond Language Pronunciation, 6, 310-328. https://doi.org/10.1075/jslp.20050.lev
Moder, C. L. (2014). Aviation English. In B. Paltridge, & S. Starfield (Eds.), The Han d book of English for Specific Purposes (pp. 227-242). John Wiley & Sons. https://doi.org/10.1002/9781118339855.ch12
Muijs, D., & Bokhove, C. (2020). Metacognition and Self-Regulation: Evidence Review . Education Endowment Foundation.
Nimehchisalem, V., Yoong, D., Singh, S., Zainuddin, S. Z., Norouzi, S., & Khalid A. S. (2014). A Self-Assessment Checklist for Undergraduate Students’ Argumentative Writing. Advances in Language and Literary Studies , 5 , 65-80. https://doi.org/10.7575/aiac.alls.v.5n.1p.65
Oxford, R. L. (1990). Language Learning Strategies: What Every Teacher Should Know . Newbury House Publishers.
Panadero, E., Jonsson, A., & Strijbos, J. W. (2016). Scaffolding Self-regulated Learning through Self-Assessment and Peer Assessment: Guidelines for Classroom Implementation. In D. Laveault, & L. Allal (Eds.), Assessment for Learning: Meeting the Challenge of Implementation (pp. 311-326). Springer. https://doi.org/10.1007/978-3-319-39211-0_18
Pawlak, M., & Szyszka, M. (2018). Researching Pronunciation Learning Strategies: An Overview and a Critical Look. Studies in Second Language Learning and Teaching, 8, 293-323. https://doi.org/10.14746/ssllt.2018.8.2.6
Pennington, M. C., & Rogerson-Revell, P. (2019). English Pronunciation Teaching and Research: Contemporary Perspectives . Palgrave Macmillan. https://doi.org/10.1057/978-1-137-47677-7
Peterson, S. (2000). Pronunciation Learning Strategies: A First Look . Research Report. https://files.eric.ed.gov/fulltext/ED450599.pdf
Rashid, R. A., Abdul Rahman, S. B., & Yunus, K. (2017). Reforms in the Policy of English Language Teaching in Malaysia. Policy Futures in Education, 15, 100-112. https://doi.org/10.1177/1478210316679069
Richey, R. C., & Klein, J. D. (2005). Developmental Research Methods: Creating Knowledge from Instructional Design and Development Practice. Journal of Computing in Higher Education, 16, 23-38. https://doi.org/10.1007/BF02961473
Richey, R. C., & Klein, J. D. (2014). Design and Development Research. In J. Spector, M. Merrill, J. Elen, & M. Bishop (Eds.), Handbook of Research on Educational Commun i cations and Technology (pp. 141-150). Springer.
Richey, R. C., Klein, J. D., & Nelson, W. A. (2004). Developmental Research: Studies of Instructional Design and Development. In D. H. Jonassen (Ed.), Handbook of Research on Educational Communications and Technology (pp. 1099-1130). Lawrence Erlbaum Associates.
Rowlands, K. D. (2007). Check It Out! Using Checklists to Support Student Learning. English Journal , 96, 61-66. https://doi.org/10.58680/ej20075818
Sardegna. V. G. (2022). Evidence in Favor of a Strategy-Based Model for English Pronunciation Instruction. Language Teaching, 55, 363-378. https://doi.org/10.1017/S0261444821000380
Sulistyowati, T., Mujianto, J., Rukmini, D., & Hartono, R. (2022). The Influence of Socio-Affective Learning and Metacognition Levels on EFL Listening and Speaking Skills in Online Learning. International Journal of Learning, Teaching and Educational Research , 21, 436-456. https://doi.org/10.26803/ijlter.21.10.24
Vandergrift, L., Goh, C. C. M., Mareschal, C, J., & Tafaghodtari, M. H. (2006). The Metacognitive Awareness Listening Questionnaire: Development and Validation. Language Learning, 56, 431-462. https://doi.org/10.1111/j.1467-9922.2006.00373.x
Wang, X. (2020). Segmental Versus Suprasegmental: Which One Is More Important to Teach? RELC Journal, 53, 194-202. https://doi.org/10.1177/0033688220925926
Wyatt, R. C., & Meyers, L. S. (1987). Psychometric Properties of Four 5-Point Likert Type Response Scales. Educational and Psychological Measurement, 47, 27-35. https://doi.org/10.1177/0013164487471003
Yan, Z., & Brown, G. T. L. (2017). A Cyclical Self-Assessment Process: Towards a Model of How Students Engage in Self-assessment. Assessment & Evaluation in Higher Ed u cation, 42, 1247-1262. https://doi.org/10.1080/02602938.2016.1260091
Yan, Z., & Carless, D. (2022). Self-Assessment Is about More than Self: The Enabling Role of Feedback Literacy. Assessment & Evaluation in Higher Education, 47, 1116-1128. https://doi.org/10.1080/02602938.2021.2001431
Zhang, W., Zhao, M., & Zhu, Y. (2022). Understanding Individual Differences in Metacognitive Strategy Use, Task Demand, and Performance in Integrated L2 Speaking Assessment Tasks. Frontiers in Psychology, 13 , Article 876208. https://doi.org/10.3389/fpsyg.2022.876208
Zimmerman, B. J., & Moylan, A. R. (2009). Self-regulation: Where Metacognition and Motivation Intersect. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of Metacognition in Education (pp. 311-328). Routledge.