Identification of Key Performance Indicators through E-Learning Critical Success Factors for an Online Course of English for Football — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Identification of Key Performance Indicators through E-Learning Critical Success Factors for an Online Course of English for Football
English Language and Literature, Payame Noor University, Tehran, Iran
,
English Language and Literature, Tarbiat Modares University, Tehran, Iran
1 English Language and Literature, Payame Noor University, Tehran, Iran
2 English Language and Literature, Tarbiat Modares University, Tehran, Iran
The main goal of this study was to identify Key Performance Indicators (KPI) through e-learning Critical Success Factors (CSF) for an online course of English for Football in Iran. To this end, the researchers prioritized the e-learning CSFs proposed in the literature from an emic perspective exclusively for the online course of English for Football as a case study. The expert participants in this study were certified football coaching instructors from Iran Football Federation who took an open-ended questionnaire and wrote their statements of success for each CSF and rated them on Analytical Hierarchy Process (AHP) ratio scale through pairwise comparisons. Based on the col lected statements of success, the researchers identified KPIs for an e-learning course of English for football. This study resulted in 24 KPIs in line with the CSFs in the literature and the statements of success proposed by the participants of this study. The results of AHP on the CSFs showed that respectively: course, instructor’s characteristics, learner’s characteristics, learning environment, instructional design, support, level of collaboration, knowledge management and technology knowledge were the important CSFs. Finally, the researchers arrived at KPIs based on each ranked CSFs and statements of success. This study could have implications for the ESP curriculum developers and online course organizers to strengthen their course structure by identifying, prioritizing and setting down CSFs and KPIs.
KeywordsKey Performance IndicatorCritical Success FactorE-LearningEnglish for Football
Alqahtani, A. Y., & Rajkhan, A. A. (2020). E-earning Critical Success Factors during COVID-19 Pandemic: A Comprehensive Analysis of e-Leaning Managerial Perspectives. Education Sciences, 10, 216. https://doi.org/10.3390/educsci10090216
Arif, M., & Smiley, F. (2004). Baldrige Theory into Practice: A Working Model. International Journal of Educational Management, 18, 324-328. https://doi.org/10.1108/09513540410543475
Badawy, M., El Aziz, A., Idress, A. M., Hefny, H., & Hossam, S. (2016). A Survey on Exploring Key Performance Indicators. Future Computing and Informatics Journal, 1, 47-52. https://doi.org/10.1016/j.fcij.2016.04.001
Ballard, P. J. (2013). Measuring Performance Excellence: Key Performance Indicators for Institutions Accepted into AQIP. Western Michigan University. https://scholarworks.wmich.edu/cgi/viewcontent.cgi?article=1198&context=dissertations
Benigno, V., & Trentin, G. (2002).The Evaluation of Online Courses. Journal of Computer Assisted Learning, 16, 259-270. https://doi.org/10.1046/j.1365-2729.2000.00137.x
Bhuasiri, W., Xaymoungkhoun, O., Zo, H., Rho, J. J., & Ciganek, A. (2012). Critical Success Factors for e-Learning in Developing Countries: A Comparative Analysis between ICT Experts and Faculty. Computers & Education, 58, 843-855. https://doi.org/10.1016/j.compedu.2011.10.010
Borden, V., & Bottrill, K. (1994). Performance Indicators; Histories, Definitions and Methods. New Directions for Institutional Research, 82, 5-21. https://doi.org/10.1002/ir.37019948203
Bruwer, J. (1998). First Destination Graduate Employment as Key Performance Indicator: Outcomes Assessment Perspectives. In Australian Australasian Association for Institutional Research (AAIR) Annual Forum.
Burke, J. C. (1998). Performance Funding: Arguments and Answers. New Directions for Institutional Research, 97, 85-90. https://doi.org/10.1002/ir.9707
Burke, J. C., Minassians, H., & Yang, P. (2002). State Performance Reporting Indicators: What Do They Indicate? Planning for Higher Education, 31, 15-29.
Caione, A., Paiano, R., Guido, A. L., Pandurino, A., & Pasanisi, S. (2016). E-Learning Project Assessment: A New Approach through the Analysis of Learners’ Posts on Social Media. EAI Endorsed Transactions on e-Learning, 3, 3-10. https://doi.org/10.4108/eai.10-3-2016.151121
Caione, A., Guido, A. L., Paiano, R., Pandurino, A., & Pasanisi, S. (2017). KPIs Identification for Evaluating e-Learning Courses through Students’ Perceptions. EAI Endorsed Transcriptions on E-Learning, 4, 2-9. https://doi.org/10.4108/eai.20-6-2017.152743
Carter, N., Klein, R., & Day, P. (1992). How Organizations Measure Success: The Use of Performance Indicators in Government. Routledge
Cave, M., Hanney, S., Henkel, M., & Kogan, M. (1997). The Use of Performance Indicators in Higher Education: The Challenge of the Quality Movement (3rd ed.). Jessica Kingsley.
Chaibate, H., Hadek, A., Ajana, S., & Bakkali, S. (2021). Analytical Hierarchy Process Applied to Pedagogical Method Selection Problems. Educational Research International, 2021, Article ID: 6664758. https://doi.org/10.1155/2021/6664758
Chalmers, D. (2008). Teaching and Learning Quality Indicators in Australian Universities. In OECD/IMHE. [Conference Presentation] Outcomes of Higher Education: Quality, Relevance and Impact.
Cheawjindakarn, B., Suwannatthachote, P., & Theeraroungchaisri, A. (2013). Critical Success Factors for Online Distance Learning in Higher Education: A Review of the Literature. Creative Education, 3, 61-66. https://doi.org/10.4236/ce.2012.38B014
Dillon, C. L., & Guawardena, C. N. (1995). A Framework for the Evaluation of Telecommunications-Based Distance Education. In 17th Congress of the International Council for Distance Education, Open University, Milton Keynes, pp. 348–351.
Doran, G. T. (1981). There’s an S.M.A.R.T. Way to Write Management’s Goals and Objectives. Management Review, 70, 35-36.
Dust, B. (2007). The E-Learning Guild’s Online Forums. E-Learning Metrics. http://www.elearningguild.com/olf/olfarchives/index.cfm?id=356&action=viewonly
Frimpon, M. (2012). A Re-Structuring of the Critical Success Factors for E-Learning Deployment. American International Journal of Contemporary Research, 2, 115-127.
Govindasamy, T. (2001). Successful Implementation of e-Learning Pedagogical Considerations. The Internet and Higher Education, 4, 287-299. https://doi.org/10.1016/S1096-7516(01)00071-9
Graf, D., & Caines, M. (2001). WebCT Exemplary Course Project. WebCT User Conference, Vancouver, Canada. Retrieved June 28, 2004. http://www.webct.com/exemplary/home
Griffee, D. T. (2012). An Introduction to Second Language Research Methods: Design and Data. TESL-EJ Publications.
Hall, B. (1997). Web-Based Training Cookbook. John Wiley & Sons.
Hilgarth, B. (2011). E-Learning Success in Action! From Case Study Research to the Creation of the Cybernetic e-Learning Management Model. International Journal of Computer Information Systems and Industrial Management Application, 3, 415-426.
Jahangirian, M., Taylor, S., Young, T., & Robinson, S. (2017). Key Performance Indicators for Successful Simulation Projects. Journal of the Operational Research Society, 68, 747-765. https://doi.org/10.1057/jors.2016.1
Leidecker, J. K., & Bruno, A. V. (1984). Identifying and Using Critical Success Factors. Long Range Plan, 17, 23-32. https://doi.org/10.1016/0024-6301(84)90163-8
Leidner, D. E., & Jarvenpaa, S. L. (1993). The Information Age Confronts Education: Case Studies on Electronic Classroom. Information Systems Research, 4, 24-54. https://doi.org/10.1287/isre.4.1.24
Lyddon, J. W., & Comb, B. E. (2008). Strategic Reporting Tool: Balanced Scorecards in Higher Education. Journal of Applied Research in the Community College, 15, 163-170.
Malik, M. W. (2010). Factors Effecting Learner’s Satisfaction towards E-Learning: A Conceptual Framework. OIDA. International Journal of Sustainable Development, 2, 77-82.
Papp, R. (2000). Critical Success Factors for Distance Learning. In [Conference Presentation]. The Americas Conference on Information Systems. Long Beach.
Parmenter, D. (2015). Key Performance Indicators: Developing, Implementing, and Using Winning KPIs (3rd ed.). John Wiley. https://doi.org/10.1002/9781119019855
Prougestaporn, P., Visansakon, T., & Saowapakpongchai, K. (2015). Key Success Factors and Evaluation Criteria of e-Learning Websites for Higher Education. International Journal of Information and Education Technology, 5, 233. https://doi.org/10.7763/IJIET.2015.V5.507
Richardson, J. T. E. (1994). A British Evaluation of the Course Experience Questionnaire. Studies in Higher Education, 19, 59-68. https://doi.org/10.1080/03075079412331382143
Rockart, J. (1979) Chief Executives Define Their Own Data Needs. Harvard Business Review, 52, 81-93.
Romainville, M. (1999). Quality Evaluation of Teaching in Higher Education. Higher Education in Europe, 24, 414-424. https://doi.org/10.1080/0379772990240309
Saaty, T. L. (1980). The Analytic Hierarchy Process: Planning, Priority Setting, Resources Allocation. McGraw-Hill.
Selim, H. M. (2007). E-Learning Critical Success Factors: An Exploratory Investigation of Student Perceptions. International Journal of Technology Marketing, 2, 157-182. https://doi.org/10.1504/IJTMKT.2007.014791
Siritongthaworn, S., Krairit, D., Dimmitt, N. J., & Paul, H. (2006). The Study of e-Learning Technology Implementation: A Preliminary Investigation of Universities in Thailand. Education and Information Technologies, 11, 137-160. https://doi.org/10.1007/s11134-006-7363-8
Soong, B. M. H., Chan, H. C., Chua, B. C., & Loh, K. F. (2001). Critical Success Factors for On-Line Course Resources. Computers & Education, 36, 101-120. https://doi.org/10.1016/S0360-1315(00)00044-0
Sun, P. C., Tasi, R. J., Finger, G., Chen, Y. Y., & Yeh, D. (2008). What Drives a Successful E-Learning? An Empirical Investigation of the Critical Factors Influencing Learner Satisfaction. Computer and Education, 50, 1183-1202. https://doi.org/10.1016/j.compedu.2006.11.007
Urdan, T. A., & Weggen C. C. (2000). Corporate e-Learning: Exploring a New Frontier. WR Hambrecht + Co.
Volery, T., & Lord, D. (2000). Critical Success Factors in Online Education. The International Journal of Educational Management, 14, 216-223. https://doi.org/10.1108/09513540010344731