Monitoring students’ level of engagement during learning activities is an important challenge in the development of tutoring interventions. In this paper, we explore the feasibility of using electroencephalographic signals (EEG) as a tool to monitor the mental engagement index of novice medicine students during a reasoning process. More precisely, the objectives were first, to track students’ mental engagement evolution in order to investigate whether there were particular sections within the learning environment that aroused the highest engagement level among the students, and, if so, did these sections have an impact on learners’ performance. Experimental analyses showed the same trends in the different resolution phases as well as across the different regions of the environments. However, we noticed a higher engagement index during the treatment identification phase since it aroused more mental effort. Moreover statistically significant effects were found between mental engagement and students’ performance.
Jraidi, I., Chaouachi, M. and Frasson, C. (2013) A Dynamic Multimodal Approach for Assessing Learners’ Interaction Experience. 15th International Conference on Multimodal Interaction, Sydney, 9-13 December 2013, 271-278. https://doi.org/10.1145/2522848.2522896
Ben Khedher, A., Jraidi, I. and Frasson, C. (2018) Static and Dynamic Eye Movement Metrics for Students’ Performance Assessment. Smart Learning Environments, 5, 14. https://doi.org/10.1186/s40561-018-0065-y
Ben Khedher, A., Jraidi, I. and Frasson, C. (2017) Assessing Learners’ Reasoning Using Eye Tracking and a Sequence Alignment Method. International Conference on Intelligent Computing, Liverpool, 7-10 August 2017, 47-57. https://doi.org/10.1007/978-3-319-63312-1_5
Roach, B.J. and Mathalon, D.H. (2008) Event-Related EEG Time-Frequency Analysis: An Overview of Measures and an Analysis of Early Gamma Band Phase Locking in Schizophrenia. Schizophrenia Bulletin, 34, 907-926. https://doi.org/10.1093/schbul/sbn093
Ben Hamida, S., Penzel, T. and Ahmed, B. (2015) EEG Time and Frequency Domain Analysis of Primary Insomnia. 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, 25-29 August 2015, 6206-6209.
Loo, S.K., Lenartowicz, A. and Makeig, S. (2016) Use of EEG Biomarkers in Child Psychiatry Research: Current State and Future Directions. Journal of Child Psychology and Psychiatry, 57, 4-17. https://doi.org/10.1111/jcpp.12435
Soleymani, M., Asghari-Esfeden, S., Fu, Y. and Pantic, M. (2016) Analysis of EEG Signals and Facial Expressions for Continuous Emotion Detection. IEEE Transactions on Affective Computing, 7, 17-28. https://doi.org/10.1109/TAFFC.2015.2436926
Kim, J., Seo, J. and Laine, T.H. (2018) Detecting Boredom from Eye Gaze and EEG. Biomedical Signal Processing and Control, 46, 302-313. https://doi.org/10.1016/j.bspc.2018.05.034
Zhuang, N., Zeng, Y., Tong, L., Zhang, C., Zhang, H. and Yan, B. (2017) Emotion Recognition from EEG Signals Using Multidimensional Information in EMD Domain. BioMed Research International, 2017, Article ID: 8317357. https://doi.org/10.1155/2017/8317357
Wang, X.-W., Nie, D. and Lu, B.-L. (2014) Emotional State Classification from EEG Data Using Machine Learning Approach. Neurocomputing, 129, 94-106. https://doi.org/10.1016/j.neucom.2013.06.046
Jraidi, I., Chaouachi, M. and Frasson, C. (2014) A Hierarchical Probabilistic Framework for Recognizing Learners’ Interaction Experience Trends and Emotions. Advances in Human-Computer Interaction, 2014, Article ID: 632630. https://doi.org/10.1155/2014/632630
Lujan-Moreno, G.A., Atkinson, R.K. and Runger, G. (2016) EEG-Based User Performance Prediction Using Random Forest in a Dynamic Learning Environment. Intelligent Tutoring Systems: Structure, Applications and Challenges, 105-128.
Jraidi, I., and Frasson, C. (2010) Subliminally Enhancing Self-Esteem: Impact on Learner Performance and Affective State. Intelligent Tutoring Systems, 11-20. https://doi.org/10.1007/978-3-642-13437-1_2
Van der Hiele, K., et al. (2007) EEG Correlates in the Spectrum of Cognitive Decline. Clinical Neurophysiology, 118, 1931-1939. https://doi.org/10.1016/j.clinph.2007.05.070
Jraidi, I., Chalfoun, P. and Frasson, C. (2012) Implicit Strategies for Intelligent Tutoring Systems. Intelligent Tutoring Systems, 1-10.
Ben Khedher, A., Jraidi, I. and Frasson, C. (2018) Exploring Students’ Eye Movements to Assess Learning Performance in a Serious Game. EdMedia + Innovate Learning, 394-401.
Aricò, P., Borghini, G., Di Flumeri, G., Colosimo, A., Pozzi, S. and Babiloni, F. (2016) A Passive Brain-Computer Interface Application for the Mental Workload Assessment on Professional Air Traffic Controllers during Realistic Air Traffic Control Tasks. Progress in Brain Research, 228, 295-328. https://doi.org/10.1016/bs.pbr.2016.04.021
Wang, S., Gwizdka, J. and Chaovalitwongse, W.A. (2016) Using Wireless EEG Signals to Assess Memory Workload in the n-Back Task. IEEE Transactions on Human-Machine Systems, 46, 424-435. https://doi.org/10.1109/THMS.2015.2476818
Keith, J.R., Rapgay, L., Theodore, D., Schwartz, J.M. and Ross, J.L. (2015) An Assessment of an Automated EEG Biofeedback System for Attention Deficits in a Substance Use Disorders Residential Treatment Setting. Psychology of Addictive Behaviors, 29, 17-25. https://doi.org/10.1037/adb0000016
Jraidi, I. and Frasson, C. (2013) Student’s Uncertainty Modeling through a Multimodal Sensor-Based Approach. Journal of Educational Technology & Society, 16, 219-230.
Chen, C.-M., Wang, J.-Y. and Yu, C.-M. (2017) Assessing the Attention Levels of Students by Using a Novel Attention Aware System Based on Brainwave Signals. British Journal of Educational Technology, 48, 348-369. https://doi.org/10.1111/bjet.12359
Mills, C., Fridman, I., Soussou, W., Waghray, D., Olney, A.M. and D’Mello, S.K. (2017) Put Your Thinking Cap on: Detecting Cognitive Load Using EEG during Learning. Proceedings of the 7th International Learning Analytics & Knowledge Conference, Vancouver, 13-17 March 2017, 80-89. https://doi.org/10.1145/3027385.3027431
Henrie, C.R., Halverson, L.R. and Graham, C.R. (2015) Measuring Student Engagement in Technology-Mediated Learning: A Review. Computers & Education, 90, 36-53. https://doi.org/10.1016/j.compedu.2015.09.005
Nakamaru, S. (2011) Investment and Return. Journal of Research on Technology in Education, 44, 273-291. https://doi.org/10.1080/15391523.2012.10782591
Yang, Y.-F. (2011) Engaging Students in an Online Situated Language Learning Environment. Computer Assisted Language Learning, 24, 181-198. https://doi.org/10.1080/09588221.2010.538700
Azevedo, R. (2015) Defining and Measuring Engagement and Learning in Science: Conceptual, Theoretical, Methodological, and Analytical Issues. Educational Psychologist, 50, 84-94. https://doi.org/10.1080/00461520.2015.1004069
Chen, P.-S.D., Lambert, A.D. and Guidry, K.R. (2010) Engaging Online Learners: The Impact of Web-Based Learning Technology on College Student Engagement. Computers & Education, 54, 1222-1232. https://doi.org/10.1016/j.compedu.2009.11.008
Jaafar, S., Awaludin, N.S. and Bakar, N.S. (2014) Motivational and Self-Regulated Learning Components of Classroom Academic Performance. Journal of Educational Psychology, 82, 33-40.
Fredricks, J.A. and McColskey, W. (2012) The Measurement of Student Engagement: A Comparative Analysis of Various Methods and Student Self-Report Instruments. In: Christenson, S.L., Reschly, A.L. and Wylie, C., Eds., Handbook of Research on Student Engagement, Springer US, Boston, 763-782.
Wigfield, A., et al. (2008) Role of Reading Engagement in Mediating Effects of Reading Comprehension Instruction on Reading Outcomes. Psychology in the Schools, 45, 432-445. https://doi.org/10.1002/pits.20307
Helme, S. and Clarke, D. (2001) Identifying Cognitive Engagement in the Mathematics Classroom. Mathematics Education Research Journal, 13, 133-153. https://doi.org/10.1007/BF03217103
Alford, B.L., Rollins, K.B., Padrón, Y.N. and Waxman, H.C. (2016) Using Systematic Classroom Observation to Explore Student Engagement as a Function of Teachers’ Developmentally Appropriate Instructional Practices (DAIP) in Ethnically Diverse Pre-Kindergarten through Second-Grade Classrooms. Early Childhood Education Journal, 44, 623-635. https://doi.org/10.1007/s10643-015-0748-8
Turner, J.C., Christensen, A., Kackar-Cam, H.Z., Trucano, M. and Fulmer, S.M. (2014) Enhancing Students’ Engagement: Report of a 3-Year Intervention with Middle School Teachers. American Educational Research Journal, 51, 1195-1226. https://doi.org/10.3102/0002831214532515
Whitehill, J., Serpell, Z., Lin, Y., Foster, A. and Movellan, J.R. (2014) The Faces of Engagement: Automatic Recognition of Student Engagement from Facial Expressions. IEEE Transactions on Affective Computing, 5, 86-98. https://doi.org/10.1109/TAFFC.2014.2316163
Benlamine, S., Bouslimi, S., Harley, J., Frasson, C. and Dufresne, A. (2015) Toward Brain-Based Gaming: Measuring Engagement during Gameplay. EdMedia: World Conference on Educational Media and Technology, Montréal, 22-25 June 2015, 717-722.
Berka, C., et al. (2007) EEG Correlates of Task Engagement and Mental Workload in Vigilance, Learning, and Memory Tasks. Aviation, Space, and Environmental Medicine, 78, B231-B244.
D’Mello, S., Chipman, P. and Graesser, A. (2007) Posture as a Predictor of Learner’s Affective Engagement. Proceedings of the 29th Annual Meeting of the Cognitive Science Society, Nashville, 1-4 August 2007, 905-910.
Pham, P. and Wang, J. (2015) Attentive Learner: Improving Mobile MOOC Learning via Implicit Heart Rate Tracking. International Conference on Artificial Intelligence in Education, Madrid, 21-25 June 2015, 367-376. https://doi.org/10.1007/978-3-319-19773-9_37
Boucheix, J.-M., Lowe, R.K., Putri, D.K. and Groff, J. (2013) Cueing Animations: Dynamic Signaling Aids Information Extraction and Comprehension. Learning and Instruction, 25, 71-84. https://doi.org/10.1016/j.learninstruc.2012.11.005
Lin, F.-R. and Kao, C.-M. (2018) Mental Effort Detection Using EEG Data in E-Learning Contexts. Computers & Education, 122, 63-79. https://doi.org/10.1016/j.compedu.2018.03.020
Klem, G.H., Lüders, H.O., Jasper, H.H. and Elger, C. (1999) The Ten-Twenty Electrode System of the International Federation. The International Federation of Clinical Neurophysiology. Electroencephalography and Clinical Neurophysiology, 52, 3-6.
Chaouachi, M., Jraidi,I. and Frasson, C. (2015) MENTOR: A Physiologically Controlled Tutoring System. In: User Modeling, Adaptation and Personalization, Springer, Berlin, 56-67. https://doi.org/10.1007/978-3-319-20267-9_5
Chaouachi, M., Jraidi, I. and Frasson, C. (2011) Modeling Mental Workload Using EEG Features for Intelligent Systems. In: User Modeling, Adaption and Personalization, Springer, Berlin, 50-61. https://doi.org/10.1007/978-3-642-22362-4_5
Chaouachi, M., Chalfoun, P., Jraidi, I. and Frasson, C. (2010) Affect and Mental Engagement: Towards Adaptability for Intelligent Systems. 23rd International FLAIRS Conference, Florida, 19-21 May 2010, 6.