Uncovering Engagement Profiles of Young Learners in K–8 Education through Learning Analytics
DOI:
https://doi.org/10.18608/jla.2024.8133Keywords:
engagement profiles, clustering, k-8 education, e-learning, research paperAbstract
E-learning platforms have become increasingly popular in K–8 education to promote student learning and enhance classroom teaching. Student interactions with these platforms produce trace data, which are digital records of learning processes. Although trace data have been effective in identifying learners’ engagement profiles in higher education and lifelong learning (e.g., MOOCs), similar research on young learners has been very scarce. This study makes a timely and novel contribution to the field by identifying emerging profiles of young students from Grades 1 to 8 based on their engagement in an e-learning platform. The k-means cluster analysis yielded seven distinct profiles in total. While the dominance of profiles differed across grade levels, some profiles were not even present at specific grades, indicating the changing engagement behaviours of young learners in different years. In addition, all emerging profiles suggest students tended to focus on specific components of the platform, thus lacking balanced engagement with all resources. In particular, while primary school students showed relatively higher interest in game-based learning, middle school students focused more on exams than their counterparts. The findings yielded seven specific considerations for the design of effective e-learning platforms.
References
Abbad, M. M., Morris, D., & de Nahlik, C. (2009). Looking under the bonnet: Factors affecting student adoption of e-learning systems in Jordan. The International Review of Research in Open and Distributed Learning, 10(2). https://doi.org/10.19173/irrodl.v10i2.596
Abdelkarim, O., Ammar, A., Chtourou, H., Wagner, M., Knisel, E., Hökelmann, A., & Bös, K. (2017). Relationship between motor and cognitive learning abilities among primary school-aged children. Alexandria Journal of Medicine, 53(4), 325–331. https://doi.org/10.1016/j.ajme.2016.12.004
Abdul Rabu, S. N., & Talib, Z. (2017). The effects of digital game-based learning on primary school students’ English vocabulary achievement and acceptance. Innovative Teaching and Learning Journal, 1(1), 61–74. https://itlj.utm.my/index.php/itlj/article/view/8
Abuhassna, H., Al-Rahmi, W. M., Yahya, N., Zakaria, M. A. Z. M., Kosnin, A. B. M., & Darwish, M. (2020). Development of a new model on utilizing online learning platforms to improve students’ academic achievements and satisfaction. International Journal of Educational Technology in Higher Education, 17, 38. https://doi.org/10.1186/s41239-020-00216-z
Agresti, A. (2019). An introduction to categorical data analysis (3rd ed.). John Wiley & Sons.
Aguerrebere, C., He, H., Kwet, M., Laakso, M.-J., Lang, C., Marconi, C., Price-Dennis, D., & Zhang, H. (2022). Global perspectives on learning analytics in K12 education. In C. Lang, A. F. Wise, D. Gašević, A. Merceron, & G. Siemens (Eds.), Handbook of Learning Analytics (2nd ed.), 223–231. Society for Learning Analytics Research (SoLAR). https://solaresearch.org/wp-content/uploads/hla22/HLA22_Chapter_22_Aguerrebere.pdf
Aguilar, S. J., Galperin, H., Baek, C., & Gonzalez, E. (2022). Live instruction predicts engagement in K–12 remote learning. Educational Researcher, 51(1), 81–84. https://doi.org/10.3102/0013189X211056884
Alario-Hoyos, C., Pérez-Sanagustín, M., Delgado-Kloos, C., Parada, G. H. A., & Muñoz-Organero, M. (2014). Delving into participants’ profiles and use of social tools in MOOCs. IEEE Transactions on Learning Technologies, 7(3), 260–266. https://doi.org/10.1109/TLT.2014.2311807
Antonenko, P. D., Toy, S., & Niederhauser, D. S. (2012). Using cluster analysis for data mining in educational technology research. Educational Technology Research and Development, 60(3), 383–398. https://doi.org/10.1007/s11423-012-9235-8
Bae, C. L., & DeBusk-Lane, M. (2019). Middle school engagement profiles: Implications for motivation and achievement in science. Learning and Individual Differences, 74(August), 101753. https://doi.org/10.1016/j.lindif.2019.101753
Bote-Lorenzo, M. L., & Gómez-Sánchez, E. (2017). Predicting the decrease of engagement indicators in a MOOC. Proceedings of the 7th International Conference on Learning Analytics and Knowledge (LAK ’17), 13–17 March 2017, Vancouver, BC, Canada (pp. 143–147). ACM Press. https://doi.org/10.1145/3027385.3027387
Bouchet, F., Harley, J. M., Trevors, G. J., & Azevedo, R. (2013). Clustering and profiling students according to their interactions with an intelligent tutoring system fostering self-regulated learning. Journal of Educational Data Mining, 5(1), 104–146. https://doi.org/10.5281/zenodo.3554613
Caspari-Sadeghi, S. (2022). Applying learning analytics in online environments: Measuring learners’ engagement unobtrusively. Frontiers in Education, 7, 840947. https://doi.org/10.3389/feduc.2022.840947
Chakraborty, N., Roy, S., Leite, W. L., Faradonbeh, M. K. S., & Michailidis, G. (2021). The effects of a personalized recommendation system on students’ high-stakes achievement scores: A field experiment. Proceedings of the 14th International Conference on Educational Data Mining (EDM2021), 29 June–2 July 2021, Online (pp. 588–594). International Educational Data Mining Society. https://educationaldatamining.org/EDM2021/virtual/static/pdf/EDM21_paper_87.pdf
Chavan, P., & Mitra, R. (2022). Tcherly: A teacher-facing dashboard for online video lectures. Journal of Learning Analytics, 9(3), 125–151. https://doi.org/10.18608/jla.2022.7555
Chiu, C. H., Yang, H. Y., Liang, T. H., & Chen, H. P. (2010). Elementary students’ participation style in synchronous online communication and collaboration. Behaviour & Information Technology, 29(6), 571–586. https://doi.org/10.1080/01449291003686195
Chou, C.-Y., Lai, K. R., Chao, P.-Y., Lan, C. H., & Chen, T.-H. (2015). Negotiation based adaptive learning sequences: Combining adaptivity and adaptability. Computers & Education, 88, 215–226. https://doi.org/10.1016/j.compedu.2015.05.007
Chuang, T.-Y., & Chen, W.-F. (2007). Effect of computer-based video games on children: An experimental study. Proceedings of the First IEEE International Workshop on Digital Game and Intelligent Toy Enhanced Learning (DIGITEL’07), 26–28 March 2007, Jhongli, Taiwan (pp. 114–118). IEEE. https://doi.org/10.1109/DIGITEL.2007.24
Cobo, G., García, D., Santamaría, E., Moran, J. A., Melenchón, J., & Monzo, C. (2011). Modeling students’ activity in online discussion forums: A strategy based on time series and agglomerative hierarchical clustering. In M. Pechenizkiy, T. Calders, C. Conati, S. Ventura, C. Romero, & J. Stamper (Eds.), Proceedings of the 4th International Conference on Educational Data Mining (EDM2011), 6–8 July 2011, Eindhoven, Netherlands (pp. 253–257). International Educational Data Mining Society. https://educationaldatamining.org/EDM2011/wp-content/uploads/proc/edm2011_paper21_short_Cobo.pdf
Cohen, J. (1992). Statistical power analysis. Current Directions in Psychological Science, 1(3), 98–101. https://doi.org/10.1111/1467-8721.ep10768783
Corrin, L., de Barba, P. G., & Bakharia, A. (2017). Using learning analytics to explore help-seeking learner profiles in MOOCs. Proceedings of the 7th International Conference on Learning Analytics and Knowledge (LAK ’17), 13–17 March 2017, Vancouver, BC, Canada (pp. 424–428). ACM Press. https://doi.org/10.1145/3027385.3027448
de Sousa, E. B. G., Alexandre, B., Ferreira Mello, R., Pontual Falcão, T., Vesin, B., & Gašević, D. (2021). Applications of learning analytics in high schools: A systematic literature review. Frontiers in Artificial Intelligence, 4, 737891. https://doi.org/10.3389/frai.2021.737891
Dixson, M. D. (2015). Measuring student engagement in the online course: The online student engagement scale (OSE). Online Learning, 19(4). https://doi.org/10.24059/olj.v19i4.561
Dutt, A., Aghabozrgi, S., Ismail, M. A. B., & Mahroeian, H. (2015). Clustering algorithms applied in educational data mining. International Journal of Information and Electronics Engineering, 5(2), 112–116. https://doi.org/10.7763/IJIEE.2015.V5.513
Er, E., Gómez-Sánchez, E., Dimitriadis, Y., Bote-Lorenzo, M. L., Asensio-Pérez, J. I., Álvarez-Álvarez, S. (2019). Aligning learning design and learning analytics through instructor involvement: A MOOC case study. Interactive Learning Environments, 27(5–6), 685–698. https://doi.org/10.1080/10494820.2019.1610455.
Eradze, M., & Laanpere, M. (2017). Lesson observation data in learning analytics datasets: Observata. In É. Lavoué, H. Drachsler, K. Verbert, J. Broisin, & M. Pérez-Sanagustín (Eds.), Proceedings of the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), 12–15 September 2017, Tallinn, Estonia (pp. 504–508). Springer Cham. https://doi.org/10.1007/978-3-319-66610-5_50
Fauzi, I., & Sastra Khusuma, I. H. (2020). Teachers’ elementary school in online learning of COVID-19 pandemic conditions. Jurnal Iqra’: Kajian Ilmu Pendidikan, 5(1), 58–70. https://doi.org/10.25217/ji.v5i1.914
Ferguson, R., & Clow, D. (2015). Examining engagement: Analysing learner subpopulations in massive open online courses (MOOCs). Proceedings of the 5th International Conference on Learning Analytics and Knowledge (LAK ʼ15), 16–20 March 2015, Poughkeepsie, NY, USA (pp. 51–58). ACM Press. https://doi.org/10.1145/2723576.2723606
Fincham, E., Whitelock-Wainwright, A., Kovanović, V., Joksimović, S., van Staalduinen, J.-P., & Gašević, D. (2019). Counting clicks is not enough: Validating a theorized model of engagement in learning analytics. Proceedings of the 9th International Conference on Learning Analytics and Knowledge (LAK ’19), 4–8 March 2019, Tempe, AZ, USA (pp. 501–510). ACM Press. https://doi.org/10.1145/3303772.3303775
Fong, C. J., Kremer, K. P., Hill-Troglin Cox, C., & Lawson, C. A. (2021). Expectancy-value profiles in math and science: A person-centered approach to cross-domain motivation with academic and STEM-related outcomes. Contemporary Educational Psychology, 65, 101962. https://doi.org/10.1016/j.cedpsych.2021.101962
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
Gardner, J., & Brooks, C. (2018). Student success prediction in MOOCs. User Modeling and User-Adapted Interaction, 28(2), 127–203. https://doi.org/10.1007/s11257-018-9203-z
Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71. https://doi.org/10.1007/s11528-014-0822-x
Giersch, J. (2018). Academic tracking, high-stakes tests, and preparing students for college: How inequality persists within schools. Educational Policy, 32(7), 907–935. https://doi.org/10.1177/0895904816681526
Greenberg, B. S., Sherry, J., Lachlan, K., Lucas, K., & Holmstrom, A. (2010). Orientations to video games among gender and age groups. Simulation & Gaming, 41(2), 238–259. https://doi.org/10.1177/1046878108319930
Hu, M., Li, H., Deng, W., & Guan, H. (2016). Student engagement: One of the necessary conditions for online learning. Proceedings of the Fifth International Conference on Educational Innovation through Technology (EITT 2016), 22–24 September 2016, Tainan, Taiwan (pp. 122–126). IEEE. https://doi.org/10.1109/EITT.2016.31
Iftikhar, S., Guerrero-Roldán, A.-E., & Mor, E. (2022). Practice promotes learning: Analyzing students’ acceptance of a learning-by-doing online programming learning tool. Applied Sciences, 12(24), 12613. https://doi.org/10.3390/app122412613
Journell, W. (2010). Perceptions of e‐learning in secondary education: A viable alternative to classroom instruction or a way to bypass engaged learning? Educational Media International, 47(1), 69–81. https://doi.org/10.1080/09523981003654985
Jovanović, J., Gašević, D., Dawson, S., Pardo, A., & Mirriahi, N. (2017). Learning analytics to unveil learning strategies in a flipped classroom. The Internet and Higher Education, 33, 74–85. https://doi.org/10.1016/j.iheduc.2017.02.001
Junco, R. (2012). The relationship between frequency of Facebook use, participation in Facebook activities, and student engagement. Computers & Education, 58(1), 162–171. https://doi.org/10.1016/j.compedu.2011.08.004
Kennedy, G., Coffrin, C., de Barba, P., & Corrin, L. (2015). Predicting success: How learners’ prior knowledge, skills and activities predict MOOC performance. Proceedings of the 5th International Conference on Learning Analytics and Knowledge (LAK ʼ15), 16–20 March 2015, Poughkeepsie, NY, USA (pp. 136–140). ACM Press. https://doi.org/10.1145/2723576.2723593
Khalil, M., & Ebner, M. (2017). Clustering patterns of engagement in massive open online courses (MOOCs): The use of learning analytics to reveal student categories. Journal of Computing in Higher Education, 29(1), 114–132. https://doi.org/10.1007/s12528-016-9126-9
Khosravi, H., & Cooper, K. M. L. (2017). Using learning analytics to investigate patterns of performance and engagement in large classes. Proceedings of the 48th ACM Technical Symposium on Computer Science Education (SIGCSE ’17), 8–11 March 2017, Seattle, WA, USA (pp. 309–314). ACM Press. https://doi.org/10.1145/3017680.3017711
Kiili, C., Bråten, I., Kullberg, N., & Leppänen, P. H. T. (2020). Investigating elementary school students’ text-based argumentation with multiple online information resources. Computers & Education, 147, 103785. https://doi.org/10.1016/j.compedu.2019.103785
Kizilcec, R. F., Piech, C., & Schneider, E. (2013). Deconstructing disengagement: Analyzing learner subpopulations in massive open online courses. Proceedings of the 3rd International Conference on Learning Analytics and Knowledge (LAK ’13), 8–12 April 2013, Leuven, Belgium (pp. 170–179). ACM Press. https://doi.org/10.1145/2460296.2460330
Kovanović, V., Joksimović, S., Gašević, D., Owers, J., Scott, A.-M., & Woodgate, A. (2016). Profiling MOOC course returners: How does student behavior change between two course enrollments? Proceedings of the 3rd ACM Conference on Learning @ Scale (L@S 2016), 25–28 April 2016, Edinburgh, Scotland (pp. 269–272). ACM Press. https://doi.org/10.1145/2876034.2893431
Kovanovic, V., Mazziotti, C., & Lodge, J. (2021). Learning analytics for primary and secondary schools. Journal of Learning Analytics, 8(2), 1–5. https://doi.org/10.18608/jla.2021.7543
Krumm, A. E., Boyce, J., & Everson, H. T. (2021). A collaborative approach to sharing learner event data. Journal of Learning Analytics, 8(2), 73–82. https://doi.org/10.18608/jla.2021.7375
Lau, C. Y., & Shaikh, J. M. (2012). The impacts of personal qualities on online learning readiness at Curtin Sarawak Malaysia (CSM). Educational Research and Reviews, 7(20), 430–444. http://hdl.handle.net/20.500.11937/47493
Lee, J.-S. (2014). The relationship between student engagement and academic performance: Is it a myth or reality? The Journal of Educational Research, 107(3), 177–185. https://doi.org/10.1080/00220671.2013.807491
Liao, Y.-C., Ottenbreit-Leftwich, A., Zhu, M., Jantaraweragul, K., Christie, L., Krothe, K., & Sparks, K. (2021). How can we support online learning for elementary students? Perceptions and experiences of award-winning K–6 teachers. TechTrends, 65(6), 939–951. https://doi.org/10.1007/s11528-021-00663-z
Liu, M., Calvo, R. A., Pardo, A., & Martin, A. (2015). Measuring and visualizing students’ behavioral engagement in writing activities. IEEE Transactions on Learning Technologies, 8(2), 215–224. https://doi.org/10.1109/TLT.2014.2378786
Milligan, C., Littlejohn, A., & Margaryan, A. (2013). Patterns of engagement in connectivist MOOCs. MERLOT Journal of Online Learning and Teaching, 9(2), 149–159. https://jolt.merlot.org/vol9no2/milligan_0613.pdf
Mirriahi, N., Liaqat, D., Dawson, S., & Gašević, D. (2016). Uncovering student learning profiles with a video annotation tool: Reflective learning with and without instructional norms. Educational Technology Research and Development, 64(6), 1083–1106. https://doi.org/10.1007/s11423-016-9449-2
Molenaar, I., & Knoop-van Campen, C. A. N. (2019). How teachers make dashboard information actionable. IEEE Transactions on Learning Technologies, 12(3), 347–355. https://doi.org/10.1109/TLT.2018.2851585
Mulqueeny, K., Kostyuk, V., Baker, R. S., & Ocumpaugh, J. (2015). Incorporating effective e-learning principles to improve student engagement in middle-school mathematics. International Journal of STEM Education, 2, 15. https://doi.org/10.1186/s40594-015-0028-6
Musoleno, R. R., & White, G. P. (2010). Influences of high-stakes testing on middle school mission and practice. Research in Middle Level Education, 34(3), 1–10. https://doi.org/10.1080/19404476.2010.11462076
Pinquart, M., & Ebeling, M. (2020). Parental educational expectations and academic achievement in children and adolescents: A meta-analysis. Educational Psychology Review, 32, 463–480. https://doi.org/10.1007/s10648-019-09506-z
Prince, M. J., & Felder, R. M. (2006). Inductive teaching and learning methods: Definitions, comparisons, and research findings. Journal of Engineering Education, 95(2), 123–138. https://doi.org/10.1002/j.2168-9830.2006.tb00884.x
Ramesh, A., Goldwasser, D., Huang, B., Daum, H., III., & Getoor, L. (2013). Modeling learner engagement in MOOCs using probabilistic soft logic. NIPS Workshop on Data Driven Education, Lake Tahoe, NV. DDE. https://linqs.org/assets/resources/ramesh-dde13.pdf
Ramesh, A., Goldwasser, D., Huang, B., Daum, H., III., & Getoor, L. (2014). Learning latent engagement patterns of students in online courses. Proceedings of the 28th Conference on Artificial Intelligence (AAAI-14), 27–31 July 2014, Québec City, QC, Canada (pp. 1272–1278). AAAI Press. https://doi.org/10.1609/aaai.v28i1.8920
Rashid, T., & Asghar, H. M. (2016). Technology use, self-directed learning, student engagement and academic performance: Examining the interrelations. Computers in Human Behavior, 63, 604–612. https://doi.org/10.1016/j.chb.2016.05.084
Rousseeuw, P. J. (1987). Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics, 20, 53–65. https://doi.org/10.1016/0377-0427(87)90125-7
Schmidt, J. A., Rosenberg, J. M., & Beymer, P. N. (2018). A person‐in‐context approach to student engagement in science: Examining learning activities and choice. Journal of Research in Science Teaching, 55(1), 19–43. https://doi.org/10.1002/tea.21409
Sher, V., Hatala, M., & Gašević, D. (2022). When do learners study? An analysis of the time-of-day and weekday-weekend usage patterns of learning management systems from mobile and computers in blended learning. Journal of Learning Analytics, 9(2), 1–23. https://doi.org/10.18608/jla.2022.6697
Smith, J. G., & Suzuki, S. (2015). Embedded blended learning within an Algebra classroom: A multimedia capture experiment. Journal of Computer Assisted Learning, 31(2), 133–147. https://doi.org/10.1111/jcal.12083
Su, C.-Y., & Chiu, C.-H. (2021). Perceived enjoyment and attractiveness influence Taiwanese elementary school students’ intention to use interactive video learning. International Journal of Human–Computer Interaction, 37(6), 574–583. https://doi.org/10.1080/10447318.2020.1841423
Toro-Troconis, M., Alexander, J., & Frutos-Perez, M. (2019). Assessing student engagement in online programmes: Using learning design and learning analytics. International Journal of Higher Education, 8(6), 171–183. https://doi.org/10.5430/ijhe.v8n6p171
Tseng, S.-F., Tsao, Y.-W., Yu, L.-C., Chan, C.-L., & Lai, K. R. (2016). Who will pass? Analyzing learner behaviors in MOOCs. Research and Practice in Technology Enhanced Learning, 11, 8. https://doi.org/10.1186/s41039-016-0033-5
Väisänen, S., Hallberg, S., Valtonen, T., Tervo, I.-A., Kankaanpää, J., Sointu, E., & Hirsto, L. (2022). Pupils’ experiences of learning analytics visualizations in supporting self-regulated learning in an elementary school classroom. Seminar.net, 18(1). https://doi.org/10.7577/seminar.4690
Wefald, A. J., & Downey, R. G. (2009). Construct dimensionality of engagement and its relation with satisfaction. The Journal of Psychology, 143(1), 91–112. https://doi.org/10.3200/JRLP.143.1.91-112
Whitehill, J., Mohan, K., Seaton, D., Rosen, Y., & Tingley, D. (2017). MOOC dropout prediction: How to measure accuracy? Proceedings of the 4th ACM Conference on Learning @ Scale (L@S 2017), 20–21 April 2017, Cambridge, MA, USA (pp. 161–164). ACM Press. https://doi.org/10.1145/3051457.3053974
Wormington, S. V., & Linnenbrink-Garcia, L. (2017). A new look at multiple goal pursuit: The promise of a person-centered approach. Educational Psychology Review, 29(3), 407–445. https://doi.org/10.1007/s10648-016-9358-2
Xing, W., Chen, X., Stein, J., & Marcinkowski, M. (2016). Temporal predication of dropouts in MOOCs: Reaching the low hanging fruit through stacking generalization. Computers in Human Behavior, 58, 119–129. https://doi.org/10.1016/j.chb.2015.12.007
Xing, W., & Du, D. (2019). Dropout prediction in MOOCs: Using deep learning for personalized intervention. Journal of Educational Computing Research, 57(3), 547–570. https://doi.org/10.1177/0735633118757015
Yang, D., Cai, Z., Wang, C., Zhang, C., Chen, P., & Huang, R. (2023). Not all engaged students are alike: Patterns of engagement and burnout among elementary students using a person-centered approach. BMC Psychology, 11, 38. https://doi.org/10.1186/s40359-023-01071-z
Yang, Y. (2021). Does greater engagement in online general education courses lead to better academic performance? Evidence from Chinese university students. Open Journal of Social Sciences, 9(6), 298–315. https://doi.org/10.4236/jss.2021.96022
Ye, C., & Biswas, G. (2014). Early prediction of student dropout and performance in MOOCs using higher granularity temporal information. Journal of Learning Analytics, 1(3), 169–172. https://doi.org/10.18608/jla.2014.13.14
Zimmerman, B. J. (1990). Self-regulated learning and academic achievement: An overview. Educational Psychologist, 25(1), 3–17. https://doi.org/10.1207/s15326985ep2501_2
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
