When Do Learners Study?
An Analysis of the Time-of-Day and Weekday-Weekend Usage Patterns of Learning Management Systems from Mobile and Computers in Blended Learning
DOI:
https://doi.org/10.18608/jla.2022.6697Keywords:
time flexibility, learner time, mobile learning, technology-enhanced learning, learning analytics, learning management systems, research paperAbstract
Recent advances in smart devices and online technologies have facilitated the emergence of ubiquitous learning environments for participating in different learning activities. This poses an interesting question about modality access, i.e., what students are using each platform for and at what time of day. In this paper, we present a log-based exploratory study on learning management system (LMS) use comparing three different modalities—computer, mobile, and tablet—based on the aspect of time. Our objective is to better understand how and to what extent learning sessions via mobiles and tablets occur at different times throughout the day compared to computer sessions. The complexity of the question is further intensified because learners rarely use a single modality for their learning activities but rather prefer a combination of two or more. Thus, we check the associations between patterns of modality usage and time of day as opposed to the counts of modality usage and time of day. The results indicate that computer-dominant learners are similar to limited-computer learners in terms of their session-time distribution, while intensive learners show completely different patterns. For all students, sessions on mobile devices are more frequent in the afternoon, while the proportion of computer sessions was higher at night. On comparison of these time-of-day preferences with respect to modalities on weekdays and weekends, they were found consistent for computer-dominant and limited-computer learners only. We demonstrate the implication of this research for enhancing contextual profiling and subsequently improving the personalization of learning systems such that personalized notification systems can be integrated with LMSs to deliver notifications to students at appropriate times.
References
Ahmad Uzir, N., Gašević, D., Matcha, W., Jovanović, J., & Pardo, A. (2020). Analytics of time management strategies in a flipped classroom. Journal of Computer Assisted Learning, 36(1), 70–88. https://doi.org/10.1111/jcal.12392
Arneberg, P., Guardia, L., Keegan, D., Lõssenko, J., Mázár, I., Michels, P., & Rekkedal, T. (2007). Analyses of European megaproviders of E-learning. Megatrends Project. https://www.researchgate.net/publication/264871599_Analyses_of_European_Megaproviders_of_E-learning
Barbera, E., Gros, B., & Kirschner, P. (2015). Paradox of time in research on educational technology. Time & Society, 24(1), 96–108. https://doi.org/10.1177/0961463X14522178
Beasley, T. M., & Schumacker, R. E. (1995). Multiple regression approach to analyzing contingency tables: Post hoc and planned comparison procedures. The Journal of Experimental Education, 64(1), 79–93. https://doi.org/10.1080/00220973.1995.9943797
Blake, M. (1967). Relationship between circadian rhythm of body temperature and introversion–extraversion. Nature, 215(5103), 896. https://doi.org/10.1038/215896a0
Boroujeni, M. S., & Dillenbourg, P. (2018). Discovery and temporal analysis of latent study patterns in MOOC interaction sequences. In Proceedings of the Eighth International Conference on Learning Analytics and Knowledge (LAK 2018), 5–9 March 2018, Sydney, Australia (pp. 206–215). New York: ACM. https://doi.org/10.1145/3170358.3170388
Casany Guerrero, M. J., Alier Forment, M., Galanis, N., Mayol Sarroca, E., & Piguillem Poch, J. (2012). Analyzing Moodle/LMS logs to measure mobile access. In Proceedings of UBICOMM 2012: The Sixth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies, 23–28 September 2012, Barcelona, Spain (pp. 35–40). https://upcommons.upc.edu/handle/2117/19058
Chen, B., Knight, S., & Wise, A. F. (2018). Critical issues in designing and implementing temporal analytics. Journal of Learning Analytics, 5(1), 1–9. https://doi.org/10.18608/jla.2018.53.1
Chen, X., Zou, D., Xie, H., & Wang, F. L. (2020). Smart learning environments: A bibliometric analysis. In Proceedings of the International Conference on Blended Learning (ICBL 2020), 24–27 August 2020, Bangkok, Thailand (pp. 353–364). https://doi.org/10.1007/978-3-030-51968-1_29
Cheng, H. N., Liu, Z., Sun, J., Liu, S., & Yang, Z. (2017). Unfolding online learning behavioral patterns and their temporal changes of college students in SPOCs. Interactive Learning Environments, 25(2), 176–188. https://doi.org/10.1080/10494820.2016.1276082
Cheon, J., Lee, S., Crooks, S. M., & Song, J. (2012). An investigation of mobile learning readiness in higher education based on the theory of planned behavior. Computers & Education, 59(3), 1054–1064. https://doi.org/10.1016/j.compedu.2012.04.015
Davidson, A., & Ritchie, K. L. (2016). The early bird catches the worm! The impact of chronotype and learning style on academic success in university students. Teaching and Learning Innovations, 18, 1–11. https://journal.lib.uoguelph.ca/index.php/tli/article/view/3553
Duck, S., Rutt, D. J., Hoy, M., & Strejc, H. H. (1991). Some evident truths about conversations in everyday relationships: All communications are not created equal. Human Communication Research, 18(2), 228–267. https://doi.org/10.1111/j.1468-2958.1991.tb00545.x
Fischer, J. E., Yee, N., Bellotti, V., Good, N., Benford, S., & Greenhalgh, C. (2010). Effects of content and time of delivery on receptivity to mobile interruptions. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI ’10), 7–10 September 2010, Lisbon, Portugal (pp. 103–112). New York: ACM. https://doi.org/10.1145/1851600.1851620
Gabadinho, A., Ritschard, G., Mueller, N. S., & Studer, M. (2011). Analyzing and visualizing state sequences in R with TraMineR. Journal of Statistical Software, 40(4), 1–37. https://doi.org/10.18637/jss.v040.i04
Goodyear, P. (2011). Emerging methodological challenges for educational research. In L. Markauskaite, P. Freebody, & J. Irwin (Eds.), Methodological Choice and Design (pp. 253–266). Springer. https://doi.org/10.1007/978-90-481-8933-5_22
Greiff, S., Scherer, R., & Kirschner, P. A. (2017). Some critical reflections on the special issue: Current innovations in computer-based assessments. Computers in Human Behavior, 76, 715–718. https://doi.org/10.1016/j.chb.2017.08.019
Gromada, A., & Shewbridge, C. (2016). Student learning time. In OECD Education Working Papers. OECD iLibrary. https://doi.org/10.1787/5jm409kqqkjh-en
Grundspenkis, J., Lavendels, J., Novitsky, L., & Sitikovs, V. (2006). Compatibility of the principles of computer-based and classical teachings. In Proceeding of IADIS International Conference Web Based Communities 2006, 26–28 February 2006, San Sebastian, Spain (pp. 335–339).
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
Itzek-Greulich, H., Randler, C., & Vollmer, C. (2016). The interaction of chronotype and time of day in a science course: Adolescent evening types learn more and are more motivated in the afternoon. Learning and Individual Differences, 51, 189–198. https://doi.org/10.1016/j.lindif.2016.09.013
Knight, S., Wise, A. F., & Chen, B. (2017). Time for change: Why learning analytics needs temporal analysis. Journal of Learning Analytics, 4(3), 7–17. https://doi.org/10.18608/jla.2017.43.2
Kolari, S., Savander-Ranne, C., & Viskari, E.-L. (2008). Learning needs time and effort: A time-use study of engineering students. European Journal of Engineering Education, 33(5-6), 483–498. https://doi.org/10.1080/03043790802564046
Kovanović, V., Gašević, D., Joksimović, S., Hatala, M., & Adesope, O. (2015). Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions. The Internet and Higher Education, 27, 74–89. https://doi.org/10.1016/j.iheduc.2015.06.002
Lee, H., Ahn, H., Nguyen, T. G., Choi, S.-W., & Kim, D. J. (2017). Comparing the self-report and measured smartphone usage of college students: A pilot study. Psychiatry Investigation, 14(2), 198. https://doi.org/10.4306/pi.2017.14.2.198
Leeuwen, A. v., Bos, N., Ravenswaaij, H. v., & Oostenrijk, J. v. (2019). The role of temporal patterns in students’ behaviour for predicting course performance: A comparison of two blended learning courses. British Journal of Educational Technology, 50(2), 921–933. https://doi.org/10.1111/bjet.12616
Lima, R. H., El-Bishouty, M. M., & Graf, S. (2013). A framework for automatic identification and visualization of mobile device functionalities and usage. In A. Holzinger & G. Pasi (Eds.), Human-Computer Interaction and Knowledge Discovery in Complex, Unstructured, Big Data (pp. 148–159). Springer. https://doi.org/10.1007/978-3-642-39146-0_14
Loureiro, F., & Garcia-Marques, T. (2015). Morning or evening person? Which type are you? Self-assessment of chronotype. Personality and Individual Differences, 86, 168–171. https://doi.org/10.1016/j.paid.2015.06.022
Luo, Y., Pan, R., Choi, J. H., & Strobel, J. (2018). Effects of chronotypes on students’ choice, participation, and performance in online learning. Journal of Educational Computing Research, 55(8), 1069–1087. https://doi.org/10.1177/0735633117697729
Lust, G., Elen, J., & Clarebout, G. (2013). Regulation of tool-use within a blended course: Student differences and performance effects. Computers & Education, 60(1), 385–395. https://doi.org/10.1016/j.compedu.2012.09.001
MacDonald, P. L., & Gardner, R. C. (2000). Type I error rate comparisons of post hoc procedures for I j chi-square tables. Educational and Psychological Measurement, 60(5), 735–754. https://doi.org/10.1177/00131640021970871
Macfadyen, L. P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54(2), 588–599. https://doi.org/10.1016/j.compedu.2009.09.008
Malmberg, J., Järvelä, S., & Järvenoja, H. (2017). Capturing temporal and sequential patterns of self-, co-, and socially shared regulation in the context of collaborative learning. Contemporary Educational Psychology, 49, 160–174. https://doi.org/10.1016/j.cedpsych.2017.01.009
McGorry, S. Y. (2003). Measuring quality in online programs. The Internet and Higher Education, 6(2), 159–177. https://doi.org/10.1016/S1096-7516(03)00022-8
Morrison, L. G., Hargood, C., Pejovic, V., Geraghty, A. W., Lloyd, S., Goodman, N., . . . Yardley, L. (2017). The effect of timing and frequency of push notifications on usage of a smartphone-based stress management intervention: An exploratory trial. PloS one, 12(1), e0169162. https://doi.org/10.1371/journal.pone.0169162
Parsons, D. (2016). The future of mobile learning and implications for education and training. In K. Alshahrani & M. Ally (Eds.), Transforming Education in the Gulf Region. Taylor & Francis. https://www.taylorfrancis.com/chapters/edit/10.4324/9781315621586-26/future-mobile-learning-implications-education-training-david-parsons
Pomerantz, J., & Brooks, D. C. (2017). ECAR Study of Faculty and Information Technology, 2017 (Tech. Rep.). https://library.educause.edu/resources/2017/10/ecar-study-of-faculty-and-information-technology-2017
Randler, C., & Frech, D. (2006). Correlation between morningness–eveningness and final school leaving exams. Biological Rhythm Research, 37(3), 233–239. https://doi.org/10.1080/09291010600645780
Rogers, Y., Connelly, K., Hazlewood, W., & Tedesco, L. (2010). Enhancing learning: A study of how mobile devices can facilitate sensemaking. Personal and Ubiquitous Computing, 14(2), 111–124. https://doi.org/10.1007/s00779-009-0250-7
Romero, M., & Barberà, E. (2011). Quality of e-learners’ time and learning performance beyond quantitative time-on-task. The International Review of Research in Open and Distributed Learning, 12(5), 125–137. https://doi.org/10.19173/irrodl.v12i5.999
Romero, M., & Barberà, E. (2015). Lifelong learners and teachers’ time-management competency in e-learning. In M. Ally & B. H. Khan (Eds.), International Handbook of E-Learning (Vol. 2: Implementation and Case Studies). Routledge. https://www.taylorfrancis.com/chapters/edit/10.4324/9781315760902-13/lifelong-learners-teachers-time-management-competency-learning-margarida-romero-elena-barber%C3%A0?context=ubx&refId=7a3d6608-7ec0-45d2-8f97-310d66302e38
Saqr, M., Nouri, J., & Fors, U. (2019). Time to focus on the temporal dimension of learning: A learning analytics study of the temporal patterns of students’ interactions and self-regulation. International Journal of Technology Enhanced Learning, 11(4), 398–412. https://doi.org/10.1504/ijtel.2019.102549
Sharpe, D. (2015). Chi-square test is statistically significant: Now what? Practical Assessment, Research, and Evaluation, Article 8, 20. https://doi.org/10.7275/tbfa-x148
Sharples, M. (2015). Making sense of context for mobile learning. In J. Traxler & A. Kukulska-Hulme (Eds.), Mobile Learning (pp. 154–167). Routledge. https://www.taylorfrancis.com/chapters/edit/10.4324/9780203076095-9/making-sense-context-mobile-learning-mike-sharples
Sher, V., Hatala, M., & Gašević, D. (2019). On multi-device use: Using technological modality profiles to explain differences in students’ learning. In Proceedings of the Ninth International Conference on Learning Analytics & Knowledge (LAK 2019), 4–8 March 2019, Tempe, AZ, USA (pp. 1–10). New York: ACM. https://doi.org/10.1145/3303772.3303790
Smith, C. S., Folkard, S., Schmieder, R. A., Parra, L. F., Spelten, E., Almiral, H., . . . Tisak, J. (2002). Investigation of morning–evening orientation in six countries using the preferences scale. Personality and Individual Differences, 32(6), 949–968. https://doi.org/10.1016/S0191-8869(01)00098-8
Song, Y., Ma, H., Wang, H., & Wang, K. (2013). Exploring and exploiting user search behavior on mobile and tablet devices to improve search relevance. In Proceedings of the 22nd International Conference on World Wide Web (WWW 2013), 13–17 May 2013, Rio de Janiero, Brazil (pp. 1201–1212). New York: ACM. https://doi.org/10.1145/2488388.2488493
Srinivasan, V., Koehler, C., & Jin, H. (2018). Ruleselector: Selecting conditional action rules from user behavior patterns. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2(1), 35:1–34. https://doi.org/10.1145/3191767
Stockwell, G. (2010). Using mobile phones for vocabulary activities: Examining the effect of platform. Language Learning Technology, 14(2), 95–110. https://doi.org/10125/44216
Stockwell, G. (2013). Tracking learner usage of mobile phones for language learning outside of the classroom. CALICO Journal, 30(1), 118–136. https://doi.org/10.1558/cj.v30i0.118-136
Tabuenca, B., Kalz, M., Börner, D., Ternier, S., & Specht, M. (2014). Where is my time? Identifying productive time of lifelong learners for effective feedback services. In Proceedings of the International Computer Assisted Assessment Conference, 30 June–1 July 2014, Zeist, Netherlands (pp. 149–161). Springer. https://doi.org/10.1007/978-3-319-08657-6_15
Tabuenca, B., Kalz, M., Drachsler, H., & Specht, M. (2015). Time will tell: The role of mobile learning analytics in self-regulated learning. Computers & Education, 89, 53–74. https://doi.org/10.1016/j.compedu.2015.08.004
Tortorella, R. A., & Graf, S. (2012). Personalized mobile learning via an adaptive engine. In Proceedings of the 12th International Conference on Advanced Learning Technologies (ICALT 2012), 4–6 July 2012, Rome, Italy (pp. 670–671). IEEE. https://doi.org/10.1109/ICALT.2012.112
Trevor, H., Robert, T., & Friedman, J. H. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer. https://doi.org/10.1007/978-0-387-84858-7
Wolk, S. (2001). The benefits of exploratory time. Educational Leadership, 59(2), 56–59. https://www.ascd.org/el/articles/the-benefits-of-exploratory-time
Xu, K., Zhu, M., Zhang, D., & Gu, T. (2008). Context-aware content filtering & presentation for pervasive & mobile information systems. In Proceedings of the First International Conference on Ambient Media and Systems (Ambi-Sys08), 11–14 February 2008, Quebec, Quebec, Canada (pp. 1–8). New York: ACM. https://dl.acm.org/doi/10.5555/1363163.1363183
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
