Session-Based Time-Window Identification in Virtual Learning Environments
DOI:
https://doi.org/10.18608/jla.2023.7911Keywords:
session identification, time-windows identification, session timeout threshold, time-on-task, time-off-task, research paperAbstract
Students organize and manage their own learning time, choosing when, what, and how to study due to the flexibility of online learning. Each person has unique learning habits that define their behaviours and distinguish them from others. To investigate the temporal behaviour of students in online learning environments, we seek to identify suitable time-windows that could be used to investigate their temporal behaviour. First, we present a novel perspective for identifying different types of sessions based on individual needs. The majority of previous works address this issue by establishing an arbitrary session timeout threshold. In this paper, we propose an algorithm for determining the optimal threshold for a given session. Second, we use data-driven methods to support investigators in determining time-windows based on the identified sessions. To this end, we developed a visual tool that assists data scientists and researchers to determine the optimal settings for session identification and locating suitable time-windows.
References
Alvarez Sainz, M., Ferrero, A. M., & Ugidos, A. (2019). Time management: Skills to learn and put into practice. Education + Training, 61(5), 635–648. https://doi.org/10.1108/ET-01-2018-0027
Asadianfam, S., & Mohammadi, M. (2014). Identify navigational patterns of web users. International Journal of Computer- Aided Technologies (IJCAx), 1(1), 398–426. https://airccse.org/journal/ijcax/papers/1114ijcax01.pdf
Ba-Omar, H., Petrounias, I., & Anwar, F. (2007). A framework for using web usage mining to personalise e-learning. In Proceedings of the Seventh IEEE International Conference on Advanced Learning Technologies (ICALT 2007), 18–20 July 2007, Niigata, Japan (pp. 937–938). IEEE. https://doi.org/10.1109/ICALT.2007.13
Boldi, P., Bonchi, F., Castillo, C., Donato, D., Gionis, A., & Vigna, S. (2008). The query-flow graph: Model and applications. In Proceedings of the 17th ACM Conference on Information and Knowledge Management (CIKM 2008), 26–30 October 2008, Napa Valley, California, USA (pp. 609–618). ACM. https://doi.org/10.1145/1458082.1458163
Britzolakis, A. (2020). Design and development of a web-based data visualization software for political tendency identification of Twitter’s users using Python Dash Framework. [Master’s thesis, Hellenic Mediterranean University, School of Engineering (ScENG) MSc in Informatics & Multimedia]. https://apothesis.lib.hmu.gr/bitstream/handle/20.500.12688/9510/BritzolakisAlexandros2020.pdf
Brooks, C. A., Thompson, C., & Teasley, S. D. (2015). A time series interaction analysis method for building predictive models of learners using log data. In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (LAK 2015), 16–20 March 2015, Poughkeepsie, New York, USA (pp. 126–135). ACM. https://doi.org/10.1145/2723576.2723581
Carroll, J. (1963). A model of school learning. Teachers College Record, 64(8), 1–9. https://doi.org/10.1177/016146816306400801 Catledge, L. D., & Pitkow, J. E. (1995). Characterizing browsing strategies in the World-Wide Web. Computer Networks and ISDN Systems, 27(6), 1065–1073. https://doi.org/10.1016/0169-7552(95)00043-7
Chen, B., Knight, S., & Wise, A. (2018). Critical issues in designing and implementing temporal analytics. Journal of Learning Analytics, 5(1), 1–9. https://doi.org/10.18608/jla.2018.53.1
Chitraa, V., & Davamani, A. S. (2010). A survey on preprocessing methods for web usage data. International Journal of Computer Science and Information Security, 7(3), 78–83. https://doi.org/10.48550/arXiv.1004.1257
Chiu, M. M., Molenaar, I., Chen, G., Wise, A. F., & Fujita, N. (2014). Micro-analysis of collaborative processes that facilitate productive online discussions: Statistical discourse analyses in three studies. In E. Barbera & P. Reimann (Eds.), Assessment and evaluation of time factors in online teaching and learning (pp. 232–263). IGI Global. https://doi.org/10.4018/978-1-4666-4651-3.ch009
Cooley, R., Mobasher, B., & Srivastava, J. (1997). Web mining: Information and pattern discovery on the World Wide Web. In Proceedings of the Ninth IEEE International Conference on Tools with Artificial Intelligence, 3–8 November 1997, Newport Beach, California, USA (pp. 558–567). IEEE. https://doi.org/10.1109/TAI.1997.632303
Cooley, R., Mobasher, B., & Srivastava, J. (1999). Data preparation for mining World Wide Web browsing patterns. Knowledge and Information Systems, 1(1), 5–32. https://doi.org/10.1007/bf03325089
Crede´, M., & Kuncel, N. R. (2008). Study habits, skills, and attitudes: The third pillar supporting collegiate academic performance. Perspectives on Psychological Science, 3(6), 425–453. https://doi.org/10.1111/j.1745-6924.2008.00089.x
Du, X., Zhang, M., Shelton, B. E., & Hung, J.-L. (2019). Learning anytime, anywhere: A spatio-temporal analysis for online learning. Interactive Learning Environments, 30(1), 34–48. https://doi.org/10.1080/10494820.2019.1633546
Fatima, B., Ramzan, H., & Asghar, S. (2016). Session identification techniques used in web usage mining: A systematic mapping of scholarly literature. Online Information Review, 40(7), 1033–1053. https://doi.org/10.1108/OIR-08-2015-0274
Fincham, E., Whitelock-Wainwright, A., Kovanovic´, V., Joksimovic´, S., van Staalduinen, J.-P., & Gaševic´, D. (2019). Counting clicks is not enough: Validating a theorized model of engagement in learning analytics. In Proceedings of the Ninth International Conference on Learning Analytics and Knowledge (LAK 2019), 4–8 March 2019, Tempe, Arizona, USA (pp. 501–510). ACM. https://doi.org/10.1145/3303772.3303775
Gitinabard, N., Barnes, T., Heckman, S., & Lynch, C. F. (2019). What will you do next? A sequence analysis on the student transitions between online platforms in blended courses. In Proceedings of the 12th International Conference on Educational Data Mining (EDM 2019), 2–5 July 2019, Montre´al, Que´bec, Canada (pp. 59–68). https://doi.org/10.48550/arXiv.1905.00928
Goda, Y., Yamada, M., Kato, H., Matsuda, T., Saito, Y., & Miyagawa, H. (2015). Procrastination and other learning behavioral types in e-learning and their relationship with learning outcomes. Learning and Individual Differences, 37, 72–80. https://doi.org/10.1016/j.lindif.2014.11.001
Goodyear, P. (2005). Educational design and networked learning: Patterns, pattern languages and design practice. Australasian Journal of Educational Technology, 21(1). https://doi.org/10.14742/ajet.1344
Goodyear, P., & Retalis, S. (2010). Technology-enhanced learning: Design patterns and pattern languages (P. Goodyear & S. Retalis, Eds.). Brill. https://doi.org/10.1163/9789460910623
Heraud, J.-M., France, L., & Mille, A. (2004). Pixed: An ITS that guides students with the help of learners’ interaction log. In Workshop Analyzing Student-Tutor Interaction Logs to Improve Educational Outcomes: Seventh International Conference on Intelligent Tutoring Systems (ITS 2004), 30 August–3 September 2004, Maceio´, Alagoas, Brazil (pp. 57–64).
Heyer, S., Oberhuemer, P., Zander, S., & Prenner, P. (2007). Making sense of IMS learning design level B: From specification to intuitive modeling software. In Creating New Learning Experiences on a Global Scale: Proceedings of the Second European Conference on Technology Enhanced Learning (EC-TEL 2007), 17–20 September 2007, Crete, Greece (pp. 86–100). Springer. https://doi.org/10.1007/978-3-540-75195-3 7
Hossain, S., Calloway, C., Lippa, D., Niederhut, D., & Shupe, D. (2019). Visualization of bioinformatics data with Dash Bio. In Proceedings of the 18th Python in Science Conference (SciPy 2019), 8–14 July 2019, Austin, Texas, USA. https://doi.org/10.25080/Majora-7ddc1dd1-012
IMS Global Learning Consortium and others. (2003). IMS Learning Design Information Model. Ver. 1.0 Final Specification. https://www.imsglobal.org/learningdesign/ldv1p0/imsld%5C_infov1p0.html
Jafari, M., SoleymaniSabzchi, F., & Jamali, S. (2013). Extracting users’ navigational behavior from web log data: A survey Journal of Computer Sciences and Applications, 1(3), 39–45. https://doi.org/10.12691/jcsa-1-3-3
Jansen, B. J., Spink, A., Blakely, C., & Koshman, S. (2007). Defining a session on web search engines. Journal of the American Society for Information Science and Technology, 58(6), 862–871. https://doi.org/10.1002/asi.20564
Jones, R., & Klinkner, K. L. (2008). Beyond the session timeout: Automatic hierarchical segmentation of search topics in query logs. In Proceedings of the 17th ACM Conference on Information and Knowledge Management (CIKM 2008), 26–30 October 2008, Napa Valley, California, USA (pp. 699–708). ACM. https://doi.org/10.1145/1458082.1458176
Jovanovic, J., Gasevic, D., Dawson, S., Pardo, A., & Mirriahi, N. (2017). Learning analytics to unveil learning strategies in a flipped classroom. The Internet and Higher Education, 33, 74–85. https://doi.org/10.1016/j.iheduc.2017.02.001
Khan, I., & Pardo, A. (2016). Data2U: Scalable real time student feedback in active learning environments. In Proceedings of the Sixth International Conference on Learning Analytics and Knowledge (LAK 2016), 25–29 April 2016, Edinburgh, UK (pp. 249–253). ACM. https://doi.org/10.1145/2883851.2883911
Kovanovic´, V., Gaševic´, D., Dawson, S., Joksimovic, S., & Baker, R. (2016). Does time-on-task estimation matter? Implications on validity of learning analytics findings. Journal of Learning Analytics, 2(3), 81–110. https://doi.org/10.18608/jla.2015.23.6
Kovanovic´, V., Gaševic´, D., Dawson, S., Joksimovic´, S., Baker, R. S., & Hatala, M. (2015). Penetrating the black box of time-on-task estimation. In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (LAK 2015), 16–20 March 2015, Poughkeepsie, New York, USA (pp. 184–193). ACM. https://doi.org/10.1145/2723576.2723623
Lee, S., Kim, K. S., Shin, J., & Park, J. (2021). Tracing knowledge for tracing dropouts: Multi-task training for study session dropout prediction. In I.-H. Hsiao, S. Sahebi, F. Bouchet, & J.-J. Vie (Eds.), Proceedings of the 14th International Conference on Educational Data Mining (EDM 2021), 29 June–2 July 2021, Paris, France (pp. 641–647). https://educationaldatamining.org/EDM2021/virtual/static/pdf/EDM21_paper_174.pdf
Lee, Y. (2018). Effect of uninterrupted time-on-task on students’ success in Massive Open Online Courses (MOOCs). Computers in Human Behavior, 86, 174–180. https://doi.org/10.1016/j.chb.2018.04.043
Lee, Y., Shin, D., Loh, H., Lee, J., Chae, P., Cho, J., Park, S., Lee, J., Baek, J., Kim, B., & Choi, Y. (2020). Deep attentive study session dropout prediction in mobile learning environment. In Proceedings of the 12th International Conference on Computer Supported Education—Volume 1: CSEDU, 2–4 May 2020, online (pp. 26–35). https://doi.org/10.5220/0009347700260035
Lokeshkumar, R., Sindhuja, R., & Sengottuvelan, P. (2014). A survey on preprocessing of web log file in web usage mining to improve the quality of data. International Journal of Emerging Technology and Advanced Engineering, 4, 229–234. https://www.ijetae.com/files/Volume4Issue8/IJETAE_0814_35.pdf
Lucchese, C., Orlando, S., Perego, R., Silvestri, F., & Tolomei, G. (2013). Discovering tasks from search engine query logs.
ACM Transactions on Information Systems (TOIS), 31(3), 1–43. https://doi.org/10.1145/2493175.2493179 Macfadyen, L. P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54(2), 588–599. https://doi.org/10.1016/j.compedu.2009.09.008
Maldonado-Mahauad, J., Pe´rez-Sanagust´ın, M., Moreno-Marcos, P. M., Alario-Hoyos, C., Mun˜oz-Merino, P. J., & Delgado- Kloos, C. (2018). Predicting learners’ success in a self-paced MOOC through sequence patterns of self-regulated learning. In V. Pammer-Schindler, M. Pe´rez-Sanagust´ın, H. Drachsler, R. Elferink, & M. Scheffel (Eds.), Proceedings of the 13th European Conference on Technology Enhanced Learning (EC-TEL 2018), 3–5 September 2018, Leeds, UK (pp. 355–369). Springer. https://doi.org/10.1007/978-3-319-98572-5 27
Marquardt, C. G., Becker, K., & Ruiz, D. D. A. (2004). A pre-processing tool for web usage mining in the distance ed- ucation domain. In J. Bernardino & B. C. Desai (Eds.), Proceedings of the International Database Engineering and Applications Symposium, 2004 (IDEAS 2004), 7–9 July 2004, Coimbra, Portugal (pp. 78–87). IEEE. https://doi.org/10.1109/IDEAS.2004.1319780
Matcha, W., Gaševic´, D., Jovanovic´, J., Uzir, N. A., Oliver, C. W., Murray, A., & Gasevic, D. (2020). Analytics of learning strategies: The association with the personality traits. In Proceedings of the 10th International Conference on Learning Analytics and Knowledge (LAK 2020), 23–27 March 2020, Frankfurt, Germany (pp. 151–160). ACM. https://doi.org/10.1145/3375462.3375534
Molenaar, I., & Friend Wise, A. (2022). Temporal aspects of learning analytics—Grounding analyses in concepts of time. In C. Lang, G. Siemens, A. Friend Wise, D. Gaševic´, & A. Merceron (Eds.), The handbook of learning analytics (pp. 66–76). SOLAR. https://doi.org/10.18608/hla22.007
Munk, M., & Drlík, M. (2011). Impact of different pre-processing tasks on effective identification of users’ behavioral patterns in web-based educational system. Procedia Computer Science, 4, 1640–1649. https://doi.org/10.1016/j.procs.2011.04.177
Nadjarbashi-Noghani, M., & Ghorbani, A. A. (2004). Improving the referrer-based web log session reconstruction. In Proceedings of the Second Annual Conference on Communication Networks and Services Research (CNSR 2004), 21 May 2004, Fredericton, New Brunswick, Canada (pp. 286–292). IEEE. https://doi.org/10.1109/DNSR.2004.1344740
Nguyen, Q. (2020). Rethinking time-on-task estimation with outlier detection accounting for individual, time, and task differences. In Proceedings of the 10th International Conference on Learning Analytics and Knowledge (LAK 2020), 23–27 March 2020, Frankfurt, Germany (pp. 376–381). ACM. https://doi.org/10.1145/3375462.3375538
Panzarasa, P., Kujawski, B., Hammond, E. J., & Roberts, C. M. (2015). Temporal patterns and dynamics of e-learning usage in medical education. Educational Technology Research and Development, 64(1), 13–35. https://doi.org/10.1007/s11423-015-9407-4
Riel, J., Lawless, K. A., & Brown, S. W. (2018). Timing matters: Approaches for measuring and visualizing behaviours of timing and spacing of work in self-paced online teacher professional development courses. Journal of Learning Analytics, 5(1), 25–40. https://doi.org/10.18608/jla.2018.51.3
Romero, C., Romero, J. R., & Ventura, S. (2014). A survey on pre-processing educational data. In A. Pen˜a-Ayala (Ed.), Educational data mining: Applications and trends (pp. 29–64). Springer. https://doi.org/10.1007/978-3-319-02738-8_2
Rotelli, D., & Monreale, A. (2022). Time-on-task estimation by data-driven outlier detection based on learning activities. In Proceedings of the 12th International Conference on Learning Analytics and Knowledge (LAK 2022), 21–25 March 2022, online (pp. 336–346). ACM. https://doi.org/10.1145/3506860.3506913
Schmitz, B., & Wiese, B. S. (2006). New perspectives for the evaluation of training sessions in self-regulated learning: Time- series analyses of diary data. Contemporary Educational Psychology, 31(1), 64–96. https://doi.org/10.1016/j.cedpsych.2005.02.002
Sher, V., Hatala, M., & Gaševic´, D. (2022). When do learners study? An analysis of the time-of-day and weekday-weekend usage patterns of learning management systems from mobile and computers in blended learning. Journal of Learning Analytics, 9(2), 1–23. https://doi.org/10.18608/jla.2022.6697
Spiliopoulou, M., Mobasher, B., Berendt, B., & Nakagawa, M. (2003). A framework for the evaluation of session reconstruction heuristics in web-usage analysis. INFORMS Journal on Computing, 15(2), 171–190. https://doi.org/10.1287/ijoc.15.2.171.14445
Thindwa, H. (2016). The role of technology in improving quality of teaching in higher education: An international perspective. In Information Resources Management Association (Ed.), Teacher education: Concepts, methodologies, tools, and applications (pp. 207–227). IGI Global. https://doi.org/10.4018/978-1-5225-0164-0.ch012
Wang, H., Tlili, A., La¨msa¨, J., Cai, Z., Zhong, X., & Huang, R. (2023). Temporal perspective on the gender-related differences in online learning behaviour. Behaviour & Information Technology, 42(6), 671–685. https://doi.org/10.1080/0144929X.2022.2039769
Weinstein, C. E., Palmer, D. R., & Schultz, A. (2002). Lassi user’s manual. H&H Publishing Company. https://www.hhpublishing.com/LASSImanual.pdf
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
