Examining the Interplay between Self-regulated Learning Activities and Types of Knowledge within a Computer-simulated Environment
DOI:
https://doi.org/10.18608/jla.2022.7571Keywords:
epistemic network analysis, self regulated learning, types of knowledge, temporal co-occurrence, computer-simulated environment, research paperAbstract
This study examined the temporal co-occurrences of self-regulated learning (SRL) activities and three types of knowledge (i.e., task information, domain knowledge, and metacognitive knowledge) of 34 medical students who solved two tasks of varying complexity in a computer-simulated environment. Specifically, we explored the effects of task complexity on SRL activities, types of knowledge, and their interplay using epistemic network analysis (ENA). We also compared the differences between high and low performers. The results showed that the use of SRL activities, especially the planning and monitoring activities, was more intensive in a difficult task compared to an easy task. Students also used more domain knowledge to solve the difficult task. For both tasks, domain knowledge and metacognitive knowledge co-occurred most frequently, followed by the co-occurrence of domain knowledge and planning. Nevertheless, the interplay of SRL activities and types of knowledge is generally different between the two tasks. Moreover, we found that high performers used significantly more metacognitive knowledge than low performers in the easy task. However, no significant differences were found in the use of SRL activities between high and low performers in both tasks. This study makes theoretical, methodological, and practical contributions to the area of SRL in clinical reasoning.
References
Artino, A. R., Hemmer, P. A., & Durning, S. J. (2011). Using self-regulated learning theory to understand the beliefs, emotions, and behaviors of struggling medical students. Academic Medicine, 86(10), S35–S38. https://doi.org/10.1097/ACM.0b013e31822a603d
Azevedo, R., & Gašević, D. (2019). Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in Human Behavior, 96, 207–210. https://doi.org/10.1016/j.chb.2019.03.025
Bernacki, M. L., Byrnes, J. P., & Cromley, J. G. (2012). The effects of achievement goals and self-regulated learning behaviors on reading comprehension in technology-enhanced learning environments. Contemporary Educational Psychology, 37(2), 148–161. https://doi.org/http://dx.doi.org/10.1016/j.cedpsych.2011.12.001
Boekaerts, M., Maes, S., & Karoly, P. (2005). Self-regulation across domains of applied psychology: Is there an emerging consensus? Applied Psychology, 54(2), 149–154. https://doi.org/10.1111/j.1464-0597.2005.00201.x
Brückner, S., Schneider, J., Zlatkin-Troitschanskaia, O., & Drachsler, H. (2020). Epistemic network analyses of economics students’ graph understanding: An eye-tracking study. Sensors, 20(23), 1–32. https://doi.org/10.3390/s20236908
Cleary, T. J., Durning, S. J., & Artino, A. R. (2016). Microanalytic assessment of self-regulated learning during clinical reasoning tasks: Recent developments and next steps. Academic Medicine, 91(11), 1516–1521. https://doi.org/10.1097/ACM.0000000000001228
Csanadi, A., Eagan, B., Kollar, I., Shaffer, D. W., & Fischer, F. (2018). When coding-and-counting is not enough: Using epistemic network analysis (ENA) to analyze verbal data in CSCL research. International Journal of Computer-Supported Collaborative Learning, 13(4), 419–438. https://doi.org/10.1007/s11412-018-9292-z
Eva, K. W. (2005). What every teacher needs to know about clinical reasoning. Medical Education, 39(1), 98–106. https://doi.org/10.1111/j.1365-2929.2004.01972.x
Fleiss, J. L. (1981). Balanced incomplete block designs for inter-rater reliability studies. Applied Psychological Measurement, 5(1), 105–112. https://doi.org/10.1177/014662168100500115
Greene, J. A., & Azevedo, R. (2007). A theoretical review of Winne and Hadwin’s model of self-regulated learning: New perspectives and directions. Review of Educational Research, 77(3), 334–372. https://doi.org/10.3102/003465430303953
Greene, J. A., Deekens, V. M., Copeland, D. Z., & Yu, S. (2017). Capturing and modeling self-regulated learning using think-aloud protocols. In P. A. Alexander, D. H. Schunk, & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 323–337). Routledge.
Greene, J. A., Robertson, J., & Costa, L.-J. C. (2011). Assessing self-regulated learning using think-aloud methods. In D. H. Schunk & B. J. Zimmerman (Eds.), Handbook of self-regulation of learning and performance (1st ed., pp. 313–328). Routledge.
Griffin, T. D., Wiley, J., & Salas, C. R. (2013). Supporting effective self-regulated learning: The critical role of monitoring. In R. Azevedo & V. Aleven (Eds.), International handbook of metacognition and learning technologies (pp. 19–34). Springer. https://doi.org/10.1007/978-1-4419-5546-3_2
Hu, J., & Gao, X. A. (2017). Using think-aloud protocol in self-regulated reading research. Educational Research Review, 22, 181–193. https://doi.org/10.1016/j.edurev.2017.09.004
Kiesewetter, J., Ebersbach, R., Tsalas, N., Holzer, M., Schmidmaier, R., & Fischer, M. R. (2016). Knowledge is not enough to solve the problems: The role of diagnostic knowledge in clinical reasoning activities. BMC Medical Education, 16(1), 1–8. https://doi.org/10.1186/s12909-016-0821-z
Klein, M., Otto, B., Fischer, M. R., & Stark, R. (2019). Fostering medical students’ clinical reasoning by learning from errors in clinical case vignettes: Effects and conditions of additional prompting procedures to foster self-explanations. Advances in Health Sciences Education, 24(2), 331–351. https://doi.org/10.1007/s10459-018-09870-5
Lajoie, S. P. (2009). Developing professional expertise with a cognitive apprenticeship model: Examples from Avionics and Medicine. In K. A. Ericsson (Ed.), Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments (pp. 61–83). Cambridge University Press.
Lajoie, S. P., & Lu, J. (2012). Supporting collaboration with technology: Does shared cognition lead to co-regulation in medicine? Metacognition and Learning, 7(1), 45–62. https://doi.org/10.1007/s11409-011-9077-5
Lajoie, S. P., Zheng, J., & Li, S. (2018). Examining the role of self-regulation and emotion in clinical reasoning: Implications for developing expertise. Medical Teacher, 40(8), 842–844. https://doi.org/10.1080/0142159X.2018.1484084
Lajoie, S. P., Zheng, J., Li, S., Jarrell, A., & Gube, M. (2019). Examining the interplay of affect and self-regulation in the context of clinical reasoning. Learning and Instruction, 101219. https://doi.org/10.1016/j.learninstruc.2019.101219
Li, S., Du, H., Xing, W., Zheng, J., Chen, G., & Xie, C. (2020). Examining temporal dynamics of self-regulated learning behaviors in STEM learning: A network approach. Computers & Education, 158, 103987. https://doi.org/10.1016/j.compedu.2020.103987
Li, S., Zheng, J., Huang, X., & Xie, C. (2022). Self-regulated learning as a complex dynamical system: Examining students’ STEM learning in a simulation environment. Learning and Individual Differences, 95, 102144. https://doi.org/10.1016/j.lindif.2022.102144
Li, S., Zheng, J., & Lajoie, S. P. (2020). Efficient clinical reasoning: Knowing when to start and when to stop. Education in the Health Professions, 3(1), 1–7. https://doi.org/10.4103/EHP.EHP_1_20
Li, S., Zheng, J., & Lajoie, S. P. (2021). The frequency of emotions and emotion variability in self-regulated learning: What matters to task performance? Frontline Learning Research, 9(4), 76–91. https://doi.org/10.14786/flr.v9i4.901
Li, S., Zheng, J., & Lajoie, S. P. (2022). Temporal structures and sequential patterns of self-regulated learning behaviors in problem solving with an intelligent tutoring system. Educational Technology & Society, 25(4), 1–14. https://www.researchgate.net/publication/357807447_Temporal_structures_and_sequential_patterns_of_self-regulated_learning_behaviors_in_problem_solving_with_an_intelligent_tutoring_system
Marcum, J. A. (2012). An integrated model of clinical reasoning: Dual‐process theory of cognition and metacognition. Journal of Evaluation in Clinical Practice, 18(5), 954–961. https://doi.org/10.1111/j.1365-2753.2012.01900.x
Marquart, C. L., Hinojosa, C., Swiecki, Z., Eagan, B., & Shaffer, D. W. (2018). Epistemic network analysis (version 1.7.0) [software].
McCarthy, K. S., & McNamara, D. S. (2021). The multidimensional knowledge in text comprehension framework. Educational Psychologist, 56(3), 196–214. https://doi.org/10.1080/00461520.2021.1872379
Meijer, J., Veenman, M. V. J., & van Hout-Wolters, B. H. A. M. (2006). Metacognitive activities in text-studying and problem-solving: Development of a taxonomy. Educational Research and Evaluation, 12(3), 209–237. https://doi.org/10.1080/13803610500479991
Moos, D. C., & Azevedo, R. (2008). Self-regulated learning with hypermedia: The role of prior domain knowledge. Contemporary Educational Psychology, 33(2), 270–298. https://doi.org/10.1016/j.cedpsych.2007.03.001
Paquette, L., Grant, T., Zhang, Y., Biswas, G., & Baker, R. (2020). Using epistemic networks to analyze self-regulated learning in an open-ended problem-solving environment. In A. R. Ruis & S. B. Lee (Eds.), Proceedings of the 2nd International Conference on Quantitative Ethnography: Advances in Quantitative Ethnography (ICQE 2021), 1–3 February 2021, Malibu, CA, USA. Communications in Computer and Information Science (pp 185–201), vol. 1312. Springer. https://doi.org/10.1007/978-3-030-67788-6_13 https://doi.org/10.1007/978-3-030-67788-6_13
Pintrich, P. R. (2002). The role of metacognitive knowledge in learning, teaching, and assessing. Theory into Practice, 41(4), 219–225. https://doi.org/10.1207/s15430421tip4104_3
Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16(4), 385–407. https://doi.org/10.1007/s10648-004-0006-x
Schunk, D. H., & Greene, J. A. (2017). Historical, contemporary, and future perspectives on self-regulated learning and performance. In P. A. Alexander, D. H. Schunk, & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 1–15). Routledge. https://doi.org/10.4324/9781315697048-1
Schwonke, R. (2015). Metacognitive load – Useful, or extraneous concept? Metacognitive and self-regulatory demands in computer-based learning. Journal of Educational Technology & Society, 18(4), 172–184. https://www.jstor.org/stable/10.2307/jeductechsoci.18.4.172
Shaffer, D. W., Collier, W., & Ruis, A. R. (2016). A tutorial on epistemic network analysis: Analyzing the structure of connections in cognitive, social, and interaction data. Journal of Learning Analytics, 3(3), 9–45. http://dx.doi.org/10.18608/jla.2016.33.3
Shaffer, D. W., & Ruis, A. R. (2017). Epistemic network analysis: A worked example of theory-based learning analytics. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook of learning analytics (1st ed., pp. 175–187). SoLAR. https://doi.org/10.18608/hla17.015
Syed, M., & Nelson, S. C. (2015). Guidelines for establishing reliability when coding narrative data. Emerging Adulthood, 3(6), 375–387. https://doi.org/10.1177/2167696815587648
ten Cate, O., Snell, L., Mann, K., & Vermunt, J. (2004). Orienting teaching toward the learning process. Academic Medicine, 79(3), 219–228. https://doi.org/10.1097/00001888-200403000-00005
Winne, P. H. (2018). Theorizing and researching levels of processing in self‐regulated learning. British Journal of Educational Psychology, 88(1), 9–20. https://doi.org/10.1111/bjep.12173
Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 277–304). Taylor & Francis.
Zheng, J., Li, S., & Lajoie, S. P. (2021). Diagnosing virtual patients in a technology-rich learning environment: A sequential mining of students’ efficiency and behavioral patterns. Education and Information Technologies. https://doi.org/10.1007/s10639-021-10772-0
Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich & M. Zeidner (Eds.), Handbook of self-regulation (1st ed., pp. 13–39). Academic Press. https://doi.org/10.1016/B978-012109890-2/50031-7
Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal, 45(1), 166–183. https://doi.org/10.3102/0002831207312909
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
