A Measurement Model of Gestures in an Embodied Learning Environment: Accounting for Temporal Dependencies
DOI:
https://doi.org/10.18608/jla.2017.43.3Keywords:
Embodied Cognition, Embodied Learning Design, Hidden Markov Models, Optimal Matching, Temporal AnalyticsAbstract
Interactive learning environments with body-centric technologies lie at the intersection of the design of embodied learning activities and multimodal learning analytics. Sensing technologies can generate large amounts of fine-grained data automatically captured from student movements. Researchers can use these fine-grained data to create a high-resolution picture of the activity that takes place during these student–computer interactions and explore whether the sequence of movements has an effect on learning. We present a use-case modelling of temporal data in an interactive learning environment with hand gestures, and discuss some validity threats if temporal dependencies are not accounted for. In particular, we assess how, if ignored, the temporal dependencies in the measurement of hand gestures might affect the goodness of fit of the statistical model and would affect the measurement of the similarity between elicited and enacted movement. Our findings show that accounting for temporality is crucial for finding a meaningful fit to the data. In using temporal analytics, we are able to create a high-resolution picture of how sensorimotor coordination correlates with learning gains in our learning system.
References
Abbott, A., & Tsay, A. (2000). Sequence analysis and optimal matching methods in sociology review and prospect. Sociological methods & research, 29(1), 3-33.
Abrahamson, D. (2014). Building educational activities for understanding: an elaboration on the embodied-design framework and its epistemic grounds. International Journal of Child-Computer Interaction, 2(1), 1-16.
Abrahamson, D., & Lindgren, R. (2014). Embodiment and Embodied Design. In K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (2nd ed., pp. 358-376). Cambridge, UK: Cambridge University Press.
Abrahamson, D., & Sánchez-García, R. (2016). Learning Is Moving in New Ways: The Ecological Dynamics of Mathematics Education. Journal of the Learning Sciences, 25(2), 203-239. doi:10.1080/10508406.2016.1143370
Agresti, A. (2014). Categorical data analysis: John Wiley & Sons.
Barsalou, L. W. (2008). Grounded cognition. Annu. Rev. Psychol., 59, 617-645.
Barsalou, L. W. (2010). Grounded cognition: Past, present, and future. Topics in Cognitive Science, 2(4), 716-724.
Black, J. B., Segal, A., Vitale, J., & Fadjo, C. (2012). Embodied cognition and learning environment design. In D. Jonassen & S. Land (Eds.), Theoretical foundations of learning environments (Second ed., pp. 198-223). New York, NY: Routledge.
Collins, L. M., & Lanza, S. T. (2013). Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences (Vol. 718). New Jersey, USA: John Wiley & Sons.
Danish, J. A., Saleh, A., & Andrade, A. (2015). Science Through Technology Enhanced Play: Designing to Support Reflection Through Play and Embodiment. Paper presented at the Proceedings of the 11th International Conference on Computer Supported Collaborative Learning (CSCL2015).
Enyedy, N., Danish, J. A., Delacruz, G., & Kumar, M. (2012). Learning physics through play in an augmented reality environment. International Journal of Computer-Supported Collaborative Learning, 7(3), 347-378.
Gabadinho, A., Ritschard, G., Mueller, N. S., & Studer, M. (2011). Analyzing and visualizing state sequences in R with TraMineR. Journal of Statistical Software, 40(4), 1-37.
Goldin-Meadow, S., & Alibali, M. W. (2013). Gesture’s role in speaking, learning, and creating language. Annual review of psychology, 64, 257.
Gollery, M. (2008). Handbook of hidden Markov models in bioinformatics. London, UK: Chapman & Hall CRC Press.
Hagenaars, J. A., & McCutcheon, A. L. (2002). Applied latent class analysis. New York: Cambridge University Press.
Hamming, R. W. (1950). Error detecting and error correcting codes. Bell System technical journal, 29(2), 147-160.
Hutto, D. D., Kirchhoff, M. D., & Abrahamson, D. (2015). The enactive roots of STEM: Rethinking educational design in mathematics. Educational Psychology Review, 27(3), 371-389.
Lindgren, R. (2015). Getting into the cue: Embracing technology-facilitated body movements as a starting point for learning. In V. Lee (Ed.), Learning technologies and the body: Integration and implementation in formal and informal learning environments (pp. 39-54). New York: Routledge.
Lindgren, R., & Johnson-Glenberg, M. (2013). Emboldened by embodiment six precepts for research on embodied learning and mixed reality. Educational Researcher, 42(8), 445-452.
Linzer, D. A., & Lewis, J. B. (2011). poLCA: An R package for polytomous variable latent class analysis. Journal of Statistical Software, 42(10), 1-29.
MacDonald, I. L., & Zucchini, W. (1997). Hidden Markov and other models for discrete-valued time series (Vol. 110). London, UK: Chapman & Hall.
Nathan, M. J., Walkington, C., Boncoddo, R., Pier, E., Williams, C. C., & Alibali, M. W. (2014). Actions speak louder with words: The roles of action and pedagogical language for grounding mathematical proof. Learning and Instruction, 33, 182-193. doi:http://dx.doi.org/10.1016/j.learninstruc.2014.07.001
Smith, C. P., King, B., & Hoyte, J. (2014). Learning angles through movement: Critical actions for developing understanding in an embodied activity. The Journal of Mathematical Behavior, 36, 95-108.
Vermunt, J. K., & Magidson, J. (2004). Latent Class Models. In D. Kaplan (Ed.), The Sage Handbook of Quantitative Methodology for the Social Sciences (pp. 175-198). California, USA: Sage Publications Inc.
Vermunt, J. K., Tran, B., & Magidson, J. (2008). Latent class models in longitudinal research. In S. Menard (Ed.), Handbook of longitudinal research: Design, measurement, and analysis (pp. 373-385). New York, USA: Academic Press Elsevier.
Visser, I., & Speekenbrink, M. (2010). depmixS4: An R-package for hidden Markov models. Journal of Statistical Software, 36(7), 1-21.
Wilson, M. (2002). Six views of embodied cognition. Psychonomic bulletin & review, 9(4), 625-636.
Zucchini, W., & MacDonald, I. L. (2009). Hidden Markov models for time series: an introduction using R: CRC Press.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2017 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
