Collaboration Analytics — Current State and Potential Futures
DOI:
https://doi.org/10.18608/jla.2021.7447Keywords:
learning analytics, collaborative learning, adaptive systems, data modelling, privacy and ethics, theoryAbstract
This special issue brings together a rich collection of papers in collaboration analytics. With topics including theory building, data collection, modelling, designing frameworks, and building machine learning models, this issue represents some of the most active areas of research in the field. In this editorial, we summarize the papers; discuss the nature of collaboration analytics based on this body of work; describe the associated opportunities, challenges, and risks; and depict potential futures for the field. We conclude by discussing the implications of this special issue for collaboration analytics.
References
ACM US Public Policy Council. (2017). Statement on algorithmic transparency and accountability. Communications of the ACM. https://www.acm.org/binaries/content/assets/public-policy/acm-pres-ltr-un-re-weapons-systems.pdf
Bachour, K., Kaplan, F., & Dillenbourg, P. (2010). An interactive table for supporting participation balance in face-to-face collaborative learning. IEEE Transactions on Learning Technologies, 3(3), 203–213. https://doi.org/10.1109/TLT.2010.18
Baker, R. S. (2016). Stupid tutoring systems, intelligent humans. International Journal of Artificial Intelligence in Education, 26(2), 600–614. https://doi.org/10.1007/s40593-016-0105-0
Blikstein, P., & Worsley, M. (2016). Multimodal learning analytics and education data mining: Using computational technologies to measure complex learning tasks. Journal of Learning Analytics, 3(2), 220–238. https://doi.org/10.18608/jla.2016.32.11
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016). Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In Proceedings of the 30th International Conference on Neural Information Processing Systems (NIPS 2016), 5–10 December 2016, Barcelona, Spain (pp. 4356–4364). Red Hook, NY, USA: Curran Associates. https://dl.acm.org/doi/10.5555/3157382.3157584
Brown, A. L. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. The Journal of the Learning Sciences, 2(2), 141–178. https://doi.org/10.1207/s15327809jls0202_2
Callahan, E. S., & Herring, S. C. (2011). Cultural bias in Wikipedia content on famous persons. Journal of the American Society for Information Science, 62(10), 1899–1915. https://doi.org/10.1002/asi.21577
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2–7 June 2019, Minneapolis, MN, USA (pp. 4171–4186). https://doi.org/10.18653/v1/N19-1423
Dowell, N. M., Nixon, T., & Graesser, A. C. (2019). Group communication analysis: A computational linguistics approach for detecting sociocognitive roles in multi-party interactions. Behavior Research Methods, 51(3), 1007–1041. https://doi.org/10.3758/s13428-018-1102-z
Dillenbourg, P. (1999) What do you mean by collaborative learning?. In P. Dillenbourg (Ed.), Collaborative Learning: Cognitive and Computational Approaches (pp. 1–19). Oxford, UK: Elsevier.
Drachsler, H., Hoel, T., Scheffel, M., Kismihók, G., Berg, A., Ferguson, R., … Manderveld, J. (2015). Ethical and privacy issues in the application of learning analytics. In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (LAK ’15), 16–20 March 2015, Poughkeepsie, NY, USA (pp. 390–391). New York: ACM. https://doi.org/10.1145/2723576.2723642
Emara, M., Hutchins, N. M., Grover, S., Snyder, C., & Biswas, G. (2021). Examining student regulation of collaborative, computational, problem-solving processes in open-ended learning environments. Journal of Learning Analytics, 8(1), 49–74. http://doi.org/10.18608/jla.2021.7230
Fiore, S. M., Graesser, A., & Greiff, S. (2018). Collaborative problem-solving education for the twenty-first-century workforce. Nature Human Behaviour, 2(6), 367–369. https://doi.org/10.1038/s41562-018-0363-y
Goodyear, P., Jones, C., & Thompson, K. (2014). Computer-supported collaborative learning: Instructional approaches, group processes and educational designs. In J. Spector, M. Merrill, J. Elen, & M. Bishop (Eds.), Handbook of Research on Educational Communications and Technology (pp. 439-451). New York: Springer. https://doi.org/10.1007/978-1-4614-3185-5_35
Gosselin, D. C., Thompson, K., Pennington, D., & Vincent, S. (2020). Learning to be an interdisciplinary researcher: Incorporating training about dispositional and epistemological differences into graduate student environmental science teams. Journal of Environmental Studies and Sciences, 10, 310–326. https://doi.org/10.1007/s13412-020-00605-w
Graesser, A. C., Fiore, S. M., Greiff, S., Andrews-Todd, J., Foltz, P. W., & Hesse, F. W. (2018). Advancing the science of collaborative problem solving. Psychological Science in the Public Interest: A Journal of the American Psychological Society, 19(2), 59–92. https://doi.org/10.1177/1529100618808244
Hadwin, A. F., Järvelä, S., and Miller, M. (2011). Self-regulated, co-regulated, and socially shared regulation of learning. In B. J. Zimmerman & D. H. Schunk (Eds.), Handbook of Self-Regulation of Learning and Performance (pp. 65–84). New York: Routledge. https://psycnet.apa.org/record/2011-12365-005
Halpin, P. (2021). Measuring dynamical interdependence in small-group collaborations. Journal of Learning Analytics, 8(1), 95–112. http://doi.org/10.18608/jla.2021.7241
Halpin, P. F., & von Davier, A. A. (2017). Modeling collaboration using point processes. In A. A. von Davier, M. Zhu, & P. C. Kyllonen (Eds.), Innovative Assessment of Collaboration (pp. 233–247). Springer. https://doi.org/10.1007/978-3-319-33261-1_15
Han, A., Krieger, F., & Greiff, S. (2021). Collaboration analytics need more comprehensive models and methods. An opinion paper. Journal of Learning Analytics, 8(1), 13–29. http://doi.org/10.18608/jla.2021.7288
Hao, J., Liu, L., von Davier, A. A., Lederer, N., Zapata‐Rivera, D., Jakl, P., & Bakkenson, M. (2017). EPCAL: ETS platform for collaborative assessment and learning. ETS Research Report Series, 2017(1), 1–14. https://doi.org/10.1002/ets2.12181
Hassan, J., Leong, J., & Schneider, B. (2021). Multimodal data collection made easy: The EZ-MMLA Toolkit. 11th International Conference on Learning Analytics and Knowledge (LAK ’21), 12–16 April 2021, Online, Everywhere.
Hudson, M. E., Voytecki, K. S., & Zhang, G. (2018). Mixed-reality teaching experiences improve preservice special education students’ perceptions of their ability to manage a classroom. Journal for Virtual Worlds Research, 11(2). https://doi.org/10.4101/jvwr.v11i2.7308
Janssen, J., Erkens, G., & Kirschner, P. A. (2011). Group awareness tools: It’s what you do with it that matters. Computers in Human Behavior, 27(3), 1046–1058. https://doi.org/10.1016/j.chb.2010.06.002
Kitto, K., Buckingham Shum, S., & Gibson, A. (2018). Embracing imperfection in learning analytics. In Proceedings of the Eighth International Conference on Learning Analytics and Knowledge (LAK ’18), 5–9 March 2018, Sydney, NSW, Australia (pp. 451–460). New York: ACM. https://doi.org/10.1145/3170358.3170413
Lämsä, J., Uribe, P., Jiménez, A., Caballero, D., Hämäläinen, R., & Araya, R. (2021). Deep networks for collaboration analytics: Promoting automatic analysis of face-to-face interaction in the context of inquiry-based learning. Journal of Learning Analytics, 8(1), 113–125. http://doi.org/10.18608/jla.2021.7118
Martinez-Maldonado, R., Gašević, D., Echeverria, V., Fernandez Nieto, G, Swiecki, Z., & Buckingham Shum, S. (2021). What do you mean by collaboration analytics? A conceptual model. Journal of Learning Analytics, 8(1), 126–153. http://doi.org/10.18608/jla.2021.7227
Markauskaite, L., Muukkonen, H., Damsa, C., Thompson, K., Arthars, N., Celik, I., … Kali, Y. (2020). Interdisciplinary learning in undergraduate and graduate education: Conceptualizations and empirical accounts. In M. Gresalfi & I. S. Horn (Eds.), The Interdisciplinarity of the Learning Sciences, 14th International Conference of the Learning Sciences (ICLS 2020), 19–23 June 2020, Nashville, TN, USA (Volume 1, pp. 398–405). International Society of the Learning Sciences. https://repository.isls.org/handle/1/6664
Martinez‐Maldonado, R., Schulte, J., Echeverria, V., Gopalan, Y., & Buckingham Shum, S. (2020). Where is the teacher? Digital analytics for classroom proxemics. Journal of Computer Assisted Learning, 36(5), 741–762. https://doi.org/10.1111/jcal.12444
Metz, C. (2019, November 11). We teach A.I. systems everything, including our biases. The New York Times. https://www.nytimes.com/2019/11/11/technology/artificial-intelligence-bias.html
Ochoa, X., & Worsley, M. (2016). Augmenting learning analytics with multimodal sensory data. Journal of Learning Analytics, 3(2), 213–219. https://doi.org/10.18608/jla.2016.32.10
O’Neil, C. (2016). Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Broadway Books.
Pennington, D., Bammer, G., Danielson, A., Gosselin, D., Gouvea, J., Habron, G., … Wei, C. (2016) National The EMBeRS project: Employing model-based reasoning in socio-environmental synthesis. Journal of Environmental Studies and Sciences, 6, 278–286. https://doi.org/10.1007/s13412-015-0335-8
Pennington, D., Vincent, S., Gosselin, D., & Thompson, K. (in press). Learning across Disciplines in Socio-Environmental Problem Framing. Socio-Environmental Systems Modeling.
Penuel, W. R., & Gallagher, D. J. (2017). Creating Research Practice Partnerships in Education. Cambridge, MA, USA: Harvard Education Press.
Rai, A. (2020). Explainable AI: From black box to glass box. Journal of the Academy of Marketing Science, 48(1), 137–141. https://doi.org/10.1007/s11747-019-00710-5
Reimann, P. (2013). Design-based research: Designing as research. In R. Luckin, S. Puntambekar, P. Goodyear, B. Grabowski, J. Underwood, & N. Winters (Eds.), Handbook of Design in Educational Technology (pp. 44–52). Routledge.
Salomon, G., & Globerson, T. (1989). When teams do not function the way they ought to. International Journal of Educational Research, 13(1), 89–99. https://doi.org/10.1016/0883-0355(89)90018-9
Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380–1400. https://doi.org/10.1177/0002764213498851
Soller, A., Martínez, A., Jermann, P., & Muehlenbrock, M. (2005). From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. International Journal of Artificial Intelligence in Education, 15(4), 261–290. https://dl.acm.org/doi/10.5555/1434935.1434937
Schwendimann, B. A., Rodriguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., ... Dillenbourg, P. (2016). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1), 30–41. https://doi.org/10.1109/TLT.2016.2599522
Swiecki, Z. (2021). Measuring the impact of interdependence on individuals during collaborative problem-solving. Journal of Learning Analytics, 8(1), 75–94. http://doi.org/10.18608/jla.2021.7240
Webster, K., Costa-jussà, M. R., Hardmeier, C., & Radford, W. (2019). Gendered ambiguous pronoun (GAP) shared task at the Gender Bias in NLP Workshop 2019. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing, 1–2 August 2019, Florence, Italy (pp. 1–7). https://doi.org/10.18653/v1/W19-3801
Winne, P. H. (2017). Leveraging big data to help each learner and accelerate learning science. Teachers College Record, 119(3), 1–24. https://psycnet.apa.org/record/2017-15518-001
Wise, A. F., & Shaffer, D. W. (2015). Why theory matters more than ever in the age of big data. Journal of Learning Analytics, 2(2), 5–13. https://doi.org/10.18608/jla.2015.22.2
Wise, A. F., & Schwarz, B. B. (2017). Visions of CSCL: Eight provocations for the future of the field. International Journal of Computer-Supported Collaborative Learning, 12(4), 423–467. https://doi.org/10.1007/s11412-017-9267-5
Wise, A. F. (2019). Learning analytics: Using data-informed decision-making to improve teaching and learning. In O. O. Adesope & A. G. Rud (Eds.), Contemporary Technologies in Education: Maximizing Student Engagement, Motivation, and Learning (pp. 119–143). Springer International. https://doi.org/10.1007/978-3-319-89680-9_7
Worsley, M., Anderson, K., Melo, N., & Jang, J. Y. (2021). Designing analytics for collaboration literacy and student empowerment. Journal of Learning Analytics, 8(1), 30–48. http://doi.org/10.18608/jla.2021.7242
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
