Exploring the Utility of Social-Network-Derived Collaborative Opportunity Temperature Readings for Informing Design and Research of Large-Group Immersive Learning Environments
DOI:
https://doi.org/10.18608/jla.2022.7419Keywords:
co-located large groups, collaboration, multi-user learning environment, social network analysis, immersive museum exhibit, data-driven formative feedback, research paperAbstract
Large-group (n > 8) co-located collaboration has not been adequately studied because it demands different conceptual framings than those used to study small-group collaboration, while also posing pragmatic constraints on data collection. Working within these pragmatic constraints, we use video data to devise an indicator of the current possibilities for learner collaboration during large-group co-located interactions. We borrow conceptualizations from proxemics and social network analysis to construct collaborative opportunity networks, allowing us to define the concept of collaborative opportunity temperature (COT) readings: a “snapshot” of the current configuration of the different social subgroup structures within a large group, indicating emergent opportunities for collaboration (via talk or shared action) due to proximity. Using a case study of two groups of people (n = 11, n = 12) who interacted with a multi-user museum exhibit, we outline the processes of deriving COT. We show how to quickly detect differences in subgroup configurations that may result from educational interventions and how COT can triangulate with and complement other forms of data (audio transcripts and activity logs) during lengthier analyses. We also outline how COT readings can be used to supply formative feedback on social engagement to learners and be adapted to other learning environments.
References
Alldieck, T., Magnor, M., Xu, W., Theobalt, C., & Pons-Moll, G. (2018). Video based reconstruction of 3D people models. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 18–22 June 2018, Salt Lake City, Utah, USA (pp. 8387–8397). IEEE. https://doi.org/10.1109/CVPR.2018.00875
Allen, S. (2003). Looking for learning in visitor talk: A methodological exploration. In G. Leinhardt, K. Crowley, & K. Knutson (Eds.), Learning Conversations in Museums (pp. 265–309). Routledge. https://doi.org/10.4324/9781410606624
Allen, S., & Gutwill, J. P. (2004). Designing with multiple interactives: Five common pitfalls. Curator, 47(2), 199–212. https://doi.org/10.1111/j.2151-6952.2004.tb00117.x
Aviv, R., Erlich, Z., Ravid, G., & Geva, A. (2003). Network analysis of knowledge construction in asynchronous learning networks. Journal of Asynchronous Learning Networks, 7(3). https://doi.org/10.24059/olj.v7i3.1842
Bakharia, A., & Dawson, S. (2011). SNAPP: A bird’s-eye view of temporal participant interaction. Proceedings of the First International Conference on Learning Analytics and Knowledge (LAK 2011), 27 February–1 March 2011, Banff, Alberta, Canada (pp. 168–173). ACM. https://doi.org/10.1145/2090116.2090144
Barab, S. A., & Roth, W.-M. (2006). Curriculum-based ecosystems: Supporting knowing from an ecological perspective. Educational Researcher, 35(5), 3–13. https://doi.org/10.3102/0013189X035005003
Barriault, C., & Pearson, D. (2010). Assessing exhibits for learning in science centers: A practical tool. Visitor Studies, 13(1), 90–106. https://doi.org/10.1080/10645571003618824
Barron, B. (2003). When smart groups fail. Journal of the Learning Sciences, 12(3), 307–359. https://doi.org/10.1207/S15327809JLS1203_1
Bitgood, S. (2006). An analysis of visitor circulation: Movement patterns and the general value principle. Curator: The Museum Journal, 49(4), 463–475. https://doi.org/10.1111/j.2151-6952.2006.tb00237.x
Block, F., Hammerman, J., Horn, M., Spiegel, A., Christiansen, J., Phillips, B., Diamond, J., Evans, E. M., & Shen, C. (2015). Fluid grouping: Quantifying group engagement around interactive tabletop exhibits in the wild. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015), 18–23 April 2015, Seoul, Republic of Korea (pp. 867–876). ACM. https://doi.org/10.1145/2702123.2702231
Cafaro, F., Panella, A., Lyons, L., Roberts, J., & Radinsky, J. (2013). I see you there! Developing identity-preserving embodied interaction for museum exhibits. Proceedings of the 2013 ACM Annual Conference on Human Factors in Computing Systems (CHI 2013), 27 April–2 May 2013, Paris, France (pp. 1911–1920). ACM. https://doi.org/10.1145/2470654.2466252
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2017). OpenPose: Realtime multi-person 2D pose estimation using part affinity fields. arXiv:1611.08050. https://arxiv.org/abs/1611.08050
Carolan, B. V. (2013). Social Network Analysis and Education: Theory, Methods & Applications. Sage Publications. https://doi.org/10.4135/9781452270104
Chan, M. C. E., Ochoa, X., & Clarke, D. (2020). Multimodal learning analytics in a laboratory classroom. In M. Virvou, E. Alepis, G. Tsihrintzis, & L. Jain (Eds.), Machine Learning Paradigms. Intelligent Systems Reference Library (pp. 131–156). Springer. https://doi.org/10.1007/978-3-030-13743-4_8
Chua, Y. H. V., Dauwels, J., & Tan, S. C. (2019). Technologies for automated analysis of co-located, real-life, physical learning spaces: Where are we now? Proceedings of the Ninth International Conference on Learning Analytics and Knowledge (LAK 2019), 4–8 March 2019, Tempe, Arizona, USA (pp. 11–20). ACM. https://doi.org/10.1145/3303772.3303811
Cukurova, M., Luckin, R., Milla ́n, E., & Mavrikis, M. (2018). The NISPI framework: Analysing collaborative problem-solving from students’ physical interactions. Computers and Education, 116, 93–109. https://doi.org/10.1016/j.compedu.2017. 08.007
Dado, M., & Bodemer, D. (2017). A review of methodological applications of social network analysis in computer-supported collaborative learning. Educational Research Review, 22, 159–180. https://doi.org/10.1016/j.edurev.2017.08.005
D’Angelo, C. M., Smith, J., Alozie, N., Tsiartas, A., Richey, C., & Bratt, H. (2019). Mapping individual to group level collaboration indicators using speech data. In K. Lund, G. P. Niccolai, E. Lavoué, C. Hmelo-Silver, G. Gweon, & M. Baker (Eds.), Proceedings of the Computer-Supported Collaborative Learning Conference (CSCL 2019), 17–21 June 2019, Lyon, France (pp. 628–631). ISLS. https://repository.isls.org/handle/1/1637
Dawson, S., Bakharia, A., & Heathcote, E. (2010). SNAPP: Realising the affordances of real-time SNA within networked learning environments. Proceedings of the Seventh International Conference on Networked Learning, 3–4 May 2010, Aalborg, Denmark (pp. 125–133). https://www.lancaster.ac.uk/fss/organisations/netlc/past/nlc2010/abstracts/Dawson.html
De Laat, M., Lally, V., Lipponen, L., & Simons, R. J. (2007). Investigating patterns of interaction in networked learning and computer-supported collaborative learning: A role for social network analysis. International Journal of Computer- Supported Collaborative Learning, 2(1), 87–103. https://doi.org/10.1007/s11412-007-9006-4
Derry, S. J., DuRussel, L. A., & O’Donnell, A. M. (1998). Individual and distributed cognitions in interdisciplinary teamwork: A developing case study and emerging theory. Educational Psychology Review, 10(1), 25–56. https://doi.org/10.1023/A:1022806130931
Diamond, J., Bond, A., Schenker, B., Meier, D., & Twersky, D. (1995). Collaborative multimedia. Curator, 38(3), 137–149. https://doi.org/10.1111/j.2151-6952.1995.tb01050.x
Diamond, J., Luke, J. J., & Uttal, D. H. (2009). Practical Evaluation Guide: Tools for Museums & Other Informal Educational Settings (2nd ed.). AltaMira Press.
Dim, E., & Kuflik, T. (2014). Automatic detection of social behavior of museum visitor pairs. ACM Transactions on Interactive Intelligent Systems, 4(4), 1–30. https://doi.org/10.1145/2662869
D’Mello, S., Dieterle, E., & Duckworth, A. (2017). Advanced, analytic, automated (AAA) measurement of engagement during learning. Educational Psychologist, 52(2), 104–123. https://doi.org/10.1080/00461520.2017.1281747
Dra ́zˇdilova ́, P., Martinovicˇ, J., Slaninova ́, K., & Sna ́sˇel, V. (2008). Analysis of relations in eLearning. Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology—Workshops, WI-IAT Workshops 2008, 9–12 December 2008, Sydney, Australia (pp. 373–376). IEEE. https://doi.org/10.1109/WIIAT.2008.250
Dunleavy, M., Dede, C., & Mitchell, R. (2009). Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. Journal of Science Education and Technology, 18, 7–22. https://doi.org/10. 1007/s10956-008-9119-1
Eagle, N., Pentland, A., & Lazer, D. (2009). Inferring friendship network structure by using mobile phone data. Proceedings of the National Academy of Sciences of the United States of America, 106(36), 15274–15278. https://doi.org/10.1073/pnas.0900282106
Echeverrıa, V., Martinez-Maldonado, R., & Buckingham Shum, S. (2019). Towards collaboration translucence: Giving meaning to multimodal group data. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI 2019), 4–9 May 2019, Glasgow, UK (pp. 1–16). ACM. https://doi.org/10.1145/3290605.3300269
Eghbal-Azar, K., & Widlok, T. (2013). Potentials and limitations of mobile eye tracking in visitor studies: Evidence from field research at two museum exhibitions in Germany. Social Science Computer Review, 31(1), 103–118. https://doi.org/10.1177/0894439312453565
Engeström, J. (2005). Why some social network services work and others don’t—Or: The case for object-centered sociality. http://www.zengestrom.com/blog/2005/04/why-some-social-network-services-work-and-others-dont-or-the-case- for-object-centered-sociality.html
Enyedy, N., Danish, J. A., & DeLiema, D. (2015). Constructing liminal blends in a collaborative augmented-reality learning environment. International Journal of Computer-Supported Collaborative Learning, 10(1), 7–34. https://doi.org/10. 1007/s11412-015-9207-1
Erlin, B., Yusof, N., & Rahman, A. A. (2009). Students’ interactions in online asynchronous discussion forum: A social network analysis. Proceedings of the 2009 International Conference on Education Technology and Computer (ICETC 2009), 17–20 April 2009, Singapore (pp. 25–29). IEEE. https://doi.org/10.1109/ICETC.2009.48
Falk, J. H., & Dierking, L. D. (2018). Learning from Museums: Visitor Experiences and the Making of Meaning (2nd ed.). Rowman & Littlefield.
Filippini Fantoni, S., Jaebker, K., Bauer, D., & Stofer, K. (2013). Capturing visitors’ gazes: Three eye tracking studies in museums. In N. Proctor & R. Cherry (Eds.), Proceedings of the 2013 Annual Conference of Museums and the Web (MW2013), 17–20 April 2013, Portland, Oregon, USA. Museums and the Web LLC. https://mw2013.museumsandtheweb.com/paper/capturing-visitors-gazes-three-eye-tracking-studies-in-museums/
Fisher, D., & Dourish, P. (2004). Social and temporal structures in everyday collaboration. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2004), 24–29 April 2004, Vienna, Austria (pp. 551–558). ACM. https://doi.org/10.1145/985692.985762
Gergle, D., Rose ́, C. P., & Kraut, R. E. (2007). Modeling the impact of shared visual information on collaborative reference. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2007), 28 April–3 May 2007, San Jose, California, USA (pp. 1543–1552). ACM. https://doi.org/10.1145/1240624.1240858
Gnoli, A., Perritano, A., Guerra, P., Lopez, B., Brown, J., & Moher, T. (2014). Back to the future: Embodied classroom simulations of animal foraging. Proceedings of the Eighth International Conference on Tangible, Embedded and Embodied Interaction (TEI 2014), 16–19 February 2014, Munich, Germany (pp. 275–282). ACM. https://doi.org/10. 1145/2540930.2540972
Greenberg, S., Boring, S., Vermeulen, J., & Dostal, J. (2014). Dark patterns in proxemic interactions: A critical perspective. Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS 2014), 21–25 June 2014, Vancouver, British Columbia, Canada (pp. 523–532). https://doi.org/10.1145/2598510.2598541
Hagberg, A., Swart, P., & S Chult, D. (2008). Exploring Network Structure, Dynamics, and Function Using NetworkX (tech. rep.). Los Alamos National Laboratory (LANL), Los Alamos, New Mexico, USA. https://www.osti.gov/biblio/960616-exploring-network-structure-dynamics-function-using-networkx
Hall, E. T. (1966). The Hidden Dimension. Anchor Books.
Haythornthwaite, C. (1999). Collaborative work networks among distributed learners. Proceedings of the Hawaii International Conference on System Sciences (HICSS 1999), 5–8 January 1999, Maui, Hawaii, USA. IEEE. https://doi.org/10.1109/hicss.1999.772707
Heath, C., Lehn, D. V., & Osborne, J. (2005). Interaction and interactives: Collaboration and participation with computer-based exhibits. Public Understanding of Science, 14(1), 91–101. https://doi.org/10.1177/0963662505047343
Hecking, T., Ziebarth, S., & Ulrich Hoppe, H. (2014). Analysis of dynamic resource access patterns in a blended learning course. Proceedings of the Fourth International Conference on Learning Analytics and Knowledge (LAK 2014), 24–28 March 2014, Indianapolis, Indiana, USA (pp. 173–182). ACM. https://doi.org/10.1145/2567574.2567584
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861. https://arxiv.org/abs/1704.04861
Intille, S. S., & Bobick, A. F. (1995). Closed-world tracking. Proceedings of the IEEE International Conference on Computer Vision (ICCV 1995), 20–23 June 1995, Cambridge, Massachusetts, USA (pp. 672–678). IEEE. https://doi.org/10. 1109/ICCV.1995.466874
Janssen, J., Erkens, G., Kanselaar, G., & Jaspers, J. (2007). Visualization of participation: Does it contribute to successful computer-supported collaborative learning? Computers & Education, 49(4), 1037–1065. https://doi.org/10.1016/j. compedu.2006.01.004
Janssen, J., Erkens, G., Kirschner, P. A., & Kanselaar, G. (2010). Effects of representational guidance during computer-supported collaborative learning. Instructional Science, 38(1), 59–88. https://doi.org/10.1007/s11251-008-9078-1
Jorion, N., Roberts, J., Bowers, A., Tissenbaum, M., Lyons, L., Kumar, V., & Berland, M. (2020). Uncovering patterns in constructionist collaborative learning activities via cluster analysis of museum exhibit log files. Frontline Learning Research, 8(6), 77–87. https://doi.org/10.14786/flr.v8i6.597
Kendon, A. (2010). Spacing and orientation in co-present interaction. In A. Esposito, N. Campbell, C. Vogel, A. Hussain, & A. Nijholt (Eds.), Development of Multimodal Interfaces: Active Listening and Synchrony. Lecture Notes in Computer Science (pp. 1–15). Springer-Verlag. https://doi.org/10.1007/978-3-642-12397-9_1
Kim, T., McFee, E., Olguin, D. O., Waber, B., & Pentland, A. (2012). Sociometric badges: Using sensor technology to capture new forms of collaboration. Journal of Organizational Behavior, 33(3), 412–427. https://doi.org/10.1002/job.1776
Kim, Y., Butail, S., Liu, L., Tscholl, M., Hwang, J., Cafaro, F., Trajkova, M., Kwon, K., Espino, D., Lee, S., Hamilton, E., D’Angelo, C., Ochoa, X., & Kline, A. (2020). Multimodal data analytics for assessing collaborative interactions. In M. Gresalfi & I. S. Horn (Eds.), Proceedings of the 14th International Conference of the Learning Sciences (ICLS 2020), 19–23 June 2020, Nashville, Tennessee, USA (pp. 2547–2554). ISLS. https://repository.isls.org//handle/1/6619
Korn, R. (1995). An analysis of differences between visitors at natural history museums and science centers. Curator: The Museum Journal, 38(3), 150–160. https://doi.org/10.1111/j.2151-6952.1995.tb01051.x
Kuflik, T., & Dim, E. (2013). Early detection of pairs of visitors by using a museum triage. In N. Proctor & R. Cherry (Eds.), Proceedings of the 2013 Annual Conference of Museums and the Web (MW2013), 17–20 April 2013, Portland, Oregon, USA. Museums and the Web LLC. https://mw2013.museumsandtheweb.com/paper/early-detection-of-pairs-of- visitors-by-using-a-museum-triage/
Kynigos, C., Smyrnaiou, Z., & Roussou, M. (2010). Exploring rules and underlying concepts while engaged with collaborative full-body games. Proceedings of the Ninth International Conference on Interaction Design and Children (IDC 2010), 9–12 June 2010, Barcelona, Spain (pp. 222–225). ACM. https://doi.org/10.1145/1810543.1810576
Lanir, J., Kuflik, T., Sheidin, J., Yavin, N., Leiderman, K., & Segal, M. (2017). Visualizing museum visitors’ behavior: Where do they go and what do they do there? Personal and Ubiquitous Computing, 21(2), 313–326. https://doi.org/10.1007/s00779-016-0994-9
Lave, J., & Wenger, E. (1991). Situated Learning: Legitimate Peripheral Participation. Cambridge University Press. https://doi.org/10.1017/CBO9780511815355
Lepri, B., Staiano, J., Rigato, G., Kalimeri, K., Finnerty, A., Pianesi, F., Sebe, N., & Pentland, A. (2012). The sociometric badges corpus: A multilevel behavioral dataset for social behavior in complex organizations. Proceedings of the 2012 ASE/IEEE International Conference on Privacy, Security, Risk and Trust and 2012 ASE/IEEE International Conference on Social Computing (SocialCom/PASSAT 2012), 3–5 September 2012, Amsterdam, Netherlands (pp. 623–628). IEEE. https://doi.org/10.1109/SocialCom-PASSAT.2012.71
Levy-Cohen, R., Mallavarapu, A., Lyons, L., & Uzzo, S. (2021). Studying shared regulation in immersive learning environments. In C. Hmelo-Silver, B. de Wever, & J. Oshima (Eds.), Proceedings of the 14th International Conference on Computer- Supported Collaborative Learning (CSCL 2021), 8–11 June 2021, Bochum, Germany (pp. 100–115). ISLS. https://repository.isls.org//handle/1/7349
Lloyd, S. (1982). Least squares quantization in PCM. IEEE Transactions on Information Theory, 28(2), 129–137. https://doi.org/10.1109/TIT.1982.1056489
Lyons, L. (2009). Designing opportunistic user interfaces to support a collaborative museum exhibit. In C. O’Malley, D. Suthers, P. Reimann, & A. Dimitracopoulou (Eds.), Proceedings of the Ninth International Conference on Computer Supported Collaborative Learning—Volume 1 (CSCL 2009), 8–13 June 2009, Rhodes, Greece (pp. 375–384). ISLS. https://doi.org/10.3115/1600053.1600110
Lyons, L., & Mallavarapu, A. (2021). Collective usability: Using simulation tools to explore embodied design challenges in immersive, shared mixed-reality experiences. Educational Technology & Society, 24(2), 120–135. https://drive.google.com/file/d/1_ZxK1eCjOKqyjcde3_UyXIc6mH2Jg7s2/view
Lyons, L., Tissenbaum, M., Berland, M., Eydt, R., Wielgus, L., & Mechtley, A. (2015). Designing visible engineering: Supporting tinkering performances in museums. Proceedings of the 14th International Conference on Interaction Design and Children (IDC 2015), 21–24 June 2015, Boston, Massachusetts, USA (pp. 49–58). ACM. https://doi.org/10.1145/2771839.2771845
Magnussen, R., Zachariassen, M., Kharlamov, N., Larsen, B., Kharlamov, N., & Larsen, B. (2017). Mobile eye-tracking methods in studies of audience learning in health promotion exhibitions. Electronic Journal of E-Learning, 15(1), 46–58. https://academic-publishing.org/index.php/ejel/article/view/1818
Malcolm, P., Moher, T., Bhatt, D., Uphoff, B., & Lo ́pez-Silva, B. (2008). Embodying scientific concepts in the physical space of the classroom. Proceedings of the Seventh International Conference on Interaction Design and Children (IDC 2008), 11–13 June 2008, Chicago, Illinois, USA (pp. 234–241). ACM. https://doi.org/10.1145/1463689.1463761
Mallavarapu, A., Lyons, L., Uzzo, S., Thompson, W., Levy-Cohen, R., & Slattery, B. (2019). Connect-to-connected worlds: Piloting a mobile, data-driven reflection tool for an open-ended simulation at a museum. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI 2019), 4–9 May 2019, Glasgow, UK (pp. 1–14). ACM. https://doi.org/10.1145/3290605.3300237
Mansur, A. B. F., Yusof, N., & Othman, Mohd, S. (2012). Analysis of social learning network for wiki in moodle E-Learning. In H. Choi, S. Hong, & F. Ko (Eds.), Proceedings of the Fourth International Conference on Information Sciences and Interaction Sciences (ICIS 2011), 16–18 August 2011, Busan, Korea (pp. 201–209). IEEE. https://ieeexplore.ieee.org/document/6014520
Marshall, P., Rogers, Y., & Pantidi, N. (2011). Using F-formations to analyse spatial patterns of interaction in physical environments. Proceedings of the 2011 ACM Conference on Computer Supported Cooperative Work (CSCW 2011), 19–23 March 2011, Hangzhou, China (pp. 445–454). ACM. https://doi.org/10.1145/1958824.1958893
Martínez, R., Collins, A., Kay, J., & Yacef, K. (2011). Who did what? Who said that? Collaid: An environment for capturing traces of collaborative learning at the tabletop. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS 2011), 13–16 November 2011, Kobe, Japan (pp. 172–181). ACM. https://doi.org/10. 1145/2076354.2076387
Martinez-Maldonado, R., Echeverria, V., Santos, O. C., Dos Santos, A. D. P., & Yacef, K. (2018). Physical learning analytics: A multimodal perspective. Proceedings of the Eighth International Conference on Learning Analytics and Knowledge (LAK 2018), 7–9 March 2018, Sydney, Australia (pp. 375–379). ACM. https://doi.org/10.1145/3170358.3170379
Martinez-Maldonado, R., Echeverria, V., Yacef, K., Dos Santos, A. D. P., & Pechenizkiy, M. (2017). How to capitalise on mobility, proximity and motion analytics to support formal and informal education? Joint Proceedings of the Sixth Multimodal Learning Analytics (MMLA) Workshop and the Second Cross-LAK Workshop co-located with Seventh International Learning Analytics and Knowledge Conference (LAK 2017), 14 March 2017, Vancouver, British Columbia, Canada (pp. 39–46). ACM. http://ceur-ws.org/Vol-1828/paper-06.pdf
Matuk, C. (2016). The learning affordances of augmented reality for museum exhibits on human health. Museums & Social Issues: A Journal of Reflective Discourse, 11(1), 73–87. https://doi.org/10.1080/15596893.2016.1142815
Meisner, R., vom Lehn, D., Heath, C., Burch, A., Gammon, B., & Reisman, M. (2007). Exhibiting performance: Co-participation in science centres and museums. International Journal of Science Education, 29(12), 1531–1555. https://doi.org/10. 1080/09500690701494050
Moher, T. (2008). Learning and participation in a persistent whole-classroom seismology simulation. Proceedings of the 2008 Computer-Supported Collaborative Learning Conference, Part 2 (CSCL 2008), 24–28 June 2008, Utrecht, Netherlands (pp. 82–90). ACM. https://dl.acm.org/doi/10.5555/1599871.1599882
Moussouri, T., & Roussos, G. (2013). Examining the effect of visitor motivation on observed visit strategies using mobile computer technologies. Visitor Studies, 16(1), 21–38. https://doi.org/10.1080/10645578.2013.767732
Moussouri, T., & Roussos, G. (2015). Conducting visitor studies using smartphone-based location sensing. Journal on Computing and Cultural Heritage, 8(3), 1–16. https://doi.org/10.1145/2677083
Munaro, M., Horn, A., Illum, R., Burke, J., & Rusu, R. B. (2014). OpenPTrack: People tracking for heterogeneous networks of color-depth cameras. IAS-13 Workshop Proceedings: First International Workshop on 3D Robot Perception with Point Cloud Library, 15–19 July 2014, Padova, Italy (pp. 1–13). http://www.dei.unipd.it/~munaro/media/Munaro_3DRP2014.pdf
National Research Council. (2010). Exploring the Intersection of Science Education and 21st Century Skills: A Workshop Summary. The National Academies Press. https://doi.org/10.17226/12771
National Research Council. (2011). Assessing 21st Century Skills: Summary of a Workshop. The National Academies Press. https://doi.org/10.17226/13215
Newman, M. E. (2006). Modularity and community structure in networks. Proceedings of the National Academy of Sciences of the United States of America, 103(23), 8577–8582. https://doi.org/10.1073/pnas.0601602103
Nicks, J. (2002). Curatorship in the exhibition planning process. In B. Lord & G. D. Lord (Eds.), The Manual of Museum Exhibitions (pp. 345–347, 353–372). AltaMira Press.
Norman, D. (1988). The Design of Everyday Things. Currency-Doubleday.
Ochoa, X., & Wise, A. F. (2021). Supporting the shift to digital with student-centered learning analytics. Educational Technology Research and Development, 69(1), 357–361. https://doi.org/10.1007/s11423-020-09882-2
Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021). Data and its (dis)contents: A survey of dataset development and use in machine learning research. Patterns, 2(11), 100336. https://doi.org/10.1016/j.patter.2021.100336
Peppler, K., Danish, J., Zaitlen, B., Glosson, D., Jacobs, A., & Phelps, D. (2010). BeeSim: Leveraging wearable computers in participatory simulations with young children. Proceedings of the Ninth International Conference on Interaction Design and Children (IDC 2010), 9–12 June 2010, Barcelona, Spain (pp. 246–249). ACM. https://doi.org/10.1145/1810543.1810582
Planey, J., & Lindgren, R. (2018). Embodying climate change: Incorporating full body tracking in the design of an interactive rates of change greenhouse gas simulation. In D. Beck, C. Allison, L. Morgado, J. Pirker, A. Pen ̃a-Rios, T. Ogle, J. Richter, & C. Gu ̈tl (Eds.), Proceedings of the Fourth International Conference on Immersive Learning (iLRN 2018), 24– 29 June 2018, Missoula, Montana, USA (pp. 23–35). Springer International Publishing. https://doi.org/10.1007/978-3- 319-93596-6_2
Poquet, O., & Jovanovic, J. (2020). Intergroup and interpersonal forum positioning in shared-thread and post-reply networks. Proceedings of the 10th International Conference on Learning Analytics and Knowledge (LAK 2020), 23–27 March 2020, Frankfurt, Germany (pp. 187–196). ACM. https://doi.org/10.1145/3375462.3375533
Povis, K. T., & Crowley, K. J. (2015). Family learning in object-based museums: The role of joint attention. Visitor Studies, 18(2), 168–182. https://doi.org/10.1080/10645578.2015.1079095
Puntambekar, S., Erkens, G., & Hmelo-Silver, C. (2011). Analyzing Interactions in CSCL: Methods, Approaches and Issues (Vol. 12). Springer Science & Business Media. https://doi.org/10.1007/978-1-4419-7710-6
Rabbany, R., Elatia, S., Takaffoli, M., & Za ̈ıane, O. R. (2014). Collaborative learning of students in online discussion forums: A social network analysis perspective. In A. Pen ̃a-Ayala (Ed.), Studies in Computational Intelligence (pp. 441–466). Springer International Publishing. https://doi.org/10.1007/978-3-319-02738-8_16
Reda, K., Tantipathananandh, C., Johnson, A., Leigh, J., & Berger-Wolf, T. (2011). Visualizing the evolution of community structures in dynamic social networks. Computer Graphics Forum, 30(3), 1061–1070. https://doi.org/10.1111/j.1467- 8659.2011.01955.x
Reilly, J. M., Ravenell, M., & Schneider, B. (2018). Exploring collaboration using motion sensors and multi-modal learning analytics. Proceedings of the 11th International Conference on Educational Data Mining (EDM 2018), 15–18 July 2018, Buffalo, New York, USA. https://educationaldatamining.org/files/conferences/EDM2018/papers/EDM2018 paper 113.pdf
Roberts, J., & Lyons, L. (2017). The value of learning talk: Applying a novel dialogue scoring method to inform interaction design in an open-ended, embodied museum exhibit. International Journal of Computer-Supported Collaborative Learning, 12(4), 343–376. https://doi.org/10.1007/s11412-017-9262-x
Roberts, J., Lyons, L., Cafaro, F., & Eydt, R. (2014). Interpreting data from within: Supporting human-data interaction in museum exhibits through perspective taking. Proceedings of the 2014 Conference on Interaction Design and Children (IDC 2014), 17–20 June 2014, Aarhus, Denmark (pp. 7–16). ACM. https://doi.org/10.1145/2593968.2593974
Robinson, E. (1928). The Behavior of the Museum Visitor. American Association of Museums.
Rousseeuw, P. (1987). Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics, 20(1), 53–65. https://doi.org/10.1016/0377-0427(87)90125-7
Schautz, A. M., van Dijk, E. M., & Meisert, A. (2016). The use of audio guides to collect individualized timing and tracking data in a science center exhibition. Visitor Studies, 19(1), 96–116. https://doi.org/10.1080/10645578.2016.1144032
Schneider, B., & Blikstein, P. (2014). Unraveling students’ interaction around a tangible interface using gesture recognition. In J. C. Stamper, Z. A. Pardos, M. Mavrikis, & B. M. McLaren (Eds.), Proceedings of the Seventh International Conference on Educational Data Mining (EDM 2014), 4–7 July 2014, London, UK (pp. 320–323). https://educationaldatamining.org/EDM2014/uploads/procs2014/short%20papers/320 EDM-2014-Short.pdf
Schneider, B., & Blikstein, P. (2015). Unraveling students’ interaction around a tangible interface using multimodal learning analytics. Journal of Educational Data Mining, 7(3), 89–116. https://doi.org/10.5281/zenodo.3554729
Schneider, B., Dowell, N., & Thompson, K. (2021). Collaboration analytics—Current state and potential futures. Journal of Learning Analytics, 8(1), 1–12. https://doi.org/10.18608/jla.2021.7447
Serrell, B. (1997). Paying attention: The duration and allocation of visitors’ time in museum exhibitions. Curator, 40(2), 108–124. https://doi.org/10.1111/j.2151-6952.1997.tb01292.x
Shapiro, B. R., Hall, R. P., & Owens, D. A. (2017). Developing & using interaction geography in a museum. International Journal of Computer-Supported Collaborative Learning, 12(4), 377–399. https://doi.org/10.1007/s11412-017-9264-8
Slotta, J. D., Tissenbaum, M., & Lui, M. (2013). Orchestrating of complex inquiry: Three roles for learning analytics in a smart classroom infrastructure. Proceedings of the Third International Conference on Learning Analytics and Knowledge (LAK 2013), 8–13 April 2013, Leuven, Belgium (pp. 270–274). ACM. https://doi.org/10.1145/2460296.2460352
Smordal, O., Slotta, J., Moher, T., Lui, M., & Jornet, A. (2012). Hybrid spaces for science learning: New demands and opportunities for research. Symposium for the 2012 International Conference of the Learning Sciences (ICLS 2012), 2–6 July 2012, Sydney, Australia (pp. 9–16). ISLS. https://www.researchgate.net/publication/233416697_Hybrid_spaces_for_science_learning_New_demands_and_opportunities_for_research
Stake, R. E. (2013). Multiple Case Study Analysis. Guilford Press.
Strandburg-Peshkin, A., Farine, D. R., Couzin, I. D., & Crofoot, M. C. (2015). Shared decision-making drives collective movement in wild baboons. Science, 348(6241), 1358–1361. https://doi.org/10.1126/science.aaa5099
Suthers, D. D., Vatrapu, R., Medina, R., Joseph, S., & Dwyer, N. (2008). Beyond threaded discussion: Representational guidance in asynchronous collaborative learning environments. Computers and Education, 50(4), 1103–1127. https://doi.org/10.1016/j.compedu.2006.10.007
Thirde, D., Xu, M., & Orwell, J. (2006). Tracking football players with multiple cameras. In S. A. Velastin & P. Remagnino (Eds.), Intelligent Distributed Video Surveillance Systems (pp. 225–252). The Institution of Engineering and Technology. https://doi.org/10.1049/PBPC005E_ch8
Tissenbaum, M., Kumar, V., & Berland, M. (2016). Modeling visitor behavior in a game-based engineering museum exhibit with hidden Markov models. Proceedings of the Ninth International Conference on Educational Data Mining (EDM 2016), 29 June–2 July 2016, Raleigh, North Carolina, USA (pp. 517–522). https://educationaldatamining.org/EDM2016/proceedings/paper_104.pdf
Tissenbaum, M., Berland, M., & Lyons, L. (2017). DCLM framework: Understanding collaboration in open-ended tabletop learning environments. International Journal of Computer-Supported Collaborative Learning, 12(1), 35–64. https://doi.org/10.1007/s11412-017-9249-7
Tscholl, M., Lindgren, R., & Johnson, E. (2013). Enacting orbits: Refining the design of a full-body learning simulation. Proceedings of the 12th International Conference on Interaction Design and Children (IDC 2013), 24–27 June 2013, New York (pp. 451–454). ACM. https://doi.org/10.1145/2485760.2485807
vom Lehn, D., Heath, C., & Hindmarsh, J. (2001). Exhibiting interaction: Conduct and collaboration in museums and galleries. Symbolic Interaction, 24(2), 189–216. https://doi.org/10.1525/si.2001.24.2.189
von Zadow, U., & Dachselt, R. (2017). GIAnT: Visualizing group interaction at large wall displays. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI 2017), 6–11 May 2017, Denver, Colorado, USA (pp. 2639–2647). ACM. https://doi.org/10.1145/3025453.3026006
Wang, M., Cheng, B., Chen, J., Mercer, N., & Kirschner, P. A. (2017). The use of web-based collaborative concept mapping to support group learning and interaction in an online environment. The Internet and Higher Education, 34, 28–40. https://doi.org/10.1016/j.iheduc.2017.04.003
Wasserman, S., & Faust, K. (2012). Social Network Analysis: Methods and Applications (Vol. 8). Cambridge University Press. https://doi.org/10.1017/CBO9780511815478
Willging, P. A. (2005). Using social network analysis techniques to examine online interactions. US-China Education Review, 2(9), 1548–6613. https://doi.org/10.13140/2.1.2643.4242
Wu, L., Waber, B., Aral, S., Brynjolfsson, E., & Pentland, A. S. (2008). Mining face-to-face interaction networks using sociometric badges: Predicting productivity in an IT configuration task. Proceedings of the 29th International Conference on Information Systems (ICIS 2008), 14–17 December 2008, Paris, France. SSRN. https://doi.org/10. 2139/ssrn.1130251
Xu, M., Orwell, J., & Jones, G. (2004). Tracking football players with multiple cameras. Proceedings of the 2004 International Conference on Image Processing (ICIP 2004), 24–27 October 2004, Singapore (pp. 2909–2912). IEEE. https://doi.org/10.1109/ICIP.2004.1421721
Yalowitz, S. S., & Bronnenkant, K. (2009). Timing and tracking: Unlocking visitor behavior. Visitor Studies, 12(1), 47–64. https://doi.org/10.1080/10645570902769134
Yan, L., Martinez-Maldonado, R., Cordoba, B. G., Deppeler, J., Corrigan, D., Nieto, G. F., & Gasevic, D. (2021). Footprints at school: Modelling in-class social dynamics from students’ physical positioning traces. Proceedings of the 11th International Conference on Learning Analytics and Knowledge (LAK 2021), 12–16 April 2021, Irvine, California, USA (pp. 43–54). ACM. https://doi.org/10.1145/3448139.3448144
Zhang, J., Zhu, Z., Zou, W., Li, P., Li, Y., Su, H., & Huang, G. (2019). FastPose: Towards real-time pose estimation and tracking via scale-normalized multi-task networks. arXiv:1908.05593. https://arxiv.org/abs/1908.05593
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
