Promising Ideas for Collective Advancement of Communal Knowledge Using Temporal Analytics and Cluster Analysis
DOI:
https://doi.org/10.18608/jla.2017.43.5Keywords:
Temporal analytics, Cluster analysis, Machine learning, Promising ideas, Idea analysis, Knowledge building discourseAbstract
Understanding ideas in a discourse is challenging, especially in textual discourse analysis. We propose using temporal analytics with unsupervised machine learning techniques to investigate promising ideas for the collective advancement of communal knowledge in an online knowledge building discourse. A discourse unit network was constructed and temporal analysis was carried out to identify promising ideas, which are improvable perceptions of significant relevance that aid in the understanding of discourse context and content. With the aid of a degree centrality–betweenness centrality (DC-BC) graph, more promising ideas were discovered. An additional analysis using multiple DC-BC graph snapshots at different discourse junctures illustrates the transition of these promising ideas over time. Machine learning in the form of k-means clustering further categorized promising ideas. Cluster centroids were calculated and represented the foci of discussions, while the movement of discourse units about cluster centroids reflected how ideas affected learning behaviours among the participants. Discourse units containing promising ideas were qualitatively verified. Overall, the results showed that the implementation of temporal analytics and clustering provided insights and feedback to users about idea-related processes in the discourse. The findings have implications for teachers, students, and researchers
References
Antonenko, P. D., Toy, S., & Niederhauser, D. S. (2012). Using cluster analysis for data mining in educational technology research. Educational Technology Research and Development, 60(3), 383-398.
Baer, L., & Campbell, J. (2012). From metrics to analytics, reporting to action: Analytics’ role in changing the learning environment. In D. G. Oblinger (Ed.), Game Changers: Education and Information Technologies (pp. 53-65). EDUCAUSE.
Bailey, K. (1994). Numerical taxonomy and cluster analysis. Typologies and Taxonomies, 34, 24.
Baker, P. (2006). Using corpora in discourse analysis. A&C Black.
Bakharia, A., & Dawson, S. (2011). SNAPP: a bird's-eye view of temporal participant interaction. In Proceedings of the 1st International Conference on Learning Analytics and Knowledge (pp. 168-173). ACM.
Bereiter, C., & Scardamalia, M. (1993). Surpassing ourselves: An inquiry into the nature and implications of expertise. Chicago: Open Court.
Chen, B. (2014). Promisingness judgements as facilitators of knowledge building in elementary science (Doctoral dissertation). University of Toronto.
Chen, B., Scardamalia, M., & Bereiter, C. (2015a). Advancing knowledge‐building discourse through judgments of promising ideas. International Journal of Computer-Supported Collaborative Learning, 10(4), 345-366.
Chen, B., Haklev, S., Harrison, L., Najafi, H., & Rolheiser, C. (2015b). How do MOOC learners’ intentions relate to their behaviors and overall outcomes. Proceedings of the AERA Annual Meeting.
Chen, B., Wise, A. F., Knight, S., & Cheng, B. H. (2016). Putting temporal analytics into practice: The 5th International Workshop on Temporality in Learning Data. In Proceedings of the Sixth International Conference on Learning Analytics and Knowledge (pp. 488-489). ACM.
Chen, B. (2017). Fostering scientific understanding and epistemic beliefs through judgments of promisingness. Educational Technology Research and Development, 65(2), 255-277.
Chiu, M. M., & Fujita, N. (2014a). Statistical Discourse Analysis of Online Discussions: Informal Cognition, Social Metacognition, and Knowledge Creation. In Knowledge Creation in Education (pp. 97-112). Springer Singapore.
Chiu, M. M., & Fujita, N. (2014b). Statistical Discourse Analysis: A method for modeling online discussion processes. Journal of Learning Analytics, 1(3), 61-83.
Estivill-Castro, V. (2002). Why so many clustering algorithms: a position paper. ACM SIGKDD explorations newsletter, 4(1), 65-75.
Finley, T., & Joachims, T. (2005). Supervised clustering with support vector machines. In Proceedings of the 22nd International Conference on Machine Learning (pp. 217-224). ACM.
García, N. A., & Caplan, A. (2014). Reading the World's Classics Critically: A Keyword-Based Approach to Literary Analysis in Foreign Language Studies. Critical Inquiry in Language Studies, 11(2), 100-120.
Gardner, H. (1994). More on private intuitions and public symbol systems. Creativity Research Journal, 7(3-4), 265-275.
Garrard, P., Rentoumi, V., Gesierich, B., Miller, B., & Gorno-Tempini, M. L. (2014). Machine learning approaches to diagnosis and laterality effects in semantic dementia discourse. Cortex, 55, 122-129.
Gruzd, A., Paulin, D., & Haythornthwaite, C. (2016). Analyzing Social Media And Learning Through Content And Social Network Analysis: A Faceted Methodological Approach. Journal of Learning Analytics, 3(3), 46-71.
Hsiao, I. H., & Awasthi, P. (2015). Topic facet modeling: semantic visual analytics for online discussion forums. In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (pp. 231-235). ACM.
Idea [Def. 1a]. (n.d.). In Merriam-Webster Online. Retrieved November 2, 2016, from http://www.merriam-webster.com/dictionary/idea.
Knight, S., Wise, A. F., Chen, B., & Cheng, B. H. (2015). It's about time: 4th international workshop on temporal analyses of learning data. In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (pp. 388-389). ACM.
Knight, S., & Littleton, K. (2015). Discourse-centric learning analytics: mapping the terrain. Journal of Learning Analytics, 2(1), 185-209.
Kovanović, V., Joksimović, S., Waters, Z., Gašević, D., Kitto, K., Hatala, M., & Siemens, G. (2016). Towards automated content analysis of discussion transcripts: A cognitive presence case. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 15-24). ACM.
Lakatos, I. (1970). The methodology of scientific research programmes. In I. Lakatos & A. Musgrave (Eds.), Criticism and the Growth of Knowledge (pp. 91-195). Cambridge University Press.
Lee, A. V. Y., Tan, S. C., & Chee, K. J. K. (2016). Idea Identification and Analysis (I2A): A search for sustainable promising ideas within knowledge-building discourse. In Proceedings of the 12th International Conference of the Learning Sciences (pp. 90-97). Singapore: National Institute of Education.
Lee, A. V. Y., & Tan, S. C. (2017). Temporal analytics with discourse analysis: Tracing ideas and impact on communal discourse. In Proceedings of the Seventh International Learning Analytics and Knowledge Conference (pp. 120-127). ACM.
Locke, J. (1836). An essay concerning human understanding. London: Balne, Printer, Gracechurch Street.
Martin, R. L. (2009). The design of business: why design thinking is the next competitive advantage. Harvard Business Press.
Mercer, N. (2008). The seeds of time: Why classroom dialogue needs a temporal analysis. The Journal of the Learning Sciences, 17(1), 33-59.
Molenaar, I. (2014). Advances in temporal analysis in learning and instruction. Frontline Learning Research, 2(4), 15-24.
Nayyar, Z., Hashmi, N., Rafique, N., & Mahmood, K. (2016). Keyword based searching in social networks. SAI Computing Conference (SAI), 701-705.
Oshima, J., Oshima, R., & Matsuzawa, Y. (2012). Knowledge Building Discourse Explorer: a social network analysis application for knowledge building discourse. Educational Technology Research and Development, 60(5), 903-921.
Oshima, J., Oshima, R., & Fujita, W. (2016). Refinement of Semantic Network Analysis for Epistemic Agency in Collaboration. The 12th International Conference of the Learning Sciences (pp. 1191-1192). Singapore: National Institute of Education.
Owoputi, O., O'Connor, B., Dyer, C., Gimpel, K., Schneider, N., & Smith, N. A. (2013). Improved part-of-speech tagging for online conversational text with word clusters. Association for Computational Linguistics.
Paavola, S., & Hakkarainen, K. (2005). The knowledge creation metaphor - An emergent epistemological approach to learning. Science & Education, 14, 535-557.
Piety, P. J., Hickey, D. T., & Bishop, M. J. (2014). Educational data sciences: framing emergent practices for analytics of learning, organizations, and systems. In Proceedings of the Fourth International Conference on Learning Analytics and Knowledge (pp. 193-202). ACM.
Reategui, E., Epstein, D., Lorenzatti, A., & Klemann, M. (2011). Sobek: A text mining tool for educational applications. In R. Stahlbock (Ed.), International conference on data mining (pp. 59–64). CSREA Press.
Reimann, P. (2009). Time is precious: Variable-and event-centred approaches to process analysis in CSCL research. International Journal of Computer-Supported Collaborative Learning, 4(3), 239-257.
Rosé, C., Wang, Y. C., Cui, Y., Arguello, J., Stegmann, K., Weinberger, A., & Fischer, F. (2008). Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning. International Journal of Computer-Supported Collaborative Learning, 3(3), 237-271.
Samuel, A. L. (1959). Some studies in machine learning using the game of checkers. IBM Journal of Research and Development, 3(3), 210-229.
Scardamalia, M. (2002). Collective cognitive responsibility for the advancement of knowledge. In B. Smith (Ed.), Liberal Education in a Knowledge Society, 97, 67-98.
Scardamalia, M., & Bereiter, C. (2003). Knowledge building. Encyclopedia of Education (pp.1370-1373). New York: Macmillan Reference.
Scardamalia, M. (2004). CSILE/Knowledge forum®. Education and technology: An encyclopedia, 183-192.
Scardamalia, M., & Bereiter, C. (2006). Knowledge building: Theory, pedagogy, and technology. In R. K. Sawyer (Ed.), Cambridge Handbook of the Learning Sciences (pp. 97-115). New York: Cambridge University Press.
Schenker, A. (2003). Graph-Theoretic Techniques for Web Content Mining (Doctoral dissertation). University of South Florida.
Schoor, C., & Bannert, M. (2012). Exploring regulatory processes during a computer-supported collaborative learning task using process mining. Computers in Human Behavior, 28(4), 1321-1331.
Sfard, A. (1998). On two metaphors for learning and the dangers of choosing just one. Educational Researcher, 27(2), 4-13.
Sun, W., Zhang, J., Jin, H., & Lyu, S. (2014). Analyzing Online Knowledge-Building Discourse Using Probabilistic Topic Models. In Proceedings of the International Conference of the Learning Sciences, 2, 823-830.
Suthers, D. D. (2006). Technology affordances for intersubjective meaning making: A research agenda for CSCL. International Journal of Computer-Supported Collaborative Learning, 1(3), 315-337.
Wilkowski, J., Deutsch, A., & Russell, D. M. (2014). Student skill and goal achievement in the mapping with google MOOC. In Proceedings of the first ACM conference on Learning@ scale conference (pp. 3-10). ACM
Zhang, J., Scardamalia, M., Reeve, R., & Messina, R. (2009). Designs for collective cognitive responsibility in knowledge-building communities. The Journal of the Learning Sciences, 18(1), 7-44.
Zhang, J., Chen, M. H., Tao, D., Naqvi, S., & Peebles, B. (2014). Using Idea Thread Mapper to Support Collaborative Reflection for Sustained Knowledge Building. Annual meeting of the American Educational Research Association, Philadelphia, PA.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2017 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST