Teachers as Producers of Data Analytics: A Case Study of a Teacher-Focused Educational Data Science Program
DOI:
https://doi.org/10.18608/jla.2016.33.10Keywords:
Educational data science, learning analytics, academic analytics, data literacy, practitioner researchAbstract
Educational data science (EDS) is an emerging, interdisciplinary research domain that seeks to improve educational assessment, teaching, and student learning through data analytics. Teachers have been portrayed in the EDS literature as users of pre-constructed data dashboards in educational technologies, with little consideration given to them as active producers of data analytics. This article presents the case study results of an EDS program at a large university in Midwestern U.S.A. in which faculty and instructors were provided with access to institutional data and data analytics technologies in order to explore questions related to their classroom and departmental environments. Semi-structured interviews of program participants were conducted to examine the participants’ experiences as practitioner researchers in EDS. The analysis showed that participants were motivated to participate to improve their learning and educational environments through data analytics, as opposed to developing a research agenda in EDS; that participants experienced a range of barriers related to data literacy; and that participant community support in addition to administrative support are vital to teacher-focused EDS programs. This study adds to a small but growing body of research in EDS and practitioner research that considers teachers as producers and not just consumers of data analytics.
References
Ali, L., Asadi, M., Gašević, D., Jovanović, J., & Hatala, M. (2013). Factors influencing beliefs for adoption of a learning analytics tool: An empirical study. Computers & Education, 62, 130-148.
Baker, R. S., & Yacef, K. (2009). The state of educational data mining in 2009: A review and future visions. JEDM-Journal of Educational Data Mining, 1(1), 3-17.
Bichsel, J. (2012). Analytics in higher education: Benefits, barriers, progress, and recommendations. EDUCAUSE Center for Applied Research. Retrieved from https://net.educause.edu/ir/library/pdf/ERS1207/ers1207.pdf
Campbell, A., & McNamara, O. (2010). Mapping the Field of Practitioner Research, Inquiry and Professional Learning in Educational Contexts: A Review. In A. Campbell & S. Groundwater-Smith (Eds.), Connecting inquiry and professional learning in education: International perspectives and practical solutions (pp. 21-38). Abingdon, Oxon: Routledge.
Chounta, I.A., & Avouris, N. (2014). Towards the real-time evaluation of collaborative activities: Integration of an automatic rater in the classroom from the teacher’s perspective. Education and Information Technologies Journal. 1-21.
Clark,W., Luckin, R., & Jewitt, C. (2011). NEXT-TELL research report D5.1: methods and specifications for TISL components V1. NEXT-TELL Consortium, European Commission IST-285114.
Clow, D. (2014, March). Data wranglers: human interpreters to help close the feedback loop. In Proceedings of the Fourth International Conference on Learning Analytics and Knowledge (pp. 49-53). ACM.
Corbin, J., & Strauss, A. (2014). Basics of qualitative research: Techniques and procedures for developing grounded theory (3rd ed.). Los Angeles, CA: Sage publications.
Cox, M. D. (2004). Introduction to faculty learning communities. New directions for teaching and learning, 2004(97), 5-23.
Dringus, L. P. (2012). Learning Analytics Considered Harmful. Journal of Asynchronous Learning Networks, 16(3), 87-100.
Dyckhoff, A. L., Zielke, D., Bültmann, M., Chatti, M. A., & Schroeder, U. (2012). Design and Implementation of a Learning Analytics Toolkit for Teachers. Educational Technology & Society, 15(3), 58-76.
Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64-71.
Goldstein, P.J., & Katz, R.N. (2005), Academic analytics: The uses of management information and technology in higher education. EDUCAUSE Center for Applied Research. Retrieved from https://net.educause.edu/ir/library/pdf/ecar_so/ers/ers0508/EKF0508.pdf
Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Journal of Educational Technology & Society, 15(3), 42-57.
Greller, W., Ebner, M., & Schön, M. (2014). Learning analytics: From theory to practice – data support for learning and teaching. In M. Kalz, & E. Ras (Eds.), Computer assisted assessment: Research into e-assessment (pp. 79-87). New York City, NY: Springer.
Emin-Martínez, V., Hansen, C., Rodríguez-Triana, M. J., Wasson, B., Mor, Y., Dascalu, M,…Pernin, J. (2014). Towards teacher-led design inquiry of learning. eLearning Papers, 36.
Ferguson, R., Macfadyen, L. P., Clow, D., Tynan, B., Alexander, S., & Dawson, S. (2014). Setting learning analytics in context: overcoming the barriers to large-scale adoption. Journal of Learning Analytics, 1(3), 120-144.
NMC. (2013). NMC Horizon Report: 2013 High Education Edition. Retrieved from http://www.nmc.org/pdf/2013-horizon-report-HE.pdf
Mandinach, E. B., & Gummer, E. S. (2013). A systemic view of implementing data literacy in educator preparation. Educational Researcher, 42(1), 30-37.
Mandinach, E. B., Honey, M., Light, D., & Brunner, C. (2008). A conceptual framework for data-driven decision making. In E. B. Mandinach & M. Honey (Eds.), Data-driven school improvement: Linking data and learning (pp. 13–31). New York, NY: Teachers College Press.
McKenney, S., & Mor, Y. (2015). Supporting teachers in data‐informed educational design. British journal of educational technology, 46(2), 265-279.
Mor, Y., Ferguson, R., & Wasson, B. (2015). Editorial: Learning design, teacher inquiry into student learning and learning analytics: A call for action. British Journal of Educational Technology, 46(2), 221-229.
Pea, R. (2014). The learning analytics workgroup: A report on building the field of learning analytics for personalized learning at scale. Retrieved from https://ed.stanford.edu/sites/default/files/law_report_complete_09-02-2014.pdf
Picciano, A. G. (2012). The Evolution of Big Data and Learning Analytics in American Higher Education. Journal of Asynchronous Learning Networks, 16(3), 9-20.
Piety, P. J., Hickey, D. T., & Bishop, M. J. (2014, March). EDSs: framing emergent practices for analytics of learning, organizations, and systems. In Proceedings of the Fourth International Conference on Learning Analytics and Knowledge (pp. 193-202). ACM.
Prinsloo, P., Archer, E., Barnes, G., Chetty, Y., & Van Zyl, D. (2015). Big (ger) data as better data in open distance learning. The International Review of Research in Open and Distributed Learning, 16(1), 284-306.
Reyes, J. A. (2015). The skinny on big data in education: Learning analytics simplified. TechTrends, 59(2), 75-80.
Siemens, G. (2012, April). Learning analytics: envisioning a research discipline and a domain of practice (pp. 4-8). In Proceedings of the Second International Conference on Learning Analytics and Knowledge (pp. 4-8). ACM.
Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380-1400.
Siemens, G., & Baker, R. S. (2012, April). Learning analytics and educational data mining: towards communication and collaboration. In Proceedings of the Second International Conference on Learning Analytics and Knowledge (pp. 252-254). ACM.
Siemens, G., & Long, P. (2011). Penetrating the Fog: Analytics in Learning and Education. EDUCAUSE Review, 46(5), 30-40.
Slade, S., & Prinsloo, P. (2013). Learning analytics ethical issues and dilemmas. American Behavioral Scientist, 57(10), 1510-1529.
Student Learning and Analytics at Michigan (SLAM). (2014). In Center for Research on Learning and Teaching. Retrieved from http://www.crlt.umich.edu/slam
Suthers, D., & Verbert, K. (2013, April). Learning analytics as a middle space. In Proceedings of the Third International Conference on Learning Analytics and Knowledge (pp. 1-4). ACM.
van Barneveld, A., Arnold, K. E., & Campbell, J. P. (2012). Analytics in higher education: Establishing a common language. EDUCAUSE Learning Initiative, 1, 1-11.
Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., & Klerkx, J. (2014). Learning dashboards: An overview and future research opportunities. Personal and Ubiquitous Computing, 18(6), 1499-1514.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2016 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
