Implementing Learning Analytics in Norway
Four Central Dilemmas
DOI:
https://doi.org/10.18608/jla.2024.8241Keywords:
learning analyics practice, learning analytics policy, learning analytics implementation dilemmas, practical reportAbstract
In June 2022, the Norwegian Expert Commission on Learning Analytics delivered an interim report to the Norwegian Minister of Education and Research. Motivated by the need to establish a solid foundation upon which to regulate and promote the use of learning analytics in the Norwegian educational sector, the Ministry asked the Expert Commission to investigate the relevant pedagogical, ethical, legal, and privacy issues. Addressing primary, secondary, higher, and vocational education, the interim report surveys the field of learning analytics and the regulatory environment across the contexts and analyzes its challenges and opportunities for Norwegian education. Four dilemmas — data, learning, governance, and competence — signal where greater knowledge, awareness, and reflection are needed, as well as the nature of necessary policy and regulatory choices. In this practical report, we offer insights on the use, development, and regulation of LA in different countries, describe the Expert Commission mandate, work method, and dilemmas, and conclude with a reflection on the relationship between research on learning analytics and the challenges that arise when implementing learning analytics in practice. This practical report is relevant for those interested in developing policies or practices surrounding the use of learning analytics at the local or national level.
References
Aguerrebere, C., He, H., Kwet, M., Laakso, M.-J., Lang, C., Marconi, C., Price-Dennis, D., & Zhang, H. (2022). Global perspectives on learning analytics in K12 education. In C. Lang, A. F. Wise, A. Merceron, D. Gašević, & G. Siemens (Eds.), Handbook of learning analytics (2nd ed., pp. 223–231). Society for Learning Analytics Research. https://doi.org/10.18608/hla22.022
Alliance for Educational Excellence. (2014). Capacity enablers and barriers for learning analytics: Implications for policy and practice: An executive summary. https://all4ed.org/wp-content/uploads/2014/06/LearningAnalyticsExecSum.pdf
Arnold, K. E., Lonn, S., & Pistilli, M. D. (2014). An exercise in institutional reflection: The learning analytics readiness instrument (LARI). Proceedings of the 4th International Conference on Learning Analytics and Knowledge (LAK ʼ14), 24–28 March 2014, Indianapolis, IN, USA (pp. 163–167). ACM Press. https://doi.org/10.1145/2567574.2567621
Colvin, C., Rogers, T., Wade, A., Dawson, S., Gašević, D., Buckingham Shum, S., Nelson, K., Alexander, S., Lockyer, L., Kennedy, G., Corrin, L., & Fisher, J. (2015). Student retention and learning analytics: A snapshot of Australian practices and a framework for advancement. Australian Government, Office for Learning and Teaching. https://www.pure.ed.ac.uk/ws/portalfiles/portal/21121591/Final_Report_190615.pdf
Datatilsynet. (2022). AVT: Sluttrapport fra sand-kasseprosjektet med KS, SLATE ved UiB og Utdanningsetaten i Oslo kommune. https://www.datatilsynet.no/regelverk-og-verktoy/sandkasse-for-kunstig-intelligens/ferdige-prosjekter-og-rapporter/avt-sluttrapport
de Wit, M., van Dompseler, H., & Manderveld, J. (2017). How to start with learning analytics? Infrastructure and support. Proceedings of the 23rd Congress of European University Information Systems (EUNIS 17), 7–9 June 2017, Münster, Germany (pp. 161–168). https://www.eunis.org/download/2017/EUNIS_2017_paper_18.pdf
Drachsler, H. (2023). Towards highly informative learning analytics. Open Universiteit. https://doi.org/10.25656/01:26787
Ekspertgruppen for digital læringsanalyse. (2022). Læringsanalyse – noen sentrale dilemmaer: Delrapport fra ekspertgruppen for digital læringsanalyse [Learning analysis – some key dilemmas: Interim report from the expert group for digital learning analytics]. Kunnskapsdepartementet. https://www.regjeringen.no/no/dokumenter/laringsanalyse-noen-sentrale-dilemmaer/id2916747/
Ekspertgruppen for digital læringsanalyse. (2023). Læring, hvor ble det av deg i alt mylderet? Bruk av elev- og studentdata for å fremme læring [Learning, where did you go in all the bustle? Use of pupil and student data to promote learning]. Kunnskapsdepartementet. https://www.regjeringen.no/no/dokumenter/nou-2023-19/id2982722/
ET 2020 Working Group on Digital Skills and Competences. (2016). Learning analytics: Key messages. European Commission. https://wikis.ec.europa.eu/display/EAC/ET+2020+Digital?preview=%2F44165766%2F80969907%2F2016-pla-learning-analytics_en+%281%29.pdf
Fasting, M. L. (2013). Vi leker ute! En fenomenologisk hermeneutisk tilnærming til barns lek og lekesteder. Novus forlag. https://novus.no/products/102587
Ferguson, R., Brasher, A., Clow, D., Cooper, A., Hillaire, G., Mittelmeier, J., Rienties, B., Ullmann, T., & Vuorikari, R. (2016). Research evidence on the use of learning analytics: Implications for education policy. In R. Vuorikari & J. Castaño Muñoz (Eds.), JRC Science for Policy Report. European Commission. https://data.europa.eu/doi/10.2791/955210
Ferguson, R., Macfadyen, L. P., Clow, D., Tynan, B., Alexander, S., & Dawson, S. (2014). Setting learning analytics in context: Overcoming the barriers to large-scale adoption. Journal of Learning Analytics, 1(3), 120–144. https://doi.org/10.18608/jla.2014.13.7
Hilliger, I., Ortiz-Rojas, M., Pesántez-Cabrera, P., Scheihing, E., Tsai, Y. S., Muñoz-Merino, P. J., Broos, T., Whitelock-Wainwright, A., & Pérez-Sanagustín, M. (2020). Identifying needs for learning analytics adoption in Latin American universities: A mixed-methods approach. Internet and Higher Education, 45, 100726. https://doi.org/10.1016/j.iheduc.2020.100726
Kunnskapsdepartementet. (2017). Framtid, fornyelse og digitalisering: Digitaliseringsstrategi for grunnopplæringen 2017–2021 [Future, renewal and digitization: Digitization strategy for basic education 2017–2021]. Kunnskapsdepartementet. https://www.regjeringen.no/contentassets/dc02a65c18a7464db394766247e5f5fc/kd_framtid_fornyelse_digitalisering_nett.pdf
Laakso, M.-J., Kaila, E., & Rajala, T. (2018). ViLLE—collaborative education tool: Designing and utilizing an exercise-based learning environment. Education and Information Technologies, 23(4), 1655–1676. https://www.learntechlib.org/p/191715/
Loebbecke, C., & Picot, A. (2015). Reflections on societal and business model transformation arising from digitization and big data analytics: A research agenda. The Journal of Strategic Information Systems, 24(3), 149–157. https://doi.org/10.1016/j.jsis.2015.08.002
Long, P., Siemens, G., Conole, G., & Gašević, D. (Eds.). (2011). Proceedings of the 1st International Conference on Learning Analytics and Knowledge: Connecting the technical, pedagogical, and social dimensions of learning analytics (LAK ʼ11), 27 February–1 March 2011, Banff, AB, Canada. ACM Press. https://dl.acm.org/doi/proceedings/10.1145/2090116
Macfadyen, L. P., & Dawson, S. (2012). Numbers are not enough: Why e-learning analytics failed to inform an institutional strategic plan. Educational Technology & Society, 15(3), 149–163.
Macfadyen, L. P., Dawson, S., Pardo, A., & Gašević, D. (2014). Embracing big data in complex educational systems: The learning analytics imperative and the policy challenge. Research & Practice in Assessment, 9, 17–28.
Morlandstø, N. I., Hansen, C. J. S., Wasson, B., & Bull, S. (2019). Aktivitetsdata for vurdering og tilpasning: Sluttrapport [Activity data for assessment and adaptation: Final report]. Centre for the Science of Learning & Technology (SLATE). https://bora.uib.no/bora-xmlui/handle/1956/20825
NOKUT. (2013). Learning analytics — automatisert kvalitetssikring av utdanning [Learning analytics — Automated quality-assurance of education]. https://kudos.dfo.no/documents/31148/files/27570.pdf
Opplæringslovutvalget. (2014). MOOC til Norge: Nye digitale læringsformer i høyere utdanning [MOOC to Norway: New digital learning forms in higher education.]. Kunnskapsdepartementet. https://www.regjeringen.no/no/dokumenter/NOU-2014-5/id762916/
Opplæringslovutvalget. (2019). Ny opplæringslov [New education act]. Kunnskapsdepartementet. https://www.regjeringen.no/no/dokumenter/nou-2019-23/id2682434/
Sanagustín, M. P., Hilliger, I., Maldonado, J., Pérez, R., Ramírez, L., Muñoz-Merino, P. J., Tsai, Y.-S., Ortiz, M., Broos, T., Zúñiga-Prieto, M., Sheihing, E., & Whitelock-Wainright, A. (2019). LALA: Building capacity to use learning analytics to improve higher education in Latin America. LALA Project. https://research.monash.edu/files/324504028/324503712_oa.pdf
Scheffel, M., Tsai, Y.-S., Gašević, D., & Drachsler, H. (2019) Policy matters: Expert recommendations for learning analytics policy. Proceedings of the 14th European Conference on Technology Enhanced Learning (EC-TEL 2019), 16–19 September 2019, Delft, The Netherlands (pp. 510–524). Lecture Notes in Computer Science, Springer. https://doi.org/10.1007/978-3-030-29736-7_38
Sclater, N., & Bailey, P. (2015). Code of practice for learning analytics: Setting out the responsibilities of educational institutions to ensure that learning analytics is carried out responsibly, appropriately and effectively. Jisc. https://repository.jisc.ac.uk/6985/1/Code_of_Practice_for_learning_analytics.pdf
Sclater, N., Peasgood, A., & Mullan, J. (2016). Learning analytics in higher education: A review of UK and international practice. Jisc. https://analytics.jiscinvolve.org/wp/2016/04/19/learning-analytics-in-higher-education-a-review-of-uk-and-international-practice/
Søby, M. (2014). Learning analytics. Nordic Journal of Digital Literacy, 9(2), 89–91. https://doi.org/10.18261/ISSN1891-943X-2014-02-01
Tore, H., Mason, J., & Chen, W. (2015). Data sharing for learning analytics — Questioning the risks and benefits. Proceedings of the 23rd International Conference on Computers in Education (ICCE 2015), 30 November–4 December 2015, Hangzhou, China (pp. 228–237). Asia-Pacific Society for Computers in Education.
Tsai, Y.-S., Gašević, D., Whitelock-Wainwright, A., Muñoz-Merino, P. J., Moreno-Marcos, P. M., Fernández, A. R., Kloos, C. D., Scheffel, M., Jivet, I., Drachsler, H., Tammets, K., Calleja, A. R., & Kollom, K. (2018). Supporting higher education to integrate learning analytics research report. SHEILA Project. https://sheilaproject.eu/2018/11/30/sheila-final-research-report/.
Tsai, Y.-S., Moreno-Marcos, P. M., Jivet, I., Scheffel, M., Tammets, K., Kollom, K., & Gašević, D. (2018). The SHEILA framework: Informing institutional strategies and policy processes of learning analytics. Journal of Learning Analytics, 5(3), 5–20. https://doi.org/10.18608/jla.2018.53.2
Tsai, Y.-S., Rates, D., Moreno-Marcos, P. M., Muñoz-Merino, P. J., Jivet, I., Scheffel, M., Drachsler, H., Kloos, C. D., & Gašević, D. (2020). Learning analytics in European higher education — Trends and barriers. Computers & Education, 155, 103933. https://doi.org/10.1016/j.compedu.2020.103933
US Department of Education. (2012). Enhancing teaching and learning through educational data mining and learning analytics: An issue brief. https://tech.ed.gov/wp-content/uploads/2014/03/edm-la-brief.pdf
Wasson, B., Morlandstø, N. I., & Hansen, C. J. S. (2019). Summary of SLATE report 2019-1: Activity data for assessment and activity (AVT). Centre for the Science of Learning & Technology (SLATE). https://bora.uib.no/bora-xmlui/handle/1956/20187
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
