Transparency and Trustworthiness in User Intentions to Follow Career Recommendations from a Learning Analytics Tool
DOI:
https://doi.org/10.18608/jla.2023.7791Keywords:
artificial intelligence, AI, learning analytics, career guidance, transparency, trustworthiness, research paperAbstract
Transparency and trustworthiness are among the key requirements for the ethical use of learning analytics (LA) and artificial intelligence (AI) in the context of social inclusion and equity. However, research on these issues pertaining to users is lacking, leaving it unclear as to how transparent and trustworthy current LA tools are for their users and how perceptions of these variables relate to user behaviour. In this study, we investigate user experiences of an LA tool in the context of career guidance, which plays a crucial role in supporting nonlinear career pathways for individuals. We review the ethical challenges of big data, AI, and LA in connection to career guidance and analyze the user experiences (N = 106) of the LA career guidance tool, which recommends study programs and institutions to users. Results indicate that the LA career guidance tool was evaluated as trustworthy but not transparent. Accuracy was found to be a stronger predictor for the intention to follow on the recommendations of the LA guidance tool than was understanding the origins of the recommendation. The user’s age emerged as an important factor in their assessment of transparency. We discuss the implications of these findings and suggest emphasizing accuracy in the development of LA tools for career guidance.
References
Albert, E. T. (2019). AI in talent acquisition: A review of AI-applications used in recruitment and selection. Strategic HR Review, 18(5), 215–221. https://doi.org/10.1108/SHR-04-2019-0024
Alkan, O., Daly, E. M., Botea, A., Valente, A. N., & Pedemonte, P. (2019). Where can my career take me? Harnessing dialogue for interactive career goal recommendations. Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI ’19), 17–20 March 2019, Marina del Ray, CA, USA (pp. 603–613). ACM Press. https://doi.org/10.1145/3301275.3302311
Ananny, M., & Crawford, K. (2018). Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. New Media & Society, 20(3), 973–989. https://doi.org/10.1177/1461444816676645
Araujo, T., Helberg, N., Kruikemeier, S., & de Vreese, C. H. (2020). In AI we trust? Perceptions about automated decision-making by artificial intelligence. AI & Society, 35, 611–623. https://doi.org/10.1007/s00146-019-00931-w
Aroyo, A. M., de Bruyne, J., Dheu, O., Fosch-Villaronga, E., Gudkov, A., Hoch, H., Jones, S., Lutz, C., Sætra, H., Solberg, M., & Tamò-Larrieux, A. (2021). Overtrusting robots: Setting a research agenda to mitigate overtrust in automation. Paladyn: Journal of Behavioral Robotics, 12(1), 423–436. https://doi.org/10.1515/pjbr-2021-0029
Ashfaq, M., Yun, J., Yu, S., & Loureiro, S. M. C. (2020). I, Chatbot: Modeling the determinants of users’ satisfaction and continuance intention of AI-powered service agents. Telematics and Informatics, 54, 101473. https://doi.org/10.1016/j.tele.2020.101473
Baker, T., & Smith, L. (2019). Educ-AI-tion rebooted? Exploring the future of artificial intelligence in schools and colleges. Nesta. https://media.nesta.org.uk/documents/Future_of_AI_and_education_v5_WEB.pdf
Baneres, D., & Conesa, J. (2017). A life-long learning recommender system to promote employability. International Journal of Emerging Technologies in Learning (iJET) 12(6), 77–93. https://doi.org/10.3991/ijet.v12i06.7166
Bengtsson, M. (2016). How to plan and perform a qualitative study using content analysis. NursingPlus Open, 2, 8–14. https://doi.org/10.1016/j.npls.2016.01.001
Betz, N. E., & Borgen, F. H. (2009). Comparative effectiveness of CAPA and FOCUS online: Career assessment systems with undecided college students. Journal of Career Assessment, 17(4), 351–366. https://doi.org/10.1177/1069072709334229
Bøegh, J. (2014). Trust and trustworthiness in human behavior and IT services: Concepts, definitions and relations. In Y. Yuan, X. Wu, & Y. Lu (Eds.), Proceedings of the International Conference on Trustworthy Computing and Services (ISCTCS 2013). Communications in Computer and Information Science, vol. 426, Beijing, China (pp. 235–251). Springer. https://doi.org/10.1007/978-3-662-43908-1_31
Cambridge Dictionary. (n.d.). Transparency. https://dictionary.cambridge.org/dictionary/english/transparency
Chen, S., Chen, H., Ling, H., & Gu, X. (2022). An online career intervention for promoting Chinese high school students’ career readiness. Frontiers in Psychology, 12, 815076. https://doi.org/10.3389/fpsyg.2021.815076
Copeland, L. Y., Dik, B. J., McLaren, M. R., Onder, C., Wolfson, N. E., & Kraiger, K. (2011). Recommendations for using computer-assisted career guidance systems (CACGS) in career counseling practice. Journal of Psychological Issues in Organizational Culture, 2(3), 86–94. https://doi.org/10.1002/jpoc.20070
Council of the European Union. (2008). Council resolution on better integrating lifelong guidance into lifelong learning strategies. http://www.consilium.europa.eu/ueDocs/cms_Data/docs/pressData/en/educ/104236.pdf
Cramer, H., Evers, V., Ramlal, S., van Someren, M., Rutledge, L., Stash, N., Aroyo, L., & Wielinga, B. (2008). The effects of transparency on trust in and acceptance of a content-based art recommender. User Modeling and User-Adapted Interaction, 18, 455–496. https://doi.org/10.1007/s11257-008-9051-3
De Laet, T., Millecamp, M., Ortiz-Rojas, M., Jimenez, A., Maya, R., & Verbert, K. (2020). Adoption and impact of a learning analytics dashboard supporting the advisor–student dialogue in a higher education institute in Latin America. British Journal of Educational Technology, 51(4), 1002–1018. https://doi.org/10.1111/bjet.12962
Dindar, M., Järvelä, S., & Haataja, E. (2020). What does physiological synchrony reveal about metacognitive experiences and group performance? British Journal of Educational Technology, 51(5), 1577–1596. https://doi.org/10.1111/bjet.12981
Drachsler, H., & Greller, W. (2016). Privacy and analytics: It’s a DELICATE issue a checklist for trusted learning analytics. Proceedings of the 6th International Conference on Learning Analytics and Knowledge (LAK ʼ16), 25–29 April 2016, Edinburgh, UK (pp. 89–98). ACM Press. https://doi.org/10.1145/2883851.2883893
Drachsler, H., Verbert, K., Santos, O. C., & Manouselis, N. (2015). Panorama of recommender systems to support learning. In F. Ricci, L. Rokach, & B. Shapira (Eds.), Recommender systems handbook (pp. 421–451). Springer. https://doi.org/10.1007/978-1-4899-7637-6_12
Eubanks, B. (2022). Artificial intelligence for HR: Use AI to support and develop a successful workforce (2nd ed.). Kogan Page.
European Commission. (2021, April 21). Proposal for a regulation of the European Parliament and of the council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain union legislative acts. https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX:52021PC0206
Ez-Zaouia, M., & Lavoué, E. (2017). EMODA: A tutor oriented multimodal and contextual emotional dashboard. Proceedings of the 7th International Conference on Learning Analytics and Knowledge (LAK ’17), 13–17 March 2017, Vancouver, BC, Canada (pp. 429–438). ACM Press. https://doi.org/10.1145/3027385.3027434
Felzmann, H., Villaronga, E. F., Lutz, C., & Tamò-Larrieux, A. (2019). Transparency you can trust: Transparency requirements for artificial intelligence between legal norms and contextual concerns. Big Data & Society, 6(1). https://doi.org/10.1177/2053951719860542
Fumagalli, E., Rezaei, S., & Salomons, A. (2022). OK computer: Worker perceptions of algorithmic recruitment. Research Policy, 51(2), 104420. https://doi.org/10.1016/j.respol.2021.104420
Gati, I., & Asher, I. (2001). The PIC model for career decision making: Prescreening, in-depth exploration, and choice. In F. T. L. Leong & A. Barak (Eds.), Contemporary models in vocational psychology: A volume in honor of Samuel H. Osipow (pp. 7–54). Lawrence Erlbaum Associates. https://doi.org/10.1002/j.2161-0045.2001.tb00979.x
Gati, I., & Kulcsár, V. (2021). Making better career decisions: From challenges to opportunities. Journal of Vocational Behavior, 126, 103545. https://doi.org/10.1016/j.jvb.2021.103545
Gedrimiene, E., Celik, I., Kaasila, A., Mäkitalo, K., Muukkonen, H. (2023). Artificial intelligence (AI)-enhanced learning analytics (LA) for supporting career decisions: Advantages and challenges from user perspective. [Manuscript submitted for publication]. Faculty of Education and Psychology, University of Oulu.
General Data Protection Regulation (2016, May 4). Legislation. Official Journal of the European Union, 59, L 119. https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:L:2016:119:TOC
Guerra, J., Ortiz-Rojas, M., Zúñiga‐Prieto, M. A., Scheihing, E., Jiménez, A., Broos, T., De Laet, T., & Verbert, K. (2020). Adaptation and evaluation of a learning analytics dashboard to improve academic support at three Latin American universities. British Journal of Educational Technology, 51(4), 973–1001. https://doi.org/10.1111/bjet.12950
Gutiérrez, F., Charleer, S., De Croon, R., Htun, N. N., Goetschalckx, G., & Verbert, K. (2019). Explaining and exploring job recommendations: A user-driven approach for interacting with knowledge-based job recommender systems. Proceedings of the 13th ACM Conference on Recommender Systems (RecSys ’19), 16–20 September 2019, New York, NY, USA (pp. 60–68). ACM Press. https://doi.org/10.1145/3298689.3347001
Gutiérrez, F., Seipp, K., Ochoa, X., Chiluiza, K., De Laet, T., & Verbert, K. (2020). LADA: A learning analytics dashboard for academic advising. Computers in Human Behavior, 107, 105826. https://doi.org/10.1016/j.chb.2018.12.004
Hakami, E., & Hernández-Leo, D. (2020). How are learning analytics considering the societal values of fairness, accountability, transparency and human well-being? Proceedings of the Learning Analytics Summer Institute (LASI 2020), 15–16 June 2020, Valladolid, Spain (pp. 121–141). CEUR-WS. https://ceur-ws.org/Vol-2671/paper12.pdf
Harman, J. L., O’Donovan, J., Abdelzaher, T., & Gonzalez, C. (2014). Dynamics of human trust in recommender systems. Proceedings of the 8th ACM Conference on Recommender Systems (RecSys ’14), 6–10 October 2014, Foster City, CA, USA (pp. 305–308). ACM Press. http://dx.doi.org/10.1145/2645710.2645761
Harris-Bowlsbey, J. (2013). Computer-assisted career guidance systems: A part of NCDA history. The Career Development Quarterly, 61(2), 181–185. https://doi.org/10.1002/j.2161-0045.2013.00047.x
Harris-Bowlsbey, J., & Samson, J. P. (2011). Computer-based career planning systems: Dreams and reality. The Career Development Quarterly, 49(3), 250–260. https://doi.org/10.1002/j.2161-0045.2001.tb00569.x
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000). Explaining collaborative filtering recommendations. Proceedings of the 2000 Conference on Computer Supported Cooperative Work (CSCW ’00), 2–6 December 2000, Philadelphia, PA, USA (pp. 241–250). ACM Press. https://doi.org/10.1145/358916.358995
High-Level Expert Group on AI. (2019). Ethics guidelines for trustworthy AI. European Commission. https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai
Hong, I. B., & Cho, H. (2011). The impact of consumer trust on attitudinal loyalty and purchase intentions in B2C e-marketplaces: Intermediary trust vs. seller trust. International Journal of Information Management, 31(5), 469–479. https://doi.org/10.1016/j.ijinfomgt.2011.02.001
Hu, L-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Kamal, N., Sarker, F., & Mamun, K. A. (2020). A comparative study of machine learning approaches for recommending university faculty. Proceedings of the 2nd International Conference on Sustainable Technologies for Industry 4.0 (STI 2020), 19–20 December 2020, Dhaka, Bangladesh (pp. 1–6). IEEE. http://doi.org/10.1109/STI50764.2020.9350461
Karaoglan Yilmaz, F. G., & Yilmaz, R. (2021). Learning analytics as a metacognitive tool to influence learner transactional distance and motivation in online learning environments. Innovations in Education and Teaching International, 58(5), 575–585. https://doi.org/10.1080/14703297.2020.1794928
Kettunen, J. (2017). Career practitioners’ conceptions of social media and competency for social media in career services. Doctoral dissertation, University of Jyväskylä. https://jyx.jyu.fi/bitstream/handle/123456789/55367/978-951-39-7160-1.pdf?sequence=1&isAllowed=y
Kew, S. N., & Tasir, Z. (2022). Developing a learning analytics intervention in e-learning to enhance students’ learning performance: A case study. Education and Information Technologies, 27, 7099–7134. https://doi.org/10.1007/s10639-022-10904-0
Khare, R., Stewart, B., & Khare, A. (2018). Artificial intelligence and the student experience: An institutional perspective. IAFOR Journal of Education, 6(3). https://doi.org/10.22492/ije.6.3.04
Lee, M. K. (2018). Understanding perception of algorithmic decisions: Fairness, trust, and emotion in response to algorithmic management. Big Data & Society, 5(1). https://doi.org/10.1177/2053951718756684
Mahmud, H., Islam, A. K. M. N., Ahmed, S. I., & Smolander, K. (2022). What influences algorithmic decision-making? A systematic literature review on algorithm aversion. Technological Forecasting and Social Change, 175, 121390. https://doi.org/10.1016/j.techfore.2021.121390
Maples, M. R., & Luzzo, D. A. (2005). Evaluating DISCOVER’s effectiveness in enhancing college students’ social cognitive career development. The Career Development Quarterly, 53(3), 274–285. https://doi.org/10.1002/j.2161-0045.2005.tb00996.x
Mau, W.-C. (1999). Effects of computer-assisted career decision making on vocational identity and career exploratory behaviors. Journal of Career Development, 25(4), 261–274. https://doi.org/10.1177/089484539902500403
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995). An integrative model of organizational trust. The Academy of Management Review, 20(3), 709–734. https://doi.org/10.2307/258792
Merriam-Webster. (n.d.). Transparency. https://www.merriam-webster.com/dictionary/transparency
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. https://doi.org/10.48550/arXiv.1301.3781
Namoun, A., & Alshanqiti, A. (2020). Predicting student performance using data mining and learning analytics techniques: A systematic literature review. Applied Sciences, 11(1), 237–265. http://dx.doi.org/10.3390/app11010237
Ochirbat, A., Shih, T. K., Chootong, C., Sommool, W., Gunarathne, W. K. T. M., Hai-Hui, W., & Zhao-Heng, M. (2018). Hybrid occupation recommendation for adolescents on interest, profile, and behavior. Telematics and Informatics, 35(3), 534–550. https://doi.org/10.1016/j.tele.2017.02.002
Offer, M., & Sampson, J. P. (1999). Quality in the content and use of information and communications technology in guidance. British Journal of Guidance & Counselling, 27(4), 501–516. https://doi.org/10.1080/03069889908256286
Osborn, D. S., Brown, C. A., & Morgan, M. J. (2021). Expectations, experiences, and career-related outcomes of computer-assisted career guidance systems. Journal of Employment Counseling, 58(2), 74–90. https://doi.org/10.1002/joec.12158
Osborn, D. S., Kronholz, J. F., Finklea, J. T., & Cantonis, A. M. (2014). Technology-savvy career counselling. Canadian Psychology, 55(4), 258–265. http://dx.doi.org/10.1037/a0038160
Pardo, A., & Siemens, G. (2014). Ethical and privacy principles for learning analytics. British Journal of Educational Technology, 45(3), 438–450. https://doi.org/10.1111/bjet.12152
Ribes, D., Henchoz, N., Portier, H., Defayes, L., Phan, T.-T., Gatica-Perez, D., & Sonderegger, A. (2021). Trust indicators and explainable AI: A study on user perceptions. Proceedings of the 18th IFIP International Conference on Human–Computer Interaction (INTERACT 2021), August 30–September 3, 2021, Bari, Italy (pp. 662–671). Springer. https://doi.org/10.1007/978-3-030-85616-8_39
Rivera, A. C., Tapia-Leon, M., & Lujan-Mora, S. (2018). Recommendation systems in education: A systematic mapping study. Proceedings of the International Conference on Information Technology & Systems (ICITS 2018), 10–12 January 2018, Libertad, Ecuador (pp. 937–947). Springer. https://doi.org/10.1007/978-3-319-73450-7_89
Sampson, J. P., & Makela, J. P. (2014). Ethical issues associated with information and communication technology in counseling and guidance. International Journal for Educational and Vocational Guidance, 14(1), 135–148. https://doi.org/doi/10.1007/s10775-013-9258-7
Sampson, J. P., Kettunen, J., & Vuorinen, R. (2020). The role of practitioners in helping persons make effective use of information and communication technology in career interventions. International Journal for Educational and Vocational Guidance, 20, 191–208. https://doi.org/10.1007/s10775-019-09399-y
Sampson, J. P., Osborn, D. S., Kettunen, J., Hou, P.-C., Miller, A. K., & Makela, J. P. (2018). The validity of social media-based career information. The Career Development Quarterly, 66(2), 121–134. https://doi.org/doi.org/10.1002/cdq.12127
Schnackenberg, A. K., & Tomlinson, E. C. (2016). Organizational transparency: A new perspective on managing trust in organization–stakeholder relationships. Journal of Management 42(7), 1784–1810. https://doi.org/10.1177/0149206314525202
Schnackenberg, A. K., Tomlinson, E., & Coen, C. (2021). The dimensional structure of transparency: A construct validation of transparency as disclosure, clarity, and accuracy in organizations. Human Relations, 74(10), 1628–1660. https://doi.org/10.1177/0018726720933317
Sclater, N. (2016). Developing a code of practice for learning analytics. Journal of Learning Analytics, 3(1), 16–42. https://doi.org/10.18608/jla.2016.31.3
Seeger, B. A. (1988). The effect of using a computer assisted career guidance system on career development attitudes, knowledge, and behaviors in students. Doctoral dissertation, Iowa State University. https://core.ac.uk/download/pdf/38899954.pdf
Shin, D. (2020). User perceptions of algorithmic decisions in the personalized AI system: Perceptual evaluation of fairness, accountability, transparency, and explainability. Journal of Broadcasting & Electronic Media, 64(4), 541–565. https://doi.org/10.1080/08838151.2020.1843357
Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380–1400. https://doi.org/10.1177/0002764213498851
Silvola, A., Näykki, P., Kaveri, A., & Muukkonen, H. (2021). Expectations for supporting student engagement with learning analytics: An academic path perspective. Computers & Education, 168, 104192. https://doi.org/10.1016/j.compedu.2021.104192
Sinha, R., & Swearingen, K. (2002). The role of transparency in recommender systems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’02), 20–25 April 2002, Minneapolis, MN, USA (pp. 830–831). ACM Press. https://doi.org/10.1145/506443.506619
Staunton, T. (2020). Icarus, grannies, black holes and the death of privacy: Exploring the use of digital networks for career enactment. British Journal of Guidance & Counselling, 48(5), 611–622. https://doi.org/10.1080/03069885.2019.1698007
Stephen, A. (2010). The effect of the Kuder career planning system used in a classroom setting on perceived career barriers, coping self-efficacy, career decidedness, and retention. Doctoral dissertation, Iowa State University. https://doi.org/10.31274/etd-180810-3114
Tirpak, D. M., & Schlosser, L. Z. (2013). Evaluating FOCUS‐2’s effectiveness in enhancing first‐year college students’ social cognitive career development. The Career Development Quarterly, 61(2), 110–123. https://doi.org/10.1002/j.2161-0045.2013.00041.x
Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018). The current landscape of learning analytics in higher education. Computers in Human Behavior, 89, 98–110. https://doi.org/10.1016/j.chb.2018.07.027
Westman, S., Kauttonen, J., Klemetti, A., Korhonen, N., Manninen, M., Mononen, A., Niittymäki, S., & Paananen, H. (2021). Artificial intelligence for career guidance: Current requirements and prospects for the future. IAFOR Journal of Education, 9(4), 43–62. https://doi.org/10.22492/ije.9.4.03
Winfield, A. F. T., & Jirotka, M. (2017). The case for an ethical black box. In Y. Gao, S. Fallah, Y. Jin, C. Lekakou (Eds.), Towards autonomous robotic systems (TAROS 2017). Lecture Notes in Computer Science, vol. 10454. (pp. 262–273). Springer. https://doi.org/10.1007/978-3-319-64107-2_21
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education: Where are the educators? International Journal of Educational Technology in Higher Education, 16. https://doi.org/10.1186/s41239-019-0171-0
Zheng, Y., & Toribio, J. R. (2021). The role of transparency in multi-stakeholder educational recommendations. User Modeling and User-Adapted Interaction, 31, 513–540. https://doi.org/10.1007/s11257-021-09291-x
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
