Timing Matters: Approaches for Measuring and Visualizing Behaviours of Timing and Spacing of Work in Self-Paced Online Teacher Professional Development Courses
DOI:
https://doi.org/10.18608/jla.2018.51.3Keywords:
Timing, participation, engagement, repetition, online learning, distance education, informal learning, self-paced learning, professional development, procrastination, spacing effect.Abstract
One feature of self-paced online courses is greater learner control over the timing of their work in a course. However, the greater timing flexibility that learners enjoy in such environments may play a different role in the learning process than has been previously observed in formal online or face-to-face courses. As such, the study of work timing merits further investigation. Toward this goal, this study forwards two measures that represent the timing of coursework: 1) the timing index, or the degree to which a participant completes 50% of their work, and 2) the spacing count, the frequency of work performed across the course timeframe. In this study, the authors demonstrate the use of these measures from a data set of 42 U.S. middle-school teachers who participated in a self-paced, online professional development course to support teacher implementation of a new blended-learning curriculum. Using the two measures, the authors identify timing behaviours of participants and examine the effects that timing has on teacher self-efficacy after completing the course. The two measures and visualizations demonstrated in this paper yield useful individual-level variables for course timing that can be used for further study on the effects on learning outcomes.
References
Admiraal, W., Wubbels, T., & Pilot, A. (1999). College teaching in legal education: Teaching method, students’ time-on-task, and achievement. Research in Higher Education, 40(6), 687–704. http://doi.org/10.1023/A:1018712914619
Andergassen, M., Mödritscher, F., & Neumann, G. (2014). Practice and repetition during exam preparation in blended learning courses: Correlations with learning results. Journal of Learning Analytics, 1(1), 48–74.
Beck, B. L., Koons, S. R., & Milgrim, D. L. (2000). Correlates and consequences of behavioral procrastination: The effects of academic procrastination, self-consciousness, self-esteem and self-handicapping. Journal of Social Behavior and Personality, 15(5), 3–13.
Benjamin, A. S., & Tullis, J. (2010). What makes distributed practice effective?. Cognitive Psychology, 61(3), 228-247.
Berzonsky, M., & Ferrari, J. (1996). Identity orientation and decisional strategies. Personality and Individual Differences, 20, 597–606.
Brownlow, S., & Reasinger, R. D. (2000). Putting off until tomorrow what is better done today: Academic procrastination as a function of motivation toward college work. Journal of Social Behavior and Personality, 15(5), 15–34.
Bruce, D., & Bahrick, H. P. (1992). Perceptions of past research. American Psychologist, 47(2), 319-328. http://dx.doi.org/10.1037/0003-066X.47.2.319.
Broadbent, J., & Poon, W. L. (2015). Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education, 27, 1-13. http://doi.org/10.3102/0013189X14523038.
Calderwood, C., Ackerman, P. L., & Conklin, E. M. (2014). What else do college students “do” while studying? An investigation of multitasking. Computers & Education, 75, 19–29. http://doi.org/10.1016/j.compedu.2014.02.004.
Carpenter, S. K., Cepeda, N. J., Rohrer, D., Kang, S. H., & Pashler, H. (2012). Using spacing to enhance diverse forms of learning: Review of recent research and implications for instruction. Educational Psychology Review, 24(3), 369-378.
Carroll, J. (1963). A model of school learning. Teachers College Record, 64(8), 723–733.
Cepeda, N.J., Vul, E., Rohrer, D., Wixted, J.T., & Pashler, H. (2008). Spacing effects in learning: A temporal ridgeline of optimal retention. Psychological Science, 19(11), 1095–1102. http://doi.org/10.1111/j.14679280.2008.02209.x.
Chu, A. H. C., & Choi, J. N. (2005). Rethinking procrastination: Positive effects of “active” procrastination behavior on attitudes and performance. The Journal of Social Psychology, 145(3), 245–264.
Cotton, K. (1989). Educational time factors (No. Close‐Up #8). Northwest Regional Educational Laboratory. Retrieved from http://educationnorthwest.org/webfm_send/564.
DeBoer, J., Ho, A. D., Stump, G. S., & Breslow, L. (2014). Changing “course”: Reconceptualizing educational variables for massive open online courses. Educational Researcher, 43(2), 74–84. http://dx.doi.org/10.3102/0013189X14523038.
Delaney, P. F., Verkoeijen, P. P., & Spirgel, A. (2010). Spacing and testing effects: A deeply critical, lengthy, and at times discursive review of the literature. Psychology of learning and motivation, 53, 63-147.
Dempster, F. N., & Farris, R. (1990). The spacing effect: research and practice. Journal of Research & Development in Education. 23(2), 97-101.
Donovan, J. J., & Radosevich, D. J. (1999). A meta-analytic review of the distribution of practice effect: Now you see it, now you don't. Journal of Applied Psychology, 84(5), 795-805. http://doi.org/10.1037/0021-9010.84.5.795.
Dunlosky, J., Rawson, K.A., Marsh, E.J., Nathan, M.J., & Willingham, D.T. (2013). Improving students’ learning with effective learning techniques promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4–58. http://doi.org/10.1177/1529100612453266.
Ferrari, J. (1992). Procrastinators and perfect behavior: An exploratory factor analysis of self-presentation, self-awareness, and self-handicapping components. Journal of Research in Personality, 26, 75–84.
Ferrari, J., & Tice, D. (2000). Procrastination as a self-handicap for men and women: A task-avoidance strategy in a laboratory setting. Journal of Research in Personality, 34, 73–83
Fournier, H., Kop, R., & Durand, G. (2014). Challenges to research in MOOCs. Journal of Online Learning and Teaching 10(1), 1-15.
Goda, Y., Yamada, M., Kato, H., Matsuda, T., Saito, Y., & Miyagawa, H. (2015). Procrastination and other learning behavioral types in e-learning and their relationship with learning outcomes. Learning and Individual Differences, 37, 72-80.
Greene, J. A., Oswald, C. A., & Pomerantz, J. (2015). Predictors of retention and achievement in a massive open online course. American Educational Research Journal, 52(5), 925-955.
Howell, A. J., Watson, D. C., Powell, R. A., & Buro, K. (2006). Academic procrastination: The pattern and correlates of behavioural postponement. Personality and Individual Differences, 40, 1519–1530
Jo, I., Kim, Y. (2013). Impact of learner`s time management strategies on achievement in an e-learning environment: A learning analytics approach. Journal of Korean Association for Educational Information and Media, 19(1), 83-107
Jossberger, H., Brand‐Gruwel, S., Boshuizen, H., & Van de Wiel, M. (2010). The challenge of self‐directed and self‐regulated learning in vocational education: A theoretical analysis and synthesis of requirements. Journal of Vocational Education and Training, 62(4), 415-440.
Karweit, N. (1984). Time-on-task reconsidered: Synthesis of research on time and learning. Educational Leadership, 41(8), 32–35.
Karweit, N., & Slavin, R. E. (1982). Time-on-task: Issues of timing, sampling, and definition. Journal of Educational Psychology, 74(6), 844–851. http://doi.org/10.1037/0022-0663.74.6.844
Klassen, R. M., Krawchuk, L. L., Lynch, S. L., & Rajani, S. (2008). Procrastination and mo- tivation of undergraduates with learning disabilities: A mixed-methods inquiry. Learning Disabilities Research and Practice, 23(3), 137–147
Kovanović, V., Gašević, D., Dawson, S., Joksimović, S., Baker, R. S., & Hatala, M. (2015). Does time-on-task estimation matter? Implications for the validity of learning analytics findings. Journal of Learning Analytics, 2(3), 81–110. http://doi.org/10.18608/jla.2015.23.6.
Lemke, J. (2001). The long and the short of it: Comments on multiple timescale studies of human activity. Journal of the Learning Sciences, 10(1-2), 17–26.
Liyanagunawardena, T. R., Adams, A. A., & Williams, S. A. (2013). MOOCs: A systematic study of the published literature 2008-2012. International Review of Research in Open and Distance Learning, 14(3), 202-227.
Lowenthal, P. R. & Hodges, C. B. (2015). In search of quality: Using quality matters to analyze the quality of massive, open, online courses (MOOCs). International Review of Research in Open and Distributed Learning, 16(5), 83-101.
Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2010). Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. Report. Washington, D.C.: US Department of Education Office of Planning, Evaluation, and Policy Development.
Mercer, N. (2008). The seeds of time: Why classroom dialogue needs a temporal analysis. Journal of the Learning Sciences, 17(1), 33–59. http://doi.org/10.1080/10508400701793182.
Meyer, C. L. (2000). Academic procrastination and self-handicapping: Gender differences in response to noncontingent feedback. Journal of Social Behavior and Personality, 15(5), 87–102.
Michinov, N., Brunot, S., Le Bohec, O., Juhel, J., & Delaval, M. (2011). Procrastination, participation, and performance in online learning environments. Computers & Education, 56(1), 243–252. http://doi.org/10.1016/j.compedu.2010.07.025
Miyamoto, Y. R., Coleman, C. A., Williams, J. J., Whitehill, J., Nesterko, S., & Reich, J. (2015). Beyond time-on-task: The relationship between spaced study and certification in MOOCs. Journal of Learning Analytics, 2(2), 70–74.
Penuel, W. R., Fishman, B. J., Yamaguchi, R., & Gallagher, L. P. (2007). What makes professional development effective? Strategies that foster curriculum implementation. American Educational Research Journal, 44(4), 921-958.
Perna, L. L., Ruby, A., Boruch, R. F., Wang, N., Scull, J., Ahmad, S., & Evans, C. (2014). Moving through MOOCs: Understanding the progression of users in massive open online courses. Educational Researcher, 43(9), 421-432.
Rawson, K.A., & Dunlosky, J. (2011). Optimizing schedules of retrieval practice for durable and efficient learning: How much is enough? Journal of Experimental Psychology. General, 140(3), 283–302. http://doi.org/10.1037/a0023956.
Riel, J., & Lawless, K. A. (2015). Massive open online courses (MOOCs) and the technologies that support learning with them. In Khosrow-Pour, M. (Ed.) Encyclopedia of Information Science and Technology (3rd Ed.). Hershey, PA: IGI Global.
Riel, J., & Lawless, K. A. (2016a). “Spread index:” A metric for identifying when work is completed and quantifying procrastination in self-paced, online teacher professional development courses. Method report – Personal Working Paper 1. http://doi.org/10.13140/RG.2.1.1119.3840.
Riel, J., & Lawless, K. A. (2016b). “Spacing count:” A metric for identifying the degree to which work is spaced out and distributed over time in distance learning and online professional development courses. Method report – Personal Working Paper 2. http://doi.org/10.13140/RG.2.2.32359.24486/1.
Riel, J., Lawless, K. A., & Brown, S. W. (2016). Completion, time-in-intervention, and movement: Relationships between dimensions of participation in oTPD and knowledge growth. Paper presented at the 2016 American Educational Research Association Annual Meeting, Washington, D.C. http://doi.org/10.13140/RG.2.1.3452.7123.
Roediger, H. L., & Butler, A. C. (2011). The critical role of retrieval practice in long-term retention. Trends in cognitive sciences, 15(1), 20-27.
Rohrer, D. (2012). Interleaving helps students distinguish among similar concepts. Educational Psychology Review, 24(3), 355-367.
Roth, W. M. (2006). Learning science: A singular plural perspective. Rotterdam, The Netherlands: Sense.
Schraw, G., & Olafson, T. W. (2007). Doing the things we do: A grounded theory of academic procrastination. Journal of Educational Psychology, 99(1), 12–25. http://doi.org/10.1037/0022-0663.99.1.12.
Shen, C., & Kuo, C.-J. (2015). Learning in massive open online courses: Evidence from social media mining. Computers in Human Behavior, 51, 568-577.
Strunk, K. K., Cho, Y., Steele, M. R., & Bridges, S. L. (2013). Development and validation of a 2×2 model of time-related academic behavior: Procrastination and timely engagement. Learning and Individual Differences, 25, 35–44. http://doi.org/10.1016/j.lindif.2013.02.007.
Terras, M. M., & Ramsay, J. (2015). Massive open online courses (MOOCs): Insights and challenges from a psychological perspective. British Journal of Educational Technology, 46(3), 472-487. http://doi.org/10.1111/bjet.12274.
Wang, Y., Paquette, L., & Baker, R. (2014). A longitudinal study on learner career advancement in MOOCs. Journal of Learning Analytics, 1(3), 203-206. Retrieved from http://epress.lib.uts.edu.au/journals/index.php/JLA/article/view/4200.
Wäschle, K., Allgaier, A., Lachner, A., Fink, S., & Nückles, M. (2014). Procrastination and self-efficacy: Tracing vicious and virtuous circles in self-regulated learning. Learning and Instruction, 29, 103–114. http://doi.org/10.1016/j.learninstruc.2013.09.005
Wolters, C. A. (2003). Understanding procrastination from a self-regulated learning perspective. Journal of Educational Psychology, 95(1), 179–187. http://doi.org/10.1037/0022-0663.95.1.179
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2018 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
TEST
