Abstract
A significant amount of educational data mining (EDM) research consider students’ past performance or non-academic factors to build predictive models, paying less attention to students’ activity data. While procrastination has been found as a crucial indicator which negatively affects performance of students, no research has investigated this underlying factor in predicting achievement of students in online courses. In this study, we aim to predict students’ course achievement in Moodle through their procrastination behaviour using their homework submission data. We first build feature vectors of students’ procrastination tendencies by considering their active, inactive, and spare time for homework, along with homework grades. Accordingly, we then use clustering and classification methods to optimally sort and put students into various categories of course achievement. We use a Moodle course from the University of Tartu in Estonia which includes 242 students to assess the efficacy of our proposed approach. Our findings show that our approach successfully predicts course achievement for students through their procrastination behaviour with precision and accuracy of 87% and 84% with L-SVM outperforming other classification methods. Furthermore, we found that students who procrastinate more are less successful and are potentially going to do poorly in a course, leading to lower achievement in courses. Finally, our results show that it is viable to use a less complex approach that is easy to implement, interpret, and use by practitioners to predict students’ course achievement with a high accuracy, and possibly take remedial actions in the semester.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Abu Tair MM, El-Halees AM (2012) Mining educational data to improve students’ performance: a case study. Int J Inf 2(2). http://hdl.handle.net/20.500.12358/25066
Ahmad F, Ismail NH, Aziz AA (2015) The prediction of students’ academic performance using classification data mining techniques. Appl Math Sci 9(129):6415–6426
Akram A, Fu C, Li Y, Javed MY, Lin R, Jiang Y, Tang Y (2019) Predicting Students’ academic procrastination in blended learning course using homework submission data. IEEE Access 7:102487–102498
Azevedo R, Cromley JG, Seibert D (2004) Does adaptive scaffolding facilitate students’ ability to regulate their learning with hypermedia? Contemp Educ Psychol 29(3):344–370
Carroll P, White A (2017) Identifying patterns of learner behaviour: what business statistics students do with learning resources. INFORMS Trans Educ 18(1):1–13
Cemalcilar Z, Gökşen F (2014) Inequality in social capital: social capital, social risk and drop-out in the Turkish education system. Br J Sociol Educ 35(1):94–114
Cerezo R, Esteban M, Sánchez-Santillán M, Núñez JC (2017) Procrastinating behaviour in computer-based learning environments to predict performance: a case study in Moodle. Front Psychol 8:1403
Cerezo R, Sánchez-Santillán M, Paule-Ruiz MP, Núñez JC (2016) Students’ LMS interaction patterns and their relationship with achievement: a case study in higher education. Comput Educ 96:42–54
Christian TM, Ayub M (2014) Exploration of classification using NBTree for predicting students’ performance. In: 2014 International conference on data and software engineering (ICODSE). IEEE, pp 1–6
Chui KT, Fung DCL, Lytras MD, Lam TM (2020) Predicting at-risk university students in a virtual learning environment via a machine learning algorithm. Comput Human Behav 107:105584
Díaz-Morales JF, Ferrari JR, Cohen JR (2008) Indecision and avoidant procrastination: the role of morningness—eveningness and time perspective in chronic delay lifestyles. J Gen Psychol 135(3):228–240
Drăgulescu B, Bucos M, Vasiu R (2015) Predicting assignment submissions in a multi-class classification problem. TEM J 4(3):244
Dutt A, Ismail MA, Herawan T (2017) A systematic review on educational data mining. IEEE Access 5:15991–16005
Elvers GC, Polzella DJ, Graetz K (2003) Procrastination in online courses: performance and attitudinal differences. Teach Psychol 30(2):159–162
Ferrari JR (2010) Still procrastinating: the no regrets guide to getting it done. Wiley, New York
Gray G, McGuinness C, Owende P (2014) An application of classification models to predict learner progression in tertiary education. In: 2014 IEEE international advance computing conference (IACC). IEEE, pp 549–554
Graff M (2019) Self-efficacy beliefs and academic procrastination. N Am J Psychol 21(1):81–99
He J, Bailey J, Rubinstein BI, Zhang R (2015) Identifying at-risk students in massive open online courses. In: Twenty-ninth AAAI conference on artificial intelligence
Hellas A, Ihantola P, Petersen A, Ajanovski VV, Gutica M, Hynninen T et al (2018) Predicting academic performance: a systematic literature review. ACM, New York, pp 175–199
Herodotou C, Rienties B, Hlosta M, Boroowa A, Mangafa C, Zdrahal Z (2020) The scalable implementation of predictive learning analytics at a distance learning university: insights from a longitudinal case study. Int High Educ 45:100725
Hill RM, Yaroslavsky I, Pettit JW (2015) Enhancing depression screening to identify college students at risk for persistent depressive symptoms. J Affect Disord 174:1–6
Hooshyar D, Kori K, Pedaste M, Bardone E (2019) The potential of open learner models to promote active thinking by enhancing self‐regulated learning in online higher education learning environments. Br J Educ Technol 50(5):2365–2386
Hooshyar D, Pedaste M, Saks K, Leijen Ä, Bardone E, Wang M (2020a) Open learner models in supporting self-regulated learning in higher education: a systematic literature review. Comput Educ 154:103878. https://doi.org/10.1016/j.compedu.2020.103878
Hooshyar D, Pedaste M, Yang Y (2020) Mining educational data to predict students’ performance through procrastination behaviour. Entropy 22(1):12
Huang S, Fang N (2013) Predicting student academic performance in an engineering dynamics course: a comparison of four types of predictive mathematical models. Comput Educ 61:133–145
Huang L, Wang CD, Chao HY, Lai JH, Philip SY (2019) A score prediction approach for optional course recommendation via cross-user-domain collaborative filtering. IEEE Access 7:19550–19563
Hüsing T, Korte WB, Fonstad N, Lanvin B, Cattaneo G, Kolding M, Lifonti R, van Welsum D (2013) E-leadership: E-skills for competitiveness and innovation–vision, roadmap and foresight scenarios. Prepared for European Commission
Hyppönen L, Hirsto L, Sointu E (2019) Perspectives on University Students’ self-regulated learning, task-avoidance, time management and achievement in a flipped classroom context. Int J Learn Teach Educ Res. https://doi.org/10.26803/ijlter.19.1.5
Junco R, Clem C (2015) Predicting course outcomes with digital textbook usage data. Internet High Educ 27:54–63
Kazanidis I, Valsamidis S, Gounopoulos E, Kontogiannis S (2020) Proposed S-Algo+ data mining algorithm for web platforms course content and usage evaluation. Soft Comput 1–23
Kotsiantis S, Pierrakeas C, Pintelas P (2004) Predicting students’ performance in distance learning using machine learning techniques. Appl Artif Intell 18(5):411–426
Kori K, Pedaste M, Tõnisson E, Palts T, Altin H, Rantsus R , Sell R, Murtazin K, Rüütmann T (2015) First-year dropout in ICT studies. In: 2015 IEEE global engineering education conference (EDUCON). IEEE, pp 437–445
Kori K, Pedaste M, Altin H, Tõnisson E, Palts T (2016) Factors that influence students' motivation to start and to continue studying information technology in Estonia. IEEE Trans Educ 59(4):255–262
Kori K, Pedaste M, Must O (2018) The academic, social, and professional integration profiles of information technology students. ACM Trans Comput Educ 18(4):20
Kotsiantis S, Tselios N, Filippidi A, Komis V (2013) Using learning analytics to identify successful learners in a blended learning course. Int J Technol Enhanc Learn 5(2):133–150
Kumar DA, Vijayalakshmi M, Kumar DA (2012) Appraising the significance of self regulated learning in higher education using neural networks. Int J Eng Res Dev 1(1):09–15
Letseka M, Maile S (2008) High university drop-out rates: a threat to South Africa’s future. Human Sciences Research Council Pretoria
Lee S, Hooshyar D, Ji H, Nam K, Lim H (2018) Mining biometric data to predict programmer expertise and task difficulty. Cluster Comput 21(1):1097–1107
Li C, Yoo J (2006) Modeling student online learning using clustering. In: Proceedings of the 44th annual Southeast regional conference, pp 186–191
Li KF, Rusk D, Song F (2013) Predicting student academic performance. In: 2013 Seventh international conference on complex, intelligent, and software intensive systems. IEEE, pp 27–33
Lust G, Vandewaetere M, Ceulemans E, Elen J, Clarebout G (2011) Tool-use in a blended undergraduate course: In search of user profiles. Comput Educ 57(3):2135–2144
Marbouti F, Diefes-Dux HA, Madhavan K (2016) Models for early prediction of at-risk students in a course using standards-based grading. Comput Educ 103:1–15
Meier Y, Xu J, Atan O, Van der Schaar M (2015) Predicting grades. IEEE Trans Signal Process 64(4):959–972
Melton AW (1970) The situation with respect to the spacing of repetitions and memory. J Verbal Learn Verbal Behav 9(5):596–606
Michinov N, Brunot S, Le Bohec O, Juhel J, Delaval M (2011) Procrastination, participation, and performance in online learning environments. Comput Educ 56(1):243–252
Michinov N, Primois C (2005) Improving productivity and creativity in online groups through social comparison process: new evidence for asynchronous electronic brainstorming. Comput Hum Behav 21(1):11–28
Minaei-Bidgoli B, Kashy DA, Kortemeyer G, Punch WF (2003) Predicting student performance: an application of data mining methods with an educational web-based system, vol 1, T2A-13. IEEE
Natek S, Zwilling M (2014) Student data mining solution–knowledge management system related to higher education institutions. Expert Syst Appl 41(14):6400–6407
Nayak SG (2019) Impact of procrastination and time-management on academic stress among undergraduate nursing students: a cross sectional study. Int J Caring Sci 12(3):1480–1486
Nieto Y, García-Díaz V, Montenegro C, Crespo RG (2019) Supporting academic decision making at higher educational institutions using machine learning-based algorithms. Soft Comput 23(12):4145–4153
Olivé DM, Huynh DQ, Reynolds M, Dougiamas M, Wiese DQ (2019) A quest for a one-size-fits-all neural network: early prediction of students at risk in online courses. IEEE Trans Learn Technol 12(2):171–183
Park Y, Yu JH, Jo IH (2016) Clustering blended learning courses by online behaviour data: a case study in a Korean higher education institute. Internet High Educ 29:1–11
Parack S, Zahid Z, Merchant F (2012) Application of data mining in educational databases for predicting academic trends and patterns. In: 2012 IEEE international conference on technology enhanced education (ICTEE). IEEE, pp 1–4
Pedaste M, Sarapuu T (2006) Developing an effective support system for inquiry learning in a web-based environment. J Comput Assist Learn 22(1):47–62
Richardson M, Abraham C, Bond R (2012) Psychological correlates of university students’ academic performance: a systematic review and meta-analysis. Psychol Bull 138(2):353
Romero C, Ventura S (2007) Educational data mining: a survey from 1995 to 2005. Expert Syst Appl 33(1):135–146
Romero C, Ventura S (2010) Educational data mining: a review of the state of the art. IEEE Trans Syst Man Cybern Part C (Appl Rev) 40(6):601–618
Romero C, Ventura S (2013) Data mining in education. Wiley Interdiscip Rev Data Min Knowl Discov 3(1):12–27
Sandoval A, Gonzalez C, Alarcon R, Pichara K, Montenegro M (2018) Centralized student performance prediction in large courses based on low-cost variables in an institutional context. Internet High Educ 37:76–89
Schraw G, Wadkins T, Olafson L (2007) Doing the things we do: a grounded theory of academic procrastination. J Educ Psychol 99(1):12
Tomasevic N, Gvozdenovic N, Vranes S (2020) An overview and comparison of supervised data mining techniques for student exam performance prediction. Comput Educ 143:103676. https://doi.org/10.1016/j.compedu.2019.103676
Tuckman BW (2002) Academic procrastinators: their rationalizations and web-course performance
Tuckman BW (2005) Relations of academic procrastination, rationalizations, and performance in a web course with deadlines. Psychol Rep 96(3_Suppl):1015–1021
Visser L, Korthagen F, Schoonenboom J (2015) Influences on and consequences of academic procrastination of first-year student teachers. Pedagogische Stud 92(6):394–412
Wighting MJ, Liu J, Rovai AP (2008) Distinguishing sense of community and motivation characteristics between online and traditional college students. Q Rev Distance Educ 9(3)
You JW (2012) The relationship among academic procrastination, self-regulated learning, fear, academic self-efficacy, and perceived academic control in e-learning. J Educ Inf Media 18(3):249–271
You JW (2016) Identifying significant indicators using LMS data to predict course achievement in online learning. Internet High Educ 29:23–30
Funding
This research was partly supported by the European Regional Development Fund through the University of Tartu project ASTRA per ASPERA; the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2020-2018-0-01405) supervised by the IITP (Institute for Information & Communications Technology Planning & Evaluation); Institute for Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2020-0-00368, A Neural-Symbolic Model for Knowledge Acquisition and Inference Techniques); Eastern Scholar Chair Professorship Fund from Shanghai Municipal Education Commission of China (No. JZ2017005); National Natural Science Foundation of China (No. 61977023).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by V. Loia.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yang, Y., Hooshyar, D., Pedaste, M. et al. Predicting course achievement of university students based on their procrastination behaviour on Moodle. Soft Comput 24, 18777–18793 (2020). https://doi.org/10.1007/s00500-020-05110-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-020-05110-4