research-article

CNN autoencoders and LSTM-based reduced order model for student dropout prediction

Authors:

Ke ZhangAuthors Info & Claims

Neural Computing and Applications, Volume 35, Issue 30

Pages 22341 - 22357

https://doi.org/10.1007/s00521-023-08894-2

Published: 08 August 2023 Publication History

Abstract

In recent years, Massive Open Online Courses (MOOCs) have become the main online learning method for students all over the world, but their development has been affected by the high dropout rate for a long time. Therefore, dropout prediction is a vital task for early teaching intervention and user retention. The students’ learning records are stored in MOOCs, which contain high-dimensional time series features. However, these features are hard to process, and the nonlinear relationship between the features is difficult to learn. These limitations have become obstacles to improve the performance in dropout prediction. In this paper, we propose a new neural dimension-reduced dropout prediction model based on neural network model to address the limitations. The proposed model, called CNNAE-LSTM, is constructed by convolutional neural network autoencoder (CNNAE) and long short-term memory neural network (LSTM). Specifically, CNNAE-LSTM compresses the students’ learning features into a low-dimensional latent space for reconstruction through CNNAE, then projects the latent space, retains the representative features in the learning records, and finally minimizes the reconstruction error to obtain the nonlinear relationship between features and dropout. The introduced LSTM neural network can obtain the time evolution of its latent vector. Our experiments on the KDD CUP 2015 dataset and the real-world dataset XuetangX demonstrate that the proposed model exhibits better predictive performance compared to the state-of-the-art baseline methods.

References

[1]

Mubarak AA, Cao H, and Hezam IM Deep analytic model for student dropout prediction in massive open online courses Comput Electr Eng 2021 93

[2]

Fu Q, Gao Z, Zhou J, et al. CLSA: a novel deep learning model for MOOC dropout prediction Comput Electr Eng 2021 94

[3]

Sinha T, Jermann P, Li N, et al. (2014) Your click decides your fate: Inferring information processing and attrition behavior from mooc video clickstream interactions. arXiv:1407.7131

[4]

Feng W, Tang J, and Liu TX Understanding dropouts in MOOCs Proc AAAI Conf Artif Intell 2019 33 01 517-524

[5]

Qi Y, Wu Q, Wang H, et al. (2018) Bandit learning with implicit feedback. Adv Neural Inf Process Syst 31.

[6]

Mourdi Y, Sadgal M, El Kabtane H, et al. A machine learning-based methodology to predict learners’ dropout, success or failure in MOOCs Int J Web Inf Syst 2019

[7]

Zhang J, Gao M, and Zhang J The learning behaviours of dropouts in MOOCs: a collective attention network perspective Comput Edu 2021 167

[8]

Moreno-Marcos PM, Munoz-Merino PJ, Maldonado-Mahauad J, et al. Temporal analysis for dropout prediction using self-regulated learning strategies in self-paced MOOCs Comput Edu 2020 145 103728.1-103728.15

[9]

Hung JL, Wang MC, Wang S, et al. Identifying at-risk students for early interventions-A time-series clustering approach IEEE Trans Emerg Topics Comput 2015 5 1 45-55

[10]

Jin C Dropout prediction model in MOOC based on clickstream data and student sample weight Soft Computing 2021 25 1 8971-8988

[11]

Zheng Y, Gao Z, Wang Y, et al. MOOC dropout prediction using FWTS-CNN model based on fused feature weighting and time series IEEE Access 2020 8 225324-225335

[12]

Wang G, Tang Y, Li J, et al. Modeling student learning Behaviors in ALEKS: A two-layer hidden Markov modeling approach Int Conf Artif Intell Edu. 2018

[13]

Shaleena KP, Paul S (2015) Data mining techniques for predicting student performance. 2015 IEEE international conference on engineering and technology (ICETECH). IEEE:1-3.

[14]

Sinha T, Jermann P, Li N, et al. (2014) Your click decides your fate: Inferring information processing and attrition behavior from mooc video clickstream interactions. arXiv:1407.7131

[15]

Taylor C, Veeramachaneni K, O’Reilly UM. Likely to stop? predicting stopout in massive open online courses. arXiv:1408.3382

[16]

Qiu L, Liu Y, Hu Q, et al. Student dropout prediction in massive open online courses by convolutional neural networks Soft Computing 2019 23 20 10287-10301

[17]

Sun D, Mao Y, Du J, et al (2019) Deep learning for dropout prediction in MOOCs. Eighth International Conference on Educational Innovation through Technology (EITT). IEEE:87-90.

[18]

Fei M, Yeung DY (2015) Temporal models for predicting student dropout in massive open online courses. 2015 IEEE International Conference on Data Mining Workshop (ICDMW). IEEE:256-263.

[19]

Chen M and Wu L A dropout prediction method based on time series model in MOOCs J Phys Conf Series. 2021 1774 1

[20]

Xing W and Du D Dropout Prediction in MOOCs: Using Deep Learning for Personalized Intervention J Edu Comput Res. 2019 57 3 547-570

[21]

Xu C, Zhu G, Ye J, et al. Educational data mining: dropout prediction in XuetangX MOOCs Neural Processing Lett 2022 54 2885-2900

[22]

Blundo C, Fenza G, Fuccio G, et al. A time-driven FCA-based approach for identifying students’ dropout in MOOCs Int J Intell Syst 2022 37 4 2683-2705

[23]

Sharkey M, Sanders R (2014) A process for predicting MOOC attrition. Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs 50–54.

[24]

Baranyi M, Nagy M, Molontay R (2020) Interpretable deep learning for university dropout prediction. Proceedings of the 21st annual conference on information technology education. pp 13–19.

[25]

Liu H, Zhu Y, Zang T, et al. Jointly modeling heterogeneous student behaviors and interactions among multiple prediction tasks ACM Trans Knowl Discov Data (TKDD) 2021 16 1 1-24

[26]

Wen Y, Tian Y, Wen B et al. (2020) Consideration of the local correlation of learning behaviors to predict dropouts from MOOCs. inTsinghua Sci Technol 25(3), 336–347.

[27]

Xie Y Student performance prediction via attention-based multi-layer long-short term memory J Comput Commun 2021 9 8 61-79

[28]

Niu K, Jia B, Zhou Y, et al. A hybrid model for predicting academic performance of engineering undergraduates Int J Model Simul Sci Comput 2022 14 1793-9623

[29]

Kloft M, Stiehler F, Zheng Z, et al. (2014) Predicting MOOC dropout over weeks using machine learning methods. Proceedings of the EMNLP 2014 workshop on analysis of large scale social interaction in MOOCs 60-65.

[30]

He J, Bailey J, Rubinstein B, et al. Identifying at-risk students in massive open online courses Proc AAAI Conf Artif Intell 2015

[31]

Liu T, Li X (2017) Finding out reasons for low completion in MOOC environment: an explicable approach using hybrid data mining methods. 2017 International Conference on Modern Education and Information Technology (MEIT 2017) 376-384.

[32]

Qiu L, Liu Y, Hu Q, et al. Student dropout prediction in massive open online courses by convolutional neural networks Soft Computing 2019 23 20 10287-10301

[33]

Salekshahrezaee LJ, Khoshgoftaar T(2021) Feature Extraction for Class Imbalance Using a Convolutional Autoencoder and Data Sampling. 2021 IEEE 33rd International Conference on Tools with Artificial Intelligence (ICTAI) pp. 217-223.

[34]

Khozeimeh F, Sharifrazi D, Izadi NH, et al. Combining a convolutional neural network with autoencoders to predict the survival chance of COVID-19 patients Sci Rep. 2021 11 15343

[35]

Shou Z, Chen P, Wen H, et al. MOOC Dropout Prediction Based on Multidimensional Time-Series Data Math Prob Eng 2022

[36]

Wu N, Zhang L, Gao Y et al (2019) CLMS-Net: dropout prediction in MOOCs with deep learning. Proceedings of the ACM Turing Celebration Conference-China 1–6.

[37]

Ketkar N Convolutional neural networks 2017 Springer International Publishing

[38]

Hinton GE and Salakhutdinov RR Reducing the dimensionality of data with neural networks Science 2006 313 5786 504-507

[39]

Niu K, Guo Z, Peng X, et al. P-ResUnet: Segmentation of brain tissue with Purified Residual Unet Comput Biol Med 2022 151 Pt B

[40]

Lu W, Yu R, Wang S, et al. Sentence Semantic Matching Based on 3D CNN for Human-Robot Language Interaction ACM Trans Int Technol 2021 21 4 1-24

[41]

Hochreiter S and Schmidhuber J Long short-term memory Neural Comput 1997 9 8 1735-1780

[42]

Breiman L Random forests Mach Learn 2001 45 1 5-32

[43]

Zhang H The optimality of naive Bayes. Aa 2004 1 2 3

[44]

Dey R, Salem FM. Gate-variants of gated recurrent unit (GRU) neural networks (2017) IEEE 60th international midwest symposium on circuits and systems (MWSCAS). IEEE 1597–1600.

[45]

Khozeimeh F, Sharifrazi D, Izadi NH, et al. Combining a convolutional neural network with autoencoders to predict the survival chance of COVID-19 patients Sci Rep 2021 11 1 1-18

[46]

Hasegawa K, Fukami K, Murata T, et al. CNN-LSTM based reduced order modeling of two-dimensional unsteady flows around a circular cylinder at different Reynolds numbers Fluid Dyn Res 2020 52 6

[47]

Vaswani A, Shazeer N, Parmar N, et al (2017) Attention is all you need. Adv Neural Inf Process Syst, 30.

Cited By

Marina BSenthilrajan A(2024)A Novel Approach Based on Fuzzy Rule and LSOWL–CNN Forecasting Students with Dropout Prediction and Recommendation ModelWireless Personal Communications: An International Journal10.1007/s11277-024-11068-5136:1(61-80)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1007/s11277-024-11068-5

Recommendations

Student dropout prediction in massive open online courses by convolutional neural networks
Abstract
Massive open online courses (MOOCs) have given global learners access to quality educational resources, but the persistent high dropout rates problem has a serious impact on their educational effectiveness. Therefore, how to predict the dropout in ...
MOOC Dropout Prediction: How to Measure Accuracy?
L@S '17: Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale

In order to obtain reliable accuracy estimates for automatic MOOC dropout predictors, it is important to train and test them in a manner consistent with how they will be used in practice. Yet most prior research on MOOC dropout prediction has measured ...
Deep Model for Dropout Prediction in MOOCs
ICCSE'17: Proceedings of the 2nd International Conference on Crowd Science and Engineering

Dropout prediction research in MOOCs aims to predict whether students will drop out from the courses instead of completing them. Due to the high dropout rates in current MOOCs, this problem is of great importance. Current methods rely on features ...

Comments

Information & Contributors

Information

Published In

cover image Neural Computing and Applications

Neural Computing and Applications Volume 35, Issue 30

Oct 2023

685 pages

ISSN:0941-0643

EISSN:1433-3058

Issue’s Table of Contents

© The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 08 August 2023

Accepted: 12 July 2023

Received: 27 November 2022

Author Tags

Qualifiers

Research-article

Funding Sources

Beijing Educational Science Planning Project under grant

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Marina BSenthilrajan A(2024)A Novel Approach Based on Fuzzy Rule and LSOWL–CNN Forecasting Students with Dropout Prediction and Recommendation ModelWireless Personal Communications: An International Journal10.1007/s11277-024-11068-5136:1(61-80)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1007/s11277-024-11068-5

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents