Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Quantification and prediction of engagement: : Applied to personalized course recommendation to reduce dropout in MOOCs

Published: 01 February 2024 Publication History
  • Get Citation Alerts
  • Abstract

    MOOCs (Massive Open Online Courses) offer tens of thousands of courses and attract hundreds of millions of online learners. After years of development, these platforms have accumulated a large number of learning action data. These data imply learners’ engagement with the enrolled courses, reflecting whether learners are willing to spend time on the courses. Meanwhile, the MOOC dropout rate remains chronically high. This paper experimentally finds that using the relationship between engagement and dropout rate can help MOOC platforms develop effective methods to reduce the dropout rate. Firstly, this paper proposes a new Quantified Engagement method named QE by using learning action data and learning duration to quantify learners’ engagement in enrolled courses. Next, an Engagement Neural Network prediction model named ENN is proposed to predict learners’ engagement in unenrolled courses. Then, applying QE, the predicted engagement by ENN, and the aforementioned relationship to personalized course recommendations to learners, ensuring that the recommended courses are likely to be completed by learners as much as possible, thus effectively reducing the dropout rate. Finally, the proposed method is evaluated on two large real-world datasets in XuetangX and KDDCUP. The RMSE and MAE of ENN are 0.1066 and 0.0727 on XuetangX and 0.062411 and 0.039621 on KDDCUP, respectively. Dropout rates were reduced by 46.99% and 10.34%, respectively, when 5% of the courses were recommended. These results demonstrate that the quantification method of engagement is valid, applying predicted engagement to personalized course recommendations and reducing dropout rates is available.

    Highlights

    Proposes a method to quantify learners’ engagement in enrolled courses.
    Construct a neural network model to predict learners’ engagement in unenrolled courses.
    Personalized course recommendations using engagement to reduce MOOC dropout rate.
    Performed comprehensive evaluation to verify the sensitivity and effectiveness of ENN.

    References

    [1]
    Almutairi F., White S., How to measure student engagement in the context of blended-MOOC, Interactive Technology and Smart Education 15 (3) (2018) 262–278,.
    [2]
    Ban Q., Wu W., Hu W., Lin H., Zheng W., He L., Knowledge-enhanced multi-task learning for course recommendation, in: Proceedings of database systems for advanced applications - 27th international conference, Springer, 2022, pp. 85–101,.
    [3]
    Boratto L., Fenu G., Marras M., The effect of algorithmic bias on recommender systems for massive open online courses, in: Proceedings of lecture notes in computer science, Springer, 2019, pp. 457–472,.
    [4]
    Boratto L., Fenu G., Marras M., Connecting user and item perspectives in popularity debiasing for collaborative recommendation, Information Processing & Management 58 (1) (2021),.
    [5]
    Borrella I., Caballero-Caballero S., Ponce-Cueto E., Taking action to reduce dropout in MOOCs: Tested interventions, Computer Education 179 (2022),.
    [6]
    Cheng Y., Nunes B.P., Manrique R., Not another hardcoded solution to the student dropout prediction problem: A novel approach using genetic algorithms for feature selection, in: Intelligent tutoring systems - 18th international conference, ITS 2022, Bucharest, Romania, June 29 - July 1, 2022, proceedings, vol. 13284, Springer, 2022, pp. 238–251,.
    [7]
    Cole A.W., Lennon L., Weber N.L., Student perceptions of online active learning practices and online learning climate predict online course engagement, Interactive Learning Environments 29 (5) (2021) 866–880,.
    [8]
    D’Aniello G., de Falco M., Gaeta M., Lepore M., Feedback generation using fuzzy cognitive maps to reduce dropout in situation-aware e-learning systems, in: IEEE conference on cognitive and computational aspects of situation management, IEEE, 2020, pp. 195–199,.
    [9]
    Drousiotis E., Pentaliotis P., Shi L., Cristea A.I., Capturing fairness and uncertainty in student dropout prediction - A comparison study, in: Artificial intelligence in education - 22nd international conference, AIED 2021, Utrecht, the Netherlands, June 14-18, 2021, proceedings, part II, vol. 12749, Springer, 2021, pp. 139–144,.
    [10]
    Feng W., Tang J., Liu T.X., Understanding dropouts in MOOCs, in: Proceedings of the thirty-third AAAI conference on artificial intelligence, AAAI, 2019, pp. 517–524,.
    [11]
    Gómez E., Boratto L., Salamó M., Provider fairness across continents in collaborative recommender systems, Information Processing & Management 59 (1) (2022),.
    [12]
    Hancox Z., Relton S.D., Temporal graph-based CNNs (TG-CNNs) for online course dropout prediction, in: Foundations of intelligent systems - 26th international symposium, ISMIS 2022, Cosenza, Italy, October 3-5, 2022, proceedings, vol. 13515, Springer, 2022, pp. 357–367,.
    [13]
    He X., Liao L., Zhang H., Nie L., Hu X., Chua T., Neural collaborative filtering, in: Proceedings of the 26th international conference on world wide web, ACM, 2017, pp. 173–182,.
    [14]
    Huang A.Y.Q., Lu O.H.T., Yang S.J.H., Effects of artificial intelligence-enabled personalized recommendations on learners’ learning engagement, motivation, and outcomes in a flipped classroom, Computer Education 194 (2023),.
    [15]
    Jing X., Tang J., Guess you like: course recommendation in MOOCs, in: Proceedings of the international conference on web intelligence, ACM, 2017, pp. 783–789,.
    [16]
    Jung H., Jang Y., Kim S., Kim H., KPCR: knowledge graph enhanced personalized course recommendation, in: Proceedings of AI 2021: Advances in artificial intelligence - 34th Australasian joint conference, Springer, 2022, pp. 739–750,.
    [17]
    Khalid A., Lundqvist K., Yates A., A literature review of implemented recommendation techniques used in Massive Open online Courses, Expert Systems with Applications 187 (September 2021) (2022),.
    [18]
    Le T., Vo V., Nguyen K., Le B., Improving deep matrix factorization with normalized cross entropy loss function for graph-based MOOC recommendation, in: Proceedings of proc. int. conf. comput. graph., vis., comput. vis. image process, IEEE, 2020, pp. 141–148,.
    [19]
    Li D., Liu H., Zhang Z., Lin K., Fang S., Li Z., et al., CARM: confidence-aware recommender model via review representation learning and historical rating behavior in the online platforms, Neurocomputing 455 (2021) 283–296,.
    [20]
    Lin Y., Feng S., Lin F., Zeng W., Liu Y., Wu P., Adaptive course recommendation in MOOCs, Knowledge-Based Systems 224 (2021),.
    [21]
    Lin Y., Lin F., Zeng W., Xiahou J., Li L., Wu P., et al., Hierarchical reinforcement learning with dynamic recurrent mechanism for course recommendation, Knowledge-Based Systems 244 (May) (2022),.
    [22]
    Lin J., Sun G., Shen J., Pritchard D., Yu P., Cui T., et al., MOOC student dropout rate prediction via separating and conquering micro and macro information, in: Neural information processing - 28th international conference, ICONIP 2021, Sanur, Bali, Indonesia, December 8-12, 2021, proceedings, part VI, vol. 1517, Springer, 2021, pp. 459–467,.
    [23]
    Ma J., Han X., Yang J., Cheng J., Examining the necessary condition for engagement in an online learning environment based on learning analytics approach: The role of the instructor, Internet and Higher Education 24 (2015) 26–34,.
    [24]
    Ma D., Wang Y., Chen M., Shen J., SRACR: Semantic and relationship-aware online course recommendation, in: Proceedings of 2021 IEEE international conference on engineering, technology &education, IEEE, 2021, pp. 367–374,.
    [25]
    Mehta N.K., Prasad S.S., Saurav S., Saini R., Singh S., Three-dimensional DenseNet self-attention neural network for automatic detection of student’s engagement, Applied Intelligence 52 (12) (2022) 13803–13823,.
    [26]
    Mogavi R.H., Ma X., Hui P., Characterizing student engagement moods for dropout prediction in question pool websites, Proceedings of the ACM Human-Computer Interaction 5 (CSCW1) (2021) 12:1–12:22,.
    [27]
    Molina O.M.A., Obando G.L., Bastidas A.A., Mosquera E.M., Motivation: Personalization of contents to reduce dropout rates, in: IEEE learning with MOOCS, IEEE, 2022, pp. 61–66,.
    [28]
    Obeidat R., Duwairi R., Al-Aiad A., A collaborative recommendation system for online courses recommendations, in: Proceedings of 2019 international conference on deep learning and machine learning in emerging applications, IEEE, 2019, pp. 49–54,.
    [29]
    O’Brien H.L., Arguello J., Capra R., An empirical study of interest, task complexity, and search behaviour on user engagement, Information Processing & Management 57 (3) (2020),.
    [30]
    Plak S., van Klaveren C., Cornelisz I., Raising student engagement using digital nudges tailored to students’ motivation and perceived ability levels, British Journal of Educational Technology 54 (2) (2023) 554–580,.
    [31]
    Raguro M.C.F., Lagman A.C., Abad L.P., Ong P.L.S., Extraction of LMS student engagement and behavioral patterns in online education using decision tree and K-means algorithm, in: APIT 2022: 4th Asia Pacific information technology conference, ACM, 2022, pp. 138–143,.
    [32]
    Sakboonyarat M.C.F., Siriporn A.C., Tantatsanawong L.P., Panjai P.L.S., Massive open online courses (MOOCs) recommendation modeling using deep learning, in: Proceedings of 2019 23rd international computer science and engineering conference, IEEE, 2019, pp. 275–280,.
    [33]
    Shao E., Guo S., Pardos Z.A., Degree planning with PLAN-BERT: multi-semester recommendation using future courses of interest, in: Proceedings of thirty-fifth AAAI conference on artificial intelligence, AAAI, 2021, pp. 14920–14929. URL: https://ojs.aaai.org/index.php/AAAI/article/view/17751.
    [34]
    Soffer T., Cohen A., Students’ engagement characteristics predict success and completion of online courses, Journal of Computer Assisted Learning 35 (3) (2019) 378–389,.
    [35]
    Song D., Rice M., Oh E.Y., Participation in online courses and interaction with a virtual agent, International Review of Research in Open and Distributed Learning 20 (1) (2019) 44–62,.
    [36]
    Symeonidis P., Malakoudis D., et al., Multi-modal matrix factorization with side information for recommending massive open online courses, Expert Systems with Applications 118 (MAR.) (2019) 261–271,.
    [37]
    Tian X., Liu F., Capacity tracing-enhanced course recommendation in MOOCs, IEEE Transactions on Learning Technologies 14 (3) (2021) 313–321,.
    [38]
    Wang X., Ma W., Guo L., Jiang H., Liu F., Xu C., HGNN: Hyperedge-based graph neural network for MOOC course recommendation, Information Processing & Management 59 (3) (2022),.
    [39]
    Wang C., Zhu H., Wang P., Zhu C., Zhang X., Chen E., et al., Personalized and explainable employee training course recommendations: A Bayesian variational approach, ACM Transactions on Information Systems 40 (4) (2022) 70:1–70:32,.
    [40]
    Xing W.D., Dropout prediction in MOOCs: Using deep learning for personalized intervention, Journal of Educational Computing Research 57 (2019),.
    [41]
    Xu G., Jia G., Shi L., Zhang Z., Personalized course recommendation system fusing with knowledge graph and collaborative filtering, Computational Intelligence and Neuroscience 2021 (2021) 9590502:1–9590502:8,.
    [42]
    Yang S., Cai X., Bilateral knowledge graph enhanced online course recommendation, Information Systems 107 (2022),.
    [43]
    Yao W., Sun H., Hu X., A novel search ranking method for MOOCs using unstructured course information, Wireless Communications and Mobile Computing 2020 (2020) 8813615:1–8813615:13,.
    [44]
    Yuan X., Han L., Qian S., Zhu L., Zhu J., Yan H., Preliminary data-based matrix factorization approach for recommendation, Information Processing & Management 58 (1) (2021),.
    [45]
    Zhang H., Huang T., Lv Z., Liu S., Zhou Z., MCRS: A course recommendation system for MOOCs, Multimedia Tools and Applications 77 (6) (2018) 7051–7069,.
    [46]
    Zhang J., Ma K., EDPS: Early dropout prediction system of MOOC courses, in: 29th Asia-Pacific software engineering conference, IEEE, 2022, pp. 562–563,.
    [47]
    Zhang H., Shen X., Yi B., Wang W., Feng Y., KGAN: Knowledge grouping aggregation network for course recommendation in MOOCs, Expert Systems with Applications 211 (2023),.

    Cited By

    View all
    • (2024)Fail or pass? Investigating learning experiences and interactive roles in MOOC discussion boardComputers & Education10.1016/j.compedu.2024.105073217:COnline publication date: 1-Aug-2024

    Index Terms

    1. Quantification and prediction of engagement: Applied to personalized course recommendation to reduce dropout in MOOCs
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Information & Contributors

            Information

            Published In

            cover image Information Processing and Management: an International Journal
            Information Processing and Management: an International Journal  Volume 61, Issue 1
            Jan 2024
            823 pages

            Publisher

            Pergamon Press, Inc.

            United States

            Publication History

            Published: 01 February 2024

            Author Tags

            1. Engagement
            2. MOOC
            3. Artificial intelligence in education
            4. Recommendation mechanism
            5. Reduce dropout

            Qualifiers

            • Research-article

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • Downloads (Last 12 months)0
            • Downloads (Last 6 weeks)0

            Other Metrics

            Citations

            Cited By

            View all
            • (2024)Fail or pass? Investigating learning experiences and interactive roles in MOOC discussion boardComputers & Education10.1016/j.compedu.2024.105073217:COnline publication date: 1-Aug-2024

            View Options

            View options

            Get Access

            Login options

            Media

            Figures

            Other

            Tables

            Share

            Share

            Share this Publication link

            Share on social media