Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3477495.3532004acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Introducing Problem Schema with Hierarchical Exercise Graph for Knowledge Tracing

Published: 07 July 2022 Publication History

Abstract

Knowledge tracing (KT) which aims at predicting learner's knowledge mastery plays an important role in the computer-aided educational system. The goal of KT is to provide personalized learning paths for learners by diagnosing the mastery of each knowledge, thus improving the learning efficiency. In recent years, many deep learning models have been applied to tackle the KT task, which has shown promising results. However, most existing methods simplify the exercising records as knowledge sequences, which fail to explore the rich information that existed in exercises. Besides, the existing diagnosis results of knowledge tracing are not convincing enough since they neglect hierarchical relations between exercises. To solve the above problems, we propose a hierarchical graph knowledge tracing model called HGKT to explore the latent complex relations between exercises. Specifically, we introduce the concept of problem schema to construct a hierarchical exercise graph that could model the exercise learning dependencies. Moreover, we employ two attention mechanisms to highlight important historical states of learners. In the testing stage, we present a knowledge&schema diagnosis matrix that could trace the transition of mastery of knowledge and problem schema, which can be more easily applied to different applications. Extensive experiments show the effectiveness and interpretability of our proposed model.

Supplementary Material

MP4 File (SIGIR22-fp0131.mp4)
Knowledge tracing (KT) which aims at predicting learner?s knowledge mastery plays an important role in the computer-aided educational system. This video shows how we propose a hierarchical graph knowledge tracing model called HGKT to explore the latent complex relations between exercises. Specifically, we introduce the concept of problem schema to construct a hierarchical exercise graph that could model the exercise learning dependencies. Extensive experiments show the effectiveness and interpretability of our proposed model.

References

[1]
Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. 2014. Engaging with massive online courses. In Proceedings of the 23rd international conference on World wide web. 687--698.
[2]
George EP Box and George C Tiao. 2011. Bayesian inference in statistical analysis. Vol. 40. John Wiley & Sons.
[3]
Hugh Burns, Carol A Luckhardt, James W Parlett, and Carol L Redfield. 2014. Intelligent tutoring systems: Evolutions in design. Psychology Press.
[4]
Cristina Carmona, Eva Millán, José-Luis Pérez-de-la Cruz, Mónica Trella, and Ricardo Conejo. 2005. IntroduciJng prerequisite relations in a multi-layered Bayesian student model. In International conference on user modeling. Springer, 347--356.
[5]
Penghe Chen, Yu Lu, Vincent W Zheng, and Yang Pian. 2018b. Prerequisite-driven deep knowledge tracing. In 2018 IEEE International Conference on Data Mining (ICDM). IEEE, 39--48.
[6]
Yetian Chen, José P González-Brenes, and Jin Tian. 2016. Joint Discovery of Skill Prerequisite Graphs and Student Models. International Educational Data Mining Society (2016).
[7]
Yunxiao Chen, Xiaoou Li, Jingchen Liu, and Zhiliang Ying. 2018a. Recommendation system for adaptive learning. Applied psychological measurement, Vol. 42, 1 (2018), 24--41.
[8]
Albert T Corbett and John R Anderson. 1994. Knowledge tracing: Modeling the acquisition of procedural knowledge. User modeling and user-adapted interaction, Vol. 4, 4 (1994), 253--278.
[9]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
[10]
Hermann Ebbinghaus. 2013. Memory: A contribution to experimental psychology. Annals of neurosciences, Vol. 20, 4 (2013), 155.
[11]
Miao Fan, Qiang Zhou, Emily Chang, and Fang Zheng. 2014. Transition-based knowledge graph embedding with relational mapping properties. In Proceedings of the 28th Pacific Asia Conference on Language, Information and Computing. 328--337.
[12]
David A Field. 1988. Laplacian smoothing and Delaunay triangulations. Communications in applied numerical methods, Vol. 4, 6 (1988), 709--712.
[13]
James Fogarty, Ryan S Baker, and Scott E Hudson. 2005. Case studies in the use of ROC curve analysis for sensor-based estimates in human computer interaction. In Proceedings of Graphics Interface 2005. 129--136.
[14]
Lynn S Fuchs, Douglas Fuchs, Karin Prentice, Carol L Hamlett, Robin Finelli, and Susan J Courey. 2004. Enhancing mathematical problem solving among third-grade students with schema-based instruction. Journal of Educational Psychology, Vol. 96, 4 (2004), 635.
[15]
Weibo Gao, Qi Liu, Zhenya Huang, Yu Yin, Haoyang Bi, Mu-Chun Wang, Jianhui Ma, Shijin Wang, and Yu Su. 2021. Rcd: Relation map driven cognitive diagnosis for intelligent education systems. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 501--510.
[16]
Aritra Ghosh, Neil Heffernan, and Andrew S Lan. 2020. Context-aware attentive knowledge tracing. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2330--2339.
[17]
Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl. 2017. Neural message passing for quantum chemistry. arXiv preprint arXiv:1704.01212 (2017).
[18]
Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Advances in neural information processing systems. 1024--1034.
[19]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780.
[20]
Yun Huang, Julio Daniel Guerra Hollstein, and Peter Brusilovsky. 2016. Modeling Skill Combination Patterns for Deeper Knowledge Tracing. In UMAP (Extended Proceedings).
[21]
Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, Guoping Hu, et almbox. 2019. EKT: Exercise-aware Knowledge Tracing for Student Performance Prediction. IEEE Transactions on Knowledge and Data Engineering (2019).
[22]
Stephen C Johnson. 1967. Hierarchical clustering schemes. Psychometrika, Vol. 32, 3 (1967), 241--254.
[23]
Vicki Jones and Jun H Jo. 2004. Ubiquitous learning environment: An adaptive teaching system using ubiquitous technology. In Beyond the comfort zone: Proceedings of the 21st ASCILITE Conference, Vol. 468. Perth, Western Australia, 474.
[24]
Diederik P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In International Conference on Learning Representations (ICLR).
[25]
Thomas N Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks, In International Conference on Learning Representations. arXiv preprint arXiv:1609.02907 (2017).
[26]
Kun Kuang, Peng Cui, Susan Athey, Ruoxuan Xiong, and Bo Li. 2018. Stable prediction across unknown environments. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1617--1626.
[27]
Junhyun Lee, Inyeop Lee, and Jaewoo Kang. 2019. Self-attention graph pooling. arXiv preprint arXiv:1904.08082 (2019).
[28]
Qi Liu, Shiwei Tong, Chuanren Liu, Hongke Zhao, Enhong Chen, Haiping Ma, and Shijin Wang. 2019. Exploiting cognitive structure for adaptive learning. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 627--635.
[29]
Yang Liu and Mirella Lapata. 2019. Text summarization with pretrained encoders. arXiv preprint arXiv:1908.08345 (2019).
[30]
Yunfei Liu, Yang Yang, Xianyu Chen, Jian Shen, Haifeng Zhang, and Yong Yu. 2020. Improving knowledge tracing via pre-training question embeddings. arXiv preprint arXiv:2012.05031 (2020).
[31]
Rada Mihalcea and Paul Tarau. 2004. Textrank: Bringing order into text. In Proceedings of the 2004 conference on empirical methods in natural language processing. 404--411.
[32]
Hiromi Nakagawa, Yusuke Iwasawa, and Yutaka Matsuo. 2019. Graph-based Knowledge Tracing: Modeling Student Proficiency Using Graph Neural Network. In 2019 IEEE/WIC/ACM International Conference on Web Intelligence (WI). IEEE, 156--163.
[33]
Shalini Pandey and Jaideep Srivastava. 2020. Rkt: Relation-aware self-attention for knowledge tracing. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 1205--1214.
[34]
Chris Piech, Jonathan Bassen, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas J Guibas, and Jascha Sohl-Dickstein. 2015. Deep knowledge tracing. In Advances in neural information processing systems. 505--513.
[35]
Eva L Ragnemalm. 1995. Student diagnosis in practice; bridging a gap. User Modeling and User-Adapted Interaction, Vol. 5, 2 (1995), 93--116.
[36]
Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini. 2008. The graph neural network model. IEEE Transactions on Neural Networks, Vol. 20, 1 (2008), 61--80.
[37]
Dominic Seyler, Mohamed Yahya, and Klaus Berberich. 2017. Knowledge questions from knowledge graphs. In Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval. 11--18.
[38]
Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research, Vol. 15, 1 (2014), 1929--1958.
[39]
Hanshuang Tong, Yun Zhou, and Zhen Wang. 2020 b. Exercise Hierarchical Feature Enhanced Knowledge Tracing. In International Conference on Artificial Intelligence in Education. Springer, 324--328.
[40]
Shiwei Tong, Qi Liu, Wei Huang, Zhenya Huang, Enhong Chen, Chuanren Liu, Haiping Ma, and Shijin Wang. 2020 a. Structure-based Knowledge Tracing: An Influence Propagation View. In 2020 IEEE International Conference on Data Mining (ICDM). IEEE, 541--550.
[41]
Petar Velivc ković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903 (2017).
[42]
Fei Wang, Qi Liu, Enhong Chen, and Zhenya Huang. 2019 b. Interpretable Cognitive Diagnosis with Neural Network for Intelligent Educational Systems. arXiv preprint arXiv:1908.08733 (2019).
[43]
Minjie Wang, Da Zheng, Zihao Ye, Quan Gan, Mufei Li, Xiang Song, Jinjing Zhou, Chao Ma, Lingfan Yu, Yu Gai, Tianjun Xiao, Tong He, George Karypis, Jinyang Li, and Zheng Zhang. 2019 c. Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks. arXiv preprint arXiv:1909.01315 (2019).
[44]
Zhiwei Wang, Xiaoqin Feng, Jiliang Tang, Gale Yan Huang, and Zitao Liu. 2019 a. Deep knowledge tracing with side information. In International conference on artificial intelligence in education. Springer, 303--308.
[45]
Runze Wu, Qi Liu, Yuping Liu, Enhong Chen, Yu Su, Zhigang Chen, and Guoping Hu. 2015. Cognitive modelling for predicting examinee performance. In Twenty-Fourth International Joint Conference on Artificial Intelligence.
[46]
Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S Yu Philip. 2020. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems (2020).
[47]
Zhitao Ying, Jiaxuan You, Christopher Morris, Xiang Ren, Will Hamilton, and Jure Leskovec. 2018. Hierarchical graph representation learning with differentiable pooling. In Advances in neural information processing systems. 4800--4810.
[48]
Dongxiang Zhang, Lei Wang, Luming Zhang, Bing Tian Dai, and Heng Tao Shen. 2019 b. The gap of semantic parsing: A survey on automatic math word problem solvers. IEEE transactions on pattern analysis and machine intelligence (2019).
[49]
Haoyu Zhang, Jianjun Xu, and Ji Wang. 2019 c. Pretraining-based natural language generation for text summarization. arXiv preprint arXiv:1902.09243 (2019).
[50]
Jiani Zhang, Xingjian Shi, Irwin King, and Dit-Yan Yeung. 2017. Dynamic key-value memory networks for knowledge tracing. In Proceedings of the 26th international conference on World Wide Web. 765--774.
[51]
Ningyu Zhang, Shumin Deng, Zhanlin Sun, Guanying Wang, Xi Chen, Wei Zhang, and Huajun Chen. 2019 a. Long-tail relation extraction via knowledge graph embeddings and graph convolution networks. arXiv preprint arXiv:1903.01306 (2019).

Cited By

View all
  • (2025)Multi-Granularity Ensemble Interaction Graph Modeling for Knowledge TracingKnowledge-Based Systems10.1016/j.knosys.2024.112834309(112834)Online publication date: Jan-2025
  • (2025)csKT: Addressing cold-start problem in knowledge tracing via kernel bias and cone attentionExpert Systems with Applications10.1016/j.eswa.2024.125988266(125988)Online publication date: Mar-2025
  • (2024)Revisiting Knowledge Tracing: A Simple and Powerful ModelProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681205(263-272)Online publication date: 28-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2022
3569 pages
ISBN:9781450387323
DOI:10.1145/3477495
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. attention mechanism
  2. hierarchical graph convolutional network
  3. intelligent education
  4. knowledge tracing

Qualifiers

  • Research-article

Funding Sources

  • The National Natural Science Foundation of China

Conference

SIGIR '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)155
  • Downloads (Last 6 weeks)27
Reflects downloads up to 08 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Multi-Granularity Ensemble Interaction Graph Modeling for Knowledge TracingKnowledge-Based Systems10.1016/j.knosys.2024.112834309(112834)Online publication date: Jan-2025
  • (2025)csKT: Addressing cold-start problem in knowledge tracing via kernel bias and cone attentionExpert Systems with Applications10.1016/j.eswa.2024.125988266(125988)Online publication date: Mar-2025
  • (2024)Revisiting Knowledge Tracing: A Simple and Powerful ModelProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681205(263-272)Online publication date: 28-Oct-2024
  • (2024)Interpretable Knowledge Tracing with Multiscale State RepresentationProceedings of the ACM Web Conference 202410.1145/3589334.3645373(3265-3276)Online publication date: 13-May-2024
  • (2024)Hybrid Models for Knowledge Tracing: A Systematic Literature ReviewIEEE Transactions on Learning Technologies10.1109/TLT.2023.334869017(1021-1036)Online publication date: 1-Jan-2024
  • (2024)Graph Attention-Enhanced Knowledge Tracing: Unveiling Exercise Variability and Long-Term Dependencies2024 12th International Conference on Information and Education Technology (ICIET)10.1109/ICIET60671.2024.10542821(482-488)Online publication date: 18-Mar-2024
  • (2024)A Review of Data Mining in Personalized Education: Current Trends and Future ProspectsFrontiers of Digital Education10.1007/s44366-024-0019-61:1(26-50)Online publication date: 2-Jul-2024
  • (2024)A survey of explainable knowledge tracingApplied Intelligence10.1007/s10489-024-05509-854:8(6483-6514)Online publication date: 16-May-2024
  • (2024)A study of progressive data flow knowledge tracing based on reconstructed attention mechanismNeural Computing and Applications10.1007/s00521-024-10011-wOnline publication date: 6-Jun-2024
  • (2023)Deep knowledge tracing with learning curvesFrontiers in Psychology10.3389/fpsyg.2023.115032914Online publication date: 30-Mar-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media