Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3637528.3672002acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Capturing Homogeneous Influence among Students: Hypergraph Cognitive Diagnosis for Intelligent Education Systems

Published: 24 August 2024 Publication History

Abstract

Cognitive diagnosis is a vital upstream task in intelligent education systems. It models the student-exercise interaction, aiming to infer the students' proficiency levels on each knowledge concept. This paper observes that most existing methods can hardly effectively capture the homogeneous influence due to its inherent complexity. That is to say, although students exhibit similar performance on given exercises, their proficiency levels inferred by these methods vary significantly, resulting in shortcomings in interpretability and efficacy. Given the complexity of homogeneous influence, a hypergraph could be a choice due to its flexibility and capability of modeling high-order similarity which aligns with the nature of homogeneous influence. However, before incorporating hypergraph, one at first needs to address the challenges of distorted homogeneous influence, sparsity of response logs, and over-smoothing. To this end, this paper proposes a hypergraph cognitive diagnosis model (HyperCDM) to address these challenges and effectively capture the homogeneous influence. Specifically, to avoid distortion, HyperCDM employs a divide-and-conquer strategy to learn student, exercise and knowledge representations in their own hypergraphs respectively, and interconnects them via a feature-based interaction function. To construct hypergraphs based on sparse response logs, the auto-encoder is utilized to preprocess response logs and K-means is applied to cluster students. To mitigate over-smoothing, momentum hypergraph convolution networks are designed to partially keep previous representations during the message propagation. Extensive experiments on both offline and online real-world datasets show that HyperCDM achieves state-of-the-art performance in terms of interpretability and capturing homogeneous influence effectively, and is competitive in generalization. The ablation study verifies the efficacy of each component, and the case study explicitly showcases the homogeneous influence captured by HyperCDM.

Supplemental Material

MP4 File - Video of Capturing Homogeneous Influence among Students: Hypergraph Cognitive Diagnosis for Intelligent Education Systems
A brief video introduction to paper titled by Capturing Homogeneous Influence among Students: Hypergraph Cognitive Diagnosis for Intelligent Education Systems

References

[1]
Ghodai Abdelrahman, QingWang, and Bernardo Pereira Nunes. 2023. Knowledge Tracing: A Survey. ACM Computing Survey 55, 11 (2023), 224:1--224:37.
[2]
Ashton Anderson, Daniel P. Huttenlocher, Jon M. Kleinberg, and Jure Leskovec. 2014. Engaging with massive online courses. In Proceedings of the ACM on Web Conference 2014. Seoul, Korea.
[3]
Albert Bandura and Richard H Walters. 1977. Social Learning Theory. Vol. 1. Englewood Cliffs Prentice Hall.
[4]
Dexiong Chen, Leslie O'Bray, and Karsten M. Borgwardt. 2022. Structure-Aware Transformer for Graph Representation Learning. In Proceedings of the 39th International Conference on Machine Learning, Vol. 162. Baltimore, MD, 3469--3489.
[5]
Youngduck Choi, Youngnam Lee, Dongmin Shin, Junghyun Cho, Seoyon Park, Seewoo Lee, Jineon Baek, Chan Bae, Byungsoo Kim, and Jaewe Heo. 2020. Ed-Net: A Large-Scale Hierarchical Dataset in Education. In Proceedings of the 21st International Conference on Artificial Intelligence in Education. Ifrane, Morocco, 69--73.
[6]
Jiajun Cui, Zeyuan Chen, Aimin Zhou, Jianyong Wang, and Wei Zhang. 2023. Fine-Grained Interaction Modeling with Multi-Relational Transformer for Knowledge Tracing. ACM Transactions on Information Systems 41, 4 (2023), 104:1--104:26.
[7]
Jimmy De La Torre. 2008. An Empirically Based Method of Q-matrix Validation for the DINA Model: Development and applications. Journal of Educational Measurement 45, 4 (2008), 343--362.
[8]
Kaize Ding, Albert Jiongqian Liang, Bryan Perozzi, Ting Chen, Ruoxi Wang, Lichan Hong, Ed H. Chi, Huan Liu, and Derek Zhiyuan Cheng. 2023. Hyper-Former: Learning Expressive Sparse Feature Representations via Hypergraph Transformer. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. Taipei, Taiwan, 2062--2066.
[9]
Paszke et al. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems 32. British Columbia, Canada, 8024--8035.
[10]
Yifan Feng, Haoxuan You, Zizhao Zhang, Rongrong Ji, and Yue Gao. 2019. Hypergraph Neural Networks. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence. Honolulu, HI, 3558--3565.
[11]
Weibo Gao, Qi Liu, Zhenya Huang, Yu Yin, Haoyang Bi, Mu-Chun Wang, Jianhui Ma, ShijinWang, and Yu Su. 2021. RCD: Relation Map Driven Cognitive Diagnosis for Intelligent Education Systems. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. Virtual, 501--510.
[12]
Yue Gao, Zizhao Zhang, Haojie Lin, Xibin Zhao, Shaoyi Du, and Changqing Zou. 2022. Hypergraph Learning: Methods and Practices. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 5 (2022), 2548--2566.
[13]
Xavier Glorot and Yoshua Bengio. 2010. Understanding the Difficulty of Training Deep Feedforward Neural Networks. In Proceedings of the 13rd International Conference on Artificial Intelligence and Statistics. Sardinia, Italy, 249--256.
[14]
William L. Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive Representation Learning on Large Graphs. In Advances in Neural Information Processing Systems 30. Long Beach, CA, 1024--1034.
[15]
John A Hartigan and Manchek A Wong. 1979. Algorithm AS 136: A k-means clustering algorithm. Journal of the royal statistical society. series c (applied statistics) 28, 1 (1979), 100--108.
[16]
Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yong-Dong Zhang, and Meng Wang. 2020. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. In Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval. virtual, 639--648.
[17]
Kurt Hornik, Maxwell Stinchcombe, and Halbert White. 1989. Multilayer Feedforward Networks are Universal Approximators. Neural Networks 2, 5 (1989), 359--366.
[18]
Lu Jiang, Kunpeng Liu, Yibin Wang, Dongjie Wang, Pengyang Wang, Yanjie Fu, and Minghao Yin. 2023. Reinforced Explainable Knowledge Concept Recommendation in MOOCs. ACM Transactions on Intelligent Systems and Technology 14, 3 (2023), 43:1--43:20.
[19]
Aisha Urooj Khan, Hilde Kuehne, BoWu, Kim Chheu,Walid Bousselham, Chuang Gan, Niels da Vitoria Lobo, and Mubarak Shah. 2023. Learning Situation Hyper-Graphs for Video Question Answering. In Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Vancouver, Canada.
[20]
Diederik P. Kingma and Jimmy Ba. 2015. Adam:A Method for Stochastic Optimization. In Proceedings of the 3rd International Conference on Learning Representations. San Diego, CA.
[21]
Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In Proceedings of the 5th International Conference on Learning Representations. Toulon, France.
[22]
Jiatong Li, FeiWang, Qi Liu, Mengxiao Zhu,Wei Huang, Zhenya Huang, Enhong Chen, Yu Su, and Shijin Wang. 2022. HierCDF: A Bayesian Network-based Hierarchical Cognitive Diagnosis Framework. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. Washington, DC, 904--913.
[23]
Mingjia Li, Hong Qian, Jinglan Lv, Mengliang He, Wei Zhang, and Aimin Zhou. 2024. Foundation Model Enhanced Derivative-Free Cognitive Diagnosis. Frontiers of Computer Science (2024).
[24]
Jiawei Liu, Cheng Yang, Zhiyuan Lu, Junze Chen, Yibo Li, Mengmei Zhang, Ting Bai, Yuan Fang, Lichao Sun, Philip S. Yu, and Chuan Shi. 2023. Towards Graph Foundation Models: A Survey and Beyond. CoRR abs/2310.11829 (2023). arXiv:2310.11829
[25]
Qi Liu. 2021. Towards a New Generation of Cognitive Diagnosis. In Proceedings of the 30th International Joint Conference on Artificial Intelligence. Montreal, Canada, 4961--4964.
[26]
Qi Liu, RunzeWu, Enhong Chen, Guandong Xu, Yu Su, Zhigang Chen, and Guoping Hu. 2018. Fuzzy Cognitive Diagnosis for Modelling Examinee Performance. ACM Transactions on Intelligent Systems and Technology 9, 4 (2018), 48:1--48:26.
[27]
Shuo Liu, Hong Qian, Mingjia Li, and Aimin Zhou. 2023. QCCDM: A QAugmented Causal Cognitive Diagnosis Model for Student Learning. In Proceedings of the 26th European Conference on Artificial Intelligence. Kraków, Poland, 1536--1543.
[28]
Shuo Liu, Junhao Shen, Hong Qian, and Aimin Zhou. 2024. Inductive Cognitive Diagnosis for Fast Student Learning in Web-Based Intelligent Education Systems. In Proceedings of the ACM on Web Conference 2024. Singapore.
[29]
Yingjie Liu, Tiancheng Zhang, Xuecen Wang, Ge Yu, and Tao Li. 2023. New development of cognitive diagnosis models. Frontiers of Computer Science 17, 1 (2023), 171604.
[30]
Frederic Lord. 1952. A Theory of Test Scores. Psychometric Monographs (1952).
[31]
Haiping Ma, Manwei Li, Le Wu, Haifeng Zhang, Yunbo Cao, Xingyi Zhang, and Xuemin Zhao. 2022. Knowledge-Sensed Cognitive Diagnosis for Intelligent Education Platforms. In Proceedings of the 31st ACM International Conference on Information and Knowledge Management. Atlanta, GA, 1451--1460.
[32]
Mark D. Reckase. 2009. Multidimensional Item Response Theory Models. Springer. 79--112 pages.
[33]
D. Sculley. 2010. Web-scale k-means clustering. In Proceedings of the ACM on Web Conference 2010. Raleigh, NC, 1177--1178.
[34]
Junhao Shen, Hong Qian, Wei Zhang, and Aimin Zhou. 2024. Symbolic Cognitive Diagnosis via Hybrid Optimization for Intelligent Education Systems. In Proceedings of the 38th AAAI Conference on Artificial Intelligence. Vancouver, Canada.
[35]
Jianwen Sun, Fenghua Yu, Sannyuya Liu, Yawei Luo, Ruxia Liang, and Xiaoxuan Shen. 2023. Adversarial Bootstrapped Question Representation Learning for Knowledge Tracing. In Proceedings of the 31st ACM International Conference on Multimedia. Ottawa, Canada, 8016--8025.
[36]
J. B. Sympson. 1978. A Model for Testing with Multidimensional Items. In Proceedings of the 1977 Computerized Adaptive Testing Conference. Minneapolis, MN, 82--98.
[37]
Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, 11 (2008).
[38]
Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2017. Graph Attention Networks. CoRR abs/1710.10903 (2017). arXiv:1710.10903
[39]
FeiWang, Qi Liu, Enhong Chen, Zhenya Huang, Yuying Chen, Yu Yin, Zai Huang, and Shijin Wang. 2020. Neural Cognitive Diagnosis for Intelligent Education Systems. In Proceedings of the 34th AAAI Conference on Artificial Intelligence. New York, NY, 6153--6161.
[40]
Fei Wang, Qi Liu, Enhong Chen, Zhenya Huang, Yu Yin, Shijin Wang, and Yu Su. 2022. NeuralCD: A General Framework for Cognitive Diagnosis. IEEE Transactions on Knowledge and Data Engineering 35, 8 (2022), 8312--8327.
[41]
ShanshanWang, Zhen Zeng, Xun Yang, and Xingyi Zhang. 2023. Self-Supervised Graph Learning for Long-Tailed Cognitive Diagnosis. In Proceedings of the 37th AAAI Conference on Artificial Intelligence. Washington, DC, 110--118.
[42]
Zichao Wang, Angus Lamb, Evgeny Saveliev, Pashmina Cameron, Yordan Zaykov, José Miguel Hernández-Lobato, Richard E Turner, Richard G Baraniuk, Craig Barton, Simon Peyton Jones, Simon Woodhead, and Cheng Zhang. 2020. Diagnostic Questions: The NeurIPS 2020 Education Challenge. arXiv preprint arXiv:2007.12061 (2020).
[43]
Lianghao Xia, Chao Huang, Yong Xu, Jiashu Zhao, Dawei Yin, and Jimmy Huang. 2022. Hypergraph Contrastive Collaborative Filtering. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, NY.
[44]
Bo Yang, Xiao Fu, Nicholas D. Sidiropoulos, and Mingyi Hong. 2017. Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering. In Proceedings of the 34th International Conference on Machine Learning, Vol. 70. Sydney, Australia, 3861--3870.
[45]
Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng, Guolin Ke, Di He, Yanming Shen, and Tie-Yan Liu. 2021. Do Transformers Really Perform Badly for Graph Representation?. In Advances in Neural Information Processing Systems 34. virtual, 28877--28888.
[46]
Yan Zhuang, Qi Liu, GuanHao Zhao, Zhenya Huang, Weizhe Huang, Zachary Pardos, Enhong Chen, Jinze Wu, and Xin Li. 2024. A Bounded Ability Estimation for Computerized Adaptive Testing. Advances in Neural Information Processing Systems 36.

Index Terms

  1. Capturing Homogeneous Influence among Students: Hypergraph Cognitive Diagnosis for Intelligent Education Systems
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          KDD '24: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
          August 2024
          6901 pages
          ISBN:9798400704901
          DOI:10.1145/3637528
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 24 August 2024

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. cognitive diagnosis
          2. homogeneous influence
          3. hypergraph
          4. student proficiency inference

          Qualifiers

          • Research-article

          Funding Sources

          Conference

          KDD '24
          Sponsor:

          Acceptance Rates

          Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • 0
            Total Citations
          • 175
            Total Downloads
          • Downloads (Last 12 months)175
          • Downloads (Last 6 weeks)58
          Reflects downloads up to 09 Nov 2024

          Other Metrics

          Citations

          View Options

          Get Access

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media