Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3534678.3539486acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

HierCDF: A Bayesian Network-based Hierarchical Cognitive Diagnosis Framework

Published: 14 August 2022 Publication History

Abstract

Cognitive diagnostic assessment is a fundamental task in intelligent education, which aims at quantifying students' cognitive level on knowledge attributes. Since there exists learning dependency among knowledge attributes, it is crucial for cognitive diagnosis models (CDMs) to incorporate attribute hierarchy when assessing students. The attribute hierarchy is only explored by a few CDMs such as Attribute Hierarchy Method, and there are still two significant limitations in these methods. First, the time complexity would be unbearable when the number of attributes is large. Second, the assumption used to model the attribute hierarchy is too strong so that it may lose some information of the hierarchy and is not flexible enough to fit all situations. To address these limitations, we propose a novel Bayesian network-based Hierarchical Cognitive Diagnosis Framework (HierCDF), which enables many traditional diagnostic models to flexibly integrate the attribute hierarchy for better diagnosis. Specifically, we first use an efficient Bayesian network to model the influence of attribute hierarchy on students' cognitive states. Then we design a CDM adaptor to bridge the gap between students' cognitive states and the input features of existing diagnostic models. Finally, we analyze the generality and complexity of HierCDF to show its effectiveness in modeling hierarchy information. The performance of HierCDF is experimentally proved on real-world large-scale datasets.

Supplemental Material

MP4 File
Presentation video

References

[1]
Andrew P. Bradley. 1997. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit. 30, 7 (1997), 1145--1159.
[2]
Justyna Brzezinska. 2020. Item response theory models in the measurement theory. Commun. Stat. Simul. Comput. 49, 12 (2020), 3299--3313.
[3]
Haw-Shiuan Chang, Hwai-Jung Hsu, and Kuan-Ta Chen. 2015. Modeling Exercise Relationships in E-Learning: A Unified Approach. In EDM. International Educational Data Mining Society (IEDMS), 532--535.
[4]
Cristina Conati, Abigail S. Gertner, and Kurt VanLehn. 2002. Using Bayesian Networks to Manage Uncertainty in Student Modeling. User Model. User Adapt. Interact. 12, 4 (2002), 371--417.
[5]
Jimmy de la Torre. 2009. DINA Model and Parameter Estimation: A Didactic. Journal of Educational and Behavioral Statistics 34, 1 (2009), 115--130.
[6]
Weibo Gao, Qi Liu, Zhenya Huang, Yu Yin, Haoyang Bi, Mu-Chun Wang, Jianhui Ma, Shijin Wang, and Yu Su. 2021. RCD: Relation Map Driven Cognitive Diagnosis for Intelligent Education Systems. In SIGIR. ACM, 501--510.
[7]
Dan Geiger and Judea Pearl. 1990. Logical and algorithmic properties of independence and their application to Bayesian networks. Ann. Math. Artif. Intell. 2 (1990), 165--178.
[8]
Eleonora Giunchiglia and Thomas Lukasiewicz. 2020. Coherent Hierarchical Multi-Label Classification Networks. In NeurIPS.
[9]
Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In AISTATS (JMLR Proceedings, Vol. 9). JMLR.org, 249--256.
[10]
Andréas Heinen and Alfonso Valdesogo. 2020. Spearman rank correlation of the bivariate Student t and scale mixtures of normal distributions. J. Multivar. Anal. 179 (2020), 104650.
[11]
Robert Henson, Jonathan Templin, and John Willse. 2009. Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent Variables. Psychometrika 74 (06 2009), 191--210.
[12]
Wei Huang, Enhong Chen, Qi Liu, Yuying Chen, Zai Huang, Yang Liu, Zhou Zhao, Dan Zhang, and Shijin Wang. 2019. Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach. In CIKM. ACM, 1051--1060.
[13]
Zhenya Huang, Xin Lin, Hao Wang, Qi Liu, Enhong Chen, Jianhui Ma, Yu Su, and Wei Tong. 2021. DisenQNet: Disentangled Representation Learning for Educational Questions. In KDD. ACM, 696--704.
[14]
Zhenya Huang, Qi Liu, Enhong Chen, Hongke Zhao, Mingyong Gao, Si Wei, Yu Su, and Guoping Hu. 2017. Question Difficulty Prediction for READING Problems in Standard Tests. In AAAI. AAAI Press, 1352--1359.
[15]
Zhenya Huang, Qi Liu, Yuying Chen, Le Wu, Keli Xiao, Enhong Chen, Haiping Ma, and Guoping Hu. 2020. Learning or Forgetting? A Dynamic Approach for Tracking the Knowledge Proficiency of Students. ACM Trans. Inf. Syst. 38, 2 (2020), 19:1--19:33.
[16]
Géraldine Jeckeln, Ying Hu, Jacqueline G. Cavazos, Amy N. Yates, Carina A. Hahn, Larry Tang, P. Jonathon Phillips, and Alice J. O'Toole. 2021. Face Identification Proficiency Test Designed Using Item Response Theory. CoRR abs/2106.15323 (2021).
[17]
Tanja Käser, Severin Klingler, Alexander G. Schwing, and Markus H. Gross. 2014. Beyond Knowledge Tracing: Modeling Skill Topologies with Bayesian Networks. In Intelligent Tutoring Systems (Lecture Notes in Computer Science, Vol. 8474). Springer, 188--198.
[18]
Saurabh Kataria, Krishnan S. Kumar, Rajeev Rastogi, Prithviraj Sen, and Srinivasan H. Sengamedu. 2011. Entity disambiguation with hierarchical topic models. In KDD. ACM, 1037--1045.
[19]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR (Poster).
[20]
Hans-Friedrich Köhn and Chia-Yi Chiu. 2019. Attribute Hierarchy Models in Cognitive Diagnosis: Identifiability of the Latent Attribute Space and Conditions for Completeness of the Q-Matrix. J. Classif. 36, 3 (2019), 541--565.
[21]
Daphne Koller and Nir Friedman. 2009. Probabilistic Graphical Models - Principles and Techniques. MIT Press.
[22]
Jacqueline P. Leighton, Mark J. Gierl, and Stephen M. Hunka. 2004. The Attribute Hierarchy Method for Cognitive Assessment: A Variation on Tatsuoka's Rule- Space Approach. Journal of Educational Measurement 41, 3 (2004), 205--237.
[23]
Qi Liu. 2021. Towards a New Generation of Cognitive Diagnosis. In IJCAI. ijcai.org, 4961--4964.
[24]
Qi Liu, Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, and Guoping Hu. 2021. EKT: Exercise-Aware Knowledge Tracing for Student Performance Prediction. IEEE Trans. Knowl. Data Eng. 33, 1 (2021), 100--115.
[25]
Yu Meng, Yunyi Zhang, Jiaxin Huang, Yu Zhang, Chao Zhang, and Jiawei Han. 2020. Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding. In KDD. ACM, 1908--1917.
[26]
Radek Pelánek. 2017. Bayesian knowledge tracing, logistic models, and beyond: an overview of learner modeling techniques. User Model. User Adapt. Interact. 27, 3--5 (2017), 313--350.
[27]
Mark D. Reckase. 2009. Multidimensional Item Response Theory Models. Springer New York, New York, NY, 79--112.
[28]
Jonathan Templin and Laine Bradshaw. 2014. Hierarchical Diagnostic Classification Models: A Family of Models for Estimating and Testing Attribute Hierarchies. Psychometrika 79 (01 2014).
[29]
C. J. van Rijsbergen. 1979. Information Retrieval. Butterworth.
[30]
Kurt Vanlehn, Collin Lynch, K. Schulze, Joel Shapiro, R. Shelby, L. Taylor, D. Treacy, A. Weinstein, and M. Wintersgill. 2005. The Andes physics tutoring system: Lessons learned. International Journal of Artificial Intelligence in Education 15 (01 2005), 147--204.
[31]
ChiWang, Xueqing Liu, Yanglei Song, and Jiawei Han. 2015. Towards Interactive Construction of Topical Hierarchy: A Recursive Tensor Decomposition Approach. In KDD. ACM, 1225--1234.
[32]
FeiWang, Qi Liu, Enhong Chen, Zhenya Huang, Yuying Chen, Yu Yin, Zai Huang, and Shijin Wang. 2020. Neural Cognitive Diagnosis for Intelligent Education Systems. In AAAI. AAAI Press, 6153--6161.
[33]
Wei Xu and Yuhan Zhou. 2020. Course video recommendation with multimodal information in online learning platforms: A deep learning framework. Br. J. Educ. Technol. 51, 5 (2020), 1734--1747.

Cited By

View all
  • (2025)An interpretable polytomous cognitive diagnosis framework for predicting examinee performanceInformation Processing and Management: an International Journal10.1016/j.ipm.2024.10391362:1Online publication date: 1-Jan-2025
  • (2025)A higher-order neural cognitive diagnosis model with hierarchical attention networksExpert Systems with Applications10.1016/j.eswa.2025.126848273(126848)Online publication date: May-2025
  • (2025)EduStudio: towards a unified library for student cognitive modelingFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-024-40372-319:8Online publication date: 1-Aug-2025
  • Show More Cited By

Index Terms

  1. HierCDF: A Bayesian Network-based Hierarchical Cognitive Diagnosis Framework

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      KDD '22: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
      August 2022
      5033 pages
      ISBN:9781450393850
      DOI:10.1145/3534678
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 14 August 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. attribute hierarchy
      2. bayesian network
      3. cognitive diagnosis

      Qualifiers

      • Research-article

      Funding Sources

      • the iFLYTEK joint research program
      • the National Natural Science Foundation of China
      • the National Key Research and Development Program of China

      Conference

      KDD '22
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

      Upcoming Conference

      KDD '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)157
      • Downloads (Last 6 weeks)12
      Reflects downloads up to 20 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)An interpretable polytomous cognitive diagnosis framework for predicting examinee performanceInformation Processing and Management: an International Journal10.1016/j.ipm.2024.10391362:1Online publication date: 1-Jan-2025
      • (2025)A higher-order neural cognitive diagnosis model with hierarchical attention networksExpert Systems with Applications10.1016/j.eswa.2025.126848273(126848)Online publication date: May-2025
      • (2025)EduStudio: towards a unified library for student cognitive modelingFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-024-40372-319:8Online publication date: 1-Aug-2025
      • (2024)Path-Specific Causal Reasoning for Fairness-aware Cognitive DiagnosisProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3672049(4143-4154)Online publication date: 25-Aug-2024
      • (2024)Capturing Homogeneous Influence among Students: Hypergraph Cognitive Diagnosis for Intelligent Education SystemsProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3672002(2628-2639)Online publication date: 25-Aug-2024
      • (2024)ORCDF: An Oversmoothing-Resistant Cognitive Diagnosis Framework for Student Learning in Online Education SystemsProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671988(2455-2466)Online publication date: 25-Aug-2024
      • (2024)HeckmanCD: Exploiting Selection Bias in Cognitive DiagnosisProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679648(768-777)Online publication date: 21-Oct-2024
      • (2024)Inductive Cognitive Diagnosis for Fast Student Learning in Web-Based Intelligent Education SystemsProceedings of the ACM Web Conference 202410.1145/3589334.3645589(4260-4271)Online publication date: 13-May-2024
      • (2024)Unified Uncertainty Estimation for Cognitive Diagnosis ModelsProceedings of the ACM Web Conference 202410.1145/3589334.3645488(3545-3554)Online publication date: 13-May-2024
      • (2024)Dual-channel feature enhancement cognitive diagnosis framework for student performance predictionThird International Symposium on Computer Applications and Information Systems (ISCAIS 2024)10.1117/12.3035228(141)Online publication date: 11-Jul-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media