Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3534678.3539486acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

HierCDF: A Bayesian Network-based Hierarchical Cognitive Diagnosis Framework

Published: 14 August 2022 Publication History
  • Get Citation Alerts
  • Abstract

    Cognitive diagnostic assessment is a fundamental task in intelligent education, which aims at quantifying students' cognitive level on knowledge attributes. Since there exists learning dependency among knowledge attributes, it is crucial for cognitive diagnosis models (CDMs) to incorporate attribute hierarchy when assessing students. The attribute hierarchy is only explored by a few CDMs such as Attribute Hierarchy Method, and there are still two significant limitations in these methods. First, the time complexity would be unbearable when the number of attributes is large. Second, the assumption used to model the attribute hierarchy is too strong so that it may lose some information of the hierarchy and is not flexible enough to fit all situations. To address these limitations, we propose a novel Bayesian network-based Hierarchical Cognitive Diagnosis Framework (HierCDF), which enables many traditional diagnostic models to flexibly integrate the attribute hierarchy for better diagnosis. Specifically, we first use an efficient Bayesian network to model the influence of attribute hierarchy on students' cognitive states. Then we design a CDM adaptor to bridge the gap between students' cognitive states and the input features of existing diagnostic models. Finally, we analyze the generality and complexity of HierCDF to show its effectiveness in modeling hierarchy information. The performance of HierCDF is experimentally proved on real-world large-scale datasets.

    Supplemental Material

    MP4 File
    Presentation video

    References

    [1]
    Andrew P. Bradley. 1997. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit. 30, 7 (1997), 1145--1159.
    [2]
    Justyna Brzezinska. 2020. Item response theory models in the measurement theory. Commun. Stat. Simul. Comput. 49, 12 (2020), 3299--3313.
    [3]
    Haw-Shiuan Chang, Hwai-Jung Hsu, and Kuan-Ta Chen. 2015. Modeling Exercise Relationships in E-Learning: A Unified Approach. In EDM. International Educational Data Mining Society (IEDMS), 532--535.
    [4]
    Cristina Conati, Abigail S. Gertner, and Kurt VanLehn. 2002. Using Bayesian Networks to Manage Uncertainty in Student Modeling. User Model. User Adapt. Interact. 12, 4 (2002), 371--417.
    [5]
    Jimmy de la Torre. 2009. DINA Model and Parameter Estimation: A Didactic. Journal of Educational and Behavioral Statistics 34, 1 (2009), 115--130.
    [6]
    Weibo Gao, Qi Liu, Zhenya Huang, Yu Yin, Haoyang Bi, Mu-Chun Wang, Jianhui Ma, Shijin Wang, and Yu Su. 2021. RCD: Relation Map Driven Cognitive Diagnosis for Intelligent Education Systems. In SIGIR. ACM, 501--510.
    [7]
    Dan Geiger and Judea Pearl. 1990. Logical and algorithmic properties of independence and their application to Bayesian networks. Ann. Math. Artif. Intell. 2 (1990), 165--178.
    [8]
    Eleonora Giunchiglia and Thomas Lukasiewicz. 2020. Coherent Hierarchical Multi-Label Classification Networks. In NeurIPS.
    [9]
    Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In AISTATS (JMLR Proceedings, Vol. 9). JMLR.org, 249--256.
    [10]
    Andréas Heinen and Alfonso Valdesogo. 2020. Spearman rank correlation of the bivariate Student t and scale mixtures of normal distributions. J. Multivar. Anal. 179 (2020), 104650.
    [11]
    Robert Henson, Jonathan Templin, and John Willse. 2009. Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent Variables. Psychometrika 74 (06 2009), 191--210.
    [12]
    Wei Huang, Enhong Chen, Qi Liu, Yuying Chen, Zai Huang, Yang Liu, Zhou Zhao, Dan Zhang, and Shijin Wang. 2019. Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach. In CIKM. ACM, 1051--1060.
    [13]
    Zhenya Huang, Xin Lin, Hao Wang, Qi Liu, Enhong Chen, Jianhui Ma, Yu Su, and Wei Tong. 2021. DisenQNet: Disentangled Representation Learning for Educational Questions. In KDD. ACM, 696--704.
    [14]
    Zhenya Huang, Qi Liu, Enhong Chen, Hongke Zhao, Mingyong Gao, Si Wei, Yu Su, and Guoping Hu. 2017. Question Difficulty Prediction for READING Problems in Standard Tests. In AAAI. AAAI Press, 1352--1359.
    [15]
    Zhenya Huang, Qi Liu, Yuying Chen, Le Wu, Keli Xiao, Enhong Chen, Haiping Ma, and Guoping Hu. 2020. Learning or Forgetting? A Dynamic Approach for Tracking the Knowledge Proficiency of Students. ACM Trans. Inf. Syst. 38, 2 (2020), 19:1--19:33.
    [16]
    Géraldine Jeckeln, Ying Hu, Jacqueline G. Cavazos, Amy N. Yates, Carina A. Hahn, Larry Tang, P. Jonathon Phillips, and Alice J. O'Toole. 2021. Face Identification Proficiency Test Designed Using Item Response Theory. CoRR abs/2106.15323 (2021).
    [17]
    Tanja Käser, Severin Klingler, Alexander G. Schwing, and Markus H. Gross. 2014. Beyond Knowledge Tracing: Modeling Skill Topologies with Bayesian Networks. In Intelligent Tutoring Systems (Lecture Notes in Computer Science, Vol. 8474). Springer, 188--198.
    [18]
    Saurabh Kataria, Krishnan S. Kumar, Rajeev Rastogi, Prithviraj Sen, and Srinivasan H. Sengamedu. 2011. Entity disambiguation with hierarchical topic models. In KDD. ACM, 1037--1045.
    [19]
    Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR (Poster).
    [20]
    Hans-Friedrich Köhn and Chia-Yi Chiu. 2019. Attribute Hierarchy Models in Cognitive Diagnosis: Identifiability of the Latent Attribute Space and Conditions for Completeness of the Q-Matrix. J. Classif. 36, 3 (2019), 541--565.
    [21]
    Daphne Koller and Nir Friedman. 2009. Probabilistic Graphical Models - Principles and Techniques. MIT Press.
    [22]
    Jacqueline P. Leighton, Mark J. Gierl, and Stephen M. Hunka. 2004. The Attribute Hierarchy Method for Cognitive Assessment: A Variation on Tatsuoka's Rule- Space Approach. Journal of Educational Measurement 41, 3 (2004), 205--237.
    [23]
    Qi Liu. 2021. Towards a New Generation of Cognitive Diagnosis. In IJCAI. ijcai.org, 4961--4964.
    [24]
    Qi Liu, Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, and Guoping Hu. 2021. EKT: Exercise-Aware Knowledge Tracing for Student Performance Prediction. IEEE Trans. Knowl. Data Eng. 33, 1 (2021), 100--115.
    [25]
    Yu Meng, Yunyi Zhang, Jiaxin Huang, Yu Zhang, Chao Zhang, and Jiawei Han. 2020. Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding. In KDD. ACM, 1908--1917.
    [26]
    Radek Pelánek. 2017. Bayesian knowledge tracing, logistic models, and beyond: an overview of learner modeling techniques. User Model. User Adapt. Interact. 27, 3--5 (2017), 313--350.
    [27]
    Mark D. Reckase. 2009. Multidimensional Item Response Theory Models. Springer New York, New York, NY, 79--112.
    [28]
    Jonathan Templin and Laine Bradshaw. 2014. Hierarchical Diagnostic Classification Models: A Family of Models for Estimating and Testing Attribute Hierarchies. Psychometrika 79 (01 2014).
    [29]
    C. J. van Rijsbergen. 1979. Information Retrieval. Butterworth.
    [30]
    Kurt Vanlehn, Collin Lynch, K. Schulze, Joel Shapiro, R. Shelby, L. Taylor, D. Treacy, A. Weinstein, and M. Wintersgill. 2005. The Andes physics tutoring system: Lessons learned. International Journal of Artificial Intelligence in Education 15 (01 2005), 147--204.
    [31]
    ChiWang, Xueqing Liu, Yanglei Song, and Jiawei Han. 2015. Towards Interactive Construction of Topical Hierarchy: A Recursive Tensor Decomposition Approach. In KDD. ACM, 1225--1234.
    [32]
    FeiWang, Qi Liu, Enhong Chen, Zhenya Huang, Yuying Chen, Yu Yin, Zai Huang, and Shijin Wang. 2020. Neural Cognitive Diagnosis for Intelligent Education Systems. In AAAI. AAAI Press, 6153--6161.
    [33]
    Wei Xu and Yuhan Zhou. 2020. Course video recommendation with multimodal information in online learning platforms: A deep learning framework. Br. J. Educ. Technol. 51, 5 (2020), 1734--1747.

    Cited By

    View all
    • (2024)Inductive Cognitive Diagnosis for Fast Student Learning in Web-Based Intelligent Education SystemsProceedings of the ACM on Web Conference 202410.1145/3589334.3645589(4260-4271)Online publication date: 13-May-2024
    • (2024)Unified Uncertainty Estimation for Cognitive Diagnosis ModelsProceedings of the ACM on Web Conference 202410.1145/3589334.3645488(3545-3554)Online publication date: 13-May-2024
    • (2024)RDGT: Enhancing Group Cognitive Diagnosis With Relation-Guided Dual-Side Graph TransformerIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.335264036:7(3429-3442)Online publication date: Jul-2024
    • Show More Cited By

    Index Terms

    1. HierCDF: A Bayesian Network-based Hierarchical Cognitive Diagnosis Framework

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        KDD '22: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
        August 2022
        5033 pages
        ISBN:9781450393850
        DOI:10.1145/3534678
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 14 August 2022

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. attribute hierarchy
        2. bayesian network
        3. cognitive diagnosis

        Qualifiers

        • Research-article

        Funding Sources

        • the iFLYTEK joint research program
        • the National Natural Science Foundation of China
        • the National Key Research and Development Program of China

        Conference

        KDD '22
        Sponsor:

        Acceptance Rates

        Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

        Upcoming Conference

        KDD '24

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)161
        • Downloads (Last 6 weeks)18
        Reflects downloads up to 12 Aug 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Inductive Cognitive Diagnosis for Fast Student Learning in Web-Based Intelligent Education SystemsProceedings of the ACM on Web Conference 202410.1145/3589334.3645589(4260-4271)Online publication date: 13-May-2024
        • (2024)Unified Uncertainty Estimation for Cognitive Diagnosis ModelsProceedings of the ACM on Web Conference 202410.1145/3589334.3645488(3545-3554)Online publication date: 13-May-2024
        • (2024)RDGT: Enhancing Group Cognitive Diagnosis With Relation-Guided Dual-Side Graph TransformerIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.335264036:7(3429-3442)Online publication date: Jul-2024
        • (2024)Modeling question difficulty for unbiased cognitive diagnosisKnowledge-Based Systems10.1016/j.knosys.2024.111750294:COnline publication date: 17-Jul-2024
        • (2023)BNMI-DINA: A Bayesian Cognitive Diagnosis Model for Enhanced Personalized LearningBig Data and Cognitive Computing10.3390/bdcc80100048:1(4)Online publication date: 29-Dec-2023
        • (2023)Homogeneous Cohort-Aware Group Cognitive Diagnosis: A Multi-grained Modeling PerspectiveProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3615287(4094-4098)Online publication date: 21-Oct-2023
        • (2023)Search-Efficient Computerized Adaptive TestingProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3615049(773-782)Online publication date: 21-Oct-2023
        • (2023)Leveraging Transferable Knowledge Concept Graph Embedding for Cold-Start Cognitive DiagnosisProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591774(983-992)Online publication date: 19-Jul-2023
        • (2023)ReliCD: A Reliable Cognitive Diagnosis Framework with Confidence Awareness2023 IEEE International Conference on Data Mining (ICDM)10.1109/ICDM58522.2023.00095(858-867)Online publication date: 1-Dec-2023
        • (2023)Efficient Parameter Learning of Bayesian Network with Latent Variables from High-Dimensional Data2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS)10.1109/AICAS57966.2023.10168662(1-5)Online publication date: 11-Jun-2023
        • Show More Cited By

        View Options

        Get Access

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media