Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3631700.3665226acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
research-article

Learner-centered Ontology for Explainable Educational Recommendation

Published: 28 June 2024 Publication History

Abstract

Ontologies form the core of knowledge graphs, which act as faithful, semantic-rich sources for training models in delivering explainable recommendations. These models learn to extract logical paths between learners and resources to be recommended within the knowledge graph, according to behavior- and content-based patterns. Extracted paths are then used not only to provide recommendations, but also to generate accompanying textual explanations. Despite the potential of this approach, current ontologies derived from the traditional learner-resource interaction data fall short in terms of richness from an educational perspective. Conversely, general-purpose ontologies, while comprehensive in educational aspects, are overly complex for recommendation tasks. Unfortunately, a suboptimal ontology might prevent to articulate reasoning paths, and thus explanations, relevant for learners within the knowledge graph. To counter this limitation, in this paper, we propose LOXER, a novel ontology designed to unlock learner-centered logical paths for explainable educational recommendation. Our design integrates insights from diverse sources, including feedback from a local co-design group of learners, observations from specialized traditional large-scale educational recommendation datasets, and connections with well-known vocabularies of other existing ontologies. To validate our ontology, we conducted an evaluation of the explanation types it enables, involving university and lifelong learners and assessing explanation properties like effectiveness, decision-making speed, motivation, satisfaction, and confidence. Results show our ontology’s ability to foster diverse considerations during the learners’ decision-making process and to establish a semantic structure for knowledge graphs for explainable recommendation.

References

[1]
Giacomo Balloccu, Ludovico Boratto, Christian Cancedda, Gianni Fenu, and Mirko Marras. 2023. Faithful Path Language Modelling for Explainable Recommendation over Knowledge Graph. CoRR abs/2310.16452 (2023). arXiv:2310.16452
[2]
Giacomo Balloccu, Ludovico Boratto, Gianni Fenu, and Mirko Marras. 2023. Reinforcement recommendation reasoning through knowledge graphs for explanation path quality. Knowl. Based Syst. 260 (2023), 110098.
[3]
Jordan Barria-Pineda. 2020. Exploring the Need for Transparency in Educational Recommender Systems. In Proc. of ACM UMAP 2020. ACM, 376–379.
[4]
Sahan Bulathwela, Maria Perez-Ortiz, Erik Novak, Emine Yilmaz, and John Shawe-Taylor. 2021. Peek: A large dataset of learner engagement with educational videos. arXiv preprint arXiv:2109.03154 (2021).
[5]
Blerta Abazi Chaushi, Besnik Selimi, Agron Chaushi, and Marika Apostolova. 2023. Explainable Artificial Intelligence in Education: A Comprehensive Review. In Proc. of xAI 2023, Vol. 1902. Springer, 48–71.
[6]
Felipe Leite da Silva, Bruna Kin Slodkowski, Ketia Kellen Araújo da Silva, and Sílvio César Cazella. 2023. A systematic literature review on educational recommender systems for teaching and learning: research trends, limitations and opportunities. Educ. Inf. Technol. 28, 3 (2023), 3289–3328.
[7]
Danilo Dessì, Gianni Fenu, Mirko Marras, and Diego Reforgiato Recupero. 2018. Coco: Semantic-enriched collection of online courses at scale with experimental use cases. In Proc. of WorldCIST 2018. Springer, 1386–1396.
[8]
Lisa Ehrlinger and Wolfram Wöß. 2016. Towards a Definition of Knowledge Graphs. In Proc. of SEMANTiCS 2016(CEUR Workshop Proceedings, Vol. 1695). CEUR-WS.org.
[9]
Jibril Frej, Neel Shah, Marta Knezevic, Tanya Nazaretsky, and Tanja Käser. 2023. Finding Paths for Explainable MOOC Recommendation: A Learner Perspective. CoRR abs/2312.10082 (2023). arXiv:2312.10082
[10]
Shijie Geng, Zuohui Fu, Juntao Tan, Yingqiang Ge, Gerard de Melo, and Yongfeng Zhang. 2022. Path Language Modeling over Knowledge Graphsfor Explainable Recommendation. In Proc. of WWW 2022. ACM, 946–955.
[11]
Bryce Goodman and Seth R. Flaxman. 2017. European Union Regulations on Algorithmic Decision-Making and a "Right to Explanation". AI Mag. 38, 3 (2017), 50–57.
[12]
Nicola Guarino, Daniel Oberle, and Steffen Staab. 2009. What Is an Ontology? In Handbook on Ontologies. Springer, 1–17.
[13]
Nicolas Hubert, Armelle Brun, and Davy Monticolo. 2022. New Ontology and Knowledge Graph for University Curriculum Recommendation. In Proc. of ISWC 2022.
[14]
Andrew Iliadis, Amelia Acker, Wesley Stevens, and Sezgi Başak Kavakli. 2022. One schema to rule them all: How Schema. org models the world of search. Journal of the Association for Information Science and Technology (2022).
[15]
Eleni Ilkou, Hasan Abu-Rasheed, MohammadReza Tavakoli, Sherzod Hakimov, Gábor Kismihók, Sören Auer, and Wolfgang Nejdl. 2021. EduCOR: An Educational and Career-Oriented Recommendation Ontology. In Proc. of ISWC 2021, Vol. 12922. Springer, 546–562.
[16]
Shaoxiong Ji, Shirui Pan, Erik Cambria, Pekka Marttinen, and Philip S. Yu. 2022. A Survey on Knowledge Graphs: Representation, Acquisition, and Applications. IEEE Trans. Neural Networks Learn. Syst. 33, 2 (2022), 494–514.
[17]
Harry X. Li, Gabriel Appleby, Camelia Daniela Brumar, Remco Chang, and Ashley Suh. 2024. Knowledge Graphs in Practice: Characterizing their Users, Challenges, and Visualization Opportunities. IEEE Trans. Vis. Comput. Graph. 30, 1 (2024), 584–594.
[18]
Danyang Liu, Jianxun Lian, Zheng Liu, Xiting Wang, Guangzhong Sun, and Xing Xie. 2021. Reinforced Anchor Knowledge Graph Generation for News Recommendation Reasoning. In Proc. of KDD 2021. ACM, 1055–1065.
[19]
Kunjia Liu, Xiang Zhao, Jiuyang Tang, Weixin Zeng, Jinzhi Liao, Feng Tian, Qinghua Zheng, Jingquan Huang, and Ao Dai. 2021. MOOPer: A Large-Scale Dataset of Practice-Oriented Online Learning. In Proc. of CCKS 2021. Springer, 281–287.
[20]
Tim Miller. 2019. Explanation in artificial intelligence: Insights from the social sciences. Artif. Intell. 267 (2019), 1–38.
[21]
Nur W. Rahayu, Ridi Ferdiana, and Sri Suning Kusumawardani. 2022. A systematic review of ontology use in E-Learning recommender system. Com. Ed. Art. Int. 3 (2022), 100047.
[22]
Kristian Stancin, Patrizia Poscic, and Danijela Jaksic. 2020. Ontologies in education - state of the art. Educ. Inf. Technol. 25, 6 (2020), 5301–5320.
[23]
Nava Tintarev and Judith Masthoff. 2007. A Survey of Explanations in Recommender Systems. In Proc. of ICDE 2007. IEEE Computer Society, 801–810.
[24]
Nava Tintarev and Judith Masthoff. 2007. A survey of explanations in recommender systems. In Proc. of ICDEW 2007. IEEE, 801–810.
[25]
Linjing Wu, Qingtang Liu, Wanlei Zhou, Gang Mao, Jingxiu Huang, and Huan Huang. 2020. A Semantic Web-Based Recommendation Framework of Educational Resources in E-Learning. Technol. Knowl. Learn. 25, 4 (2020), 811–833.
[26]
Yikun Xian, Zuohui Fu, S. Muthukrishnan, Gerard de Melo, and Yongfeng Zhang. 2019. Reinforcement Knowledge Graph Reasoning for Explainable Recommendation. In Proc. of SIGIR 2019. ACM, 285–294.
[27]
Yikun Xian, Zuohui Fu, Handong Zhao, Yingqiang Ge, Xu Chen, Qiaoying Huang, Shijie Geng, Zhou Qin, Gerard de Melo, S. Muthukrishnan, and Yongfeng Zhang. 2020. CAFE: Coarse-to-Fine Neural Symbolic Reasoning for Explainable Recommendation. In Proc. of CIKM 2020. ACM, 1645–1654.
[28]
Jifan Yu, Gan Luo, Tong Xiao, Qingyang Zhong, Yuquan Wang, Wenzheng Feng, Junyi Luo, Chenyu Wang, Lei Hou, Juanzi Li, 2020. MOOCCube: a large-scale data repository for NLP applications in MOOCs. In Proc. of ACL 2020. 3135–3142.
[29]
Yongfeng Zhang and Xu Chen. 2020. Explainable Recommendation: A Survey and New Perspectives. Found. Trends Inf. Retr. 14, 1 (2020), 1–101.

Cited By

View all

Index Terms

  1. Learner-centered Ontology for Explainable Educational Recommendation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UMAP Adjunct '24: Adjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization
    June 2024
    662 pages
    ISBN:9798400704666
    DOI:10.1145/3631700
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 June 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Explainability.
    2. Ontology
    3. Recommendation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • National Recovery and Resilience Plan

    Conference

    UMAP '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 162 of 633 submissions, 26%

    Upcoming Conference

    UMAP '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 69
      Total Downloads
    • Downloads (Last 12 months)69
    • Downloads (Last 6 weeks)12
    Reflects downloads up to 03 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media