Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3442381.3449874acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Role-Aware Modeling for N-ary Relational Knowledge Bases

Published: 03 June 2021 Publication History

Abstract

N-ary relational knowledge bases (KBs) represent knowledge with binary and beyond-binary relational facts. Especially, in an n-ary relational fact, the involved entities play different roles, e.g., the ternary relation PlayCharacterIn consists of three roles, Actor, Character and Movie. However, existing approaches are often directly extended from binary relational KBs, i.e., knowledge graphs, while missing the important semantic property of role. Therefore, we start from the role level, and propose a Role-Aware Modeling, RAM for short, for facts in n-ary relational KBs. RAM explores a latent space that contains basis vectors, and represents roles by linear combinations of these vectors. This way encourages semantically related roles to have close representations. RAM further introduces a pattern matrix that captures the compatibility between the role and all involved entities. To this end, it presents a multilinear scoring function to measure the plausibility of a fact composed by certain roles and entities. We show that RAM achieves both theoretical full expressiveness and computation efficiency, which also provides an elegant generalization for approaches in binary relational KBs. Experiments demonstrate that RAM outperforms representative baselines on both n-ary and binary relational datasets.

References

[1]
Michal Aharon, Michael Elad, and Alfred Bruckstein. 2006. K-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation. TIP 54, 11 (2006), 4311–4322.
[2]
Nesreen Ahmed, Ryan Rossi, Theodore Willke, and Rong Zhou. 2017. Edge Role Discovery via Higher-order Structures. In PAKDD. 291–303.
[3]
Andreas Argyriou, Theodoros Evgeniou, and Massimiliano Pontil. 2007. Multi-task Feature Learning. In NeurIPS.
[4]
Collin F Baker, Charles J Fillmore, and John B Lowe. 1998. The Berkeley FrameNet Project. In COLING. 86–90.
[5]
Ivana Balazevic, Carl Allen, and Timothy Hospedales. 2019. TuckER: Tensor Factorization for Knowledge Graph Completion. In EMNLP. 5188–5197.
[6]
Anselm Blumer, Andrzej Ehrenfeucht, David Haussler, and Manfred K Warmuth. 1987. Occam’s Razor. Inform. Process. Lett. 24, 6 (1987), 377–380.
[7]
Kurt Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor. 2008. Freebase: A Collaboratively Created Graph Database for Structuring Human Knowledge. In SIGMOD. 1247–1250.
[8]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-relational Data. In NeurIPS.
[9]
Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, and Sebastian Riedel. 2018. Convolutional 2d Knowledge Graph Embeddings. In AAAI.
[10]
Bahare Fatemi, Perouz Taslakian, David Vazquez, and David Poole. 2020. Knowledge Hypergraphs: Prediction Beyond Binary Relations. In IJCAI.
[11]
Mikhail Galkin, Priyansh Trivedi, Gaurav Maheshwari, Ricardo Usbeck, and Jens Lehmann. 2020. Message Passing for Hyper-relational Knowledge Graphs. In EMNLP.
[12]
Daniel Gildea and Daniel Jurafsky. 2002. Automatic Labeling of Semantic Roles. Computational Linguistics 28, 3 (2002), 245–288.
[13]
Marco Giunti, Giuseppe Sergioli, Giuliano Vivanet, and Simone Pinna. 2019. Representing N-ary Relations in the Semantic Web. Logic J. IGPL (2019).
[14]
Saiping Guan, Xiaolong Jin, Jiafeng Guo, Yuanzhuo Wang, and Xueqi Cheng. 2020. NeuInfer: Knowledge Inference on N-ary Facts. In ACL. 6141–6151.
[15]
Saiping Guan, Xiaolong Jin, Yuanzhuo Wang, and Xueqi Cheng. 2019. Link Prediction on N-ary Relational Data. In WWW.
[16]
Aidan Hogan, Eva Blomqvist, Michael Cochez, Claudia d’Amato, Gerard de Melo, Claudio Gutierrez, José Emilio Labra Gayo, Sabrina Kirrane, Sebastian Neumaier, Axel Polleres, 2020. Knowledge Graphs. arXiv preprint arXiv:2003.02320(2020).
[17]
Shaoxiong Ji, Shirui Pan, Erik Cambria, Pekka Marttinen, and Philip S Yu. 2020. A Survey on Knowledge Graphs: Representation, Acquisition and Applications. arXiv preprint arXiv:2002.00388(2020).
[18]
Rudolf Kadlec, Ondrej Bajgar, and Jan Kleindienst. 2017. Knowledge Base Completion: Baselines Strike Back. arXiv preprint arXiv:1705.10744(2017).
[19]
Seyed Mehran Kazemi and David Poole. 2018. SimplE Embedding for Link Prediction in Knowledge Graphs. In NeurIPS.
[20]
Denis Krompaß, Stephan Baier, and Volker Tresp. 2015. Type-constrained Representation Learning in Knowledge Graphs. In ISWC. 640–655.
[21]
Timothée Lacroix, Nicolas Usunier, and Guillaume Obozinski. 2018. Canonical Tensor Decomposition for Knowledge Base Completion. In ICML.
[22]
Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning Entity and Relation Embeddings for Knowledge Graph Completion. In AAAI.
[23]
Yu Liu, Quanming Yao, and Yong Li. 2020. Generalizing Tensor Decomposition for N-Ary Relational Knowledge Bases. In WWW.
[24]
Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing Data Using t-sne. JMLR 9, Nov (2008), 2579–2605.
[25]
Maximilian Nickel, Kevin Murphy, Volker Tresp, and Evgeniy Gabrilovich. 2015. A Review of Relational Machine Learning for Knowledge Graphs. Proc. IEEE 104, 1 (2015), 11–33.
[26]
Natasha Noy, Alan Rector, Pat Hayes, and Chris Welty. 2006. Defining N-ary Relations on the Semantic Web. W3C Working Group Note 12, 4 (2006).
[27]
Yulong Pei, Jianpeng Zhang, George Fletcher, and Mykola Pechenizkiy. 2019. Infinite Motif Stochastic Blockmodel for Role Discovery in Networks. In ASONAM.
[28]
Hongyu Ren, Weihua Hu, and Jure Leskovec. 2019. Query2box: Reasoning Over Knowledge Graphs in Vector Space Using Box Embeddings. In ICLR.
[29]
Andrea Rossi, Donatella Firmani, Antonio Matinata, Paolo Merialdo, and Denilson Barbosa. 2020. Knowledge Graph Embedding for Link Prediction: A Comparative Analysis. arXiv preprint arXiv:2002.00819(2020).
[30]
Ryan Rossi and Nesreen Ahmed. 2014. Role Discovery in Networks. TKDE 27, 4 (2014), 1112–1131.
[31]
Paolo Rosso, Dingqi Yang, and Philippe Cudré-Mauroux. 2020. Beyond Triplets: Hyper-relational Knowledge Graph Embedding for Link Prediction. In WWW.
[32]
Jacobo Rouces, Gerard De Melo, and Katja Hose. 2015. Framebase: Representing N-ary Relations Using Semantic Frames. In ESWC. 505–521.
[33]
Ali Sadeghian, Mohammadreza Armandpour, Patrick Ding, and Daisy Zhe Wang. 2019. DRUM: End-to-end Differentiable Rule Mining On Knowledge Graphs. In NeurIPS.
[34]
Michael Schlichtkrull, Thomas N Kipf, Peter Bloem, Rianne Van Den Berg, Ivan Titov, and Max Welling. 2018. Modeling Relational Data With Graph Convolutional Networks. In ESWC. 593–607.
[35]
Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. 2019. RotatE: Knowledge Graph Embedding By Relational Rotation in Complex Space. In ICLR.
[36]
Yee W Teh, Michael I Jordan, Matthew J Beal, and David M Blei. 2005. Sharing Clusters Among Related Groups: Hierarchical Dirichlet Processes. In NeurIPS.
[37]
Hung Nghiep Tran and Atsuhiro Takasu. 2019. Analyzing Knowledge Graph Embedding Methods from a Multi-embedding Interaction Perspective. arXiv preprint arXiv:1903.11406(2019).
[38]
Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, and Guillaume Bouchard. 2016. Complex Embeddings for Simple Link Prediction. In ICML.
[39]
Shikhar Vashishth, Soumya Sanyal, Vikram Nitin, and Partha Talukdar. 2019. Composition-based Multi-relational Graph Convolutional Networks. In ICLR.
[40]
W3C. 2020. Roles in Schema.org. https://www.w3.org/wiki/images/c/c8/RolesinSchema.orgMay8.pdf. Accessed: 2020-10-03.
[41]
Quan Wang, Zhendong Mao, Bin Wang, and Li Guo. 2017. Knowledge Graph Embedding: A Survey of Approaches and Applications. TKDE 29, 12 (2017), 2724–2743.
[42]
Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge Graph Embedding By Translating on Hyperplanes. In AAAI.
[43]
Jianfeng Wen, Jianxin Li, Yongyi Mao, Shini Chen, and Richong Zhang. 2016. On the Representation and Embedding of Knowledge Bases Beyond Binary Relations. In IJCAI. 1300–1307.
[44]
Ruobing Xie, Zhiyuan Liu, and Maosong Sun. 2016. Representation Learning of Knowledge Graphs with Hierarchical Types. In IJCAI. 2965–2971.
[45]
Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In ICLR.
[46]
Alireza Zareian, Svebor Karaman, and Shih-Fu Chang. 2020. Weakly Supervised Visual Semantic Parsing. In CVPR. 3736–3745.
[47]
Richong Zhang, Junpeng Li, Jiajie Mei, and Yongyi Mao. 2018. Scalable Instance Reconstruction in Knowledge Bases via Relatedness Affiliated Embedding. In WWW.
[48]
Shuai Zhang, Yi Tay, Lina Yao, and Qi Liu. 2019. Quaternion Knowledge Graph Embeddings. In NeurIPS.
[49]
Yongqi Zhang, Quanming Yao, Wenyuan Dai, and Lei Chen. 2020. AutoSF: Searching Scoring Functions for Knowledge Graph Embedding. In ICDE.

Cited By

View all
  • (2025)Power on graph: Mining power relationship via user interaction correlationExpert Systems with Applications10.1016/j.eswa.2024.126348270(126348)Online publication date: Apr-2025
  • (2024)Heterogeneous causal metapath graph neural network for gene-microbe-disease association predictionProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/681(6161-6169)Online publication date: 3-Aug-2024
  • (2024)MetaphorPrompt - An Analogical Reasoning Approach for Extracting Causal Links from Biological TextProceedings of the 15th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics10.1145/3698587.3701384(1-6)Online publication date: 22-Nov-2024
  • Show More Cited By
  1. Role-Aware Modeling for N-ary Relational Knowledge Bases

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WWW '21: Proceedings of the Web Conference 2021
    April 2021
    4054 pages
    ISBN:9781450383127
    DOI:10.1145/3442381
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 June 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Embedding Method
    2. Knowledge Graph
    3. Latent Space Embedding
    4. N-ary Relational Knowledge Base

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    WWW '21
    Sponsor:
    WWW '21: The Web Conference 2021
    April 19 - 23, 2021
    Ljubljana, Slovenia

    Acceptance Rates

    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)87
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 31 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Power on graph: Mining power relationship via user interaction correlationExpert Systems with Applications10.1016/j.eswa.2024.126348270(126348)Online publication date: Apr-2025
    • (2024)Heterogeneous causal metapath graph neural network for gene-microbe-disease association predictionProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/681(6161-6169)Online publication date: 3-Aug-2024
    • (2024)MetaphorPrompt - An Analogical Reasoning Approach for Extracting Causal Links from Biological TextProceedings of the 15th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics10.1145/3698587.3701384(1-6)Online publication date: 22-Nov-2024
    • (2024)RHKH: Relational Hypergraph Neural Network for Link Prediction on N-ary Knowledge HypergraphProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681706(8759-8767)Online publication date: 28-Oct-2024
    • (2024)Integrating Structure and Text for Enhancing Hyper-relational Knowledge Graph Representation via Structure Soft Prompt TuningProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679698(1226-1234)Online publication date: 21-Oct-2024
    • (2024)Robust Link Prediction over Noisy Hyper-Relational Knowledge Graphs via Active LearningProceedings of the ACM on Web Conference 202410.1145/3589334.3645686(2282-2293)Online publication date: 13-May-2024
    • (2024)HJE: Joint Convolutional Representation Learning for Knowledge Hypergraph CompletionIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.336572736:8(3879-3892)Online publication date: Aug-2024
    • (2024)Schema-Aware Hyper-Relational Knowledge Graph Embeddings for Link PredictionIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.332349936:6(2614-2628)Online publication date: Jun-2024
    • (2024)Learning higher-order features for relation prediction in knowledge hypergraphKnowledge-Based Systems10.1016/j.knosys.2024.111510289:COnline publication date: 25-Jun-2024
    • (2024)MHRE: Multivariate link prediction method for medical hyper-relational factsApplied Intelligence10.1007/s10489-023-05248-254:2(1311-1334)Online publication date: 4-Jan-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media