Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3534678.3539350acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article
Open access

Dual-Geometric Space Embedding Model for Two-View Knowledge Graphs

Published: 14 August 2022 Publication History

Abstract

Two-view knowledge graphs (KGs) jointly represent two components: an ontology view for abstract and commonsense concepts, and an instance view for specific entities that are instantiated from ontological concepts. As such, these KGs contain heterogeneous structures that are hierarchical, from the ontology-view, and cyclical, from the instance-view. Despite these various structures in KGs, recent works on embedding KGs assume that the entire KG belongs to only one of the two views but not both simultaneously. For works that seek to put both views of the KG together, the instance and ontology views are assumed to belong to the same geometric space, such as all nodes embedded in the same Euclidean space or non-Euclidean product space, an assumption no longer reasonable for two-view KGs where different portions of the graph exhibit different structures. To address this issue, we define and construct a dual-geometric space embedding model (DGS) that models two-view KGs using a complex non-Euclidean geometric space, by embedding different portions of the KG in different geometric spaces. DGS utilizes the spherical space, hyperbolic space, and their intersecting space in a unified framework for learning embeddings. Furthermore, for the spherical space, we propose novel closed spherical space operators that directly decompose to using properties of the spherical space without the need for mapping to an approximate tangent space. Experiments on public datasets show that DGS significantly outperforms previous state-of-the-art baseline models on KG completion tasks, demonstrating its ability to better model heterogeneous structures in KGs.

Supplemental Material

MP4 File
Two-view knowledge graphs (KGs) jointly represent two components: an ontology view for concepts, and an instance view for entities. For works that seek to put both views of the KG together, the instance and ontology views are assumed to belong to the same geometric space, an assumption no longer reasonable for two-view KGs where different portions of the graph exhibit different structures e.g., hierarchy and cycles. To address this issue, we define and construct a dual-geometric space embedding model (DGS) that models two-view KGs using complex non-Euclidean geometric spaces for different portions of the graph. DGS utilizes the spherical space, hyperbolic space, and their intersecting space in a unified framework for learning embeddings. Furthermore, for the spherical space, we propose novel closed spherical space operators that directly operate in the spherical space without the need for retraction. Experiments on public datasets demonstrate the ability of DGS to better model heterogeneous structures in KGs.

References

[1]
Yushi Bai, Rex Ying, Hongyu Ren, and Jure Leskovec. 2021. Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones. NeurIPS (2021).
[2]
Carl Allen, and Timothy Hospedales. 2019. Multi-relational Poincaré Graph Embeddings. NeurIPS (2019).
[3]
Eugenio Beltrami. 1897. Teoria fondamentale degli spazii di curvatura costante.
[4]
Jonathan Berant and Percy Liang. 2014. Semantic Parsing via Paraphrasing. ACL (2014).
[5]
Silvère Bonnabel. 2013. Stochastic gradient descent on Riemannian manifolds. IEEE (2013).
[6]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-relational Data. NeurIPS (2013).
[7]
James W. Cannon, William J. Floyd, Richard Kenyon, and Walter R. Parry. 1997. Hyperbolic Geometry.
[8]
Ines Chami, Adva Wolf, Da-Cheng Juan, Frederic Sala, Sujith Ravi, and Christo- pher Re'. 2020. Low-Dimensional Hyperbolic Knowledge Graph Embeddings. ACL (2020).
[9]
Ines Chami, Rex Ying, Christopher Ré, and Jure Leskovec. 2019. Hyperbolic Graph Convolutional Neural Networks. NeurIPS (2019).
[10]
Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, and Sebastian Riedel. 2018. Convolutional 2D knowledge graph embeddings. AAAI.
[11]
Albert Gu, Frederic Sala, Beliz Gunel, and Christopher Ré. 2018. Learning mixed- curvature representations in product spaces. In ICLR.
[12]
Junheng Hao, Muhao Chen, Wenchao Yu, Yizhou Sun, and Wei Wang. 2019. Universal Representation Learning of Knowledge Bases by Jointly Embedding Instances and Ontological Concepts. KDD (2019).
[13]
Xiao Huang, Jingyuan Zhang, Dingcheng Li, and Ping Li. 2019. Knowledge Graph Embedding Based Question Answering. WSDM (2019).
[14]
Xiao Huang, Jingyuan Zhang, Dingcheng Li, and Ping Li. 2019. Knowledge Graph Embedding Based Question Answering. WSDM (2019).
[15]
Prodromos Kolyvakis, Alexandros Kalousis, and Dimitris Kiritsis. 2019. HyperKG: Hyperbolic Knowledge Graph Embeddings for Knowledge Base Completion. arXiv preprint arXiv:1908.04895 (2019).
[16]
Jens Lehmann, Robert Isele, Max Jakob, Anja Jentzsch, Dimitris Kontokostas, Pablo N. Mendesf, Sebastian Hellmann, Mohamed Morsey, Patrick van Kleef, Soren Auer, and Christian Bizer. 2015. DBpedia: A large-scale, multilingual knowledge base extracted from Wikipedia. In Semantic Web Journal. 167--195.
[17]
Yu Meng, Jiaxin Huang, Guangyuan Wang, Chao Zhang, Honglei Zhuang, Lance Kaplan, and Jiawei Han. 2019. Spherical Text Embedding. NeurIPS (2019).
[18]
Maximilian Nickel and Douwe Kiela. 2017. Poincaré Embeddings for Learning Hierarchical Representations. NeurIPS (2017).
[19]
Peter Petersen, S. Axler, and K.A. Ribet. 2006. Riemannian Geometry.
[20]
Fabian M. Suchanek, Gjergji Kasneci, and Gerhard Weikum. 2007. Yago: A Core of Semantic Knowledge. WWW.
[21]
Li Sun, Zhongbao Zhang, Junda Ye, Hao Peng, Jiawei Zhang, Sen Su, and Philip S. Yu. 2022. A Self-supervised Mixed-curvature Graph Neural Network. AAAI (2022).
[22]
Zequn Sun, Muhao Chen, Wei Hu, Chengming Wang, Jian Dai, and Wei Zhang. 2020. Knowledge Association with Hyperbolic Knowledge Graph Embeddings. ACL (2020).
[23]
Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. 2019. RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. ICLR (2019).
[24]
Kristina Toutanova and Danqi Chen. 2015. Observed versus latent features for knowledge base and text inference. In Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality.
[25]
Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, and Guillaume Bouchard. 2016. Complex Embeddings for Simple Link Prediction. ICML (2016).
[26]
Hongwei Wang, Fuzheng Zhang, Jialin Wang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2019. RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems. WSDM (2019).
[27]
Shen Wang, Xiaokai Wei, Cícero Nogueira dos Santos, Zhiguo Wang, Ramesh Nallapati, Andrew Arnold, Bing Xiang, Philip S. Yu, and Isabel F Cruz. 2021. Mixed-Curvature Multi-Relational Graph Neural Network for Knowledge Graph Completion. WWW (2021).
[28]
Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Em- bedding Entities and Relations for Learning and Inference in Knowledge Bases. ICLR (2015).
[29]
Shuai Zhang, Yi Tay, Wenqi Jiang, Da-cheng Juan, and Ce Zhang. 2021. Switch spaces: Learning product spaces with sparse gating. arXiv preprint arXiv:2102.08688 (2021).
[30]
Zhanqiu Zhang, Jianyu Cai, Yongdong Zhang, and Jie Wang. 2020. Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction. AAAI (2020).

Cited By

View all
  • (2024)Knowledge Graph Embedding: A Survey from the Perspective of Representation SpacesACM Computing Surveys10.1145/364380656:6(1-42)Online publication date: 13-Mar-2024
  • (2024)Embedding Two-View Knowledge Graphs with Class Inheritance and Structural SimilarityProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671941(3931-3941)Online publication date: 25-Aug-2024
  • (2024)CONHyperKGE: Using Contrastive Learning in Hyperbolic Space for Knowledge Graph EmbeddingInternational Journal of Pattern Recognition and Artificial Intelligence10.1142/S021800142451005438:04Online publication date: 18-Apr-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
KDD '22: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
August 2022
5033 pages
ISBN:9781450393850
DOI:10.1145/3534678
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 August 2022

Check for updates

Author Tags

  1. knowledge graph embeddings
  2. non-euclidean geometry

Qualifiers

  • Research-article

Funding Sources

Conference

KDD '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)271
  • Downloads (Last 6 weeks)32
Reflects downloads up to 07 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Knowledge Graph Embedding: A Survey from the Perspective of Representation SpacesACM Computing Surveys10.1145/364380656:6(1-42)Online publication date: 13-Mar-2024
  • (2024)Embedding Two-View Knowledge Graphs with Class Inheritance and Structural SimilarityProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671941(3931-3941)Online publication date: 25-Aug-2024
  • (2024)CONHyperKGE: Using Contrastive Learning in Hyperbolic Space for Knowledge Graph EmbeddingInternational Journal of Pattern Recognition and Artificial Intelligence10.1142/S021800142451005438:04Online publication date: 18-Apr-2024
  • (2024)Graph Contrastive Learning With Personalized AugmentationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.338872836:11(6305-6316)Online publication date: Nov-2024
  • (2024)Logical Relation Modeling and Mining in Hyperbolic Space for Recommendation2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00108(1310-1323)Online publication date: 13-May-2024
  • (2023)UUKGProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3668849(62442-62456)Online publication date: 10-Dec-2023
  • (2023)DyLFG: A Dynamic Network Learning Framework Based on GeometryEntropy10.3390/e2512161125:12(1611)Online publication date: 30-Nov-2023
  • (2023)SHGCN: Socially Enhanced Heterogeneous Graph Convolutional Network for Multi-behavior PredictionACM Transactions on the Web10.1145/361751018:1(1-27)Online publication date: 11-Oct-2023
  • (2022)Knowledge Graph Completion Based on Entity Descriptions in Hyperbolic SpaceApplied Sciences10.3390/app1301025313:1(253)Online publication date: 25-Dec-2022
  • (2022)Heterogeneous information networksProceedings of the VLDB Endowment10.14778/3554821.355490115:12(3807-3811)Online publication date: 1-Aug-2022

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media