research-article

Nonuniform Hyper-Network Embedding with Dual Mechanism

Authors:

Zibin ZhengAuthors Info & Claims

ACM Transactions on Information Systems (TOIS), Volume 38, Issue 3

Article No.: 28, Pages 1 - 18

https://doi.org/10.1145/3388924

Published: 05 May 2020 Publication History

Abstract

Network embedding which aims to learn the low-dimensional representations for vertices in networks has been extensively studied in recent years. Although there are various models designed for networks with different properties and different structures for different tasks, most of them are only applied to normal networks which only contain pairwise relationships between vertices. In many realistic cases, relationships among objects are not pairwise and such relationships can be better modeled by a hyper-network in which each edge can connect an uncertain number of vertices. In this article, we focus on two properties of hyper-networks: nonuniform and dual property. In order to make full use of these two properties, we firstly propose a flexible model called Hyper2vec to learn the embeddings of hyper-networks by applying a biased second order random walk strategy to hyper-networks in the framework of Skip-gram. Then, we combine the features of hyperedges by considering the dual hyper-networks to build a further model called NHNE based on 1D convolutional neural networks, and train a tuplewise similarity function for the nonuniform relationships in hyper-networks. Extensive experiments demonstrate the significant effectiveness of our methods for hyper-network embedding.

References

[1]

Sameer Agarwal, Kristin Branson, and Serge Belongie. 2006. Higher order learning with graphs. In ICML. ACM, 17--24.

[2]

Lars Backstrom and Jure Leskovec. 2011. Supervised random walks: Predicting and recommending links in social networks. In WSDM. ACM, 635--644.

[3]

Inci M. Baytas, Cao Xiao, Fei Wang, Anil K. Jain, and Jiayu Zhou. 2018. Heterogeneous hyper-network embedding. In ICDM. IEEE, 875--880.

[4]

Luca Becchetti, Carlos Castillo, Debora Donato, Adriano Fazzone, and I. Rome. 2006. A comparison of sampling techniques for web graph characterization. In LinkKDD.

[5]

Mikhail Belkin and Partha Niyogi. 2002. Laplacian eigenmaps and spectral techniques for embedding and clustering. In NIPS. 585--591.

[6]

Claude Berge. 1984. Hypergraphs: Combinatorics of Finite Sets. Vol. 45. Elsevier.

[7]

Claude Berge and Edward Minieka. 1973. Graphs and hypergraphs. North-Holland, Amsterdam.

[8]

Shaosheng Cao, Wei Lu, and Qiongkai Xu. 2016. Deep neural networks for learning graph representations. In AAAI. 1145--1152.

[9]

Shiyu Chang, Wei Han, Jiliang Tang, Guo-Jun Qi, Charu C. Aggarwal, and Thomas S. Huang. 2015. Heterogeneous network embedding via deep architectures. In KDD. ACM, 119--128.

[10]

Peng Cui, Xiao Wang, Jian Pei, and Wenwu Zhu. 2018. A survey on network embedding. IEEE Transactions on Knowledge and Data Engineering (2018).

[11]

Yuxiao Dong, Nitesh V. Chawla, and Ananthram Swami. 2017. metapath2vec: Scalable representation learning for heterogeneous networks. In KDD. ACM, 135--144.

[12]

Rui Feng, Yang Yang, Wenjie Hu, Fei Wu, and Yueting Zhang. 2018. Representation learning for scale-free networks. In AAAI.

[13]

Ming Gao, Leihui Chen, Xiangnan He, and Aoying Zhou. 2018. BiNE: Bipartite network embedding. In SIGIR. 715--724.

[14]

Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In KDD. ACM, 855--864.

[15]

Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW. 173--182.

[16]

Geoffrey Hinton, Nitish Srivastava, and Kevin Swersky. 2012. Neural networks for machine learning lecture 6a overview of mini-batch gradient descent. Retrieved on January 20, 2019 from http://www.cs.toronto.edu/∼hinton/coursera/lecture6/lec6.pdf.

[17]

Peter D. Hoff, Adrian E. Raftery, and Mark S. Handcock. 2002. Latent space approaches to social network analysis. Journal of the American Statistical Association 97, 460 (2002), 1090--1098.

[18]

Jie Huang, Chuan Chen, Fanghua Ye, Jiajing Wu, Zibin Zheng, and Guohui Ling. 2019. Hyper2vec: Biased random walk for hyper-network embedding. In DASFAA. Springer, 273--277.

[19]

Thomas N. Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907.

[20]

Richard A. Kronmal and Arthur V. Peterson, Jr. 1979. On the alias method for generating random variables from a discrete distribution. The American Statistician 33, 4 (1979), 214--218.

[21]

Maciej Kurant, Athina Markopoulou, and Patrick Thiran. 2010. On the bias of BFS (breadth first search). In ITC. IEEE, 1--8.

[22]

Sang Hoon Lee, Pan-Jun Kim, and Hawoong Jeong. 2006. Statistical properties of sampled networks. Physical Review E 73, 1 (2006), 016102.

[23]

David Liben-Nowell and Jon Kleinberg. 2007. The link-prediction problem for social networks. Journal of the Association for Information Science and Technology 58, 7 (2007), 1019--1031.

Digital Library

[24]

Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781.

[25]

Marc Najork and Janet L. Wiener. 2001. Breadth-first crawling yields high-quality pages. In WWW. ACM, 114--118.

[26]

Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. 2002. On spectral clustering: Analysis and an algorithm. In NIPS. 849--856.

[27]

Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In KDD. ACM, 701--710.

[28]

Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In UAI. AUAI Press, 452--461.

Digital Library

[29]

Sam T. Roweis and Lawrence K. Saul. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290, 5500 (2000), 2323--2326.

[30]

Michael Schlichtkrull, Thomas N. Kipf, Peter Bloem, Rianne Van Den Berg, Ivan Titov, and Max Welling. 2018. Modeling relational data with graph convolutional networks. In ESWC. Springer, 593--607.

[31]

Chuan Shi, Binbin Hu, Wayne Xin Zhao, and S. Yu Philip. 2018. Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering 31, 2 (2018), 357--370.

Digital Library

[32]

Liang Sun, Shuiwang Ji, and Jieping Ye. 2008. Hypergraph spectral learning for multi-label classification. In KDD. ACM, 668--676.

[33]

Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. Line: Large-scale information network embedding. In WWW. 1067--1077.

[34]

Lei Tang and Huan Liu. 2011. Leveraging social media networks for classification. Data Mining and Knowledge Discovery 23, 3 (2011), 447--478.

Digital Library

[35]

Joshua B. Tenenbaum, Vin De Silva, and John C. Langford. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500 (2000), 2319--2323.

[36]

Ke Tu, Peng Cui, Xiao Wang, Fei Wang, and Wenwu Zhu. 2018. Structural deep embedding for hyper-networks. In AAAI.

[37]

Daixin Wang, Peng Cui, and Wenwu Zhu. 2016. Structural deep network embedding. In KDD. ACM, 1225--1234.

[38]

Hongwei Wang, Fuzheng Zhang, Min Hou, Xing Xie, Minyi Guo, and Qi Liu. 2018. Shine: Signed heterogeneous information network embedding for sentiment link prediction. In WSDM. ACM, 592--600.

[39]

Suhang Wang, Jiliang Tang, Charu Aggarwal, Yi Chang, and Huan Liu. 2017. Signed network embedding in social media. In SDM. SIAM, 327--335.

[40]

Carolyn Watters and Michael A. Shepherd. 1990. A transient hypergraph-based model for data access. ACM Transactions on Information Systems (TOIS) 8, 2 (1990), 77--102.

Digital Library

[41]

George H. Weiss. 1983. Random walks and their applications: Widely used as mathematical models, random walks play an important role in several areas of physics, chemistry, and biology. American Scientist 71, 1 (1983), 65--71.

[42]

Fei Wu, Ya-Hong Han, and Yue-Ting Zhuang. 2010. Multiple hypergraph clustering of web images by miningword2image correlations. Journal of Computer Science and Technology 25, 4 (2010), 750--760.

Digital Library

[43]

Biao Xiang, Ziqi Liu, Jun Zhou, and Xiaolong Li. 2018. Feature propagation on graph: A new perspective to graph representation learning. arXiv preprint arXiv:1804.06111.

[44]

Linchuan Xu, Xiaokai Wei, Jiannong Cao, and Philip S. Yu. 2017. Embedding of embedding (eoe): Joint embedding for coupled heterogeneous networks. In WSDM. ACM, 741--749.

[45]

Chia-An Yu, Ching-Lun Tai, Tak-Shing Chan, and Yi-Hsuan Yang. 2018. Modeling multi-way relations with hypergraph embedding. In CIKM. ACM, 1707--1710.

[46]

Ziqian Zeng, Xin Liu, and Yangqiu Song. 2018. Biased random walk based social regularization for word embeddings. In IJCAI. 4560--4566.

[47]

Ziwei Zhang, Peng Cui, Xiao Wang, Jian Pei, Xuanrong Yao, and Wenwu Zhu. 2018. Arbitrary-order proximity preserved network embedding. In KDD. ACM, 2778--2786.

[48]

Denny Zhou, Jiayuan Huang, and Bernhard Schölkopf. 2007. Learning with hypergraphs: Clustering, classification, and embedding. In NIPS. 1601--1608.

[49]

Yu Zhu, Ziyu Guan, Shulong Tan, Haifeng Liu, Deng Cai, and Xiaofei He. 2016. Heterogeneous hypergraph embedding for document recommendation. Neurocomputing 216 (2016), 150--162.

Cited By

Chen LQin CSun YSong XXu TZhu HXiong HChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Collaboration-Aware Hybrid Learning for Knowledge Development PredictionProceedings of the ACM on Web Conference 202410.1145/3589334.3645326(3976-3985)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645326
Behrouz AHashemi FSadeghian SSeltzer MOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)CAT-WALKProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3667538(32636-32671)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3667538
Zhao GHuang ZZhuang YLiu JLiu QLiu ZWu JChen EFrommholz IHopfgartner FLee MOakes MLalmas MZhang MSantos R(2023)Simulating Student Interactions with Two-stage Imitation Learning for Intelligent Educational SystemsProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3615060(3423-3432)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3583780.3615060
Show More Cited By

Index Terms

Nonuniform Hyper-Network Embedding with Dual Mechanism
1. Information systems
  1. Information systems applications
2. Mathematics of computing
  1. Discrete mathematics
    1. Graph theory
      1. Hypergraphs

Recommendations

Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec
WSDM '18: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining

Since the invention of word2vec, the skip-gram model has significantly advanced the research of network embedding, such as the recent emergence of the DeepWalk, LINE, PTE, and node2vec approaches. In this work, we show that all of the aforementioned ...
Read More
Network embedding: Taxonomies, frameworks and applications
Abstract
Networks are a general language for describing complex systems of interacting entities. In the real world, a network always contains massive nodes, edges and additional complex information which leads to high complexity in computing ...
Read More
Dynamic Network Embedding via Temporal Path Adjacency Matrix Factorization
CIKM '22: Proceedings of the 31st ACM International Conference on Information & Knowledge Management

Network embedding has been widely investigated to learn low dimensional nodes representation of networks, and serves for many downstream machine learning tasks. Previous network embedding studies mainly focus on static networks, and cannot adapt well to ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems

ACM Transactions on Information Systems Volume 38, Issue 3

July 2020

311 pages

ISSN:1046-8188

EISSN:1558-2868

DOI:10.1145/3394096

Editor:
Maarten de Rijke
University of Amsterdam, The Netherlands

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2020

Accepted: 01 March 2020

Revised: 01 March 2020

Received: 01 July 2019

Published in TOIS Volume 38, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

CCF Opening Project of Information System
National Key Research and Development Program
National Natural Science Foundation of China
Natural Science Foundation of Guangdong
Program for Science and Technology Planning Project of Guangdong Province of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
464
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)4

Other Metrics

View Author Metrics

Citations

Cited By

Chen LQin CSun YSong XXu TZhu HXiong HChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Collaboration-Aware Hybrid Learning for Knowledge Development PredictionProceedings of the ACM on Web Conference 202410.1145/3589334.3645326(3976-3985)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645326
Behrouz AHashemi FSadeghian SSeltzer MOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)CAT-WALKProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3667538(32636-32671)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3667538
Zhao GHuang ZZhuang YLiu JLiu QLiu ZWu JChen EFrommholz IHopfgartner FLee MOakes MLalmas MZhang MSantos R(2023)Simulating Student Interactions with Two-stage Imitation Learning for Intelligent Educational SystemsProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3615060(3423-3432)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3583780.3615060
Xu BHuang ZLiu JShen SLiu QChen EWu JWang SSingh ASun YAkoglu LGunopulos DYan XKumar ROzcan FYe J(2023)Learning Behavior-oriented Knowledge TracingProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599407(2789-2800)Online publication date: 6-Aug-2023
https://dl.acm.org/doi/10.1145/3580305.3599407
Ma BHettiarachchi GFukui SAndo YHilliger IKhosravi HRienties BDawson S(2023)Each Encounter Counts: Modeling Language Learning and ForgettingLAK23: 13th International Learning Analytics and Knowledge Conference10.1145/3576050.3576062(79-88)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3576050.3576062
Zhang ZChen CChang YHu WXing XZhou YZheng Z(2023)SHNE: Semantics and Homophily Preserving Network EmbeddingIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2021.311693634:8(4296-4307)Online publication date: Aug-2023
https://doi.org/10.1109/TNNLS.2021.3116936
Zhuang YLiu QHuang ZLi ZJin BBi HChen EWang SAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)A Robust Computerized Adaptive Testing Approach in Educational Question RetrievalProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531928(416-426)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3531928
Yan DXie WZhang YHe QYang Y(2022)Hypernetwork Dismantling via Deep Reinforcement LearningIEEE Transactions on Network Science and Engineering10.1109/TNSE.2022.31741639:5(3302-3315)Online publication date: 1-Sep-2022
https://doi.org/10.1109/TNSE.2022.3174163
Gao C(2021)Athlete Behavior Recognition Technology Based on Siamese-RPN Tracker ModelComputational Intelligence and Neuroscience10.1155/2021/62553902021Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1155/2021/6255390
Shen SLiu QChen EHuang ZHuang WYin YSu YWang SZhu FChin Ooi BMiao CWang HSkrypnyk IHsu WChawla S(2021)Learning Process-consistent Knowledge TracingProceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining10.1145/3447548.3467237(1452-1460)Online publication date: 14-Aug-2021
https://dl.acm.org/doi/10.1145/3447548.3467237
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents