research-article

Public Access

Relation Learning on Social Networks with Multi-Modal Graph Edge Variational Autoencoders

Authors:

Jiawei HanAuthors Info & Claims

WSDM '20: Proceedings of the 13th International Conference on Web Search and Data Mining

Pages 699 - 707

https://doi.org/10.1145/3336191.3371829

Published: 22 January 2020 Publication History

Abstract

While node semantics have been extensively explored in social networks, little research attention has been paid to pro le edge semantics, i.e., social relations. Ideal edge semantics should not only show that two users are connected, but also why they know each other and what they share in common. However, relations in social networks are often hard to pro le, due to noisy multi-modal signals and limited user-generated ground-truth labels.

In this work, we aim to develop a uni ed and principled frame- work that can pro le user relations as edge semantics in social networks by integrating multi-modal signals in the presence of noisy and incomplete data. Our framework is also exible towards limited or missing supervision. Speci cally, we assume a latent distribution of multiple relations underlying each user link, and learn them with multi-modal graph edge variational autoencoders. We encode the network data with a graph convolutional network, and decode arbitrary signals with multiple reconstruction networks. Extensive experiments and case studies on two public DBLP author networks and two internal LinkedIn member networks demonstrate the superior e ectiveness and e ciency of our proposed model.

References

[1]

James Atwood and Don Towsley. 2016. Diffusion-convolutional neural networks. In NIPS. 1993--2001.

[2]

Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In NIPS . 2787--2795.

[3]

Simon Bourigault, Cedric Lagnier, Sylvain Lamprier, Ludovic Denoyer, and Patrick Gallinari. 2014. Learning social network embeddings for predicting information diffusion. In WSDM . 393--402.

[4]

Simon Bourigault, Sylvain Lamprier, and Patrick Gallinari. 2016. Representation learning for information diffusion through social networks: an embedded cascade model. In WSDM. 573--582.

[5]

Deepayan Chakrabarti, Stanislav Funiak, Jonathan Chang, and Sofus A Macskassy. 2014. Joint Inference of Multiple Label Types in Large Networks. In ICML .

[6]

Jie Chen, Tengfei Ma, and Cao Xiao. 2018. FastGCN: fast learning with graph convolutional networks via importance sampling. In ICLR .

[7]

Shanshan Feng, Gao Cong, Arijit Khan, Xiucheng Li, Yong Liu, and Yeow Meng Chee. 2018. Inf2vec: Latent Representation Model for Social Influence Embedding. ICDE.

[8]

Soumyajit Ganguly and Vikram Pudi. 2017. Paper2vec: Combining graph and text information for scientific paper representation. In ECIR . 383--395.

[9]

Matt Gardner and Tom Mitchell. 2015. Efficient and expressive knowledge base completion using subgraph feature extraction. In EMNLP . 1488--1498.

[10]

Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. NIPS. 1025--1035.

[11]

Jingrui He, Jaime G Carbonell, and Yan Liu. 2007. Graph-Based Semi-Supervised Learning as a Generative Model. In IJCAI, Vol. 7. 2492--2497.

[12]

Eric Jang, Shixiang Gu, and Ben Poole. 2017. Categorical reparameterization with gumbel-softmax. In ICLR .

[13]

Meng Jiang, Jingbo Shang, Taylor Cassidy, Xiang Ren, Lance M Kaplan, Timothy P Hanratty, and Jiawei Han. 2017. MetaPAD: Meta Pattern Discovery from Massive Text Corpora. In KDD. 877--886.

[14]

Diederik P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In ICLR .

[15]

Diederik P. Kingma and Max Welling. 2014. Auto-Encoding Variational Bayes. ICLR (2014).

[16]

Thomas N Kipf and Max Welling. 2016. Variational graph auto-encoders. In NIPS Workshop on Bayesian Deep Learning .

[17]

Thomas N Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In ICLR .

[18]

Quoc V Le. 2013. Building high-level features using large scale unsupervised learning. In ICASSP . 8595--8598.

[19]

Jure Leskovec and Julian J Mcauley. 2012. Learning to discover social circles in ego networks. In NIPS. 539--547.

[20]

Yankai Lin, Shiqi Shen, Zhiyuan Liu, Huanbo Luan, and Maosong Sun. 2016. Neural relation extraction with selective attention over instances. In ACL, Vol. 1. 2124--2133.

[21]

Jie Liu, Zhicheng He, Lai Wei, and Yalou Huang. 2018. Content to node: Self-translation network embedding. In KDD. 1794--1802.

[22]

Liyuan Liu, Xiang Ren, Qi Zhu, Shi Zhi, Huan Gui, Heng Ji, and Jiawei Han. 2017. Heterogeneous Supervision for Relation Extraction: A Representation Learning Approach. In EMNLP .

[23]

Chris J Maddison, Andriy Mnih, and Yee Whye Teh. 2017. The concrete distribution: A continuous relaxation of discrete random variables. In ICLR .

[24]

Miller McPherson, Lynn Smith-Lovin, and James M Cook. 2001. Birds of a feather: Homophily in social networks. Annual review of sociology, Vol. 27, 1 (2001), 415--444.

[25]

Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In KDD . 701--710.

Digital Library

[26]

Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. 2014. Stochastic backpropagation and approximate inference in deep generative models. In ICML .

[27]

Yiye Ruan, David Fuhry, and Srinivasan Parthasarathy. 2013. Efficient community detection in large networks using content and links. In WWW . 1089--1098.

[28]

Jürgen Schmidhuber. 2015. Deep learning in neural networks: An overview. Neural networks, Vol. 61 (2015), 85--117.

[29]

Richard Socher, Danqi Chen, Christopher D Manning, and Andrew Ng. 2013. Reasoning with neural tensor networks for knowledge base completion. In NIPS . 926--934.

[30]

Jian Tang, Meng Qu, and Qiaozhu Mei. 2015a. Pte: Predictive text embedding through large-scale heterogeneous text networks. In KDD . 1165--1174.

Digital Library

[31]

Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015b. Line: Large-scale information network embedding. WWW. 1067--1077.

Digital Library

[32]

Lei Tang and Huan Liu. 2009. Relational learning via latent social dimensions. KDD. ACM, 817--826.

[33]

Cunchao Tu, Han Liu, Zhiyuan Liu, and Maosong Sun. 2017. Cane: Context-aware network embedding for relation modeling. In ACL, Vol. 1. 1722--1731.

[34]

Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2018. Graph attention networks. In ICLR .

[35]

Petar Velivc ković, William Fedus, William L Hamilton, Pietro Liò, Yoshua Bengio, and R Devon Hjelm. 2019. Deep graph infomax. In ICLR .

[36]

Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. 2008. Extracting and composing robust features with denoising autoencoders. In ICML . 1096--1103.

[37]

Chi Wang, Jiawei Han, Yuntao Jia, Jie Tang, Duo Zhang, Yintao Yu, and Jingyi Guo. 2010. Mining advisor-advisee relationships from research publication networks. In KDD . 203--212.

[38]

Chenguang Wang, Yangqiu Song, Dan Roth, Chi Wang, Jiawei Han, Heng Ji, and Ming Zhang. 2015a. Constrained Information-Theoretic Tripartite Graph Clustering to Identify Semantically Similar Relations. In IJCAI. 3882--3889.

[39]

Jia Wang, Vincent W Zheng, Zemin Liu, and Kevin Chen-Chuan Chang. 2017. Topological recurrent neural network for diffusion prediction. In ICDM. 475--484.

[40]

Quan Wang, Bin Wang, Li Guo, and others. 2015b. Knowledge Base Completion Using Embeddings and Rules. In IJCAI. 1859--1866.

[41]

Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge graph and text jointly embedding. In EMNLP. 1591--1601.

[42]

Keyulu Xu, Chengtao Li, Yonglong Tian, Tomohiro Sonobe, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2018. Representation Learning on Graphs with Jumping Knowledge Networks. In ICML .

[43]

Carl Yang and Kevin Chang. 2019. Relationship Profiling over Social Networks: Reverse Smoothness from Similarity to Closeness. In SDM. 342--350.

[44]

Carl Yang, Mengxiong Liu, Frank He, Xikun Zhang, Jian Peng, and Jiawei Han. 2018. Similarity Modeling on Heterogeneous Networks via Automatic Path Discovery. In ECML-PKDD .

[45]

Cheng Yang, Zhiyuan Liu, Deli Zhao, Maosong Sun, and Edward Y Chang. 2015. Network Representation Learning with Rich Text Information. In IJCAI . 2111--2117.

[46]

Carl Yang, Xiaolin Shi, Luo Jie, and Jiawei Han. 2018. I Know You'll Be Back: Interpretable New User Clustering and Churn Prediction on a Mobile Social Application. In KDD .

[47]

Carl Yang, Dai Teng, Siyang Liu, Sayantani Basu, Jieyu Zhang, Jiaming Shen, Chao Zhang, Jingbo Shang, Lance Kaplan, Timothy Harratty, and others. 2019 a. Cubenet: Multi-facet hierarchical heterogeneous network construction, analysis, and mining. In KDD demo .

[48]

Carl Yang, Jieyu Zhang, and Jiawei Han. 2019 b. Neural Embedding Propagation on Heterogeneous Networks. In ICDM .

[49]

Carl Yang, Lin Zhong, Li-Jia Li, and Luo Jie. 2017. Bi-directional joint inference for user links and attributes on large social graphs. In WWW .

[50]

Carl Yang, Peiye Zhuang, Wenhan Shi, Alan Luu, and Pan Li. 2019. Conditional Structure Generation through Graph Variational Generative Adversarial Nets. In NeurIPS .

[51]

Jaewon Yang, Julian McAuley, and Jure Leskovec. 2013. Community detection in networks with node attributes. In ICDM. 1151--1156.

[52]

Tianbao Yang, Rong Jin, Yun Chi, and Shenghuo Zhu. 2009. Combining link and content for community detection: a discriminative approach. In KDD . 927--936.

[53]

Zhilin Yang, William Cohen, and Ruslan Salakhutdinov. 2016. Revisiting semi-supervised learning with graph embeddings. In ICML .

[54]

Zhitao Ying, Jiaxuan You, Christopher Morris, Xiang Ren, Will Hamilton, and Jure Leskovec. 2018. Hierarchical graph representation learning with differentiable pooling. In NIPS . 4805--4815.

[55]

Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, and Jun Zhao. 2014. Relation classification via convolutional deep neural network. In COLING . 2335--2344.

Cited By

Chen XLei PSheng YLiu YGong ZSerra ESpezzano F(2024)Social Influence Learning for Recommendation SystemsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679598(312-322)Online publication date: 21-Oct-2024
https://dl.acm.org/doi/10.1145/3627673.3679598
Yang YSun YWang SGao JJu FYin B(2024)A Dual-Masked Deep Structural Clustering Network With Adaptive Bidirectional Information DeliveryIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.328157035:10(14783-14796)Online publication date: Oct-2024
https://doi.org/10.1109/TNNLS.2023.3281570
Yang JYang LWang HGao Y(2024)Temporal Interaction Embedding for Link Prediction in Global News Event GraphIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.335769611:4(5327-5336)Online publication date: Aug-2024
https://doi.org/10.1109/TCSS.2024.3357696
Show More Cited By

Index Terms

Relation Learning on Social Networks with Multi-Modal Graph Edge Variational Autoencoders

Recommendations

Quantifying triadic closure in multi-edge social networks
ASONAM '19: Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining

In social networks, edges often form closed triangles or triads. Standard approaches to measuring triadic closure, however, fail for multi-edge networks, because they do not consider that triads can be formed by edges of different multiplicity. We ...
Building social capital with Facebook: Type of network, availability of other media, and social self-efficacy matter^#
Highlights
- Type of friends affects building social capital via Facebook and traditional media.
Abstract
Findings about Facebook's effect on relationships are mixed, possibly due to lack of models that acknowledge differences across users, types of their friends, and use of competing media. To address this, we proposed and tested how ...
Meta-Path Based Social Relation Reasoning in a Deep and Robust Way
Database Systems for Advanced Applications
Abstract
Social relation reasoning in heterogeneous social networks (HSNs) should not only infer whether people are connected, but also why they know each other and what their relationship is. This task is challenging because the heterogeneous social ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WSDM '20: Proceedings of the 13th International Conference on Web Search and Data Mining

January 2020

950 pages

ISBN:9781450368223

DOI:10.1145/3336191

General Chairs:
James Caverlee
Texas A&M University
,
Xia "Ben" Hu
Texas A&M University
,
Program Chairs:
Mounia Lalmas
Spotify
,
Wei Wang
University of California, Los Angeles

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 January 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

WSDM '20

Sponsor:

WSDM '20: The Thirteenth ACM International Conference on Web Search and Data Mining

February 3 - 7, 2020

TX, Houston, USA

Acceptance Rates

Overall Acceptance Rate 498 of 2,863 submissions, 17%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
1,314
Total Downloads

Downloads (Last 12 months)247
Downloads (Last 6 weeks)31

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen XLei PSheng YLiu YGong ZSerra ESpezzano F(2024)Social Influence Learning for Recommendation SystemsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679598(312-322)Online publication date: 21-Oct-2024
https://dl.acm.org/doi/10.1145/3627673.3679598
Yang YSun YWang SGao JJu FYin B(2024)A Dual-Masked Deep Structural Clustering Network With Adaptive Bidirectional Information DeliveryIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.328157035:10(14783-14796)Online publication date: Oct-2024
https://doi.org/10.1109/TNNLS.2023.3281570
Yang JYang LWang HGao Y(2024)Temporal Interaction Embedding for Link Prediction in Global News Event GraphIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.335769611:4(5327-5336)Online publication date: Aug-2024
https://doi.org/10.1109/TCSS.2024.3357696
Zhao WXu GWang LCui ZZhang TYang J(2024)Intra-Inter Graph Representation Learning for Protein-Protein Binding Sites PredictionIEEE/ACM Transactions on Computational Biology and Bioinformatics10.1109/TCBB.2024.341634121:6(1685-1696)Online publication date: Nov-2024
https://doi.org/10.1109/TCBB.2024.3416341
Li NGuo BLiu YYu Z(2024)Disentangled-feature and composite-prior VAE on social recommendation for new usersExpert Systems with Applications10.1016/j.eswa.2024.123309247(123309)Online publication date: Aug-2024
https://doi.org/10.1016/j.eswa.2024.123309
Shin SShomorony IZhao HOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)Efficient learning of linear graph neural networks via node subsamplingProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3668544(55479-55501)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3668544
Tan YZhou ZLv HLiu WYang COh ANaumann TGloberson ASaenko KHardt MLevine S(2023)WalkLMProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3666706(13308-13325)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3666706
Lu HDeng XLu J(2023)Research on Efficient Multi-Behavior Recommendation Method Fused with Graph Neural NetworkElectronics10.3390/electronics1209210612:9(2106)Online publication date: 4-May-2023
https://doi.org/10.3390/electronics12092106
Wu LZhao HLi ZHuang ZLiu QChen E(2023)Learning the Explainable Semantic Relations via Unified Graph Topic-Disentangled Neural NetworksACM Transactions on Knowledge Discovery from Data10.1145/358996417:8(1-23)Online publication date: 12-May-2023
https://dl.acm.org/doi/10.1145/3589964
Bai QNie CZhang HZhao DYuan X(2023)HGWaveNet: A Hyperbolic Graph Neural Network for Temporal Link PredictionProceedings of the ACM Web Conference 202310.1145/3543507.3583455(523-532)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543507.3583455
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents