Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3477495.3531836acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper

AHP: Learning to Negative Sample for Hyperedge Prediction

Published: 07 July 2022 Publication History

Abstract

Hypergraphs (i.e., sets of hyperedges) naturally represent group relations (e.g., researchers co-authoring a paper and ingredients used together in a recipe), each of which corresponds to a hyperedge (i.e., a subset of nodes). Predicting future or missing hyperedges bears significant implications for many applications (e.g., collaboration and recipe recommendation). What makes hyperedge prediction particularly challenging is the vast number of non-hyperedge subsets, which grows exponentially with the number of nodes. Since it is prohibitive to use all of them as negative examples for model training, it is inevitable to sample a very small portion of them, and to this end, heuristic sampling schemes have been employed. However, trained models suffer from poor generalization capability for examples of different natures. In this paper, we propose AHP, an adversarial training-based hyperedge-prediction method. It learns to sample negative examples without relying on any heuristic schemes. Using six real hypergraphs, we show that AHP generalizes better to negative examples of various natures. It yields up to 28.2% higher AUROC than the best existing methods and often even outperforms its variants with sampling schemes tailored to test sets.

Supplementary Material

MP4 File (SIGIR-sp1681.mp4)
A hypergraph is a general form of the graph, which can represent the group interactions among the multiple nodes, e.g., researchers co-authoring a paper and ingredients used together in a recipe. Along with its high expressive power, hypergraph suffers from an exponential number of non-hyperedge subsets. In practice, this is bypassed by adopting heuristic sampling rules. In our work, we show that previous heuristic sampling rules lead to poor generalization ability. To this end, we propose AHP, an adversarial training-based hyperedge-prediction method that learns to negative sample that successfully replace the heuristic rules. Using six real hypergraphs, we show that AHP generalizes better to negative examples of various natures. It yields up to 28.2% higher AUROC than best existing methods and often even outperforms its variants with sampling schemes tailored to test sets.

References

[1]
Ilya Amburg, Nate Veldt, and Austin Benson. 2020. Clustering in graphs and hypergraphs with categorical edge labels. In WWW.
[2]
Martin Arjovsky and Léon Bottou. 2017. Towards principled methods for training generative adversarial networks. In ICLR.
[3]
Martin Arjovsky, Soumith Chintala, and Léon Bottou. 2017. Wasserstein generative adversarial networks. In ICML.
[4]
Austin R Benson, Rediet Abebe, Michael T Schaub, Ali Jadbabaie, and Jon Kleinberg. 2018. Simplicial closure and higher-order link prediction. PNAS 115, 48 (2018), E11221--E11230.
[5]
Austin R Benson, Ravi Kumar, and Andrew Tomkins. 2018. Sequences of sets. In KDD.
[6]
Minyoung Choe, Jaemin Yoo, Geon Lee, Woonsung Baek, U Kang, and Kijung Shin. 2022. MiDaS: Representative Sampling from Real-world Hypergraphs. In WWW.
[7]
Hyunjin Choo and Kijung Shin. 2022. On the Persistence of Higher-Order Interactions in Real-World Hypergraphs. In SDM.
[8]
Cazamere Comrie and Jon Kleinberg. 2021. Hypergraph Ego-networks and Their Temporal Evolution. In ICDM.
[9]
Manh Tuan Do, Se-eun Yoon, Bryan Hooi, and Kijung Shin. 2020. Structural patterns and generative models of real-world hypergraphs. In KDD.
[10]
Yihe Dong, Will Sawin, and Yoshua Bengio. 2020. HNHN: Hypergraph networks with hyperedge neurons. arXiv preprint arXiv:2006.12278 (2020).
[11]
Yifan Feng, Haoxuan You, Zizhao Zhang, Rongrong Ji, and Yue Gao. 2019. Hypergraph neural networks. In AAAI.
[12]
Li He, Hongxu Chen, Dingxian Wang, Shoaib Jameel, Philip Yu, and Guandong Xu. 2021. Click-Through Rate Prediction with Multi-Modal Hypergraphs. In CIKM.
[13]
Ming Hou, Brahim Chaib-draa, Chao Li, and Qibin Zhao. 2018. Generative Adversarial Positive-Unlabelled Learning. In IJCAI.
[14]
Wenpeng Hu, Ran Le, Bing Liu, Feng Ji, Jinwen Ma, Dongyan Zhao, and Rui Yan. 2021. Predictive Adversarial Learning from Positive and Unlabeled Data. In AAAI.
[15]
Leo Katz. 1953. A new status index derived from sociometric analysis. Psychometrika 18, 1 (1953), 39--43.
[16]
Thomas N Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In ICLR.
[17]
Ryuichi Kiryo, Gang Niu, Marthinus C Du Plessis, and Masashi Sugiyama. 2017. Positive-unlabeled learning with non-negative risk estimator. In NIPS.
[18]
Yunbum Kook, Jihoon Ko, and Kijung Shin. 2020. Evolution of Real-world Hypergraphs: Patterns and Models without Oracles. In ICDM.
[19]
Geon Lee, Minyoung Choe, and Kijung Shin. 2021. How Do Hyperedges Overlap in Real-World Hypergraphs? - Patterns, Measures, and Generators. In WWW.
[20]
Geon Lee, Jihoon Ko, and Kijung Shin. 2020. Hypergraph Motifs: Concepts, Algorithms, and Discoveries. PVLDB 13, 11 (2020).
[21]
Geon Lee and Kijung Shin. 2021. THyMe+: Temporal Hypergraph Motifs and Fast Algorithms for Exact Counting. In ICDM.
[22]
Yicong Li, Hongxu Chen, Xiangguo Sun, Zhenchao Sun, Lin Li, Lizhen Cui, Philip S Yu, and Guandong Xu. 2021. Hyperbolic hypergraphs for sequential recommendation. In CIKM.
[23]
David Liben-Nowell and Jon Kleinberg. 2007. The link-prediction problem for social networks. JASIST 58, 7 (2007), 1019--1031.
[24]
Zheng Liu, Xing Xie, and Lei Chen. 2018. Context-aware academic collaborator recommendation. In KDD.
[25]
Byeonghu Na, Hyemi Kim, Kyungwoo Song, Weonyoung Joo, Yoon-Yeong Kim, and Il-Chul Moon. 2020. Deep generative positive-unlabeled learning under selection bias. In CIKM.
[26]
Duc Anh Nguyen, Canh Hao Nguyen, and Hiroshi Mamitsuka. 2021. CentSmoothie: Central-Smoothing Hypergraph Neural Networks for Predicting Drug-Drug Interactions. arXiv preprint arXiv:2112.07837 (2021).
[27]
Prasanna Patil, Govind Sharma, and M Narasimha Murty. 2020. Negative sampling for hyperlink prediction in networks. In PAKDD.
[28]
Kevin Roth, Aurelien Lucchi, Sebastian Nowozin, and Thomas Hofmann. 2017. Stabilizing training of Generative Adversarial Networks through regularization. In NIPS.
[29]
Hoang Thanh-Tung, Svetha Venkatesh, and Truyen Tran. 2019. Improving generalization and stability of generative adversarial networks. In ICLR.
[30]
Thonet Thibaut, Renders Jean-Michel, Choi Mario, and Kim Jinho. 2022. Joint Personalized Search and Recommendation with Hypergraph Convolutional Networks. In ECIR.
[31]
Leo Torres, Ann S Blevins, Danielle Bassett, and Tina Eliassi-Rad. 2021. The why, how, and when of representations for complex systems. SIAM Rev. 63, 3 (2021), 435--485.
[32]
Ke Tu, Peng Cui, Xiao Wang, Fei Wang, and Wenwu Zhu. 2018. Structural deep embedding for hyper-networks. In AAAI.
[33]
Maria Vaida and Kevin Purcell. 2019. Hypergraph link prediction: learning drug interaction networks embeddings. In ICMLA.
[34]
Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. 2015. Pointer networks. In NIPS.
[35]
Jianling Wang, Kaize Ding, Liangjie Hong, Huan Liu, and James Caverlee. 2020. Next-item recommendation with sequential hypergraphs. In SIGIR.
[36]
Man Wu, Shirui Pan, Lan Du, Ivor Tsang, Xingquan Zhu, and Bo Du. 2019. Longshort distance aggregation networks for positive unlabeled graph learning. In CIKM.
[37]
Naganand Yadati, Madhav Nimishakavi, Prateek Yadav, Vikram Nitin, Anand Louis, and Partha Talukdar. 2019. HyperGCN: A New Method For Training Graph Convolutional Networks on Hypergraphs. In NeurIPS.
[38]
Naganand Yadati, Vikram Nitin, Madhav Nimishakavi, Prateek Yadav, Anand Louis, and Partha Talukdar. 2020. NHP: Neural Hypergraph Link Prediction. In CIKM.
[39]
Se-eun Yoon, Hyungseok Song, Kijung Shin, and Yung Yi. 2020. How Much and When Do We Need Higher-order Information in Hypergraphs? A Case Study on Hyperedge Prediction. In WWW.
[40]
Chia-An Yu, Ching-Lun Tai, Tak-Shing Chan, and Yi-Hsuan Yang. 2018. Modeling multi-way relations with hypergraph embedding. In CIKM.
[41]
Junwei Zhang, Min Gao, Junliang Yu, Lei Guo, Jundong Li, and Hongzhi Yin. 2021. Double-Scale Self-Supervised Hypergraph Learning for Group Recommendation. In CIKM.
[42]
Muhan Zhang, Zhicheng Cui, Shali Jiang, and Yixin Chen. 2018. Beyond link prediction: Predicting hyperlinks in adjacency space. In AAAI.
[43]
Ruochi Zhang, Yuesong Zou, and Jian Ma. 2020. Hyper-SAGNN: a self-attention based graph neural network for hypergraphs. In ICLR.
[44]
Yao Zhou, Jianpeng Xu, Jun Wu, Zeinab Taghavi, Evren Korpeoglu, Kannan Achan, and Jingrui He. 2021. PURE: Positive-Unlabeled Recommendation with Generative Adversarial Network. In KDD.

Cited By

View all
  • (2024)A Survey on Hypergraph Neural Networks: An In-Depth and Step-By-Step GuideProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671457(6534-6544)Online publication date: 25-Aug-2024
  • (2024)VilLain: Self-Supervised Learning on Homogeneous Hypergraphs without Features via Virtual Label PropagationProceedings of the ACM Web Conference 202410.1145/3589334.3645454(594-605)Online publication date: 13-May-2024
  • (2024)Simplex Pattern Prediction Based on Dynamic Higher Order Path Convolutional NetworksIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.340821411:5(6623-6636)Online publication date: Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2022
3569 pages
ISBN:9781450387323
DOI:10.1145/3477495
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. adversarial training
  2. hyperedge prediction
  3. hypergraph
  4. link prediction
  5. recommendation

Qualifiers

  • Short-paper

Funding Sources

  • Institute for Information & Communication Technology Planning & Evaluation
  • National Research Foundation of Korea

Conference

SIGIR '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)103
  • Downloads (Last 6 weeks)11
Reflects downloads up to 15 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)A Survey on Hypergraph Neural Networks: An In-Depth and Step-By-Step GuideProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671457(6534-6544)Online publication date: 25-Aug-2024
  • (2024)VilLain: Self-Supervised Learning on Homogeneous Hypergraphs without Features via Virtual Label PropagationProceedings of the ACM Web Conference 202410.1145/3589334.3645454(594-605)Online publication date: 13-May-2024
  • (2024)Simplex Pattern Prediction Based on Dynamic Higher Order Path Convolutional NetworksIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.340821411:5(6623-6636)Online publication date: Oct-2024
  • (2024)Predicting Higher Order Links in Social Interaction NetworksIEEE Transactions on Computational Social Systems10.1109/TCSS.2023.329307511:2(2796-2806)Online publication date: Apr-2024
  • (2024)HyperGCN – a multi-layer multi-exit graph neural network to enhance hyperspectral image classificationInternational Journal of Remote Sensing10.1080/01431161.2024.237050145:14(4848-4882)Online publication date: 5-Jul-2024
  • (2024)Higher-order neurodynamical equation for simplex predictionNeural Networks10.1016/j.neunet.2024.106185173(106185)Online publication date: May-2024
  • (2024)Learning higher-order features for relation prediction in knowledge hypergraphKnowledge-Based Systems10.1016/j.knosys.2024.111510289:COnline publication date: 25-Jun-2024
  • (2023)Disentangling Degree-related Biases and Interest for Out-of-Distribution Generalized Directed Network EmbeddingProceedings of the ACM Web Conference 202310.1145/3543507.3583271(231-239)Online publication date: 30-Apr-2023
  • (2023)Interpretable Subgraph Feature Extraction for Hyperlink Prediction2023 IEEE International Conference on Data Mining (ICDM)10.1109/ICDM58522.2023.00037(279-288)Online publication date: 1-Dec-2023
  • (2023)A Graph Representation Learning Framework Predicting Potential Multivariate InteractionsInternational Journal of Computational Intelligence Systems10.1007/s44196-023-00329-z16:1Online publication date: 5-Sep-2023
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media