Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3477495.3531836acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper

AHP: Learning to Negative Sample for Hyperedge Prediction

Published: 07 July 2022 Publication History
  • Get Citation Alerts
  • Abstract

    Hypergraphs (i.e., sets of hyperedges) naturally represent group relations (e.g., researchers co-authoring a paper and ingredients used together in a recipe), each of which corresponds to a hyperedge (i.e., a subset of nodes). Predicting future or missing hyperedges bears significant implications for many applications (e.g., collaboration and recipe recommendation). What makes hyperedge prediction particularly challenging is the vast number of non-hyperedge subsets, which grows exponentially with the number of nodes. Since it is prohibitive to use all of them as negative examples for model training, it is inevitable to sample a very small portion of them, and to this end, heuristic sampling schemes have been employed. However, trained models suffer from poor generalization capability for examples of different natures. In this paper, we propose AHP, an adversarial training-based hyperedge-prediction method. It learns to sample negative examples without relying on any heuristic schemes. Using six real hypergraphs, we show that AHP generalizes better to negative examples of various natures. It yields up to 28.2% higher AUROC than the best existing methods and often even outperforms its variants with sampling schemes tailored to test sets.

    Supplementary Material

    MP4 File (SIGIR-sp1681.mp4)
    A hypergraph is a general form of the graph, which can represent the group interactions among the multiple nodes, e.g., researchers co-authoring a paper and ingredients used together in a recipe. Along with its high expressive power, hypergraph suffers from an exponential number of non-hyperedge subsets. In practice, this is bypassed by adopting heuristic sampling rules. In our work, we show that previous heuristic sampling rules lead to poor generalization ability. To this end, we propose AHP, an adversarial training-based hyperedge-prediction method that learns to negative sample that successfully replace the heuristic rules. Using six real hypergraphs, we show that AHP generalizes better to negative examples of various natures. It yields up to 28.2% higher AUROC than best existing methods and often even outperforms its variants with sampling schemes tailored to test sets.

    References

    [1]
    Ilya Amburg, Nate Veldt, and Austin Benson. 2020. Clustering in graphs and hypergraphs with categorical edge labels. In WWW.
    [2]
    Martin Arjovsky and Léon Bottou. 2017. Towards principled methods for training generative adversarial networks. In ICLR.
    [3]
    Martin Arjovsky, Soumith Chintala, and Léon Bottou. 2017. Wasserstein generative adversarial networks. In ICML.
    [4]
    Austin R Benson, Rediet Abebe, Michael T Schaub, Ali Jadbabaie, and Jon Kleinberg. 2018. Simplicial closure and higher-order link prediction. PNAS 115, 48 (2018), E11221--E11230.
    [5]
    Austin R Benson, Ravi Kumar, and Andrew Tomkins. 2018. Sequences of sets. In KDD.
    [6]
    Minyoung Choe, Jaemin Yoo, Geon Lee, Woonsung Baek, U Kang, and Kijung Shin. 2022. MiDaS: Representative Sampling from Real-world Hypergraphs. In WWW.
    [7]
    Hyunjin Choo and Kijung Shin. 2022. On the Persistence of Higher-Order Interactions in Real-World Hypergraphs. In SDM.
    [8]
    Cazamere Comrie and Jon Kleinberg. 2021. Hypergraph Ego-networks and Their Temporal Evolution. In ICDM.
    [9]
    Manh Tuan Do, Se-eun Yoon, Bryan Hooi, and Kijung Shin. 2020. Structural patterns and generative models of real-world hypergraphs. In KDD.
    [10]
    Yihe Dong, Will Sawin, and Yoshua Bengio. 2020. HNHN: Hypergraph networks with hyperedge neurons. arXiv preprint arXiv:2006.12278 (2020).
    [11]
    Yifan Feng, Haoxuan You, Zizhao Zhang, Rongrong Ji, and Yue Gao. 2019. Hypergraph neural networks. In AAAI.
    [12]
    Li He, Hongxu Chen, Dingxian Wang, Shoaib Jameel, Philip Yu, and Guandong Xu. 2021. Click-Through Rate Prediction with Multi-Modal Hypergraphs. In CIKM.
    [13]
    Ming Hou, Brahim Chaib-draa, Chao Li, and Qibin Zhao. 2018. Generative Adversarial Positive-Unlabelled Learning. In IJCAI.
    [14]
    Wenpeng Hu, Ran Le, Bing Liu, Feng Ji, Jinwen Ma, Dongyan Zhao, and Rui Yan. 2021. Predictive Adversarial Learning from Positive and Unlabeled Data. In AAAI.
    [15]
    Leo Katz. 1953. A new status index derived from sociometric analysis. Psychometrika 18, 1 (1953), 39--43.
    [16]
    Thomas N Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In ICLR.
    [17]
    Ryuichi Kiryo, Gang Niu, Marthinus C Du Plessis, and Masashi Sugiyama. 2017. Positive-unlabeled learning with non-negative risk estimator. In NIPS.
    [18]
    Yunbum Kook, Jihoon Ko, and Kijung Shin. 2020. Evolution of Real-world Hypergraphs: Patterns and Models without Oracles. In ICDM.
    [19]
    Geon Lee, Minyoung Choe, and Kijung Shin. 2021. How Do Hyperedges Overlap in Real-World Hypergraphs? - Patterns, Measures, and Generators. In WWW.
    [20]
    Geon Lee, Jihoon Ko, and Kijung Shin. 2020. Hypergraph Motifs: Concepts, Algorithms, and Discoveries. PVLDB 13, 11 (2020).
    [21]
    Geon Lee and Kijung Shin. 2021. THyMe+: Temporal Hypergraph Motifs and Fast Algorithms for Exact Counting. In ICDM.
    [22]
    Yicong Li, Hongxu Chen, Xiangguo Sun, Zhenchao Sun, Lin Li, Lizhen Cui, Philip S Yu, and Guandong Xu. 2021. Hyperbolic hypergraphs for sequential recommendation. In CIKM.
    [23]
    David Liben-Nowell and Jon Kleinberg. 2007. The link-prediction problem for social networks. JASIST 58, 7 (2007), 1019--1031.
    [24]
    Zheng Liu, Xing Xie, and Lei Chen. 2018. Context-aware academic collaborator recommendation. In KDD.
    [25]
    Byeonghu Na, Hyemi Kim, Kyungwoo Song, Weonyoung Joo, Yoon-Yeong Kim, and Il-Chul Moon. 2020. Deep generative positive-unlabeled learning under selection bias. In CIKM.
    [26]
    Duc Anh Nguyen, Canh Hao Nguyen, and Hiroshi Mamitsuka. 2021. CentSmoothie: Central-Smoothing Hypergraph Neural Networks for Predicting Drug-Drug Interactions. arXiv preprint arXiv:2112.07837 (2021).
    [27]
    Prasanna Patil, Govind Sharma, and M Narasimha Murty. 2020. Negative sampling for hyperlink prediction in networks. In PAKDD.
    [28]
    Kevin Roth, Aurelien Lucchi, Sebastian Nowozin, and Thomas Hofmann. 2017. Stabilizing training of Generative Adversarial Networks through regularization. In NIPS.
    [29]
    Hoang Thanh-Tung, Svetha Venkatesh, and Truyen Tran. 2019. Improving generalization and stability of generative adversarial networks. In ICLR.
    [30]
    Thonet Thibaut, Renders Jean-Michel, Choi Mario, and Kim Jinho. 2022. Joint Personalized Search and Recommendation with Hypergraph Convolutional Networks. In ECIR.
    [31]
    Leo Torres, Ann S Blevins, Danielle Bassett, and Tina Eliassi-Rad. 2021. The why, how, and when of representations for complex systems. SIAM Rev. 63, 3 (2021), 435--485.
    [32]
    Ke Tu, Peng Cui, Xiao Wang, Fei Wang, and Wenwu Zhu. 2018. Structural deep embedding for hyper-networks. In AAAI.
    [33]
    Maria Vaida and Kevin Purcell. 2019. Hypergraph link prediction: learning drug interaction networks embeddings. In ICMLA.
    [34]
    Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. 2015. Pointer networks. In NIPS.
    [35]
    Jianling Wang, Kaize Ding, Liangjie Hong, Huan Liu, and James Caverlee. 2020. Next-item recommendation with sequential hypergraphs. In SIGIR.
    [36]
    Man Wu, Shirui Pan, Lan Du, Ivor Tsang, Xingquan Zhu, and Bo Du. 2019. Longshort distance aggregation networks for positive unlabeled graph learning. In CIKM.
    [37]
    Naganand Yadati, Madhav Nimishakavi, Prateek Yadav, Vikram Nitin, Anand Louis, and Partha Talukdar. 2019. HyperGCN: A New Method For Training Graph Convolutional Networks on Hypergraphs. In NeurIPS.
    [38]
    Naganand Yadati, Vikram Nitin, Madhav Nimishakavi, Prateek Yadav, Anand Louis, and Partha Talukdar. 2020. NHP: Neural Hypergraph Link Prediction. In CIKM.
    [39]
    Se-eun Yoon, Hyungseok Song, Kijung Shin, and Yung Yi. 2020. How Much and When Do We Need Higher-order Information in Hypergraphs? A Case Study on Hyperedge Prediction. In WWW.
    [40]
    Chia-An Yu, Ching-Lun Tai, Tak-Shing Chan, and Yi-Hsuan Yang. 2018. Modeling multi-way relations with hypergraph embedding. In CIKM.
    [41]
    Junwei Zhang, Min Gao, Junliang Yu, Lei Guo, Jundong Li, and Hongzhi Yin. 2021. Double-Scale Self-Supervised Hypergraph Learning for Group Recommendation. In CIKM.
    [42]
    Muhan Zhang, Zhicheng Cui, Shali Jiang, and Yixin Chen. 2018. Beyond link prediction: Predicting hyperlinks in adjacency space. In AAAI.
    [43]
    Ruochi Zhang, Yuesong Zou, and Jian Ma. 2020. Hyper-SAGNN: a self-attention based graph neural network for hypergraphs. In ICLR.
    [44]
    Yao Zhou, Jianpeng Xu, Jun Wu, Zeinab Taghavi, Evren Korpeoglu, Kannan Achan, and Jingrui He. 2021. PURE: Positive-Unlabeled Recommendation with Generative Adversarial Network. In KDD.

    Cited By

    View all
    • (2024)Predicting Higher Order Links in Social Interaction NetworksIEEE Transactions on Computational Social Systems10.1109/TCSS.2023.329307511:2(2796-2806)Online publication date: Apr-2024
    • (2024)HyperGCN – a multi-layer multi-exit graph neural network to enhance hyperspectral image classificationInternational Journal of Remote Sensing10.1080/01431161.2024.237050145:14(4848-4882)Online publication date: 5-Jul-2024
    • (2024)Higher-order neurodynamical equation for simplex predictionNeural Networks10.1016/j.neunet.2024.106185173(106185)Online publication date: May-2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
    July 2022
    3569 pages
    ISBN:9781450387323
    DOI:10.1145/3477495
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 July 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. adversarial training
    2. hyperedge prediction
    3. hypergraph
    4. link prediction
    5. recommendation

    Qualifiers

    • Short-paper

    Funding Sources

    • Institute for Information & Communication Technology Planning & Evaluation
    • National Research Foundation of Korea

    Conference

    SIGIR '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)104
    • Downloads (Last 6 weeks)10

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Predicting Higher Order Links in Social Interaction NetworksIEEE Transactions on Computational Social Systems10.1109/TCSS.2023.329307511:2(2796-2806)Online publication date: Apr-2024
    • (2024)HyperGCN – a multi-layer multi-exit graph neural network to enhance hyperspectral image classificationInternational Journal of Remote Sensing10.1080/01431161.2024.237050145:14(4848-4882)Online publication date: 5-Jul-2024
    • (2024)Higher-order neurodynamical equation for simplex predictionNeural Networks10.1016/j.neunet.2024.106185173(106185)Online publication date: May-2024
    • (2024)Learning higher-order features for relation prediction in knowledge hypergraphKnowledge-Based Systems10.1016/j.knosys.2024.111510289:COnline publication date: 25-Jun-2024
    • (2023)Disentangling Degree-related Biases and Interest for Out-of-Distribution Generalized Directed Network EmbeddingProceedings of the ACM Web Conference 202310.1145/3543507.3583271(231-239)Online publication date: 30-Apr-2023
    • (2023)Interpretable Subgraph Feature Extraction for Hyperlink Prediction2023 IEEE International Conference on Data Mining (ICDM)10.1109/ICDM58522.2023.00037(279-288)Online publication date: 1-Dec-2023
    • (2023)A Graph Representation Learning Framework Predicting Potential Multivariate InteractionsInternational Journal of Computational Intelligence Systems10.1007/s44196-023-00329-z16:1Online publication date: 5-Sep-2023
    • (2023)Improving the core resilience of real-world hypergraphsData Mining and Knowledge Discovery10.1007/s10618-023-00958-037:6(2438-2493)Online publication date: 9-Aug-2023
    • (2023)Datasets, tasks, and training methods for large-scale hypergraph learningData Mining and Knowledge Discovery10.1007/s10618-023-00952-637:6(2216-2254)Online publication date: 26-Jul-2023

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media