Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

A Joint Entity and Relation Extraction Model based on Efficient Sampling and Explicit Interaction

Published: 11 August 2023 Publication History

Abstract

Joint entity and relation extraction (RE) construct a framework for unifying entity recognition and relationship extraction, and the approach can exploit the dependencies between the two tasks to improve the performance of the task. However, the existing tasks still have the following two problems. First, when the model extracts entity information, the boundary is blurred. Secondly, there are mostly implicit interactions between modules, that is, the interactive information is hidden inside the model, and the implicit interactions are often insufficient in the degree of interaction and lack of interpretability. To this end, this study proposes a joint entity and relation extraction model (ESEI) based on Efficient Sampling and Explicit Interaction. We innovatively divide negative samples into sentences based on whether they overlap with positive samples, which improves the model’s ability to extract entity word boundary information by controlling the sampling ratio. In order to increase the explicit interaction ability between the models, we introduce a heterogeneous graph neural network (GNN) into the model, which will serve as a bridge linking the entity recognition module and the relation extraction module, and enhance the interaction between the modules through information transfer. Our method substantially improves the model’s discriminative power on entity extraction tasks and enhances the interaction between relation extraction tasks and entity extraction tasks. Experiments show that the method is effective, we validate our method on four datasets, and for joint entity and relation extraction, our model improves the F1 score on multiple datasets.

References

[1]
Elisa Bassignana and Barbara Plank. 2022. CrossRE: A Cross-domain dataset for relation extraction. In Findings of the Association for Computational Linguistics: (EMNLP’22), Association for Computational Linguistics, Abu Dhabi, United Arab Emirates, 3592–3604. Retrieved from https://aclanthology.org/2022.findings-emnlp.263
[2]
Giannis Bekoulis, Johannes Deleu, Thomas Demeester, and Chris Develder. 2018. Adversarial training for multi-context joint entity and relation extraction. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics. Brussels, Belgium, 2830–2836. DOI:
[3]
Giannis Bekoulis, Johannes Deleu, Thomas Demeester, and Chris Develder. 2018. Joint entity recognition and relation extraction as a multi-head selection problem. Expert Systems with Applications 114, (2018), 34–45. DOI:
[4]
Iz Beltagy, Kyle Lo, and Arman Cohan. 2019. SciBERT: A Pretrained Language Model for Scientific Text. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP’19), Association for Computational Linguistics, Hong Kong, 3615–3620. DOI:
[5]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Association for Computational Linguistics, Minneapolis, 4171–4186. DOI:
[6]
Markus Eberts and Adrian Ulges. 2020. Span-based joint entity and relation extraction with transformer pre-training. In Proceedings of the 24th European Conference on Artificial Intelligence.
[7]
Victor Garcia Satorras and Joan Bruna Estrach. 2018. Few-shot learning with graph neural networks. In International Conference on Learning Representations. Retrieved from https://openreview.net/forum?id=BJj6qGbRW
[8]
Pankaj Gupta, Hinrich Schütze, and Bernt Andrassy. 2016. Table filling multi-task recurrent neural network for joint entity and relation extraction. In Proceedings of the COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. 2537–2547.
[9]
Harsha Gurulingappa, Abdul Mateen Rajput, Angus Roberts, Juliane Fluck, Martin Hofmann-Apitius, and Luca Toldo. 2012. Development of a benchmark corpus to support the automatic extraction of drug-related adverse effects from medical case reports. Journal of Biomedical Informatics 45, 5 (2012), 885–892.
[10]
Luheng He, Kenton Lee, Omer Levy, and Luke Zettlemoyer. 2018. Jointly predicting predicates and arguments in neural semantic role labeling. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Association for Computational Linguistics, Melbourne, 364–369. DOI:
[11]
Bo Jiang and Jia Cao. 2023. Joint extraction of entities and relations via entity and relation heterogeneous graph attention networks. Applied Sciences 13, 2 (2023), 842.
[12]
Arzoo Katiyar and Claire Cardie. 2017. Going out on a limb: Joint extraction of entity mentions and relations without dependency trees. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. 917–928.
[13]
Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, Donghyeon Kim, Sunkyu Kim, Chan Ho So, and Jaewoo Kang. 2020. BioBERT: A pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36, 4 (2020), 1234–1240.
[14]
Kenton Lee, Luheng He, Mike Lewis, and Luke Zettlemoyer. 2017. End-to-end neural coreference resolution. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Copenhagen, 188–197. DOI:
[15]
Kenton Lee, Luheng He, and Luke Zettlemoyer. 2018. Higher-order coreference resolution with coarse-to-fine inference. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), Association for Computational Linguistics, New Orleans, 687–692. DOI:
[16]
Qi Li and Heng Ji. 2014. Incremental joint extraction of entity mentions and relations. In Proceedings of the ACL. 402–412.
[17]
Xiaoya Li, Fan Yin, Zijun Sun, Xiayu Li, Arianna Yuan, Duo Chai, Mingxin Zhou, and Jiwei Li. 2019. Entity-relation extraction as multi-turn question answering. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Florence, 1340–1350. DOI:
[18]
Yi Luan, Luheng He, Mari Ostendorf, and Hannaneh Hajishirzi. 2018. Multi-task identification of entities, relations, and coreference for scientific knowledge graph construction. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Brussels, 3219–3232. DOI:
[19]
Makoto Miwa and Mohit Bansal. 2016. End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics, Berlin, 1105–1116. DOI:
[20]
Makoto Miwa and Yutaka Sasaki. 2014. Modeling joint entity and relation extraction with table representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP’14), Association for Computational Linguistics, Doha, 1858–1869. DOI:
[21]
Hiroki Ouchi, Hiroyuki Shindo, and Yuji Matsumoto. 2018. A span selection model for semantic role labeling. arXiv:1810.02245. Retrieved from https://arxiv.org/abs/1810.02245.
[22]
Dan Roth and Wen-tau Yih. 2004. A Linear Programming Formulation for Global Inference in Natural Language Tasks. Technical Report. Illinois Univ at Urbana-Champaign Dept of Computer Science.
[23]
TYSS Santosh, Prantika Chakraborty, Sudakshina Dutta, Debarshi Kumar Sanyal, and Partha Pratim Das. 2021. Joint entity and relation extraction from scientific documents: role of linguistic information and entity types. EEKE@ JCDL 21 (2021), 15–19.
[24]
Richard Socher, Brody Huval, Christopher D. Manning, and Andrew Y. Ng. 2012. Semantic compositionality through recursive matrix-vector spaces. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. 1201–1211.
[25]
Qi Sun, Kun Zhang, Laishui Lv, Xun Li, Kun Huang, and Ting Zhang. 2022. Joint extraction of entities and overlapping relations by improved graph convolutional networks. Applied Intelligence 52, 5 (2022), 5212–5224.
[26]
Ryuichi Takanobu, Tianyang Zhang, Jiexi Liu, and Minlie Huang. 2019. A hierarchical framework for relation extraction with reinforcement learning. In Proceedings of the AAAI Conference on Artificial Intelligence. 7072–7079.
[27]
Tung Tran and Ramakanth Kavuluru. 2019. Neural metric learning for fast end-to-end relation extraction. arXiv:1905.07458. Retrieved from https://arxiv.org/abs/1905.07458.
[28]
Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018. Graph Attention Networks. In International Conference on Learning Representations. Retrieved from https://openreview.net/forum?id=rJXMpikCZ
[29]
David Wadden, Ulme Wennberg, Yi Luan, and Hannaneh Hajishirzi. 2019. Entity, Relation, and Event Extraction with Contextualized Span Representations. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP’19), Association for Computational Linguistics, Hong Kong, 5784–5789. DOI:
[30]
Qian Wan, Luona Wei, Xinhai Chen, and Jie Liu. 2022. Modeling full information with graph network for joint entity-relation extraction. In Proceedings of the 2021 4th International Conference on Algorithms, Computing, and Artificial Intelligence (ACAI’21). Association for Computing Machinery, 8 pages. DOI:
[31]
Shaolei Wang, Yue Zhang, Wanxiang Che, and Ting Liu. 2018. Joint extraction of entities and relations based on a novel graph scheme. In Proceedings of the IJCAI. Yokohama, 4461–4467.
[32]
Yuxiang Xie, Hua Xu, Jiaoe Li, Congcong Yang, and Kai Gao. 2020. Heterogeneous graph neural networks for noisy few-shot relation classification. Knowledge-Based Systems 194, (2020), 105548. DOI:
[33]
Li Yuan, Yi Cai, Jin Wang, and Qing Li. 2023. Joint multimodal entity-relation extraction based on edge-enhanced graph alignment network and word-pair relation tagging. In Proceedings of the AAAI Conference on Artificial Intelligence.
[34]
Dongxu Zhang and Dong Wang. 2015. Relation Classification via Recurrent Neural Network. Computer Science (2015).
[35]
Kang Zhao, Hua Xu, Yue Cheng, Xiaoteng Li, and Kai Gao. 2021. Representation iterative fusion based on heterogeneous graph neural network for joint entity and relation extraction. Knowledge-Based Systems 219 (2021), 106888. DOI:
[36]
Tianyang Zhao, Zhao Yan, Yunbo Cao, and Zhoujun Li. 2021. Asking effective and diverse questions: A machine reading comprehension based framework for joint entity-relation extraction. In Proceedings of the 29th International Conference on International Joint Conferences on Artificial Intelligence. 3948–3954.
[37]
Zexuan Zhong and Danqi Chen. 2021. A frustratingly easy approach for entity and relation extraction. In Proceedings of the 2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics(NAACL2021).
[38]
Peng Zhou, Suncong Zheng, Jiaming Xu, Zhenyu Qi, Hongyun Bao, and Bo Xu. 2017. Joint extraction of multiple relations and entities by using a hybrid neural network. In Proceedings of the Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data. Springer, 135–146.

Cited By

View all
  • (2024)A Novel Framework for Joint Learning of City Region Partition and RepresentationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365285720:7(1-23)Online publication date: 16-May-2024
  • (2024)SiG: A Siamese-Based Graph Convolutional Network to Align Knowledge in Autonomous Transportation SystemsACM Transactions on Intelligent Systems and Technology10.1145/364386115:2(1-20)Online publication date: 28-Mar-2024
  • (2024)Sequential Recommendation with Collaborative Explanation via Mutual Information MaximizationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657770(1062-1072)Online publication date: 10-Jul-2024
  • Show More Cited By

Index Terms

  1. A Joint Entity and Relation Extraction Model based on Efficient Sampling and Explicit Interaction

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Intelligent Systems and Technology
    ACM Transactions on Intelligent Systems and Technology  Volume 14, Issue 5
    October 2023
    472 pages
    ISSN:2157-6904
    EISSN:2157-6912
    DOI:10.1145/3615589
    • Editor:
    • Huan Liu
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 August 2023
    Online AM: 17 June 2023
    Accepted: 28 May 2023
    Revised: 14 May 2023
    Received: 11 December 2022
    Published in TIST Volume 14, Issue 5

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Efficient Sampling
    2. Explicit Interaction
    3. entity recognition
    4. relation extraction

    Qualifiers

    • Research-article

    Funding Sources

    • Project of China National Intellectual Property Administration
    • National Key R&D Program of China

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)337
    • Downloads (Last 6 weeks)22
    Reflects downloads up to 03 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A Novel Framework for Joint Learning of City Region Partition and RepresentationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365285720:7(1-23)Online publication date: 16-May-2024
    • (2024)SiG: A Siamese-Based Graph Convolutional Network to Align Knowledge in Autonomous Transportation SystemsACM Transactions on Intelligent Systems and Technology10.1145/364386115:2(1-20)Online publication date: 28-Mar-2024
    • (2024)Sequential Recommendation with Collaborative Explanation via Mutual Information MaximizationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657770(1062-1072)Online publication date: 10-Jul-2024
    • (2024)A Decoupling and Aggregating Framework for Joint Extraction of Entities and RelationsIEEE Access10.1109/ACCESS.2024.342087712(103313-103328)Online publication date: 2024
    • (2024)BAMRE: Joint extraction model of Chinese medical entities and relations based on Biaffine transformation with relation attentionJournal of Biomedical Informatics10.1016/j.jbi.2024.104733158(104733)Online publication date: Oct-2024
    • (2023)Triple Dual Learning for Opinion-based Explainable RecommendationACM Transactions on Information Systems10.1145/363152142:3(1-27)Online publication date: 30-Dec-2023
    • (2023)MHANER: A Multi-source Heterogeneous Graph Attention Network for Explainable Recommendation in Online GamesACM Transactions on Intelligent Systems and Technology10.1145/3626243Online publication date: 9-Oct-2023
    • (2023)A Novel Joint Extraction Model for Entity Relations Using Interactive Encoding and Visual AttentionIEEE Access10.1109/ACCESS.2023.333562311(132567-132575)Online publication date: 2023
    • (undefined)Mobile User Traffic Generation via Multi-Scale Hierarchical GANACM Transactions on Knowledge Discovery from Data10.1145/3664655

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media