Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Token-Event-Role Structure-Based Multi-Channel Document-Level Event Extraction

Published: 22 March 2024 Publication History
  • Get Citation Alerts
  • Abstract

    Document-level event extraction is a long-standing challenging information retrieval problem involving a sequence of sub-tasks: entity extraction, event type judgment, and event type-specific multi-event extraction. However, addressing the problem as multiple learning tasks leads to increased model complexity. Also, existing methods insufficiently utilize the correlation of entities crossing different events, resulting in limited event extraction performance. This article introduces a novel framework for document-level event extraction, incorporating a new data structure called token-event-role and a multi-channel argument role prediction module. The proposed data structure enables our model to uncover the primary role of tokens in multiple events, facilitating a more comprehensive understanding of event relationships. By leveraging the multi-channel prediction module, we transform entity and multi-event extraction into a single task of predicting token–event pairs, thereby reducing the overall parameter size and enhancing model efficiency. The results demonstrate that our approach outperforms the state-of-the-art method by 9.5 percentage points in terms of the F1 score, highlighting its superior performance in event extraction. Furthermore, an ablation study confirms the significant value of the proposed data structure in improving event extraction tasks, further validating its importance in enhancing the overall performance of the framework.

    References

    [1]
    Wasi Uddin Ahmad, Nanyun Peng, and Kai-Wei Chang. 2021. GATE: Graph attention transformer encoder for cross-lingual relation and event extraction. In Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI). 12462–12470.
    [2]
    Antoine Bosselut, Ronan Le Bras, and Yejin Choi. 2021. Dynamic neuro-symbolic knowledge graph construction for zero-shot commonsense question answering. In Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI). 4923–4931.
    [3]
    Qingqing Cao, Harsh Trivedi, Aruna Balasubramanian, and Niranjan Balasubramanian. 2021. DeFormer: Decomposing pre-trained transformers for faster question answering. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL). 4487–4497.
    [4]
    Yuwei Cao, Hao Peng, Jia Wu, Yingtong Dou, Jianxin Li, and Philip S. Yu. 2021. Knowledge-preserving incremental social event detection via heterogeneous GNNs. In Proceedings of the Web Conference 2021 (WWW). 3383–3395.
    [5]
    Yubo Chen, Liheng Xu, Kang Liu, Daojian Zeng, and Jun Zhao. 2015. Event extraction via dynamic multi-pooling convolutional neural networks. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (ACL-IJCNLP). 167–176.
    [6]
    Yubo Chen, Hang Yang, Kang Liu, Jun Zhao, and Yantao Jia. 2018. Collective event detection via a hierarchical and bias tagging networks with gated multi-level attention mechanisms. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1267–1276.
    [7]
    Dawei Cheng, Fangzhou Yang, Xiaoyang Wang, Ying Zhang, and Liqing Zhang. 2020. Knowledge graph-based event embedding framework for financial quantitative investments. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 2221–2230.
    [8]
    Shiyao Cui, Bowen Yu, Tingwen Liu, Zhenyu Zhang, Xuebin Wang, and Jinqiao Shi. 2020. Edge-enhanced graph convolution networks for event detection with syntactic relation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2329–2339.
    [9]
    Jacob Devlin, Mingwei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT). 4171–4186.
    [10]
    Xinya Du and Claire Cardie. 2020. Document-level event role filler extraction using multi-granularity contextualized encoding. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL). 8010–8020.
    [11]
    Xinya Du and Claire Cardie. 2020. Event extraction by answering (almost) natural questions. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 829–838.
    [12]
    Seth Ebner, Patrick Xia, Ryan Culkin, Kyle Rawlins, and Benjamin Van Durme. 2020. Multi-sentence argument linking. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL). 8057–8077.
    [13]
    Li Gao, Jia Wu, Zhi Qiao, Chuan Zhou, Hong Yang, and Yue Hu. 2016. Collaborative social group influence for event recommendation. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management (CIKM). 1941–1944.
    [14]
    Cuiyun Han, Jinchuan Zhang, Xinyu Li, Guojin Xu, Weihua Peng, and Zengfeng Zeng. 2022. DuEE-Fin: A large-scale dataset for document-level event extraction. In Proceedings of the CCF International Conference on Natural Language Processing and Chinese Computing. 172–183.
    [15]
    Kung-Hsiang Huang, Mu Yang, and Nanyun Peng. 2020. Biomedical event extraction with hierarchical knowledge graphs. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1277–1285.
    [16]
    Yusheng Huang and Weijia Jia. 2021. Exploring sentence community for document-level event extraction. In Findings of the Association for Computational Linguistics: (EMNLP’21). Punta Cana, Dominican Republic. Association for Computational Linguistics, 340–351.
    [17]
    Viet Dac Lai, Minh Van Nguyen, Thien Huu Nguyen, and Franck Dernoncourt. 2021. Graph learning regularization and transfer learning for few-shot event detection. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 2172–2176.
    [18]
    Viet Dac Lai, Tuan Ngo Nguyen, and Thien Huu Nguyen. 2020. Event detection: Gate diversity and syntactic importance scores for graph convolution neural networks. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 5405–5411.
    [19]
    Haochen Li, Tong Mo, Hongcheng Fan, Jingkun Wang, Jiaxi Wang, Fuhao Zhang, and Weiping Li. 2022. KiPT: Knowledge-injected prompt tuning for event detection. In Proceedings of the 29th International Conference on Computational Linguistics (COLING). 1943–1952.
    [20]
    Rui Li, Wenlin Zhao, Cheng Yang, and Sen Su. 2021. Treasures outside contexts: Improving event detection via global statistics. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2625–2635.
    [21]
    Rui Li, Wenlin Zhao, Cheng Yang, and Sen Su. 2022. A dual-expert framework for event argument extraction. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 1110–1121.
    [22]
    Sha Li, Heng Ji, and Jiawei Han. 2021. Document-level event argument extraction by conditional generation. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT). 894–908.
    [23]
    Xin Liang, Dawei Cheng, Fanzhou Yang, Yifeng Luo, Weining Qain, and Aoying Zhou. 2020. F-HMTC: Detecting financial events for investment decisions based on neural hierarchical multi-label text classification. In Proceedings of the 29th International Joint Conference on Artificial Intelligence (IJCAI). 4490–4496.
    [24]
    Yuan Liang, Zhuoxuan Jiang, Di Yin, and Bo Ren. 2022. RAAT: Relation-augmented attention transformer for relation modeling in document-level event extraction. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT). 4985–4997.
    [25]
    Jinzhi Liao, Xiang Zhao, Xinyi Li, Lingling Zhang, and Jiuyang Tang. 2021. Learning discriminative neural representations for event detection. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 644–653.
    [26]
    Yi Liao, Wai Lam, Lidong Bing, and Xin Shen. 2018. Joint modeling of participant influence and latent topics for recommendation in event-based social networks. ACM Transactions on Information Systems (TOIS) 36, 3 (2018), 1–31.
    [27]
    Jiaju Lin, Qin Chen, Jie Zhou, Jian Jin, and Liang He. 2022. CUP: Curriculum learning based prompt tuning for implicit event argument extraction. In Proceedings of the 31st International Joint Conference on Artificial Intelligence (IJCAI). 4245–4251.
    [28]
    Jian Liu, Yubo Chen, Kang Liu, Wei Bi, and Xiaojiang Liu. 2020. Event extraction as machine reading comprehension. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1641–1651.
    [29]
    Jian Liu, Yufeng Chen, and Jinan Xu. 2022. Saliency as evidence: Event detection with trigger saliency attribution. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL). 4573–4585.
    [30]
    Xiao Liu, Zhunchen Luo, and Heyan Huang. 2018. Jointly multiple events extraction via attention-based graph information aggregation. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1247–1256.
    [31]
    Chenwei Lou, Jun Gao, Changlong Yu, Wei Wang, Huan Zhao, Weiwei Tu, and Ruifeng Xu. 2022. Translation-based implicit annotation projection for zero-shot cross-lingual event argument extraction. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 2076–2081.
    [32]
    Yubo Ma, Zehao Wang, Yixin Cao, Mukai Li, Meiqi Chen, Kun Wang, and Jing Shao. 2022. Prompt for extraction? PAIE: Prompting argument interaction for event argument extraction. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL). 6759–6774.
    [33]
    Richard McCreadie, Rodrygo L. T. Santos, Craig Macdonald, and Iadh Ounis. 2018. Explicit diversification of event aspects for temporal summarization. ACM Transactions on Information Systems (TOIS) 36, 3 (2018), 1–31.
    [34]
    Thien Nguyen and Ralph Grishman. 2018. Graph convolutional networks with argument-aware pooling for event detection. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI). 5900–5907.
    [35]
    Thien Huu Nguyen, Kyunghyun Cho, and Ralph Grishman. 2016. Joint event extraction via recurrent neural networks. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT). 300–309.
    [36]
    Lei Sha, Feng Qian, Baobao Chang, and Zhifang Sui. 2018. Jointly extracting event triggers and arguments by dependency-bridge RNN and tensor-based argument interaction. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI). 5916–5923.
    [37]
    Jiawei Sheng, Rui Sun, Shu Guo, Shiyao Cui, Jiangxia Cao, Lihong Wang, Tingwen Liu, and Hongbo Xu. 2022. CorED: Incorporating type-level and instance-level correlations for fine-grained event detection. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 1122–1132.
    [38]
    Meihan Tong, Bin Xu, Shuai Wang, Yixin Cao, Lei Hou, Juanzi Li, and Jun Xie. 2020. Improving event detection via open-domain trigger knowledge. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL). 5887–5897.
    [39]
    Amir Pouran Ben Veyseh, Viet Lai, Franck Dernoncourt, and Thien Huu Nguyen. 2021. Unleash GPT-2 power for event detection. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP). 6271–6282.
    [40]
    Qizhi Wan, Changxuan Wan, Rong Hu, and Dexi Liu. 2021. Chinese financial event extraction based on syntactic and semantic dependency parsing. Chinese Journal of Computer 44, 3 (2021), 508–530.
    [41]
    Qizhi Wan, Changxuan Wan, Keli Xiao, Rong Hu, and Dexi Liu. 2023. A multi-channel hierarchical graph attention network for open event extraction. ACM Transactions on Information Systems (TOIS) 41, 1 (2023), 1–27.
    [42]
    Qizhi Wan, Changxuan Wan, Keli Xiao, Rong Hu, Dexi Liu, and Xiping Liu. 2023. CFERE: Multi-type Chinese financial event relation extraction. Information Sciences 630, C (2023), 119–134.
    [43]
    Qizhi Wan, Changxuan Wan, Keli Xiao, Dexi Liu, Chenliang Li, Bolong Zheng, Xiping Liu, and Rong Hu. 2023. Joint document-level event extraction via token-token bidirectional event completed graph. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. 10481–10492.
    [44]
    Qizhi Wan, Changxuan Wan, Keli Xiao, Dexi Liu, Qing Liu, Jiangling Deng, Wenkang Luo, and Rong Hu. 2022. Construction of a Chinese corpus for multi-type economic event relation. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 21, 6 (2022), 1–20.
    [45]
    Sijia Wang, Mo Yu, and Lifu Huang. 2023. The art of prompting: Event detection based on type specific prompts. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL). 1286–1299.
    [46]
    Runxin Xu, Tianyu Liu, Lei Li, and Baobao Chang. 2021. Document-level event extraction via heterogeneous graph-based interaction model with a tracker. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP). 3533–3546.
    [47]
    Haoran Yan, Xiaolong Jin, Xiangbin Meng, Jiafeng Guo, and Xueqi Cheng. 2019. Event detection with multi-order graph convolution and aggregated attention. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 5765–5769.
    [48]
    Hang Yang, Yubo Chen, Kang Liu, Yang Xiao, and Jun Zhao. 2018. DCFEE: A document-level Chinese financial event extraction system based on automatically labeled training data. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics-System Demonstrations (ACL). 1–6.
    [49]
    Hang Yang, Dianbo Sui, Yubo Chen, Kang Liu, Jun Zhao, and Taifeng Wang. 2021. Document-level event extraction via parallel prediction networks. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP). 6298–6308.
    [50]
    Zhenrui Yue, Huimin Zeng, Mengfei Lan, Heng Ji, and Dong Wang. 2023. Zero-and few-shot event detection via prompt-based meta learning. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL). 7928–7943.
    [51]
    Zhisong Zhang, Xiang Kong, Zhengzhong Liu, Xuezhe Ma, and Eduard Hovy. 2020. A two-step approach for implicit event argument detection. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL). 7479–7485.
    [52]
    Shun Zheng, Wei Cao, Wei Xu, and Jiang Bian. 2019. Doc2EDAG: An end-to-end document-level framework for Chinese financial event extraction. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJNLP). 337–346.
    [53]
    Tong Zhu, Xiaoye Qu, Wenliang Chen, Zhefeng Wang, Baoxing Huai, Nicholas Jing Yuan, and Min Zhang. 2022. Efficient document-level event extraction via pseudo-trigger-aware pruned complete graph. In Proceedings of the 31st International Joint Conference on Artificial Intelligence (IJCAI). 4552–4558.

    Cited By

    View all
    • (2024)Recurrent event query decoder for document-level event extractionEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108533133(108533)Online publication date: Jul-2024

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Information Systems
    ACM Transactions on Information Systems  Volume 42, Issue 4
    July 2024
    751 pages
    ISSN:1046-8188
    EISSN:1558-2868
    DOI:10.1145/3613639
    • Editor:
    • Min Zhang
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 March 2024
    Online AM: 07 February 2024
    Accepted: 20 January 2024
    Revised: 02 December 2023
    Received: 30 July 2023
    Published in TOIS Volume 42, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Document-level event extraction
    2. token-event-role data structure
    3. joint learning
    4. multi-channel
    5. neural network

    Qualifiers

    • Research-article

    Funding Sources

    • National Natural Science Foundation of China
    • Guangzhou-HKUST(GZ) Joint Funding Program
    • Natural Science Foundation of Jiangxi Province
    • Funding Program for Academic and Technical Leaders in Major Disciplines of Jiangxi Province
    • Education Bureau of Guangzhou Municipality
    • Guangdong Science and Technology Department

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)259
    • Downloads (Last 6 weeks)42

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Recurrent event query decoder for document-level event extractionEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108533133(108533)Online publication date: Jul-2024

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media