Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3459104.3459181acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiseeieConference Proceedingsconference-collections
research-article

STC: Stacked Two-stage Convolution for Aspect Term Extraction

Published: 20 July 2021 Publication History

Abstract

Aspect term extraction (ATE) aims to extract aspect terms from reviews as opinion targets for sentiment analysis. Although some of the previous works prove that dependency relationship between aspect terms and context is useful for ATE, they have barely tried to use graph neural networks to capture valuable information in dependency patterns automatically. In this paper, we propose a novel sequence labeling method for ATE, which exploits convolutional neural network (CNN) to capture local information of a sentence, and further aggregate k-order neighbor nodes’ information via graph convolutional network (GCN) over dependency tree. Differently from approaches based on sequential networks like recurrent neural network (RNN), our convolution model can be calculated in parallel, which improves the training and inference speed. Experimental results show that our approach outperforms other baseline methods, which don't rely on pre-trained transformer model.

References

[1]
Shaowei Chen, Jie Liu, Yu Wang, Wenzheng Zhang and Ziming Chi. 2020. Synchronous Double-channel Recurrent Network for Aspect-Opinion Pair Extraction. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.
[2]
Maryna Chernyshevich. 2014. Ihs r&d belarus: Crossdomain extraction of product features using crf. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pages 309– 313.
[3]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
[4]
Ruidan He, Wee Sun Lee, Hwee Tou Ng, and Daniel Dahlmeier. 2019. An interactive multi-task learning network for end-to-end aspect-based sentiment analysis. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. pages 504–515.
[5]
Ruidan He, Wee Sun Lee, Hwee Tou Ng, and Daniel Dahlmeier. 2017. An unsupervised neural attention model for aspect extraction. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. volume 1, pages 388–397.
[6]
Minqing Hu and Bing Liu. 2004. Mining and summarizing customer reviews. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 168–177.
[7]
Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of ICLR.
[8]
Xin Li, Lidong Bing, Piji Li, Wai Lam, and Zhimou Yang. 2018. Aspect term extraction with history attention and selective transformation. In IJCAI. pages 4194–4200.
[9]
Kun Li, Chengbo Chen, Xiaojun Quan, Qing Ling, Yan Song 2020. Conditional Augmentation for Aspect Term Extraction via Masked Sequence-to-Sequence Generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.
[10]
Omer Levy and Yoav Goldberg. 2014. Dependency based word embeddings. In ACL. pages 302–308.
[11]
Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, Chris Dyer. 2016. Neural Architectures for Named Entity Recognition. arXiv preprint arXiv:1603.01360.
[12]
Huaishao Luo, Tianrui Li, Bing Liu, and Junbo Zhang. 2019. DOER: Dual cross-shared RNN for aspect term polarity co-extraction. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. pages 591–601.
[13]
Xin Li and Wai Lam. 2017. Deep multi-task learning for aspect term extraction with memory interaction. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing.pages2886–2892.
[14]
Pengfei Liu, Shafiq Joty, and Helen Meng. 2015. Fine-grained opinion mining with recurrent neural networks and word embeddings. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).pages 1433–1443.
[15]
Dehong Ma, Sujian Li, Fangzhao Wu, Xing Xie, and Houfeng Wang. 2019. Exploring sequence-to-sequence learning in aspect term extraction. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. pages 3538–3547.
[16]
Margaret Mitchell, Jacqui Aguilar, Theresa Wilson, and Benjamin Van Durme. 2013. Open domain targeted sentiment. In ACL ’13.pages 1643–1654.
[17]
Diego Marcheggiani and Ivan Titov. 2017. Encoding sentences with graph convolutional networks for semantic role labeling. arXiv preprint arXiv:1703.04826.
[18]
Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP).pages 1532–1543.
[19]
Maria Pontiki, Dimitris Galanis, John Pavlopoulos, Harris Papageorgiou, Ion Androutsopoulos, and Suresh Manandhar. 2014. Semeval-2014 task 4: Aspect based sentiment analysis. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014).pages 27–35.
[20]
Guang Qiu, Bing Liu, Jiajun Bu, and Chun Chen. 2011. Opinion word expansion and target extraction through double propagation. Computational Linguistics.37(1):9–27.
[21]
Nils Reimers and Iryna Gurevych. 2017. Reporting Score Distributions Makes a Difference: Performance Study of LSTM-networks for Sequence Tagging. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP).pages 338–348.
[22]
Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu and Tieyan Liu 2019. Mass: Masked sequence to sequence pretraining for language generation. In ICML.
[23]
Kai Sun, Richong Zhang, Samuel Mensah, Yongyi Mao, and Xudong Liu. 2019. Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP).pages 5679-5688.
[24]
Wenya Wang, Sinno Jialin Pan, Daniel Dahlmeier, and Xiaokui Xiao. 2017. Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In AAAI. pages 3316–3322.
[25]
Hu Xu, Bing Liu, Lei Shu, and Philip S. Yu. 2018. Double embeddings and cnn-based sequence labeling for aspect extraction. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.
[26]
Hu Xu, Bing Liu, Lei Shu, and Philip Yu 2019. BERT post-training for review reading comprehension and aspect-based sentiment analysis. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers).pages 2324–2335.
[27]
Yichun Yin, Chenguang Wang, Ming Zhang. 2019. POD: Positional Dependency-Based Word Embedding for Aspect Term Extraction. arXiv preprint arXiv:1911.03785.
[28]
Yichun Yin, Furu Wei, Li Dong, Kaimeng Xu, Ming Zhang, and Ming Zhou. 2016. Unsupervised word and dependency path embeddings for aspect term extraction. arXiv preprint arXiv:1605.07843.

Cited By

View all
  • (2023)Adaptive Local Context and Syntactic Feature Modeling for Aspect-Based Sentiment AnalysisApplied Sciences10.3390/app1301060313:1(603)Online publication date: 1-Jan-2023

Index Terms

  1. STC: Stacked Two-stage Convolution for Aspect Term Extraction
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        ISEEIE 2021: 2021 International Symposium on Electrical, Electronics and Information Engineering
        February 2021
        644 pages
        ISBN:9781450389839
        DOI:10.1145/3459104
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 20 July 2021

        Permissions

        Request permissions for this article.

        Check for updates

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        ISEEIE 2021

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)4
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 23 Dec 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2023)Adaptive Local Context and Syntactic Feature Modeling for Aspect-Based Sentiment AnalysisApplied Sciences10.3390/app1301060313:1(603)Online publication date: 1-Jan-2023

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media