Cited By
View all- Chen XHu M(2024)Multi-feature fusion and dual-channel networks for sentiment analysisJournal of Intelligent & Fuzzy Systems10.3233/JIFS-237749(1-12)Online publication date: 22-Mar-2024
Multi-feature Microblog Sentiment Analysis based on BERT-AttBiGRU model
Authors: 
Xuyang Wang, Nan HeAuthors Info & Claims
Xuyang Wang, Nan HeAuthors Info & ClaimsPages 967 - 974
Abstract
In recent years, there has been an increasing amount of research on Weibo sentiment analysis techniques, but less attention has been paid to emoji. However, emoji are closely related to Weibo sentiment. So to judge the microblog sentiment tendency more accurately, in this paper, we select Weibo comments that contain a large number of emoji and propose a neural network classification model that combines emoji. The model first obtains word vectors containing contextual semantic information through the BERT pre-training model, then extracts deep-level feature information by using bi-directional gated recurrent network (BiGRU), and then puts the emoji vector and text vector into the Attention mechanism, and assigns weights to the extracted feature information to highlight the important information. Finally, the Softmax function is used to classify the microblog sentiment.The experimental results prove that the accuracy of the model reaches 97.65%, which effectively improves the accuracy of microblog sentiment classification.
References
[1]
G. E. Hinton, and R. R. Salakhutdnov, “Reducing the dimensionality of data with neural networks,” Science, vol. 313, no. 5786, pp. 504-507, 2006.
[2]
T. Mikolov, I. Sutskever, k. Chen, G. S. Corrado, and J. Dean, “Distributed representations of words and phrases and their compositionality,” Proceedings of the 27th Annual Conference on Neural lnforxnation Processing Systems, pp. 3111-3119, February 2014.
[3]
J. Liang, Y. M. Chai, H. B. Yuan, M. Gao, and H. Zan, “Polarity shifting and LSTM based recursive networks for sentiment analysis,” Journal of Chinese Information Processing, vol. 29, no. 5, pp. 152-159, 2015.
[4]
K. S. Tai, R. Socher, and C. D. Manning, “Improved semantic representations from tree structured long short-term memory netorks,” Computer Science, vol 5, no. 1, pp. 1556-1566, February 2015.
[5]
L. Y. Wang, C. H. Liu, and D. H. Cai, “Chinese text sentiment analysis based on character level two channel composite network,” Application Research of Computers, vol. 37, no. 9, pp. 2674-2678, March 2020.
[6]
Y. Li, and H. B. Dong, “Text sentiment analysis based on feature fusion of convolution neural network and bidirectional long short-term memory network,” Journal of Computer Applications, vol. 38, no. 11, pp. 3075-3080, November 2018.
[7]
R. Ghosh, K. Ravi, and V. Ravi, “A novel deep learning architecture for sentiment classification,” Proceedings of the 3rd International Conference on Recent Advances in Information Technology, pp. 511-516, July 2016.
[8]
G. Liu, and J. B. Guo, “Bidirectional LSTM with attention mechanism and convolutional layer for text classification,” Neurocomputing, pp. 325-338, December 2019.
[9]
J. Ebrahimi, A. Y. Rao, D. Lowed, and D. Dou, “HotFlip: White-Box adversarial examples for text classification,” Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 31-36, 2018.
[10]
D. W. Zhang, H. Xu, and Z. H. Su, “Chinese comments sentiment classification based on word2vec and SVMperf,” Expert Systems with Applications, vol. 42, no.4, pp. 1857-1863, December 2014.
[11]
J. Lilleberg, Y. Zhu, and Y. Q. Zhang, “Support vector machines and word2vec for text classification with semantic features,” Proceedings of the 14th IEEE International Conference on Cognitive Informatics and Cognitive Computing, pp. 136-140, September 2015.
[12]
G. Hollis, “Estimating the average need of semantic knowledge from distributional semantic models,” Memory & cognition, vol. 45, no. 8, pp. 1350-1370, November 2017.
[13]
S. Bartubov, D. Kondrashkin, A. Osokin, and D. Vetrov, “Breaking sticks and ambiguities with adaptive skip-gram,” Proceedings of the 19th International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 130-138, February 2016.
[14]
J. Peninington, R. Socher, and C. Mamming, “GloVe: global vectors for word representation,” Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 1532-1543, 2014.
[15]
J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: pre-training of deep bidirectional transformers for language understanding,” pp. 4171-4186, 2018.
[16]
M. Peters, M. Neumann, M. Iyyer, M. Gardner, and L. Zettlemoyer “Deep contextualized word representations,” Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018.
[17]
M. Munikar, S. Shakya, and A. Sherstha, “Fine-grained sentiment classification using BERT,” Proceedings of the Artificial Intelligence for Transforming Business and Society (AITB), pp. 1435-1439, October 2019.
[18]
D. Araci, “FinBERT: financial sentiment analysis with pre-trained language models,” arXiv:1908.10063.
[19]
J. Fei, Y. Liu, H. Luan, M. Zhang, and S. P. Ma, “Microblog sentiment analysis with emoticon space model,” Journal of Computer Science and Technology, vol. 30, no. 5, pp. 1120-1129, 2015.
[20]
Y. X. He, S. T. Sun, and F. F. Niu, “A deep learning model enhanced with emotion semantics for microblog sentiment analysis,” Chinese Journal of Computers, vol. 40, no. 4, pp. 773-790, April 2017.
[21]
B. Eisner, T. Rocktschel, I. Augenstrin, M. Bosnjak, and S. Riedel, “Emoji2vec: learning emoji representations from their description,” Proceedings of the 4th International Workshop on Natural Language Processing for Social Media, pp. 326-335, December 2016.
[22]
S. Wijeratne, L. Balasuriya, A. Sheth, and D. Doran, “A semantics based measure of emoji similarity,” ACM, pp. 646-653, 2017.
[23]
M. Li, E. Cheng, A. Chong, and Y. Alain, “Multi-class twitter sentiment classification with emojis,” Industrial Management & Data Systems, vol. 118, no. 9, pp. 1804-1820, April 2018.
[24]
B. Bansal, and S. Srivastava, “Lexicon-based twitter sentiment analysis for vote share prediction using emoji and n-gram features,” International Journal of Web Based Communities, vol. 15, no. 1, pp. 85-99, January 2019.
- Multi-feature Microblog Sentiment Analysis based on BERT-AttBiGRU model
Recommendations
Visual sentiment topic model based microblog image sentiment analysis
With a growing number of images being used to express opinions in Microblog, text based sentiment analysis is not enough to understand the sentiments of users. To obtain the sentiments implied in Microblog images, we propose a Visual Sentiment Topic ...
The Media Feature Analysis of Microblog Topics
Proceedings of the 18th International Conference on Database Systems for Advanced Applications - Volume 7827As microblogging grows in popularity, many research articles are exploring and studying the micro-blogs, especially the English micro-blogging, i.e., twitter. However, Chinese micro-blog service starts rather late and a few research is about its data ...
Microblog sentiment classification with heterogeneous sentiment knowledge
Microblogging services, such as Twitter, are very popular for information release and dissemination. Analyzing the sentiments in massive microblog messages is useful for sensing the public's opinions on various topics, which has wide applications in both ...
Comments
Information & Contributors
Information
Published In
April 2022
1065 pages
ISBN:9781450395786
DOI:10.1145/3544109
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 July 2022
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
IPEC2022
IPEC2022: 2022 3rd Asia-Pacific Conference on Image Processing, Electronics and Computers
April 14 - 16, 2022
Dalian, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 38Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Feb 2025
Other Metrics
Citations
Cited By
View all- Chen XHu M(2024)Multi-feature fusion and dual-channel networks for sentiment analysisJournal of Intelligent & Fuzzy Systems10.3233/JIFS-237749(1-12)Online publication date: 22-Mar-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format