Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Irony detection via sentiment-based transfer learning

Published: 01 September 2019 Publication History
  • Get Citation Alerts
  • Highlights

    Take advantage of the readily available sentiment resources to identify implicit incongruity for irony detection.
    Transferring deep sentiment features to a neural attention model is an effective approach to extract patterns of implicit incongruity embedded in ironic texts.
    Evaluate irony detection models using human-annotated and automatic hashtag-labeled datasets separately.

    Abstract

    Irony as a literary technique is widely used in online texts such as Twitter posts. Accurate irony detection is crucial for tasks such as effective sentiment analysis. A text’s ironic intent is defined by its context incongruity. For example in the phrase “I love being ignored”, the irony is defined by the incongruity between the positive word “love” and the negative context of “being ignored”. Existing studies mostly formulate irony detection as a standard supervised learning text categorization task, relying on explicit expressions for detecting context incongruity. In this paper we formulate irony detection instead as a transfer learning task where supervised learning on irony labeled text is enriched with knowledge transferred from external sentiment analysis resources. Importantly, we focus on identifying the hidden, implicit incongruity without relying on explicit incongruity expressions, as in “I like to think of myself as a broken down Justin Bieber – my philosophy professor.” We propose three transfer learning-based approaches to using sentiment knowledge to improve the attention mechanism of recurrent neural models for capturing hidden patterns for incongruity. Our main findings are: (1) Using sentiment knowledge from external resources is a very effective approach to improving irony detection; (2) For detecting implicit incongruity, transferring deep sentiment features seems to be the most effective way. Experiments show that our proposed models outperform state-of-the-art neural models for irony detection.

    References

    [1]
    S. Baccianella, A. Esuli, F. Sebastiani, Sentiwordnet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining, LREC, vol. 10, 2010, pp. 2200–2204.
    [2]
    F. Barbieri, V. Basile, D. Croce, M. Nissim, N. Novielli, V. Patti, Overview of the evalita 2016 sentiment polarity classification task, Proceedings of third Italian conference on computational linguistics (CLiC-it 2016) & fifth evaluation campaign of natural language processing and speech tools for Italian. Final workshop (EVALITA 2016), 2016.
    [3]
    F. Barbieri, H. Saggion, F. Ronzano, Modelling sarcasm in Twitter, a novel approach, Proceedings of the 5th workshop on computational approaches to subjectivity, sentiment and social media analysis, 2014, pp. 50–58.
    [4]
    Y. Bengio, Deep learning of representations for unsupervised and transfer learning, Proceedings of ICML workshop on unsupervised and transfer learning, 2012, pp. 17–36.
    [5]
    Z. Cao, W. Li, S. Li, F. Wei, Improving multi-document summarization via text classification, Proceedings of AAAI, 2017, pp. 3053–3059.
    [6]
    B. Felbo, A. Mislove, A. Søgaard, I. Rahwan, S. Lehmann, Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm, Proceedings of the 2017 conference on empirical methods in natural language processing, 2017, pp. 1615–1625.
    [7]
    R.J. Gerrig, Y. Goldvarg, Additive effects in the perception of sarcasm: situational disparity and echoic mention, Metaphor and Symbol 15 (4) (2000) 197–208.
    [8]
    A. Ghosh, G. Li, T. Veale, P. Rosso, E. Shutova, J. Barnden, et al., Semeval-2015 task 11: sentiment analysis of figurative language in Twitter, Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015), 2015, pp. 470–478.
    [9]
    A. Ghosh, T. Veale, Fracking sarcasm using neural network, Proceedings of the 7th workshop on computational approaches to subjectivity, sentiment and social media analysis, 2016, pp. 161–169.
    [10]
    A. Ghosh, T. Veale, Magnets for sarcasm: Making sarcasm detection timely, contextual and very personal, Proceedings of the 2017 conference on empirical methods in natural language processing, 2017, pp. 482–491.
    [11]
    D. Ghosh, A.R. Fabbri, S. Muresan, The role of conversation context for sarcasm detection in online interactions, Proceedings of the 18th annual SIGdial meeting on discourse and dialogue, 2017, pp. 186–196.
    [12]
    R. González-Ibáñez, S. Muresan, N. Wacholder, Identifying sarcasm in Twitter: A closer look, Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies, 2011, pp. 581–586.
    [13]
    C.V. Hee, E. Lefever, V. Hoste, Semeval-2018 task 3: Irony detection in English tweets, Proceedings of the 12th international workshop on semantic evaluation, 2018, pp. 39–50.
    [14]
    F.D.I. Hernańdez, V. Patti, P. Rosso, Irony detection in Twitter: The role of affective content, ACM Transactions on Internet Technology 16 (3) (2016) 19.
    [15]
    F.D.I. Hernańdez, P. Rosso, Irony, sarcasm, and sentiment analysis, in: Pozzi F.A., Fersini E., Messina E., Liu B. (Eds.), (Sentiment analysis in social networks), Morgan Kaufmann, 2016, pp. 113–128.
    [16]
    S. Hochreiter, J. Schmidhuber, Long short-term memory, Neural computation 9 (8) (1997) 1735–1780.
    [17]
    Y.H. Huang, H.H. Huang, H.H. Chen, Irony detection with attentive recurrent neural networks, Proceedings of European conference on information retrieval, Springer, 2017, pp. 534–540.
    [18]
    C. Hutto, E. Gilbert, Vader: A parsimonious rule-based model for sentiment analysis of social media text, Proceedings of eighth international AAAI conference on weblogs and social media, 2014.
    [19]
    S.L. Ivanko, P.M. Pexman, Context incongruity and irony processing, Discourse Processes 35 (3) (2003) 241–279.
    [20]
    A. Joshi, P. Bhattacharyya, M.J. Carman, Automatic sarcasm detection: A survey, ACM Computing Surveys (CSUR) 50 (5) (2017) 73.
    [21]
    A. Joshi, V. Sharma, P. Bhattacharyya, Harnessing context incongruity for sarcasm detection, Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing, vol. 2, 2015, pp. 757–762.
    [22]
    A. Joshi, V. Tripathi, K. Patel, P. Bhattacharyya, M. Carman, Are word embedding-based features useful for sarcasm detection?, Proceedings of the 2016 conference on empirical methods in natural language processing, 2016, pp. 1006–1011.
    [23]
    Y. Kim, Convolutional neural networks for sentence classification, Proceedings of the 2014 conference on empirical methods in natural language processing, 2014, pp. 1746–1751.
    [24]
    F. Kunneman, C. Liebrecht, M.V. Mulken, A.V.d. Bosch, Signaling sarcasm: From hyperbole to hashtag, Information Processing & Management 51 (4) (2015) 500–509.
    [25]
    T. Luong, H. Pham, C.D. Manning, Effective approaches to attention-based neural machine translation, Proceedings of the 2015 conference on empirical methods in natural language processing, 2015, pp. 1412–1421.
    [26]
    D. Maynard, M.A. Greenwood, Who cares about sarcastic tweets? Investigating the impact of sarcasm on sentiment analysis, LREC, 2014, pp. 4238–4243.
    [27]
    T. Mikolov, E. Grave, P. Bojanowski, C. Puhrsch, A. Joulin, Advances in pre-training distributed word representations, Proceedings of the international conference on language resources and evaluation (LREC 2018), 2018.
    [28]
    S.M. Mohammad, X. Zhu, S. Kiritchenko, J. Martin, Sentiment, emotion, purpose, and style in electoral tweets, Information Processing & Management 51 (4) (2015) 480–499.
    [29]
    P.K. Novak, J. Smailović, B. Sluban, I. Mozetič, Sentiment of emojis, PloS one 10 (12) (2015).
    [30]
    D. Nozza, E. Fersini, E. Messina, Unsupervised irony detection: A probabilistic model with word embeddings, KDIR, 2016, pp. 68–76.
    [31]
    S. Oraby, V. Harrison, A. Misra, E. Riloff, M. Walker, Are you serious?: Rhetorical questions and sarcasm in social media dialog, Proceedings of the 18th annual SIGdial meeting on discourse and dialogue, 2017, pp. 310–319.
    [32]
    S. Poria, E. Cambria, D. Hazarika, P. Vij, A deeper look into sarcastic tweets using deep convolutional neural networks, Proceedings of the 26th international conference on computational linguistics, 2016, pp. 1601–1612.
    [33]
    T. Ptáček, I. Habernal, J. Hong, Sarcasm detection on Czech and English Twitter, Proceedings of the 25th international conference on computational linguistics, 2014, pp. 213–223.
    [34]
    A. Reyes, P. Rosso, T. Veale, A multidimensional approach for detecting irony in Twitter, Language Resources and Evaluation 47 (1) (2013) 239–268.
    [35]
    E. Riloff, A. Qadir, P. Surve, L. De Silva, N. Gilbert, R. Huang, Sarcasm as contrast between a positive sentiment and negative situation, Proceedings of the 2013 conference on empirical methods in natural language processing, 2013, pp. 704–714.
    [36]
    S. Rosenthal, N. Farra, P. Nakov, Semeval-2017 task 4: Sentiment analysis in Twitter, Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017), 2017, pp. 502–518.
    [37]
    P. Rosso, F. Rangel, I.H. Farías, L. Cagnina, W. Zaghouani, A. Charfi, A survey on author profiling, deception, and irony detection for the arabic language, Language and Linguistics Compass 12 (4) (2018).
    [38]
    X. Shu, G.J. Qi, J. Tang, J. Wang, Weakly-shared deep transfer networks for heterogeneous-domain knowledge propagation, Proceedings of the 23rd ACM international conference on multimedia, ACM, 2015, pp. 35–44.
    [39]
    E. Sulis, D.I.H. Farías, P. Rosso, V. Patti, G. Ruffo, Figurative messages and affect in Twitter: Differences between# irony,# sarcasm and# not, Knowledge-Based Systems 108 (2016) 132–143.
    [40]
    Y. Tay, L.A. Tuan, S.C. Hui, J. Su, Reasoning with sarcasm by reading in-between, Proceedings of the 56th annual meeting of the association for computational linguistics, 2018.
    [41]
    B.C. Wallace, Computational irony: A survey and new perspectives, Artificial Intelligence Review 43 (4) (2015) 467–483.
    [42]
    Y. Wang, M. Huang, L. Zhao, et al., Attention-based lstm for aspect-level sentiment classification, Proceedings of the 2016 conference on empirical methods in natural language processing, 2016, pp. 606–615.
    [43]
    K. Weiss, T.M. Khoshgoftaar, D. Wang, A survey of transfer learning, Journal of Big Data 3 (1) (2016) 9.
    [44]
    F. Wilcoxon, Individual comparisons by ranking methods, Biometrics bulletin 1 (6) (1945) 80–83.
    [45]
    T. Wilson, J. Wiebe, P. Hoffmann, Recognizing contextual polarity in phrase-level sentiment analysis, Proceedings of human language technology conference and conference on empirical methods in natural, 2005, p. 347.
    [46]
    R. Xia, F. Xu, J. Yu, Y. Qi, E. Cambria, Polarity shift detection, elimination and ensemble: A three-stage model for document-level sentiment analysis, Information Processing & Management 52 (1) (2016) 36–45.
    [47]
    P. Zhou, W. Shi, J. Tian, Z. Qi, B. Li, H. Hao, et al., Attention-based bidirectional long short-term memory networks for relation classification, Proceedings of the 54th annual meeting of the association for computational linguistics, vol. 2, 2016, pp. 207–212.

    Cited By

    View all
    • (2024)Emotional Intelligence Attention Unsupervised Learning Using Lexicon Analysis for Irony-based AdvertisingACM Transactions on Asian and Low-Resource Language Information Processing10.1145/358049623:1(1-19)Online publication date: 15-Jan-2024
    • (2023)On Stance Detection in Image Retrieval for ArgumentationProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591917(2562-2571)Online publication date: 19-Jul-2023
    • (2023)Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis ResearchIEEE Transactions on Affective Computing10.1109/TAFFC.2020.303816714:1(108-132)Online publication date: 1-Jan-2023
    • Show More Cited By

    Index Terms

    1. Irony detection via sentiment-based transfer learning
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Information & Contributors

            Information

            Published In

            cover image Information Processing and Management: an International Journal
            Information Processing and Management: an International Journal  Volume 56, Issue 5
            Sep 2019
            320 pages

            Publisher

            Pergamon Press, Inc.

            United States

            Publication History

            Published: 01 September 2019

            Author Tags

            1. Irony detection
            2. Transfer learning

            Qualifiers

            • Research-article

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • Downloads (Last 12 months)0
            • Downloads (Last 6 weeks)0

            Other Metrics

            Citations

            Cited By

            View all
            • (2024)Emotional Intelligence Attention Unsupervised Learning Using Lexicon Analysis for Irony-based AdvertisingACM Transactions on Asian and Low-Resource Language Information Processing10.1145/358049623:1(1-19)Online publication date: 15-Jan-2024
            • (2023)On Stance Detection in Image Retrieval for ArgumentationProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591917(2562-2571)Online publication date: 19-Jul-2023
            • (2023)Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis ResearchIEEE Transactions on Affective Computing10.1109/TAFFC.2020.303816714:1(108-132)Online publication date: 1-Jan-2023
            • (2023)FACapsnetNeurocomputing10.1016/j.neucom.2023.126253542:COnline publication date: 14-Jul-2023
            • (2022)Building towards Automated Cyberbullying DetectionComputational Intelligence and Neuroscience10.1155/2022/47942272022Online publication date: 1-Jan-2022
            • (2022)Deep Learning in Sentiment Analysis: Recent ArchitecturesACM Computing Surveys10.1145/354877255:8(1-37)Online publication date: 23-Dec-2022
            • (2022)Aspect-level sentiment classification based on attention-BiLSTM model and transfer learningKnowledge-Based Systems10.1016/j.knosys.2022.108586245:COnline publication date: 7-Jun-2022
            • (2022)Vector based sentiment and emotion analysis from textEngineering Applications of Artificial Intelligence10.1016/j.engappai.2022.104922113:COnline publication date: 1-Aug-2022
            • (2021)IronyTRInternational Journal of Intelligent Information Technologies10.4018/IJIIT.28996517:4(1-18)Online publication date: 1-Oct-2021
            • (2021)Enhancement of a multi-dialectal sentiment analysis system by the detection of the implied sarcastic featuresKnowledge-Based Systems10.1016/j.knosys.2021.107232227:COnline publication date: 5-Sep-2021
            • Show More Cited By

            View Options

            View options

            Get Access

            Login options

            Media

            Figures

            Other

            Tables

            Share

            Share

            Share this Publication link

            Share on social media