Abstract
Personalized news headline generation aims to model users interests through their news browsing history, and then generate news headlines based on their preferences. Using the user representation of existing news recommendation systems to personalize news headlines has been very successful, but there are still many problems to be solved. Firstly, news recommendation and headline generation tasks have different requirements for user interest modelling. Secondly, the user interest embedding approach does not consider the redundancy of user interests and the complementarity between user interests and candidate news texts. In this paper, we propose a new personalized headline generation framework to enhance the user interest perception. It can highlight user interests related to candidate texts for accurate embedding. We further offer to improve user interest representation using entity words in the news to meet the demand for news headline personalization. Extensive experiments show that our approach achieves better performance in headline generation tasks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
An, M., Wu, F., Wu, C., Zhang, K., Liu, Z., Xie, X.: Neural news recommendation with long-and short-term user representations. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 336–345 (2019)
Ao, X., Wang, X., Luo, L., Qiao, Y., He, Q., Xie, X.: Pens: a dataset and generic framework for personalized news headline generation. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 82–92 (2021)
Gavrilov, D., Kalaidin, P., Malykh, V.: Self-attentive model for headline generation. In: Azzopardi, L., Stein, B., Fuhr, N., Mayr, P., Hauff, C., Hiemstra, D. (eds.) ECIR 2019. LNCS, vol. 11438, pp. 87–93. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-15719-7_11
Gu, X., et al.: Generating representative headlines for news stories. In: Proceedings of The Web Conference 2020, pp. 1773–1784 (2020)
Murao, K., et al.: A case study on neural headline generation for editing support. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Industry Papers), pp. 73–82 (2019)
Okura, S., Tagami, Y., Ono, S., Tajima, A.: Embedding-based news recommendation for millions of users. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1933–1942 (2017)
ROUGE, L.C.: A package for automatic evaluation of summaries. In: Proceedings of Workshop on Text Summarization of ACL, Spain (2004)
Rush, A.M., Chopra, S., Weston, J.: A neural attention model for abstractive sentence summarization. arXiv preprint arXiv:1509.00685 (2015)
See, A., Liu, P.J., Manning, C.D.: Get to the point: summarization with pointer-generator networks. arXiv preprint arXiv:1704.04368 (2017)
Wang, H., Zhang, F., Xie, X., Guo, M.: DKN: deep knowledge-aware network for news recommendation. In: Proceedings of the 2018 World Wide Web Conference, pp. 1835–1844 (2018)
Woodsend, K., Feng, Y., Lapata, M.: Generation with quasi-synchronous grammar. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pp. 513–523 (2010)
Wu, C., Wu, F., An, M., Huang, J., Huang, Y., Xie, X.: Neural news recommendation with attentive multi-view learning. arXiv preprint arXiv:1907.05576 (2019)
Wu, C., Wu, F., Ge, S., Qi, T., Huang, Y., Xie, X.: Neural news recommendation with multi-head self-attention. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 6389–6394 (2019)
Wu, C., Wu, F., Qi, T., Huang, Y.: Is news recommendation a sequential recommendation task? arXiv preprint arXiv:2108.08984 (2021)
Wu, F., et al.: Mind: a large-scale dataset for news recommendation. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3597–3606 (2020)
Xu, P., Wu, C.S., Madotto, A., Fung, P.: Clickbait? sensational headline generation with auto-tuned reinforcement learning. arXiv preprint arXiv:1909.03582 (2019)
Xu, S., Yang, S., Lau, F.: Keyword extraction and headline generation using novel word features. In: Twenty-Fourth AAAI Conference on Artificial Intelligence (2010)
Yu, W., et al.: A survey of knowledge-enhanced text generation. arXiv preprint arXiv:2010.04389 (2020)
Zheng, Y., et al.: Disentangling long and short-term interests for recommendation. arXiv preprint arXiv:2202.13090 (2022)
Zhou, G., et al.: Deep interest evolution network for click-through rate prediction. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 5941–5948 (2019)
Lu, G., Li, J., Wei, J.: Aspect sentiment analysis with heterogeneous graph neural networks. Inf. Process. Manage. 59(4), 102953 (2022)
Acknowledgements
This work is partially supported by the Innovation Project of Guangxi Graduate Education (YCSW2022124); and the Research Fund of Guangxi Key Lab of Multi-source Information Mining & Security (MIMS20-04, MIMS21-M-01, MIMS20-M-01, No.20-A-01-01, No.20-A-01-02).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, K., Lu, G., Zhang, G., Lei, Z., Wu, L. (2022). Personalized Headline Generation with Enhanced User Interest Perception. In: Pimenidis, E., Angelov, P., Jayne, C., Papaleonidas, A., Aydin, M. (eds) Artificial Neural Networks and Machine Learning – ICANN 2022. ICANN 2022. Lecture Notes in Computer Science, vol 13530. Springer, Cham. https://doi.org/10.1007/978-3-031-15931-2_65
Download citation
DOI: https://doi.org/10.1007/978-3-031-15931-2_65
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15930-5
Online ISBN: 978-3-031-15931-2
eBook Packages: Computer ScienceComputer Science (R0)