Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

TME: Tree-guided Multi-task Embedding Learning towards Semantic Venue Annotation

Published: 08 April 2023 Publication History

Abstract

The prevalence of location-based services has generated a deluge of check-ins, enabling the task of human mobility understanding. Among the various types of information associated with the check-in venues, categories (e.g., Bar and Museum) are vital to the task, as they often serve as excellent semantic characterization of the venues. Despite its significance and importance, a large portion of venues in the check-in services do not have even a single category label, such as up to 30% of venues in the Foursquare system lacking category labels. We, therefore, address the problem of semantic venue annotation, i.e., labeling the venue with a semantic category. Existing methods either fail to fully exploit the contextual information in the check-in sequences, or do not consider the semantic correlations across related categories. As such, we devise a Tree-guided Multi-task Embedding model (TME for short) to learn effective representations of venues and categories for the semantic annotation. TME jointly learns a common feature space by modeling multi-contexts of check-ins and utilizes the predefined category hierarchy to regularize the relatedness among categories. We evaluate TME over the task of semantic venue annotation on two check-in datasets. Experimental results show the superiority of TME over several state-of-the-art baselines.

References

[1]
Mohammad Aliannejadi, Dimitrios Rafailidis, and Fabio Crestani. 2018. A collaborative ranking model with multiple location-based similarities for venue suggestion. In Proceedings of the 2018 ACM SIGIR International Conference on Theory of Information Retrieval. 19–26.
[2]
Mohammed Alsuhaibani, Takanori Maehara, and Danushka Bollegala. 2019. Joint learning of hierarchical word embeddings from a corpus and a taxonomy. In Proceedings of the Automated Knowledge Base Construction.
[3]
Francis R. Bach. 2008. Consistency of the group lasso and multiple kernel learning. Journal of Machine Learning Research 9, 6 (2008), 1179–1225.
[4]
R. Caruana. 1997. Multitask learning. Machine Learning 28, 1 (1997), 41–75.
[5]
Chih-Wei Chang, Yao-Chung Fan, Kuo-Chen Wu, and Arbee LP Chen. 2014. On the semantic annotation of daily places: A machine-learning approach. In Proceedings of the 4th International Workshop on Location and the Web. 3–8.
[6]
Ahmed Cheikhrouhou, Yousri Kessentini, and Slim Kanoun. 2021. Multi-task learning for simultaneous script identification and keyword spotting in document images. Pattern Recognition 113, C (2021), 107832.
[7]
Hongshen Chen, Jiashu Zhao, and Dawei Yin. 2019. Fine-grained product categorization in e-commerce. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2349–2352.
[8]
Ling Chen, Mingrui Han, Hongyu Shi, and Xiaoze Liu. 2021. Multi-context embedding-based personalized place semantics recognition. Information Processing and Management 58, 1 (2021), 102416.
[9]
Meng Chen, Xiaohui Yu, and Yang Liu. 2019. MPE: A mobility pattern embedding model for predicting next locations. World Wide Web 22, 6 (2019), 2901–2920.
[10]
Meng Chen, Yan Zhao, Yang Liu, Xiaohui Yu, and Kai Zheng. 2020. Modeling spatial trajectories with attribute representation learning. IEEE Transactions on Knowledge and Data Engineering 34, 4 (2020), 1902–1914.
[11]
Meng Chen, Lei Zhu, Ronghui Xu, Yang Liu, Xiaohui Yu, and Yilong Yin. 2021. Embedding hierarchical structures for venue category representation. ACM Transactions on Information Systems 40, 3 (2021), 1–29.
[12]
Yingying Duan, Wei Lu, Weiwei Xing, Peng Bao, and Xiang Wei. 2019. PBEM: A pattern-based embedding model for user location category prediction. In Proceedings of the 12th International Conference on Mobile Computing and Ubiquitous Network. 1–6.
[13]
Deborah Falcone, Cecilia Mascolo, Carmela Comito, Domenico Talia, and Jon Crowcroft. 2014. What is this place? Inferring place categories through user patterns identification in geo-tagged tweets. In Proceedings of the 6th International Conference on Mobile Computing, Applications, and Services. 10–19.
[14]
Jianping Fan, Tianyi Zhao, Zhenzhong Kuang, Yu Zheng, Ji Zhang, Jun Yu, and Jinye Peng. 2017. HD-MTL: Hierarchical deep multi-task learning for large-scale visual recognition. IEEE Transactions on Image Processing 26, 4 (2017), 1923–1938.
[15]
Dehong Gao, Wenjing Yang, Huiling Zhou, Yi Wei, Yi Hu, and Hao Wang. 2020. Deep hierarchical classification for category prediction in e-commerce system. In Proceedings of the 3rd Workshop on e-Commerce and NLP. 64–68.
[16]
Tieke He, Hongzhi Yin, Zhenyu Chen, Xiaofang Zhou, Shazia Sadiq, and Bin Luo. 2016. A spatial-temporal topic model for the semantic annotation of POIs in LBSNs. ACM Transactions on Intelligent Systems and Technology 8, 1 (2016), 1–24.
[17]
David Hull. 1993. Using statistical testing in the evaluation of retrieval experiments. In Proceedings of the 16th International ACM SIGIR Conference on Research and Development in Information Retrieval. 329–338.
[18]
John Krumm and Dany Rouhana. 2013. Placer: Semantic place labels from diary data. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 163–172.
[19]
Omer Levy and Yoav Goldberg. 2014. Neural word embedding as implicit matrix factorization. In Proceedings of the 27th International Conference on Neural Information Processing Systems. 2177–2185.
[20]
Yanhui Li, Xiangguo Zhao, Zhen Zhang, Ye Yuan, and Guoren Wang. 2020. Annotating semantic tags of locations in location-based social networks. GeoInformatica 24, 1 (2020), 133–152.
[21]
Hefei Ling, Ziyang Wang, Ping Li, Yuxuan Shi, Jiazhong Chen, and Fuhao Zou. 2019. Improving person re-identification by multi-task learning. Neurocomputing 347 (2019), 109–118.
[22]
Hairong Liu, Xingwei Yang, Longin Jan Latecki, and Shuicheng Yan. 2012. Dense neighborhoods on affinity graph. International Journal of Computer Vision 98, 1 (2012), 65–82.
[23]
Qian Liu, Heyan Huang, Guangquan Zhang, Yang Gao, Junyu Xuan, and Jie Lu. 2018. Semantic structure-based word embedding by incorporating concept convergence and word divergence. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 5261–5268.
[24]
Xiao Lu, Yaonan Wang, Xuanyu Zhou, Zhenjun Zhang, and Zhigang Ling. 2016. Traffic sign recognition via multi-modal tree-structure embedded multi-task learning. IEEE Transactions on Intelligent Transportation Systems 18, 4 (2016), 960–972.
[25]
Massimiliano Luca, Gianni Barlacchi, Bruno Lepri, and Luca Pappalardo. 2021. A survey on deep learning for human mobility. ACM Computing Surveys 55, 1 (2021), 1–44.
[26]
Minnan Luo, Xiaojun Chang, Liqiang Nie, Yi Yang, Alexander G. Hauptmann, and Qinghua Zheng. 2017. An adaptive semisupervised feature analysis for video semantic recognition. IEEE Transactions on Cybernetics 48, 2 (2017), 648–660.
[27]
Mingqi Lv, Ling Chen, Zhenxing Xu, Yinglong Li, and Gencai Chen. 2016. The discovery of personally semantic places based on trajectory data mining. Neurocomputing 173 (2016), 1142–1153.
[28]
Jarana Manotumruksa, Craig Macdonald, and Iadh Ounis. 2018. A contextual attention recurrent architecture for context-aware venue recommendation. In Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. 555–564.
[29]
Kaidi Meng, Haojie Li, Zhihui Wang, Xin Fan, Fuming Sun, and Zhongxuan Luo. 2017. A deep multi-modal fusion approach for semantic place prediction in social media. In Proceedings of the Workshop on Multimodal Understanding of Social, Affective, and Subjective Attributes. 31–37.
[30]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of the 27th Annual Conference on Neural Information Processing Systems. 3111–3119.
[31]
Yaqiong Qiao, Xiangyang Luo, Chenliang Li, Hechan Tian, and Jiangtao Ma. 2020. Heterogeneous graph-based joint representation learning for users and POIs in location-based social network. Information Processing and Management 57, 2 (2020), 102151.
[32]
Hossein A. Rahmani, Mohammad Aliannejadi, Rasoul Mirzaei Zadeh, Mitra Baratchi, Mohsen Afsharchi, and Fabio Crestani. 2019. Category-aware location embedding for point-of-interest recommendation. In Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval. 173–176.
[33]
Liling Tan, Maggie Yundi Li, and Stanley Kok. 2020. E-commerce product categorization via machine translation. ACM Transactions on Management Information Systems 11, 3 (2020), 1–14.
[34]
Yue Wang, Meng Chen, Xiaohui Yu, and Yang Liu. 2017. LCE: A location category embedding model for predicting the category labels of POIs. In Proceedings of the 2017 International Conference on Neural Information Processing. 710–720.
[35]
Xiaojie Wu, Ling Chen, Mingqi Lv, Mingrui Han, and Gencai Chen. 2017. Cost-sensitive semi-supervised personalized semantic place label recognition using multi-context data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–14.
[36]
Caixia Yan, Qinghua Zheng, Xiaojun Chang, Minnan Luo, Chung-Hsing Yeh, and Alexander G. Hauptman. 2020. Semantics-preserving graph propagation for zero-shot object detection. IEEE Transactions on Image Processing 29 (2020), 8163–8176.
[37]
Cheng Yang, Maosong Sun, Wayne Xin Zhao, Zhiyuan Liu, and Edward Y. Chang. 2017. A neural network approach to jointly modeling social networks and mobile trajectories. ACM Transactions on Information Systems 35, 4 (2017), 1–28.
[38]
Dingqi Yang, Bingqing Qu, Jie Yang, and Philippe Cudre-Mauroux. 2019. Revisiting user mobility and social relationships in LBSNs: A hypergraph embedding approach. In Proceedings of the Web Conference. 2147–2157.
[39]
Dingqi Yang, Daqing Zhang, and Bingqing Qu. 2016. Participatory cultural mapping based on collective behavior data in location-based social networks. ACM Transactions on Intelligent Systems and Technology 7, 3 (2016), 30.
[40]
Jing Yang and Carsten Eickhoff. 2018. Unsupervised learning of parsimonious general-purpose embeddings for user and location modeling. ACM Transactions on Information Systems 36, 3 (2018), 32.
[41]
Mao Ye, Dong Shou, Wang-Chien Lee, Peifeng Yin, and Krzysztof Janowicz. 2011. On the semantic annotation of places in location-based social networks. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 520–528.
[42]
Haochao Ying, Jian Wu, Guandong Xu, Yanchi Liu, Tingting Liang, Xiao Zhang, and Hui Xiong. 2019. Time-aware metric embedding with asymmetric projection for successive POI recommendation. World Wide Web 22, 5 (2019), 2209–2224.
[43]
Fuqiang Yu, Lizhen Cui, Wei Guo, Xudong Lu, Qingzhong Li, and Hua Lu. 2020. A category-aware deep model for successive POI recommendation on sparse check-in data. In Proceedings of the Web Conference. 1264–1274.
[44]
Ming Yuan and Yi Lin. 2006. Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 68, 1 (2006), 49–67.
[45]
Daniel Yue Zhang, Dong Wang, Hao Zheng, Xin Mu, Qi Li, and Yang Zhang. 2017. Large-scale point-of-interest category prediction using natural language processing models. In Proceedings of the 2017 IEEE International Conference on Big Data. 1027–1032.
[46]
Jianglong Zhang, Liqiang Nie, Xiang Wang, Xiangnan He, Xianglin Huang, and Tat Seng Chua. 2016. Shorter-is-better: Venue category estimation from micro-video. In Proceedings of the 24th ACM International Conference on Multimedia. 1415–1424.
[47]
Shenglin Zhao, Tong Zhao, Irwin King, and Michael R. Lyu. 2017. Geo-teaser: Geo-temporal Sequential embedding rank for point-of-interest recommendation. In Proceedings of the 26th International Conference on World Wide Web Companion. 153–162.
[48]
Wayne Xin Zhao, Feifan Fan, Ji-Rong Wen, and Edward Y. Chang. 2018. Joint representation learning for location-based social networks with multi-grained sequential contexts. ACM Transactions on Knowledge Discovery from Data 12, 2 (2018), 1–21.
[49]
Jie Zhou, Chunping Ma, Dingkun Long, Guangwei Xu, Ning Ding, Haoyu Zhang, Pengjun Xie, and Gongshen Liu. 2020. Hierarchy-aware global model for hierarchical text classification. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 1106–1117.
[50]
Ningnan Zhou, Wayne Xin Zhao, Xiao Zhang, Ji-Rong Wen, and Shan Wang. 2016. A general multi-context embedding model for mining human trajectory data. IEEE Transactions on Knowledge and Data Engineering 28, 8 (2016), 1945–1958.
[51]
Yin Zhu, Erheng Zhong, Zhongqi Lu, and Qiang Yang. 2013. Feature engineering for semantic place prediction. Pervasive and Mobile Computing 9, 6 (2013), 772–783.

Cited By

View all
  • (2024)TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting MethodsProceedings of the VLDB Endowment10.14778/3665844.366586317:9(2363-2377)Online publication date: 1-May-2024
  • (2024)Profiling Urban Streets: A Semi-Supervised Prediction Model Based on Street View Imagery and Spatial TopologyProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671918(319-328)Online publication date: 25-Aug-2024
  • (2023)Towards an integrated view of semantic annotation for POIs with spatial and textual informationProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/271(2441-2449)Online publication date: 19-Aug-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems
ACM Transactions on Information Systems  Volume 41, Issue 4
October 2023
958 pages
ISSN:1046-8188
EISSN:1558-2868
DOI:10.1145/3587261
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 April 2023
Online AM: 01 February 2023
Accepted: 25 January 2023
Revised: 26 November 2022
Received: 14 January 2022
Published in TOIS Volume 41, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Semantic venue annotation
  2. human mobility
  3. check-in analysis
  4. embedding learning

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China
  • Shandong Excellent Young Scientists Fund (Oversea)
  • Natural Science Foundation of Shandong Province of China
  • Young Scholars Program of Shandong University
  • Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation
  • Ministry of Natural Resources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)180
  • Downloads (Last 6 weeks)8
Reflects downloads up to 30 Aug 2024

Other Metrics

Citations

Cited By

View all
  • (2024)TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting MethodsProceedings of the VLDB Endowment10.14778/3665844.366586317:9(2363-2377)Online publication date: 1-May-2024
  • (2024)Profiling Urban Streets: A Semi-Supervised Prediction Model Based on Street View Imagery and Spatial TopologyProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671918(319-328)Online publication date: 25-Aug-2024
  • (2023)Towards an integrated view of semantic annotation for POIs with spatial and textual informationProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/271(2441-2449)Online publication date: 19-Aug-2023

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media