Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Public Access

Trembr: Exploring Road Networks for Trajectory Representation Learning

Published: 04 February 2020 Publication History

Abstract

In this article, we propose a novel representation learning framework, namely TRajectory EMBedding via Road networks (Trembr), to learn trajectory embeddings (low-dimensional feature vectors) for use in a variety of trajectory applications. The novelty of Trembr lies in (1) the design of a recurrent neural network--(RNN) based encoder--decoder model, namely Traj2Vec, that encodes spatial and temporal properties inherent in trajectories into trajectory embeddings by exploiting the underlying road networks to constrain the learning process in accordance with the matched road segments obtained using road network matching techniques (e.g., Barefoot [24, 27]), and (2) the design of a neural network--based model, namely Road2Vec, to learn road segment embeddings in road networks that captures various relationships amongst road segments in preparation for trajectory representation learning. In addition to model design, several unique technical issues raising in Trembr, including data preparation in Road2Vec, the road segment relevance-aware loss, and the network topology constraint in Traj2Vec, are examined. To validate our ideas, we learn trajectory embeddings using multiple large-scale real-world trajectory datasets and use them in three tasks, including trajectory similarity measure, travel time prediction, and destination prediction. Empirical results show that Trembr soundly outperforms the state-of-the-art trajectory representation learning models, trajectory2vec and t2vec, by at least one order of magnitude in terms of mean rank in trajectory similarity measure, 23.3% to 41.7% in terms of mean absolute error (MAE) in travel time prediction, and 39.6% to 52.4% in terms of MAE in destination prediction.

References

[1]
Helmut Alt, Alon Efrat, Günter Rote, and Carola Wenk. 2003. Matching planar maps. J. Algor. 49, 2 (2003), 262--283.
[2]
Yoshua Bengio, Aaron Courville, and Pascal Vincent. 2013. Representation learning: A review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35, 8 (2013), 1798--1828.
[3]
Sotiris Brakatsoulas, Dieter Pfoser, Randall Salas, and Carola Wenk. 2005. On map-matching vehicle tracking data. In Proceedings of the International Conference on Very Large Data Bases. VLDB Endowment, 853--864.
[4]
Taxi Service Trajectory (TST) Prediction Challenge. 2015. Taxi Trajectory Prediction. Retrieved from http://www.geolink.pt/ecmlpkdd2015-challenge/.
[5]
Kyunghyun Cho, Bart van Merriënboer, Çağlar Gülçehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder--decoder for statistical machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Doha, Qatar, 1724--1734.
[6]
Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1724--1734.
[7]
Jan K. Chorowski, Dzmitry Bahdanau, Dmitriy Serdyuk, Kyunghyun Cho, and Yoshua Bengio. 2015. Attention-based models for speech recognition. In Advances in Neural Information Processing Systems 28, C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett (Eds.). Curran Associates, Inc., 577--585.
[8]
Yuxiao Dong, Nitesh V. Chawla, and Ananthram Swami. 2017. metapath2vec: Scalable representation learning for heterogeneous networks. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining. ACM, 135--144.
[9]
Tao-yang Fu, Wang-Chien Lee, and Zhen Lei. 2017. Hin2vec: Explore meta-paths in heterogeneous information networks for representation learning. In Proceedings of the ACM on Conference on Information and Knowledge Management. ACM, 1797--1806.
[10]
Qiang Gao, Fan Zhou, Kunpeng Zhang, Goce Trajcevski, Xucheng Luo, and Fengli Zhang. 2017. Identifying human mobility via trajectory embeddings. In Proceedings of the IJCAI, Vol. 17. 1689--1695.
[11]
Chong Yang Goh, Justin Dauwels, Nikola Mitrovic, Muhammad Tayyab Asif, Ali Oran, and Patrick Jaillet. 2012. Online map-matching based on hidden markov model for real-time traffic sensing applications. IEEE Trans. Intell. Transport. Syst. (2012), 776--781.
[12]
Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining. ACM, 855--864.
[13]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neur. Comput. 9, 8 (1997), 1735--1780.
[14]
Xiao Huang, Jundong Li, and Xia Hu. 2017. Label informed attributed network embedding. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining. ACM, 731--739.
[15]
Ryan Kiros, Yukun Zhu, Ruslan R. Salakhutdinov, Richard Zemel, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015. Skip-thought vectors. In Proceedings of the Annual Conference on Neural Information Processing Systems. 3294--3302.
[16]
Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In Proceedings of the International Conference on Machine Learning. 1188--1196.
[17]
Jundong Li, Harsh Dani, Xia Hu, Jiliang Tang, Yi Chang, and Huan Liu. 2017. Attributed network embedding for learning in a dynamic environment. In Proceedings of the ACM on Conference on Information and Knowledge Management. ACM, 387--396.
[18]
Xiucheng Li, Kaiqi Zhao, Gao Cong, Christian S. Jensen, and Wei Wei. 2018. Deep representation learning for trajectory similarity computation. In Proceedings of the International Conference on Data Engineering. IEEE, 617--628.
[19]
Bing Liu and Ian Lane. 2016. Attention-based recurrent neural network models for joint intent detection and slot filling. In Proceedings of the Annual Conference of the International Speech Communication Association. 685--689.
[20]
Siyuan Liu, Yunhuai Liu, Lionel M Ni, Jianping Fan, and Minglu Li. 2010. Towards mobility-based clustering. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining. ACM, 919--928.
[21]
Siyuan Liu, Shuhui Wang, Kasthuri Jayarajah, Archan Misra, and Ramayya Krishnan. 2013. TODMIS: Mining communities from trajectories. In Proceedings of the ACM International Conference on Information and Knowledge Management. ACM, 2109--2118.
[22]
Yin Lou, Chengyang Zhang, Yu Zheng, Xing Xie, Wei Wang, and Yan Huang. 2009. Map-matching for low-sampling-rate GPS trajectories. In Proceedings of the ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 352--361.
[23]
Yisheng Lv, Yanjie Duan, Wenwen Kang, Zhengxi Li, and Fei-Yue Wang. 2015. Traffic flow prediction with big data: A deep learning approach. IEEE Trans. Intell. Transport. Syst. 16, 2 (2015), 865--873.
[24]
Sebastian Mattheis. 2016. Barefoot. Retrieved from https://github.com/bmwcarit/barefoot/.
[25]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of the Annual Conference on Neural Information Processing Systems. 3111--3119.
[26]
Reham Mohamed, Heba Aly, and Moustafa Youssef. 2017. Accurate real-time map matching for challenging environments. IEEE Trans. Intell. Transport. Syst. 18, 4 (2017), 847--857.
[27]
Paul Newson and John Krumm. 2009. Hidden Markov map matching through noise and sparseness. In Proceedings of the ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 336--343.
[28]
Anastasios Noulas, Salvatore Scellato, Neal Lathia, and Cecilia Mascolo. [n.d.]. Mining user mobility features for next place prediction in location-based services. In Proceedings of the IEEE International Conference on Data Mining. IEEE, 1038--1043.
[29]
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, and Rabab Ward. 2016. Deep sentence embedding using long short-term memory networks: Analysis and application to information retrieval. IEEE/ACM Trans. Aud. Speech Lang. Process. 24, 4 (2016), 694--707.
[30]
Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the Conference on Empirical Methods on Natural Language Processing, Vol. 14. 1532--1543.
[31]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining. ACM, 701--710.
[32]
Sayan Ranu, P. Deepak, Aditya D. Telang, Prasad Deshpande, Sriram Raghavan, et al. 2015. Indexing and matching trajectories under inconsistent sampling rates. In Proceedings of the IEEE International Conference on Data Engineering. IEEE, 999--1010.
[33]
Hyun Oh Song, Stefanie Jegelka, Vivek Rathod, and Kevin Murphy. 2017. Deep metric learning via facility location. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE.
[34]
Hyun Oh Song, Yu Xiang, Stefanie Jegelka, and Silvio Savarese. 2016. Deep metric learning via lifted structured feature embedding. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 4004--4012.
[35]
Nitish Srivastava, Elman Mansimov, and Ruslan Salakhudinov. 2015. Unsupervised learning of video representations using lstms. In Proceedings of the International Conference on Machine Learning. 843--852.
[36]
Han Su, Kai Zheng, Haozhou Wang, Jiamin Huang, and Xiaofang Zhou. 2013. Calibrating trajectory data for similarity-based analysis. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, 833--844.
[37]
Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Proceedings of the Annual Conference on Neural Information Processing Systems. 3104--3112.
[38]
Yoshihide Sekimoto, Takehiro Kashiyama, and Yanbo Pang. 2017. An open dataset for Tokyo trajectory. Retrieved from https://github.com/sekilab/OpenPFLOW.
[39]
Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. LINE: Large-scale information network embedding. In Proceedings of the International Conference on World Wide Web. ACM, 1067--1077.
[40]
Yilun Wang, Yu Zheng, and Yexiang Xue. 2014. Travel time estimation of a path using sparse trajectories. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining. ACM, 25--34.
[41]
Karl Weiss, Taghi M. Khoshgoftaar, and DingDing Wang. 2016. A survey of transfer learning. J. Big Data 3, 1 (2016), 9.
[42]
Christopher E. White, David Bernstein, and Alain L. Kornhauser. 2000. Some map matching algorithms for personal navigation assistants. Transport. Res. Part C: Emerg. Technol. 8, 1--6 (2000), 91--108.
[43]
Hao Wu, Ziyang Chen, Weiwei Sun, Baihua Zheng, and Wei Wang. 2017. Modeling trajectories with recurrent neural networks. In Proceedings of the International Joint Conferences on Artificial Intelligence. 3083--3090.
[44]
Di Yao, Chao Zhang, Zhihua Zhu, Jianhui Huang, and Jingping Bi. 2017. Trajectory clustering via deep representation learning. In Proceedings of the International Joint Conference on Neural Networks. IEEE, 3880--3887.
[45]
Yu Zheng. 2015. Trajectory data mining: An overview. ACM Trans. Intell. Syst. Technol. 6, 3 (2015), 29.

Cited By

View all
  • (2025)UniTE: A Survey and Unified Pipeline for Pre-Training Spatiotemporal Trajectory EmbeddingsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.352399637:3(1475-1494)Online publication date: 1-Mar-2025
  • (2025)Map-Informed Trajectory Recovery With Adaptive Spatio-Temporal AutoencoderIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.348394126:1(102-115)Online publication date: Jan-2025
  • (2025)Learning to discover anomalous spatiotemporal trajectory via Open-world State Space modelKnowledge-Based Systems10.1016/j.knosys.2024.112918310(112918)Online publication date: Feb-2025
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 11, Issue 1
February 2020
304 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3375625
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 February 2020
Accepted: 01 September 2019
Revised: 01 June 2019
Received: 01 February 2019
Published in TIST Volume 11, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Trajectory
  2. neural networks
  3. representation learning
  4. road network

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)611
  • Downloads (Last 6 weeks)57
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)UniTE: A Survey and Unified Pipeline for Pre-Training Spatiotemporal Trajectory EmbeddingsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.352399637:3(1475-1494)Online publication date: 1-Mar-2025
  • (2025)Map-Informed Trajectory Recovery With Adaptive Spatio-Temporal AutoencoderIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.348394126:1(102-115)Online publication date: Jan-2025
  • (2025)Learning to discover anomalous spatiotemporal trajectory via Open-world State Space modelKnowledge-Based Systems10.1016/j.knosys.2024.112918310(112918)Online publication date: Feb-2025
  • (2024)A graph-based representation framework for trajectory recovery via spatiotemporal interval-informed seq2seqProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/286(2588-2597)Online publication date: 3-Aug-2024
  • (2024)Let's Speak Trajectories: A Vision to Use NLP Models for Trajectory Analysis TasksACM Transactions on Spatial Algorithms and Systems10.1145/365647010:2(1-25)Online publication date: 1-Jul-2024
  • (2024)LaDe: The First Comprehensive Last-mile Express Dataset from IndustryProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671548(5991-6002)Online publication date: 25-Aug-2024
  • (2024)Urban Foundation Models: A SurveyProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671453(6633-6643)Online publication date: 25-Aug-2024
  • (2024)Foundation Models for Time Series Analysis: A Tutorial and SurveyProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671451(6555-6565)Online publication date: 25-Aug-2024
  • (2024)Hypergraph Hash Learning for Efficient Trajectory Similarity ComputationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679555(175-186)Online publication date: 21-Oct-2024
  • (2024)More Than Routing: Joint GPS and Route Modeling for Refine Trajectory Representation LearningProceedings of the ACM Web Conference 202410.1145/3589334.3645644(3064-3075)Online publication date: 13-May-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Full Access

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media