Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

DeepRoute+: Modeling Couriers’ Spatial-temporal Behaviors and Decision Preferences for Package Pick-up Route Prediction

Published: 05 January 2022 Publication History

Abstract

Over 10 billion packages are picked up every day in China. A fundamental task raised in the emerging intelligent logistics systems is the couriers’ package pick-up route prediction, which is beneficial for package dispatching, arrival-time estimation and overdue-risk evaluation, by leveraging the predicted routes to improve those downstream tasks. In the package pick-up scene, the decision-making of a courier is affected by strict spatial-temporal constraints (e.g., package location, promised pick-up time, current time, and courier’s current location). Furthermore, couriers have different decision preferences on various factors (e.g., time factor, distance factor, and balance of both), based on their own perception of the environments and work experience. In this article, we propose a novel model, named DeepRoute+, to predict couriers’ future package pick-up routes according to the couriers’ decision experience and preference learned from the historical behaviors. Specifically, DeepRoute+ consists of three layers: (1) The representation layer produces experience- and preference-aware representations for the unpicked-up packages, in which a decision preference module can dynamically adjust the importance of factors that affects the courier’s decision under the current situation. (2) The transformer encoder layer encodes the representations of packages while considering the spatial-temporal correlations among them. (3) The attention-based decoder layer uses the attention mechanism to generate the whole pick-up route recurrently. Experiments on a real-world logistics dataset demonstrate the state-of-the-art performance of our model.

References

[1]
Niels Agatz, Alan Erera, Martin Savelsbergh, and Xing Wang. 2012. Optimization for dynamic ride-sharing: A review. Eur. J. Oper. Res. 223, 2 (2012), 295–303.
[2]
Irwan Bello, Sayali Kulkarni, Sagar Jain, Craig Boutilier, Ed Chi, Elad Eban, Xiyang Luo, Alan Mackey, and Ofer Meshi. 2019. Seq2Slate: Re-ranking and slate optimization with RNNs. In Proceedings of the Workshop on Negative Dependence in Machine Learning.
[3]
Irwan Bello, Hieu Pham, Quoc V. Le, Mohammad Norouzi, and Samy Bengio. 2017. Neural combinatorial optimization with reinforcement learning. In Workshop Track Proceedings of the 5th International Conference on Learning Representations.
[4]
Dimitri P. Bertsekas, Dimitri P. Bertsekas, Dimitri P. Bertsekas, and Dimitri P. Bertsekas. 1995. Dynamic Programming and Optimal Control. Vol. 1. Athena Scientific, Belmont, MA.
[5]
Olli Bräysy, Wout Dullaert, and Michel Gendreau. 2004. Evolutionary algorithms for the vehicle routing problem with time windows. J. Heurist. 10, 6 (2004), 587–611.
[6]
Chris Burges, Tal Shaked, Erin Renshaw, Ari Lazier, Matt Deeds, Nicole Hamilton, and Greg Hullender. 2005. Learning to rank using gradient descent. In Proceedings of the 22nd International Conference on Machine Learning. 89–96.
[7]
Zhe Cao, Tao Qin, Tie-Yan Liu, Ming-Feng Tsai, and Hang Li. 2007. Learning to rank: From pairwise approach to listwise approach. In Proceedings of the 24th International Conference on Machine Learning. 129–136.
[8]
Qiwei Chen, Huan Zhao, Wei Li, Pipei Huang, and Wenwu Ou. 2019. Behavior sequence transformer for e-commerce recommendation in Alibaba. In Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data. 1–4.
[9]
Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. 2016. Wide & deep learning for recommender systems. In Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. 7–10.
[10]
Arthur Cruz de Araujo and Ali Etemad. 2020. End-to-End prediction of parcel delivery time with deep learning for smart-city applications. arXiv preprint arXiv:2009.12197.
[11]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
[12]
Masabumi Furuhata, Maged Dessouky, Fernando Ordóñez, Marc-Etienne Brunet, Xiaoqing Wang, and Sven Koenig. 2013. Ridesharing: The state-of-the-art and future directions. Transport. Res. Part B: Methodol. 57 (2013), 28–46.
[13]
Michel Gendreau, Gilbert Laporte, and Daniele Vigo. 1999. Heuristics for the traveling salesman problem with pickup and delivery. Comput. Oper. Res. 26, 7 (1999), 699–714.
[14]
Felix A. Gers, Jürgen Schmidhuber, and Fred Cummins. 2000. Learning to forget: Continual prediction with LSTM. Neural Comput. 12, 10 (2000), 2451–2471.
[15]
Anthony Gillioz, Jacky Casas, Elena Mugellini, and Omar Abou Khaled. 2020. Overview of the transformer-based models for NLP tasks. In Proceedings of the 15th Conference on Computer Science and Information Systems (FedCSIS). IEEE, 179–183.
[16]
Rajeev Goel and Raman Maini. 2017. Vehicle routing problem and its solution methodologies: A survey. Int. J. Logist. Syst. Manag. 28, 4 (2017), 419–435.
[17]
David E. Goldberg. 2006. Genetic Algorithms. Pearson Education India.
[18]
Jiafeng Guo, Yixing Fan, Liang Pang, Liu Yang, Qingyao Ai, Hamed Zamani, Chen Wu, W. Bruce Croft, and Xueqi Cheng. 2019. A deep look into neural ranking models for information retrieval. Inf. Process. Manag. 57, 6 (2019), 102067.
[19]
Shengnan Guo, Youfang Lin, Huaiyu Wan, Xiucheng Li, and Gao Cong. 2021. Learning dynamics and heterogeneity of spatial-temporal graph data for traffic forecasting. IEEE Trans. Knowl. Data Eng. (2021).
[20]
Xiangnan He, Zhankui He, Xiaoyu Du, and Tat-Seng Chua. 2018. Adversarial personalized ranking for recommendation. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 355–364.
[21]
Wenjie Huang, Zhiwei Zhao, Xiaolong An, Geyong Min, and Jingjing Li. 2020. Dynamic scheduling for urban instant delivery with strict deadlines. In Proceedings of the IEEE International Conference on Communications. 1–6.
[22]
Feng Jie, Li Yong, Zhang Chao, Funing Sun, and Depeng Jin. 2018. DeepMove: Predicting human mobility with attentional recurrent networks. In Proceedings of the World Wide Web Conference.
[23]
Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In Proceedings of the IEEE International Conference on Data Mining. 197–206.
[24]
Maurice G. Kendall. 1938. A new measure of rank correlation. Biometrika 30, 1/2 (1938), 81–93.
[25]
Dejiang Kong and Fei Wu. 2018. HST-LSTM: A hierarchical spatial-temporal long-short term memory network for location prediction. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. 2341–2347.
[26]
Gakuto Kurata, Bing Xiang, and Bowen Zhou. 2016. Improved neural network-based multi-label classification with better initialization leveraging label co-occurrence. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 521–526.
[27]
Yu-Lin Lan, Fagui Liu, Wing W. Y. Ng, Jun Zhang, and Mengke Gui. 2020. Decomposition based multi-objective variable neighborhood descent algorithm for logistics dispatching. IEEE Trans. Emerg. Topics Computat. Intell. (2020).
[28]
Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2019. AlBERT: A lite BERT for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942.
[29]
Eugene L. Lawler and David E. Wood. 1966. Branch-and-bound methods: A survey. Oper. Res. 14, 4 (1966), 699–719.
[30]
Ping Li, Qiang Wu, and Christopher J. Burges. 2008. MCRank: Learning to rank using multiple classification and gradient boosting. In Advances in Neural Information Processing Systems 20. Citeseer, 897–904.
[31]
Yuanyuan Li, Yang Liu, and Jun Xie. 2020. A path-based equilibrium model for ridesharing matching. Transport. Res. Part B: Methodol. 138 (2020), 373–405.
[32]
Yexin Li, Yu Zheng, and Qiang Yang. 2019. Efficient and effective express via contextual cooperative reinforcement learning. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 510–519.
[33]
Yexin Li, Yu Zheng, and Qiang Yang. 2020. Cooperative multi-agent reinforcement learning in express system. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 805–814.
[34]
J. Liao, T. Liu, M. Liu, J. Wang, Y. Wang, and H. Sun. 2018. Multi-context integrated deep neural network model for next location prediction. IEEE Access 6 (2018), 21980–21990.
[35]
Yan Lin, Huaiyu Wan, Shengnan Guo, and Youfang Lin. 2020. Pre-training context and time aware location embeddings from spatial-temporal trajectories for user next location prediction. In Proceedings of the AAAI Conference on Artificial Intelligence.
[36]
Wei Niu, James Caverlee, and Haokai Lu. 2018. Neural personalized ranking for image recommendation. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 423–431.
[37]
Liang Pang, Yanyan Lan, Jiafeng Guo, Jun Xu, Jingfang Xu, and Xueqi Cheng. 2017. DeepRank: A new deep architecture for relevance ranking in information retrieval. In Proceedings of the ACM Conference on Information and Knowledge Management (CIKM’17). Association for Computing Machinery, New York, NY, 257–266. DOI:https://doi.org/10.1145/3132847.3132914
[38]
Jan Petzold, Faruk Bagci, Wolfgang Trumler, and Theo Ungerer. 2005. Next location prediction within a smart office building. Cogn. Sci. Res. Paper-Univ. Sussex CSRP 577 (2005), 69.
[39]
Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. (2018).
[40]
Bilong Shen, Yan Huang, and Ying Zhao. 2016. Dynamic ridesharing. Sigsp. Spec. 7, 3 (2016), 3–10.
[41]
Reza Tavakkoli-Moghaddam, Nima Safaei, and Y. Gholipour. 2006. A hybrid simulated annealing for capacitated vehicle routing problems with the independent route length. Appl. Math. Comput. 176, 2 (2006), 445–454.
[42]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems 30. 5998–6008.
[43]
Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. 2015. Pointer networks. Advances in Neural Information Processing Systems 28. 2692–2700.
[44]
Huaiyu Wan, Youfang Lin, Shengnan Guo, and Yan Lin. 2021. Pre-training time-aware location embeddings from spatial-temporal trajectories. IEEE Trans. Knowl. Data Eng. (2021), 1–1. DOI: https://doi.org/10.1109/TKDE.2021.3057875
[45]
Haomin Wen, Youfang Lin, Fan Wu, Huaiyu Wan, Shengnan Guo, Lixia Wu, Chao Song, and Yinghui Xu. 2020. Package pick-up route prediction via modeling couriers’ spatial-temporal behaviors. In Proceedings of the IEEE 36th International Conference on Data Engineering (ICDE). IEEE.
[46]
Xian Wu, Chao Huang, Chuxu Zhang, and Nitesh V. Chawla. 2020. Hierarchically structured transformer networks for fine-grained spatial event forecasting. In Proceedings of the Web Conference. 2320–2330.
[47]
Mingxing Xu, Wenrui Dai, Chunmiao Liu, Xing Gao, Weiyao Lin, Guo-Jun Qi, and Hongkai Xiong. 2020. Spatial-temporal transformer networks for traffic flow forecasting. arXiv preprint arXiv: 2001.02908.
[48]
Di Yao, Chao Zhang, Jianhui Huang, and Jingping Bi. 2017. SERM: A recurrent model for next location prediction in semantic trajectories. In Proceedings of the ACM on Conference on Information and Knowledge Management. 2411–2414.
[49]
Siyuan Zhang, Lu Qin, Yu Zheng, and Hong Cheng. 2016. Effective and efficient: Large-scale dynamic city express. IEEE Trans. Knowl. Data Eng. 28, 12 (2016), 3203–3217.
[50]
Yan Zhang, Yunhuai Liu, Genjian Li, Yi Ding, Ning Chen, Hao Zhang, Tian He, and Desheng Zhang. 2019. Route prediction for instant delivery. Proc. ACM Interact., Mob., Wear. Ubiq. Technol. 3 (09 2019).
[51]
Pengpeng Zhao, Anjing Luo, Yanchi Liu, Fuzhen Zhuang, Jiajie Xu, Zhixu Li, Victor S. Sheng, and Xiaofang Zhou. 2020. Where to go next: A spatio-temporal gated network for next poi recommendation. IEEE Trans. Knowl. Data Eng. (2020).

Cited By

View all
  • (2024)Optimization algorithms for adaptative route sequencing on real-world last-mile deliveriesIngenius10.17163/ings.n31.2024.06(64-80)Online publication date: 1-Jan-2024
  • (2024)Fine-grained Courier Delivery Behavior Recovery with a Digital Twin Based Iterative Calibration FrameworkACM Transactions on Intelligent Systems and Technology10.1145/366348415:5(1-25)Online publication date: 13-Jun-2024
  • (2024)A variable neighborhood search algorithm for locker-based drone delivery makespan minimization problemTransportation Research Part E: Logistics and Transportation Review10.1016/j.tre.2024.103820192(103820)Online publication date: Dec-2024
  • Show More Cited By

Index Terms

  1. DeepRoute+: Modeling Couriers’ Spatial-temporal Behaviors and Decision Preferences for Package Pick-up Route Prediction

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Intelligent Systems and Technology
      ACM Transactions on Intelligent Systems and Technology  Volume 13, Issue 2
      April 2022
      392 pages
      ISSN:2157-6904
      EISSN:2157-6912
      DOI:10.1145/3508464
      • Editor:
      • Huan Liu
      Issue’s Table of Contents

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 05 January 2022
      Accepted: 01 August 2021
      Revised: 01 March 2021
      Received: 01 October 2020
      Published in TIST Volume 13, Issue 2

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Trajectory
      2. deep neural networks
      3. package pick-up route prediction

      Qualifiers

      • Research-article
      • Refereed

      Funding Sources

      • Fundamental Research Funds for the Central Universities

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)209
      • Downloads (Last 6 weeks)28
      Reflects downloads up to 10 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Optimization algorithms for adaptative route sequencing on real-world last-mile deliveriesIngenius10.17163/ings.n31.2024.06(64-80)Online publication date: 1-Jan-2024
      • (2024)Fine-grained Courier Delivery Behavior Recovery with a Digital Twin Based Iterative Calibration FrameworkACM Transactions on Intelligent Systems and Technology10.1145/366348415:5(1-25)Online publication date: 13-Jun-2024
      • (2024)A variable neighborhood search algorithm for locker-based drone delivery makespan minimization problemTransportation Research Part E: Logistics and Transportation Review10.1016/j.tre.2024.103820192(103820)Online publication date: Dec-2024
      • (2024)PLSRP: prompt learning for send–receive path predictionInternational Journal of Machine Learning and Cybernetics10.1007/s13042-024-02387-xOnline publication date: 26-Sep-2024
      • (2023)DRL4Route: A Deep Reinforcement Learning Framework for Pick-up and Delivery Route PredictionProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599811(4628-4637)Online publication date: 6-Aug-2023
      • (2023)Modeling Intra- and Inter-community Information for Route and Time Prediction in Last-mile Delivery2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00238(3106-3112)Online publication date: Apr-2023
      • (2023)Attention Enhanced Package Pick-Up Time Prediction via Heterogeneous Behavior ModelingAlgorithms and Architectures for Parallel Processing10.1007/978-981-97-0862-8_12(189-208)Online publication date: 20-Oct-2023
      • (2022)Graph2Route: A Dynamic Spatial-Temporal Graph Neural Network for Pick-up and Delivery Route PredictionProceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3534678.3539084(4143-4152)Online publication date: 14-Aug-2022
      • (2022)Factors affecting the Acceptance of Video Games as a Tool to improve students’ academic performance in Physical EducationEducation and Information Technologies10.1007/s10639-022-11295-y28:5(5717-5737)Online publication date: 4-Nov-2022

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media