Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Feature Grouping–based Trajectory Outlier Detection over Distributed Streams

Published: 04 February 2021 Publication History

Abstract

Owing to a wide variety of deployment of GPS-enabled devices, tremendous amounts of trajectories have been generated in distributed stream manner. It opens up new opportunities to track and analyze the moving behaviors of the entities. In this work, we focus on the issue of outlier detection over distributed trajectory streams, where the outliers refer to a few entities whose motion behaviors are significantly different from their local neighbors. In view of skewed distribution property and evolving nature of trajectory data, and on-the-fly detection requirement over distributed streams, we first design a high-efficiency outlier detection solution. It consists of identifying abnormal trajectory fragment and exceptional fragment cluster at the remote sites and then detecting abnormal evolving object at the coordinator site. Further, given that outlier detection accuracy would be damaged due to using inappropriate proximity thresholds or a few trajectory data not having sufficient neighbors at the remote sites, we extract proximity thresholds of different regions and spatial context relationship of each region from historical data to improve the precision. Built upon this is an improved version consisting of off-line modeling phase and on-line detection phase. During the on-line phase, the proximity thresholds that are derived from historical trajectories during the off-line phase are leveraged to assist in detecting abnormal trajectory fragments and exceptional fragment clusters at the remote sites. Additionally, at the coordinator site, the detection results of some remote sites can be refined by incorporating those of other remote sites with neighborhood relationship. Extensive experimental results on real data demonstrate that our proposed methods own high detection validity, less communication cost and linear scalability for online identifying outliers over distributed trajectory streams.

References

[1]
Markus M. Breunig, Hans-Peter Kriegel, Raymond T. Ng, and Jorg Sander. 2000. LOF: Identifying density-based local outliers. In SIGMOD. 93--104.
[2]
Yingyi Bu, Lei Chen, Ada Wai-Chee Fu, and Dawei Liu. 2009. Efficient anomaly monitoring over moving object trajectory streams. In SIGKDD. 159--168.
[3]
Lei Cao, Yizhou Yan, Caitlin Kuhlman, Qingyang Wang, Elke A. Rundensteiner, and Mohamed Y. Eltabakh. 2017. Multi-tactic distance-based outlier detection. In ICDE. 959--970.
[4]
Sanjay Chawla, Yu Zheng, and Jiafeng Hu. 2012. Inferring the root cause in road traffic anomalies. In ICDM. 141--150.
[5]
Chao Chen, Daqing Zhang, Pablo Samuel Castro, Nan Li, Lin Sun, Shijian Li, and Zonghui Wang. 2013. iBOAT: Isolation-based online anomalous trajectory detection. Trans. Intell. Transport. Syst. 14, 2 (2013), 806--818.
[6]
Artur Ribeiro de Aquino, Luis Otávio Alvares, Chiara Renso, and Vania Bogorny. 2013. Towards semantic trajectory outlier detection. In Geoinfo. 115--126.
[7]
Xiaoyi Duan, Cheqing Jin, Xiaoling Wang, Aoying Zhou, and Kun Yue. 2016. Real-time personalized taxi-sharing. In DASFAA. 451--465.
[8]
Yong Ge, Hui Xiong, Chuanren Liu, and Zhi-Hua Zhou. 2011. A taxi driving fraud detection system. In ICDM. 181--190.
[9]
Yong Ge, Hui Xiong, Zhi-Hua Zhou, Hasan Timucin Ozdemir, Jannite Yu, and Kuo Chu Lee. 2010. Top-eye: Top-k evolving trajectory outlier detection. In CIKM. 1733--1736.
[10]
Tung Kieu, Bin Yang, Chenjuan Guo, and Christian S. Jensen. 2019. Outlier detection for time series with recurrent autoencoder ensembles. In IJCAI. 2725--2732.
[11]
Tung Kieu, Bin Yang, and Christian S. Jensen. 2018. Outlier detection for multidimensional time series using deep neural networks. In MDM. 125--134.
[12]
Edwin M. Knorr and Raymond T. Ng. 1998. Algorithms for mining distance-based outliers in large datasets. In VLDB. 392--403.
[13]
Edwin M. Knorr and Raymond T. Ng. 1999. Finding intensional knowledge of distance-based outliers. In VLDB. 211--222.
[14]
Edwin M. Knorr, Raymond T. Ng, and V. Tucakov. 2000. Distance-based outliers: Algorithms and applications. VLDB J. 8, 3–4 (2000), 237--253.
[15]
Jae-Gil Lee, Jiawei Han, and Xiaolei Li. 2008. Trajectory outlier detection: A partition-and-detect framework. In ICDE. 140--149.
[16]
Jae-Gil Lee, Jiawei Han, and Kyu-Young Whang. 2007. Trajectory clustering: A partition-and-group framework. In SIGMOD. 593--604.
[17]
Po-Ruey Lei. 2016. A framework for anomaly detection in maritime trajectory behavior. KIS 47, 1 (2016), 189--214.
[18]
Xiaolei Li, Jiawei Han, Sangkyum Kim, and Hector Gonzalez. 2007. ROAM: Rule- and motif-based anomaly detection in massive moving object data sets. In SDM. 273--284.
[19]
Xiaolei Li, Zhenhui Li, Jiawei Han, and Jae-Gil Lee. 2009. Temporal outlier detection in vehicle traffic data. In ICDE. 1319--1322.
[20]
Huiping Liu, Cheqing Jin, and Aoying Zhou. 2016. Popular route planning with travel cost estimation. In DASFAA. 403--418.
[21]
Siyuan Liu, Lionel M. Ni, and Ramayya Krishnan. 2014. Fraud detection from taxis’ driving behaviors. TVT 63, 1 (2014), 464--472.
[22]
Wei Liu, Yu Zheng, Sanjay Chawla, Jing Yuan, and Xie Xing. 2011. Discovering spatio-temporal causal interactions in traffic data streams. In SIGKDD. 1010--1018.
[23]
Zhongjian Lv, Jiajie Xu, Pengpeng Zhao, Guanfeng Liu, Lei Zhao, and Xiaofang Zhou. 2017. Outlier trajectory detection: A trajectory analytics based approach. In DASFAA. 231--246.
[24]
Qiang Ma, Bin Yang, Weining Qian, and Aoying Zhou. 2009. Query processing of massive trajectory data based on mapreduce. In CIKM. 9--16.
[25]
Jiali Mao, Cheqing Jin, Zhigang Zhang, and Aoying Zhou. 2017. Anomaly detection for trajectory big data: Advancements and framework. J. Softw. 28, 1 (2017), 17--34.
[26]
Jiali Mao, Qiuge Song, Cheqing Jin, Zhigang Zhang, and Aoying Zhou. 2016. TSCluWin: Trajectory stream clustering over sliding window. In DASFAA. 133--148.
[27]
Jiali Mao, Pengda Sun, Cheqing Jin, and Aoying Zhou. 2018. Outlier detection over distributed trajectory streams. In SDM. 64--72.
[28]
Jiali Mao, Tao Wang, Cheqing Jin, and Aoying Zhou. 2017. Feature grouping-based outlier detection upon streaming trajectories. Trans. Knowl. Data Eng. 29, 12 (2017), 2696--2709.
[29]
Bei Pan, Yu Zheng, David Wilkie, and Cyrus Shahabi. 2013. Crowd sensing of traffic anomalies based on human mobility and social media. In SIGSPATIAL. 334--343.
[30]
Tao Wang, Jiali Mao, and Cheqing Jin. 2017. HyMU: A hybrid map updating framework. In DASFAA. 19--33.
[31]
Hao Wu, Weiwei Sun, and Baihua Zheng. 2017. A fast trajectory outlier detection approach via driving behavior modeling. In CIKM. 837--846.
[32]
Yizhou Yan, Lei Cao, Caitlin Kuhlman, and Elke A. Rundensteiner. 2017. Distributed local outlier detection in big data. In SIGKDD. 1225--1234.
[33]
Wanqi Yang, Yang Gao, and Longbing Cao. 2013. TRASMIL: A local anomaly detection framework based on trajectory segmentation and multi-instance learning. Comput. Vis. Image Understand. 117, 10 (2013), 1273--1286.
[34]
Qingying Yu, Yonglong Luo, Chuanming Chen, and Xiaohan Wang. 2018. Trajectory outlier detection approach based on common slices sub-sequence. Appl. Intell. 48, 9 (2018), 2661--2680.
[35]
Yanwei Yu, Lei Cao, Elke A. Rundensteiner, and Qin Wang. 2014. Detecting moving object outliers in massive-scale trajectory streams. In SIGKDD. 422--431.
[36]
Yanwei Yu, Lei Cao, Elke A. Rundensteiner, and Qin Wang. 2017. Outlier detection over massive-scale trajectory streams. ACM Trans. Database Syst. 42, 2 (2017), 10:1--10:33.
[37]
Demetrios Zeinalipour-Yazti, Christos Laoudias, Constantinos Costa, Michail Vlachos, Maria I. Andreou, and Dimitrios Gunopulos. 2013. Crowdsourced trace similarity with smartphones. Trans. Knowl. Data Eng. 25, 6 (2013), 1240--1253.
[38]
Zhigang Zhang, Yilin Wang, Jiali Mao, Shaojie Qiao, Cheqing Jin, and Aoying Zhou. 2017. DT-KST: Distributed top-k similarity query on big trajectory streams. In DASFAA. 199--214.
[39]
Jie Zhu, Wei Jiang, An Liu, Guanfeng Liu, and Lei Zhao. 2017. Effective and efficient trajectory outlier detection based on time-dependent popular route. World Wide Web 20, 1 (2017), 111--134.

Cited By

View all
  • (2024)An Efficient and Distributed Framework for Real-Time Trajectory Stream ClusteringIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.3312319(1-17)Online publication date: 2024
  • (2024)Safety: A spatial and feature mixed outlier detection method for big trajectory dataInformation Processing & Management10.1016/j.ipm.2024.10367961:3(103679)Online publication date: May-2024
  • (2023)Ghost: A General Framework for High-Performance Online Similarity Queries over Distributed Trajectory StreamsProceedings of the ACM on Management of Data10.1145/35893181:2(1-25)Online publication date: 20-Jun-2023
  • Show More Cited By

Index Terms

  1. Feature Grouping–based Trajectory Outlier Detection over Distributed Streams

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Intelligent Systems and Technology
    ACM Transactions on Intelligent Systems and Technology  Volume 12, Issue 2
    Survey Paper and Regular Paper
    April 2021
    319 pages
    ISSN:2157-6904
    EISSN:2157-6912
    DOI:10.1145/3447400
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 February 2021
    Accepted: 01 December 2020
    Revised: 01 November 2019
    Received: 01 March 2019
    Published in TIST Volume 12, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Distributed trajectory streams
    2. feature-grouping
    3. outlier detection
    4. scalability

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)30
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 30 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)An Efficient and Distributed Framework for Real-Time Trajectory Stream ClusteringIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.3312319(1-17)Online publication date: 2024
    • (2024)Safety: A spatial and feature mixed outlier detection method for big trajectory dataInformation Processing & Management10.1016/j.ipm.2024.10367961:3(103679)Online publication date: May-2024
    • (2023)Ghost: A General Framework for High-Performance Online Similarity Queries over Distributed Trajectory StreamsProceedings of the ACM on Management of Data10.1145/35893181:2(1-25)Online publication date: 20-Jun-2023
    • (2023)Leveraging similarity analysis to understand variability in movement behaviorTransactions in GIS10.1111/tgis.1308227:5(1441-1466)Online publication date: 28-Jun-2023
    • (2023)A Lightweight Framework for Fast Trajectory Simplification2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00184(2386-2399)Online publication date: Apr-2023
    • (2022)Spatial Data Quality in the Internet of Things: Management, Exploitation, and ProspectsACM Computing Surveys10.1145/349833855:3(1-41)Online publication date: 3-Feb-2022
    • (2022)Deviation Point Curriculum Learning for Trajectory Outlier Detection in Cooperative Intelligent Transport SystemsIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2021.313179323:9(16514-16523)Online publication date: 1-Sep-2022
    • (2022)T-Detector: A Trajectory based Pre-trained Model for Game Bot Detection in MMORPGs2022 IEEE 38th International Conference on Data Engineering (ICDE)10.1109/ICDE53745.2022.00079(992-1003)Online publication date: May-2022
    • (2021)Detection of Trajectory Outliers in Intelligent Transportation Systems2021 IEEE International Conference on Big Data (Big Data)10.1109/BigData52589.2021.9671410(5484-5490)Online publication date: 15-Dec-2021

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media