research-article

An advanced approach for incremental flexible periodic pattern mining on time-series data

Authors:

Jerry Chun-Wei Lin,

Unil YunAuthors Info & Claims

Volume 230, Issue C

https://doi.org/10.1016/j.eswa.2023.120697

Published: 15 November 2023 Publication History

Abstract

Periodic pattern mining is a topic for mining periodic event patterns with sufficient confidence. The resulted patterns are often used to predict future events because they have established confidence that their periodicity will be maintained after the last time of the given data. Therefore, intelligent decision-making through periodic patterns has led to popularity in various applications, such as oil price fluctuations prediction, traffic congestion prediction, human behavior analysis, and sensor-based data analysis in the industry. Meanwhile, previous approaches adopting data structures based on the suffix-tree or trie developed the mining performance of this topic, and a concept that flexible periodic patterns consider don’t-care events in their intermediate events increased the flexibility of the results in this field. However, the data structures have limitations in terms of computing performance. Meanwhile, technological development has made collecting and accumulating data faster and faster. To conduct mining on modern databases which keep increasing incrementally, processing data streams in real time should be considered in the mining method. In this paper, we propose a novel flexible periodic pattern mining approach that can operate on incremental time-series databases by utilizing an enhanced data structure. Moreover, various experiments, such as multivariable analysis, sensitivity analysis, scalability analysis, demonstrate that the proposed approach has superior performance over previously proposed state-of-the-art algorithms in terms of runtime and memory usage.

References

[1]

A. Addeh, A. Khormali, M.A. Golilarz, Control chart pattern recognition using RBF neural network with new training algorithm and practical features, ISA Transactions 79 (2018) 202–206.

[2]

M.K. Afriyie, V.M. Nofong, J. Wondoh, H. Abdel-Fatao, Efficient Mining of Non-Redundant Periodic Frequent Patterns, Vietnam Journal of Computer Science 8 (4) (2021) 455–469.

[3]

S. Akther, M.R. Karim, M.d. Samiullah, C.F. Ahmed, Mining non-redundant closed flexible periodic patterns, Engineering Applications of Artificial Intelligence 69 (2018) 1–23.

[4]

Y. Baek, U. Yun, H. Kim, H. Nam, G. Lee, E. Yoon, …., J.C. Lin, Erasable pattern mining based on tree structures with damped window over data streams, Engineering Applications of Artificial Intelligence 94 (2020).

[5]

Y. Baek, U. Yun, E. Yoon, P. Fournier-Viger, Uncertainty-Based Pattern Mining for Maximizing Profit of Manufacturing Plants With List Structure, IEEE Transactions on Industrial Electronics 67 (11) (2020) 9914–9926.

[6]

Bashir, S. (2020). An efficient pattern growth approach for mining fault tolerant frequent itemsets. Expert Systems with Applications. 143.

[7]

H.A. Behrooz, Robust set-point optimization of inferential control system of crude oil distillation units, ISA Transactions 95 (2019) 93–109.

[8]

A.K. Chanda, C.F. Ahmed, M.d. Samiullah, C.K. Leung, A new framework for mining weighted periodic patterns in time series databases, Engineering Applications of Artificial Intelligence 79 (2017) 207–224.

[9]

A.K. Chanda, S. Saha, M.A. Nishi, M.d. Samiullah, C.F. Ahmed, An efficient approach to mine flexible periodic patterns in time series databases, Engineering Applications of Artificial Intelligence 44 (2015) 46–63.

[10]

Y.-I. Chang, C.-A. Fu, J.-Z. Que, Mining Weighted Periodic Patterns by a Weighted Direction Graph Based Approach for Time-Series Databases, Journal of Software 16 (6) (2021) 267–284.

[11]

J. Dai, N. Chen, X. Yuan, W. Gui, L. Luo, Temperature prediction for roller kiln based on hybrid first-principle model and data-driven MW-DLWKPCR model, ISA Transactions 98 (2020) 403–417.

[12]

S. Datta, K. Mali, S. Das, S. Kundu, S. Harh, Rhythmus periodic frequent pattern mining without periodicity threshold, Journal of Ambient Intelligence and Humanized Computing (2022) 1–13.

[13]

M.G. Elfeky, W.G. Aref, A.K. Elmagarmid, Periodicity Detection in Time Series Databases, IEEE Transactions Knowledge and Data Engineering 17 (7) (2005) 875–887.

[14]

P. Fournier-Viger, Y. Wang, P. Yang, J.C.W. Lin, U. Yun, Tspin: Mining top-k stable periodic patterns, Applied Intelligence 52 (2022) 6917–6938.

[15]

P. Fournier-Viger, P. Yang, R.U. Kiran, S. Ventura, J. Luna, Mining local periodic patterns in a discrete sequence, Information Sciences 544 (2021) 519–548.

[16]

A. Ghaghishpour, A. Koochaki, An intelligent method for online voltage stability margin assessment using optimized ANFIS and associated rules technique, ISA Transactions 102 (2020) 91–104.

[17]

A. Gupta, H.K. Thakur, A. Garg, D. Garg, Mining and Analysis of Periodic Patterns in Weighted Directed Dynamic Network, International Journal of Service Science, Management, Engineering, and Technology 7 (1) (2016) 1–26.

[18]

S. Halder, M.d. Samiullah, Y. Lee, Supergraph based periodic pattern mining in dynamic social networks, Expert Systems with Applications 72 (2017) 430–442.

[19]

W.N. Ismail, M.M. Hassan, Mining Productive-Associated Periodic-Frequent Patterns in Body Sensor Data for Smart Home Care, Sensors 17 (5) (2017) 952.

[20]

W.N. Ismail, M.M. Hassan, H.A. Alsalamah, Mining of productive periodic-frequent patterns for IoT data analytics, Future Generation Computer Systems 88 (2018) 512–523.

[21]

W.N. Ismail, M.M. Hassan, H.A. Alsalamah, G. Fortino, Mining productive-periodic frequent patterns in tele-health systems, Journal of Network and Computer Applications 115 (2018) 33–47.

[22]

M.F. Javed, W. Nawaz, K.U. Khan, Hova-FPPM: Flexible Periodic Pattern Mining in Time Series Databases Using Hashed Occurrence Vectors and Apriori Approach, Scientific Programming 8841188 (2021) 1–14.

[23]

H. Kim, T. Ryu, C. Lee, H. Kim, T. Truong, P. Fournier-Viger, U. Yun, Mining high occupancy patterns to analyze incremental data in intelligent systems, ISA (2022) Transactions.

[24]

D. Kim, U. Yun, Efficient algorithm for mining high average-utility itemsets in incremental transaction databases, Applied Intelligence 47 (1) (2017) 114–131.

[25]

H. Kim, U. Yun, Y. Baek, J. Kim, B. Vo, E. Yoon, H. Fujita, Efficient List based Mining of High Average Utility Patterns with Maximum Average Pruning Strategies, Information Sciences (2020).

[26]

J. Kim, U. Yun, H. Kim, T. Ryu, J.C.W. Lin, P. Fournier-Vier, W. Pedrycz, Average utility driven data analytics on damped windows for intelligent systems with data streams, International Journal of intelligent systems 36 (10) (2021) 5741–5769.

[27]

H. Kim, U. Yun, B. Vo, J. Lin, W. Pedrycz, Periodicity-Oriented Data Analytics on Time-Series Data for Intelligence System, IEEE Systems Journal (2021) 1–12.

[28]

J. Kim, U. Yun, E. Yoon, J.C. Lin, P. Fournier-Viger, One scan based high average-utility pattern mining in static and dynamic databases, Future Generation Computer Systems 111 (2020) 143–158.

[29]

A.J.T. Lee, H. Wu, T. Lee, Y. Liu, K. Chen, Mining closed patterns in multi-sequence time-series databases, Data Knowledge Engineering 68 (10) (2009) 1071–1090.

[30]

G. Lee, U. Yun, A new efficient approach for mining uncertain frequent patterns using minimum data structure without false positives, Future Generation Computer Systems 68 (2017) 89–110.

[31]

G. Lee, U. Yun, Single-pass based efficient erasable pattern mining using list data structure on dynamic incremental databases, Future Generation Computer Systems 80 (2018) 12–28.

Digital Library

[32]

Y. Liu, X. Wang, Z. Xhai, B. Chen, B. Zhang, Y. Jiang, Timely daily activity recognition from headmost sensor events, ISA Transactions 94 (2019) 379–390.

[33]

H. Nam, U. Yun, E. Yoon, J.C. Lin, Efficient approach for incremental weighted erasable pattern mining with list structure, Expert Systems with Applications 143 (2020).

Digital Library

[34]

H. Nam, U. Yun, E. Yoon, J.C. Lin, Efficient approach of recent high utility stream pattern mining with indexed list structure and pruning strategy considering arrival times of transactions, Information Sciences 529 (2020) 1–27.

[35]

M.A. Nishi, C.F. Ahmed, M.d. Samiullah, B. Jeong, Effective periodic pattern mining in time series databases, Expert Systems with Applications 40 (8) (2013) 3015–3027.

[36]

T. Niyazmand, I. Izadi, Pattern mining in alarm flood sequences using a modified PrefixSpan algorithm, ISA Transactions 90 (2019) 287–293.

[37]

C. Oswald, B. Sivaselvan, Smart Multimedia Compressor-Intelligent Algorithms for Text and Image Compression, The Computer Journal 66 (2) (2023) 463–478.

[38]

K. Qian, S. Gao, L. Yu, Marginal frequent itemset mining for fault prevention of railway overhead contact system, ISA Transactions 126 (2022) 276–287.

[39]

F. Rasheed, R. Alhajj, STNR: A suffix tree based noise resilient algorithm for periodicity detection in time series databases, Applied Intelligence 32 (3) (2010) 267–278.

[40]

J.P. Salameh, S. Cauet, E. Etien, A. Sakout, L. Rambault, A new modified sliding window empirical mode decomposition technique for signal carrier and harmonic separation in non-stationary signals: Application to wind turbines, ISA Transactions 89 (2019) 20–30.

[41]

D. Sengupta, P.K. Naik, SN algorithm: Analysis of temporal clinical data for mining periodic patterns and impending augury, Journal of Clinical Bioinformatics 3 (2013) 24.

[42]

J. Singh, C. Banerjee, S.K. Pandey, Smart automation in manufacturing process using industrial internet of things (IIoT) architecture, Innovations in Systems and Software Engineering 19 (2023) 15–22.

[43]

L. Tightiz, M.A. Nasab, H. Yang, A. Addeh, An intelligent system based on optimized ANFIS and association rules for power transformer fault diagnosis, ISA Transactions 103 (2020) 63–74.

[44]

H. Wu, A.J.T. Lee, Mining closed flexible patterns in time-series databases, Expert Systems with Applications 37 (3) (2010) 2098–2107.

[45]

X. Wu, J. Lin, Y. Yang, J. Guo, A digital decision approach for scheduling process planning of shared bikes under Internet of Things environment, Applied Soft Computing 133 (2023).

[46]

S. Xie, L. Zhao, An Efficient Algorithm for Mining Stable Periodic High-Utility Sequential Patterns, Symmetry 14 (10) (2022).

[47]

Y. Xun, L. Wang, H. Yang, J. Cai, Mining relevant partial periodic pattern of multi-source time-series data, Information Sciences 615 (2022) 638–656.

[48]

K. Yang, T. Hong, Y. Chen, G. Lan, Projection-based partial periodic pattern mining for event sequences, Expert Systems with Applications 40 (10) (2013) 4232–4240.

[49]

K. Yang, T. Hong, G. Lan, Y. Chen, A two-phase approach for mining weighted partial periodic patterns, Engineering Applications of Artificial Intelligence 30 (2014) 225–234.

[50]

U. Yun, D. Kim, E. Yoon, H. Fujita, Damped window based high average utility pattern mining over data streams, Knowledge Based Systems 144 (2018) 188–205.

[51]

U. Yun, G. Lee, E. Yoon, Advanced approach of sliding window based erasable pattern mining with list structure of industrial fields, Information Sciences 494 (2019) 37–59.

Digital Library

[52]

U. Yun, H. Nam, J. Kim, H. Kim, Y. Baek, J. Lee, …., W. Pedrycz, Efficient transaction deleting approach of pre-large based high utility pattern mining in dynamic databases, Future Generation Computer Systems 103 (2020) 58–78.

[53]

U. Yun, H. Nam, G. Lee, E. Yoon, Efficient approach for incremental high utility pattern mining with indexed list structure, Future Generation Computer Systems 95 (2019) 221–239.

Digital Library

[54]

D. Zhang, K. Lee, I. Lee, Hierarchical trajectory clustering for spatio-temporal periodic pattern mining, Expert Systems with Applications 92 (2018) 1–11.

[55]

D. Zhang, K. Lee, I. Lee, Mining hierarchical semantic periodic patterns from GPS-collected spatio-temporal trajectories, Expert Systems with Applications 122 (2019) 85–101.

Digital Library

[56]

D. Zhang, K. Lee, I. Lee, Semantic periodic pattern mining from spatio-temporal trajectories, Information Sciences 502 (2019) 164–189.

[57]

X. Zhang, Y. Qi, G. Chen, W. Gan, P. Fournier-Viger, Fuzzy-driven periodic frequent pattern mining, Information Science 618 (2022) 253–269.

Cited By

Huynh HPham NOplatkova ZNguyen LThanh Nguyen NYun UVo B(2024)Incremental clickstream pattern mining with search boundariesInformation Sciences: an International Journal10.1016/j.ins.2024.120257662:COnline publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1016/j.ins.2024.120257

Index Terms

An advanced approach for incremental flexible periodic pattern mining on time-series data
1. Information systems
  1. Data management systems
  2. Information systems applications
    1. Data mining
2. Theory of computation

Index terms have been assigned to the content through auto-classification.

Recommendations

Erasable itemset mining over incremental databases with weight conditions

Erasable itemset mining is an approach for mining itemsets with low profits from large-scale product databases in order to solve financial crises of plants in manufacturing industries. Previous erasable itemset mining methods deal with static product ...
Mining productive-periodic frequent patterns in tele-health systems
Abstract
Recently, tele-health systems have gained attention from vast research fields because they facilitate remote monitoring of patients (e.g. vital sign data, physical activities, etc.) by utlizing various technologies such as body sensor ...
Mining weighted sequential patterns in incremental uncertain databases
Highlights
- An efficient algorithm named FUWS, to mine weighted uncertain sequences.
- The ...
Abstract
Due to the rapid development of science and technology, the importance of imprecise, noisy, and uncertain data is increasing at an exponential rate. Thus, mining patterns in uncertain databases have drawn the attention of researchers. ...

Comments

Information & Contributors

Information

Published In

cover image Expert Systems with Applications: An International Journal

Expert Systems with Applications: An International Journal Volume 230, Issue C

Nov 2023

1487 pages

ISSN:0957-4174

Issue’s Table of Contents

Elsevier Ltd.

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 15 November 2023

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Huynh HPham NOplatkova ZNguyen LThanh Nguyen NYun UVo B(2024)Incremental clickstream pattern mining with search boundariesInformation Sciences: an International Journal10.1016/j.ins.2024.120257662:COnline publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1016/j.ins.2024.120257

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents